Eval Case

One repeatable test of an agent, lifted from a /wrong-answer report: the prompt that produced a bad answer, the node the answer had to read, the value it must not invent and the value it should state. Run N times against the agent; scored on the answer's own ThreadMessage record — did it look, did it invent, did it get it right. Stored under Feedback/_Evals/{agentId}/{case}, written as System. Compiled live from Source/.

Configuration: config => config.WithContentType<EvalCaseContent>().LiftOnActivation().StampConfirmationOnActivation().AddDefaultLayoutAreas().AddLayout(layout => layout.AddEvalCaseLayoutAreas().WithView("Tests", EvalCaseTestsArea.Tests).WithDefaultArea("Eval"))
Include global types: yes
Cell surface: no
Owns partition: no
Keeps history: yes
Sources: namespace:Source scope:subtree, shared=@Feedback/Feedback/Source/FeedbackContent, shared=@Feedback/Feedback/Source/WrongAnswerReport
Stamped fields: confirmedBy
Compilation status: 3
Last compile started at: 2026-10-07T09:22:00.1119406+00:00
Last compile succeeded at: 2026-10-30T07:23:59.4726714+00:00
Last compiled version: 289
Latest release path: Feedback/EvalCase/Release/20261007092200-NBdeU159
Requested release at: 2026-10-29T16:05:17.4543481+00:00
Requested release force: no
Requested release by: system-security
Last release request handled at: 2026-10-29T16:05:17.4543481+00:00
Latest assembly collection: local
Latest assembly path: Feedback_EvalCase/v289-c003e001-ebd985ed3248.dll
Latest assembly mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled sources › Feedback/ eval case/ source/ eval runner: 639274445724492480
Compiled sources › Feedback/ eval case/ source/ eval scoring: 639261973768857630
Compiled sources › Feedback/ eval case/ test/ eval case tests: 639265625211342560
Compiled sources › Feedback/ eval case/ source/ eval case content: 639274445723783940
Compiled sources › Feedback/ eval case/ source/ eval case lifting: 639265625211755910
Compiled sources › Feedback/ eval case/ test/ eval case tests area: 639265625210937400
Compiled sources › Feedback/ feedback/ source/ feedback content: 639288867172210110
Compiled sources › Feedback/ feedback/ source/ wrong answer report: 639265625210501840
Compiled sources › Feedback/ eval case/ source/ eval case layout areas: 639275128865228070
Compiled sources › Feedback/ eval case/ source/ eval case confirmation: 639275128865855520
Current source versions › Feedback/ eval case/ source/ eval runner: 639274445724492480
Current source versions › Feedback/ eval case/ source/ eval scoring: 639261973768857630
Current source versions › Feedback/ eval case/ test/ eval case tests: 639265625211342560
Current source versions › Feedback/ eval case/ source/ eval case content: 639274445723783940
Current source versions › Feedback/ eval case/ source/ eval case lifting: 639265625211755910
Current source versions › Feedback/ eval case/ test/ eval case tests area: 639265625210937400
Current source versions › Feedback/ feedback/ source/ feedback content: 639288867172210110
Current source versions › Feedback/ feedback/ source/ wrong answer report: 639265625210501840
Current source versions › Feedback/ eval case/ source/ eval case layout areas: 639275128865228070
Current source versions › Feedback/ eval case/ source/ eval case confirmation: 639275128865855520
Current source fingerprint: ed54340b6a557e41
Build provenance: 2
Adopted module version: 1.10.8
Current module version: 1.11
Built module version: 1.10.8
Built module version mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled framework version: c003e001
Compiled modules hash: e6e06c7f13cfdcaf8f63f10abedd75550156d4562328a42fc554e04824166b98
Compiled dependencies › !input: i158a3ecdc1eb338e4f36723daebda6a3
Compiled dependencies › !toolchain: compat:c003e001
Compiled dependencies › Mesh weaver. aI: min:3.1.0.0
Compiled dependencies › Mesh weaver. data: compat:c003e001
Compiled dependencies › Mesh weaver. graph: compat:c003e001
Compiled dependencies › Mesh weaver. layout: compat:c003e001
Compiled dependencies › Mesh weaver. mesh. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. hub: compat:c003e001
Compiled dependencies › Mesh weaver. utils: compat:c003e001