Retained evidence · issue #287

Answer quality, with its limits

The latest retained assessment contains eight cases and zero deterministic passes. Every semantic and language criterion remains UNJUDGED. The useful-answer rate is unavailable (null). These archives do not measure the current release or customer success.

Release trend: NOT_COMPARABLE. The two-, six- and eight-case suites have different denominators. The corrected October 9 assessment reuses the original two captures. Regrading or expanding an archive is not a release improvement.

What the rubric measures

Deterministic diagnostics check text presence, retained binding identity and any specified bullet, word or target-binding contracts. PASS on text or matching rows does not prove an answered question, factual completeness, entailment or source truth. Language and required facts have no qualified judge; sentence/qualitative format judgments remain unjudged where no deterministic contract exists.

Recorded inspector commits and byte fingerprints describe the assessment source. Recorded answer commits and capture clocks describe the archives, not a clean build, present deployment or fresh release-candidate acceptance. The last two cases were captured October 10 from saved October 7 runs on app 0.27.18; the first six record app 0.27.44. Receipt clocks and digests identify retained projections, without independently verifying settlement.

Only reviewed case labels, kinds, requested languages, issue numbers, rubric statuses and artifact provenance are published here. Report links and question, answer, excerpt and identity text are excluded. Previously public reports do not establish consent for this page.

October 10 · final eight-case archive

Assessment completed (UTC): Oct 10, 2026, 4:59 PM · 2026-10-10T16:59:22.754Z
Recorded inspector commit: 84c96d21c1091f416fe3cea13a8edc849e962602
Frozen assessment (SHA256): 732882b620480fe6dbbd757fdab9af03df0f18269bde80adc1af34bc6697768a
Recorded inspector runtime: v24.21.0

Sample and diagnostics

Cases: 8
Deterministic passes: 0
Deterministic failures: 8
Deterministic pass rate: 0%
Useful-answer rate: Unavailable (null)
Required facts / semantics: UNJUDGED
Language match: UNJUDGED

Historical model/search allowance and cost: UNKNOWN. No known allowance is inferred from the offline inspector's zero model, search, payment and database calls.

By question kind
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
Single page	4	4	0%	Unavailable (null)
Exact metadata	1	1	0%	Unavailable (null)
Comparison	1	1	0%	Unavailable (null)
Teaching note	1	1	0%	Unavailable (null)
Newest release	1	1	0%	Unavailable (null)

By requested language
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
German (de)	1	1	0%	Unavailable (null)
English (en)	3	3	0%	Unavailable (null)
Spanish (es)	1	1	0%	Unavailable (null)
Brazilian Portuguese (pt-BR)	1	1	0%	Unavailable (null)
Vietnamese (vi)	2	2	0%	Unavailable (null)

Requested language is recorded metadata, not detected or verified answer language. Empty groups retain a null diagnostic rate.

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)
Failing diagnostics: Bullet count
Original public issues: #238
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:08.694Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
351840af8f58f8c066d74c7f45d2bf5895fabe8a3ff4dd087183e92bdb9147d4
Report capture (SHA256)
69d8f81b43fca4262a07a36c52fbfdfb2168027291bd19e63bd659c88728d8a5
case-02 · Single page · English (en)
Failing diagnostics: Whitespace word limit
Original public issues: #230
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:57.739Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
FAIL
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
a20b1697b9bb45febb799d393da262cc6ce36b17b921545f376635486b3e3257
Report capture (SHA256)
5140cd4bf5f4af6fcb6029c2a5e7bc91d021b71a8f7bae96de5a4f5d0e99ac31
case-03 · Single page · Spanish (es)
Failing diagnostics: Retained target bindings
Original public issues: #231 #276 #331
Report artifact captured (UTC)
Oct 9, 2026, 2:25 AM · 2026-10-09T02:25:43.987Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
77b27ec2ce331b6b1c531e245f9d6094daca0a93f1e7fe7e1060d6ecb890312c
Report capture (SHA256)
be1c4b1f6453a3312691d80f23701bee35b44ac6bdd2008a1b8096bff0e9e96b
Receipt artifact captured (UTC)
Oct 9, 2026, 2:25 AM · 2026-10-09T02:25:39.127Z
Receipt capture (SHA256)
6d2e0bde42f4deeae9ecee63983b96e1b25ad351bac07aba8407c8d1ea67a26d
Receipt payload (SHA256)
cf45d1dd5cd3285b4bdf3175ec75b5525286e3407cc6a8196dc96ab12492bf53
case-04 · Single page · German (de)
Failing diagnostics: Bullet count · Retained target bindings
Original public issues: #276
Report artifact captured (UTC)
Oct 9, 2026, 2:32 AM · 2026-10-09T02:32:08.538Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
07f620bee382c14fd5b1399dfa8ce740482eb705e2971b4e824de31aed9057b2
Report capture (SHA256)
a601201097ced2c260260eb9d1f2a53b710291c41fa7d1b6e4ba3a739752fb5b
Receipt artifact captured (UTC)
Oct 9, 2026, 2:32 AM · 2026-10-09T02:32:06.953Z
Receipt capture (SHA256)
8579bb33bb3ce540c4e758d4b38cd5d8c447c296b11a0463a0703e093eb56796
Receipt payload (SHA256)
aa7adcd439db9672bc94281b8f4b3559964b3334d73be62418f8efeccdd4dde2
case-05 · Exact metadata · English (en)
Failing diagnostics: Bullet count · Retained target bindings
Original public issues: #128
Report artifact captured (UTC)
Oct 9, 2026, 2:30 AM · 2026-10-09T02:30:35.824Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
8a215866ebf63d9486916a5941881ab591654c7c823fd08e08ceddaa8120ad5d
Report capture (SHA256)
dd0ae353bdfb26f10f79de65a274e5eb0a8e7dff4c56ebab4176faa9860a7536
Receipt artifact captured (UTC)
Oct 9, 2026, 2:30 AM · 2026-10-09T02:30:35.157Z
Receipt capture (SHA256)
f2c745930d61756172f259fbb58a33536fdd46810c40b19679dbc0c595977f02
Receipt payload (SHA256)
769c37f46eafeb8fb27c3b7193ed76e9a0f46a6b578b44a336899bf4700b05e9
case-06 · Comparison · Vietnamese (vi)
Failing diagnostics: Retained target bindings
Original public issues: #212
Report artifact captured (UTC)
Oct 9, 2026, 2:27 AM · 2026-10-09T02:27:10.072Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
0c0ef20ec6189299f7ed641eb23e4cdded3076fe5b12aeb62adff3ef30dea371
Report capture (SHA256)
a51e5360c23e0f11401663c07e57f2c51e98db63a40d5579f47b218998ecc80f
Receipt artifact captured (UTC)
Oct 9, 2026, 2:27 AM · 2026-10-09T02:27:05.204Z
Receipt capture (SHA256)
bcbf44710ef886e45b4854a60f8592d5505a5fec3bf7d22c9ff24907dd4e1755
Receipt payload (SHA256)
a4b9e54964ae1b44d4392c698213f125b46a26e3c270a5c17b87b84882186139
case-07 · Teaching note · Vietnamese (vi)
Failing diagnostics: Retained target bindings
Original public issues: #211
Report artifact captured (UTC)
Oct 10, 2026, 4:47 PM · 2026-10-10T16:47:32.654Z
Recorded answer commit
c70006182a4d187b2c8b82f17ce9dc671a4b6c6c
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
c9b5bcdea9bb071ea5f0a46ecc5752a99e89507cefba0255952cf564c99b8e7f
Report capture (SHA256)
0869253f071354d589a92508c92f24f291dbd7f9b3e0ec531005a2a65c7f6ef1
Receipt artifact captured (UTC)
Oct 10, 2026, 4:47 PM · 2026-10-10T16:47:33.147Z
Receipt capture (SHA256)
d6c4a35bffafe222cb1fd288eda3b6a876bb1d2e1d3f088fd10e31ac01b77b74
Receipt payload (SHA256)
a8afc1bf95fa8cfc55935bbb4a83fa790ba43addc583144e5450c62e945df642
case-08 · Newest release · English (en)
Failing diagnostics: Retained target bindings
Original public issues: #217
Report artifact captured (UTC)
Oct 10, 2026, 4:47 PM · 2026-10-10T16:47:33.526Z
Recorded answer commit
c70006182a4d187b2c8b82f17ce9dc671a4b6c6c
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
7b49e5e2cd66bd538ae924b5d4de10a2d23c425ee0e5ff6d7f43f38492685fa0
Report capture (SHA256)
dccd3a9c5ac709a0814a577ae8db7f2e19db12aa7aa283c74276384d4ebbfe9b
Receipt artifact captured (UTC)
Oct 10, 2026, 4:47 PM · 2026-10-10T16:47:33.974Z
Receipt capture (SHA256)
bdc91074fe0928374e722f34568fbefdebe646ca9288f710059aebc9435ef63a
Receipt payload (SHA256)
c7a7ee298593a8eb0520581d9f6367938f98e213012b2a64e590bbd3192d49ec

Historical coverage plan

This October 9 inventory and its selected mapping remain historical. They do not report today's open issues. An example does not satisfy an issue's full acceptance criteria. Complete open-failure coverage remains false, including planning and source-selection failures without completed reports.

Issue inventory captured (UTC): Oct 9, 2026, 12:27 PM · 2026-10-09T12:27:34.006Z

#128
Planned kinds: Exact metadata
Retained cases: case-05
Kinds without examples: None
#158
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#169
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#172
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#181
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#211
Planned kinds: Teaching note
Retained cases: case-07
Kinds without examples: None
#212
Planned kinds: Comparison
Retained cases: case-06
Kinds without examples: None
#217
Planned kinds: Newest release
Retained cases: case-08
Kinds without examples: None
#230
Planned kinds: Single page
Retained cases: case-02
Kinds without examples: None
#231
Planned kinds: Single page
Retained cases: case-03
Kinds without examples: None
#238
Planned kinds: Single page
Retained cases: case-01
Kinds without examples: None
#276
Planned kinds: Single page
Retained cases: case-03 · case-04
Kinds without examples: None
#331
Planned kinds: Single page
Retained cases: case-03
Kinds without examples: None

Removal record: no removals recorded in these frozen assessments. New removals need a dated reason and previous-suite digest; they cannot silently improve a denominator.

Artifact provenance

Inspector source fingerprint (SHA256): e89176988aa0167ba57c78cfc29a21a5928f04337fb4407c5aea25f7f4e78b68
Suite definition (SHA256): d7e56f9c4d42f2c78d3272fabc5e5fc1a5042599e0e81d5da9321f394fa51e9e
Corpus (SHA256): 2b9605f2947248116d7914cc576a046ef2e1effbc256b01efb05f4026d3805d0
Capture fingerprint (SHA256): 21855049069d1255fe40da5afcb7d654ccc767c27698878e8e0f92e7386e6621
Issue inventory (SHA256): bcc049c0a50e54850faa8292c2bc96c8bcd52bb380e1a58cfff4db6fe0466d34
Coverage registry (SHA256): ebcd507bd230996b7c294b6f147b52ad60069a78eab6cdc0c0d59cee45e57f7f

Earlier frozen assessments

October 10 · earlier six-case archive

Assessment completed (UTC): Oct 10, 2026, 4:42 PM · 2026-10-10T16:42:38.664Z
Recorded inspector commit: 52f52260f44661ecec5392bfcf67321dded06dc3
Frozen assessment (SHA256): 5ab158a520efe26fe81b722143ccd0e96565fb2b1e0fd38759c0f67ffb66a6de
Recorded inspector runtime: v24.21.0

Sample and diagnostics

Cases: 6
Deterministic passes: 0
Deterministic failures: 6
Deterministic pass rate: 0%
Useful-answer rate: Unavailable (null)
Required facts / semantics: UNJUDGED
Language match: UNJUDGED

Historical model/search allowance and cost: UNKNOWN. No known allowance is inferred from the offline inspector's zero model, search, payment and database calls.

By question kind
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
Single page	4	4	0%	Unavailable (null)
Exact metadata	1	1	0%	Unavailable (null)
Comparison	1	1	0%	Unavailable (null)
Teaching note	0	0	Unavailable (null)	Unavailable (null)
Newest release	0	0	Unavailable (null)	Unavailable (null)

By requested language
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
German (de)	1	1	0%	Unavailable (null)
English (en)	2	2	0%	Unavailable (null)
Spanish (es)	1	1	0%	Unavailable (null)
Brazilian Portuguese (pt-BR)	1	1	0%	Unavailable (null)
Vietnamese (vi)	1	1	0%	Unavailable (null)

Requested language is recorded metadata, not detected or verified answer language. Empty groups retain a null diagnostic rate.

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)
Failing diagnostics: Bullet count
Original public issues: #238
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:08.694Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
351840af8f58f8c066d74c7f45d2bf5895fabe8a3ff4dd087183e92bdb9147d4
Report capture (SHA256)
69d8f81b43fca4262a07a36c52fbfdfb2168027291bd19e63bd659c88728d8a5
case-02 · Single page · English (en)
Failing diagnostics: Whitespace word limit
Original public issues: #230
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:57.739Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
FAIL
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
a20b1697b9bb45febb799d393da262cc6ce36b17b921545f376635486b3e3257
Report capture (SHA256)
5140cd4bf5f4af6fcb6029c2a5e7bc91d021b71a8f7bae96de5a4f5d0e99ac31
case-03 · Single page · Spanish (es)
Failing diagnostics: Retained target bindings
Original public issues: #231 #276 #331
Report artifact captured (UTC)
Oct 9, 2026, 2:25 AM · 2026-10-09T02:25:43.987Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
77b27ec2ce331b6b1c531e245f9d6094daca0a93f1e7fe7e1060d6ecb890312c
Report capture (SHA256)
be1c4b1f6453a3312691d80f23701bee35b44ac6bdd2008a1b8096bff0e9e96b
Receipt artifact captured (UTC)
Oct 9, 2026, 2:25 AM · 2026-10-09T02:25:39.127Z
Receipt capture (SHA256)
6d2e0bde42f4deeae9ecee63983b96e1b25ad351bac07aba8407c8d1ea67a26d
Receipt payload (SHA256)
cf45d1dd5cd3285b4bdf3175ec75b5525286e3407cc6a8196dc96ab12492bf53
case-04 · Single page · German (de)
Failing diagnostics: Bullet count · Retained target bindings
Original public issues: #276
Report artifact captured (UTC)
Oct 9, 2026, 2:32 AM · 2026-10-09T02:32:08.538Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
07f620bee382c14fd5b1399dfa8ce740482eb705e2971b4e824de31aed9057b2
Report capture (SHA256)
a601201097ced2c260260eb9d1f2a53b710291c41fa7d1b6e4ba3a739752fb5b
Receipt artifact captured (UTC)
Oct 9, 2026, 2:32 AM · 2026-10-09T02:32:06.953Z
Receipt capture (SHA256)
8579bb33bb3ce540c4e758d4b38cd5d8c447c296b11a0463a0703e093eb56796
Receipt payload (SHA256)
aa7adcd439db9672bc94281b8f4b3559964b3334d73be62418f8efeccdd4dde2
case-05 · Exact metadata · English (en)
Failing diagnostics: Bullet count · Retained target bindings
Original public issues: #128
Report artifact captured (UTC)
Oct 9, 2026, 2:30 AM · 2026-10-09T02:30:35.824Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
8a215866ebf63d9486916a5941881ab591654c7c823fd08e08ceddaa8120ad5d
Report capture (SHA256)
dd0ae353bdfb26f10f79de65a274e5eb0a8e7dff4c56ebab4176faa9860a7536
Receipt artifact captured (UTC)
Oct 9, 2026, 2:30 AM · 2026-10-09T02:30:35.157Z
Receipt capture (SHA256)
f2c745930d61756172f259fbb58a33536fdd46810c40b19679dbc0c595977f02
Receipt payload (SHA256)
769c37f46eafeb8fb27c3b7193ed76e9a0f46a6b578b44a336899bf4700b05e9
case-06 · Comparison · Vietnamese (vi)
Failing diagnostics: Retained target bindings
Original public issues: #212
Report artifact captured (UTC)
Oct 9, 2026, 2:27 AM · 2026-10-09T02:27:10.072Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Retained target bindings:
FAIL
Sentence count:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
0c0ef20ec6189299f7ed641eb23e4cdded3076fe5b12aeb62adff3ef30dea371
Report capture (SHA256)
a51e5360c23e0f11401663c07e57f2c51e98db63a40d5579f47b218998ecc80f
Receipt artifact captured (UTC)
Oct 9, 2026, 2:27 AM · 2026-10-09T02:27:05.204Z
Receipt capture (SHA256)
bcbf44710ef886e45b4854a60f8592d5505a5fec3bf7d22c9ff24907dd4e1755
Receipt payload (SHA256)
a4b9e54964ae1b44d4392c698213f125b46a26e3c270a5c17b87b84882186139

Historical coverage plan

Issue inventory captured (UTC): Oct 9, 2026, 12:27 PM · 2026-10-09T12:27:34.006Z

#128
Planned kinds: Exact metadata
Retained cases: case-05
Kinds without examples: None
#158
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#169
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#172
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#181
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#211
Planned kinds: Teaching note
Retained cases: None
Kinds without examples: Teaching note
#212
Planned kinds: Comparison
Retained cases: case-06
Kinds without examples: None
#217
Planned kinds: Newest release
Retained cases: None
Kinds without examples: Newest release
#230
Planned kinds: Single page
Retained cases: case-02
Kinds without examples: None
#231
Planned kinds: Single page
Retained cases: case-03
Kinds without examples: None
#238
Planned kinds: Single page
Retained cases: case-01
Kinds without examples: None
#276
Planned kinds: Single page
Retained cases: case-03 · case-04
Kinds without examples: None
#331
Planned kinds: Single page
Retained cases: case-03
Kinds without examples: None

Removal record: no removals recorded in these frozen assessments. New removals need a dated reason and previous-suite digest; they cannot silently improve a denominator.

Artifact provenance

Inspector source fingerprint (SHA256): ff801472462d655f964b896f24beef1a5d1e25c64bcc5858b1e591532987303f
Suite definition (SHA256): 8bef1b119e316997c697b723ef6842d1c6e7207c6f7e5000a5754afbc3e2df9e
Corpus (SHA256): 4302d6c5361a304bf9c1089dd754d916b4ad504fbec043f270e973d73a92b9da
Capture fingerprint (SHA256): 807a11792a81f6886a240a90c51ca11e519705ebdf4c6f5571b3cd51f41e1a63
Issue inventory (SHA256): bcc049c0a50e54850faa8292c2bc96c8bcd52bb380e1a58cfff4db6fe0466d34
Coverage registry (SHA256): 06e6a03490da2fe179987e39d44e62a6761a5f1167fb99927678b60fa6bb212b

October 9 · corrected inspector, same two-case archive

Assessment completed (UTC): Oct 9, 2026, 12:46 PM · 2026-10-09T12:46:12.796Z
Recorded inspector commit: 02fe224695ece6db92bcef6437365a1484ef5e39
Frozen assessment (SHA256): ac1650383b812baaf50b837221b039069da6cb53e88a4f2754608450a9f5110d
Recorded inspector runtime: v24.21.0

Sample and diagnostics

Cases: 2
Deterministic passes: 0
Deterministic failures: 2
Deterministic pass rate: 0%
Useful-answer rate: Unavailable (null)
Required facts / semantics: UNJUDGED
Language match: UNJUDGED

Historical model/search allowance and cost: UNKNOWN. No known allowance is inferred from the offline inspector's zero model, search, payment and database calls.

By question kind
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
Single page	2	2	0%	Unavailable (null)
Exact metadata	0	0	Unavailable (null)	Unavailable (null)
Comparison	0	0	Unavailable (null)	Unavailable (null)
Teaching note	0	0	Unavailable (null)	Unavailable (null)
Newest release	0	0	Unavailable (null)	Unavailable (null)

By requested language
Declared group	Cases	Deterministic passes	Deterministic failures	Deterministic pass rate	Useful-answer rate
English (en)	1	0	1	0%	Unavailable (null)
Brazilian Portuguese (pt-BR)	1	0	1	0%	Unavailable (null)

Requested language is recorded metadata, not detected or verified answer language. Empty groups retain a null diagnostic rate.

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)
Failing diagnostics: Bullet count
Original public issues: #238
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:08.694Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
351840af8f58f8c066d74c7f45d2bf5895fabe8a3ff4dd087183e92bdb9147d4
Report capture (SHA256)
69d8f81b43fca4262a07a36c52fbfdfb2168027291bd19e63bd659c88728d8a5
case-02 · Single page · English (en)
Failing diagnostics: Whitespace word limit
Original public issues: #230
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:57.739Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
FAIL
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
a20b1697b9bb45febb799d393da262cc6ce36b17b921545f376635486b3e3257
Report capture (SHA256)
5140cd4bf5f4af6fcb6029c2a5e7bc91d021b71a8f7bae96de5a4f5d0e99ac31

Historical coverage plan

Issue inventory captured (UTC): Oct 9, 2026, 12:27 PM · 2026-10-09T12:27:34.006Z

#128
Planned kinds: Exact metadata
Retained cases: None
Kinds without examples: Exact metadata
#158
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#169
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#172
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#181
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#211
Planned kinds: Teaching note
Retained cases: None
Kinds without examples: Teaching note
#212
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#217
Planned kinds: Newest release
Retained cases: None
Kinds without examples: Newest release
#230
Planned kinds: Single page
Retained cases: case-02
Kinds without examples: None
#238
Planned kinds: Single page
Retained cases: case-01
Kinds without examples: None
#276
Planned kinds: Single page
Retained cases: None
Kinds without examples: Single page
#331
Planned kinds: Single page
Retained cases: None
Kinds without examples: Single page

Removal record: no removals recorded in these frozen assessments. New removals need a dated reason and previous-suite digest; they cannot silently improve a denominator.

Artifact provenance

Inspector source fingerprint (SHA256): 3a0fd5db6d5eaacc5cfa8509f50f0ab543a9032cce43f96c4c2e54270252fd17
Suite definition (SHA256): 1615a9a2556ee35d2571ef18bb2b1e57d75ad729f3ad6d2681103e7c78b58fde
Corpus (SHA256): abc83ab3a545f5a7d155cb85e4fdfcdf8d08583f16fb87422cfc0cf8785be9c4
Capture fingerprint (SHA256): d8dd043af91a9a8051e40cba153f2a7c00f7906bb982e386d1b044fa577ac8c8
Issue inventory (SHA256): bcc049c0a50e54850faa8292c2bc96c8bcd52bb380e1a58cfff4db6fe0466d34
Coverage registry (SHA256): 7f68b69606ea6f841e434d7cfbf956659ecf5f009abf3d4df613337d7c605413

October 9 · original two-case archive

Assessment completed (UTC): Oct 9, 2026, 12:33 PM · 2026-10-09T12:33:38.255Z
Recorded inspector commit: 21a328484236198740e76ee7e8c07c9f551254a9
Frozen assessment (SHA256): 5407e206154c5a9679345512e096a99ae2e73057e6c9e63dd60077eef12a87e0
Recorded inspector runtime: v24.21.0

Sample and diagnostics

Cases: 2
Deterministic passes: 0
Deterministic failures: 2
Deterministic pass rate: 0%
Useful-answer rate: Unavailable (null)
Required facts / semantics: UNJUDGED
Language match: UNJUDGED

Historical model/search allowance and cost: UNKNOWN. No known allowance is inferred from the offline inspector's zero model, search, payment and database calls.

By question kind
Declared group	Cases	Deterministic failures	Deterministic pass rate	Useful-answer rate
Single page	2	2	0%	Unavailable (null)
Exact metadata	0	0	Unavailable (null)	Unavailable (null)
Comparison	0	0	Unavailable (null)	Unavailable (null)
Teaching note	0	0	Unavailable (null)	Unavailable (null)
Newest release	0	0	Unavailable (null)	Unavailable (null)

By requested language
Declared group	Cases	Deterministic passes	Deterministic failures	Deterministic pass rate	Useful-answer rate
English (en)	1	0	1	0%	Unavailable (null)
Brazilian Portuguese (pt-BR)	1	0	1	0%	Unavailable (null)

Requested language is recorded metadata, not detected or verified answer language. Empty groups retain a null diagnostic rate.

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)
Failing diagnostics: Bullet count
Original public issues: #238
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:08.694Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
FAIL
Whitespace word limit:
UNJUDGED
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
351840af8f58f8c066d74c7f45d2bf5895fabe8a3ff4dd087183e92bdb9147d4
Report capture (SHA256)
69d8f81b43fca4262a07a36c52fbfdfb2168027291bd19e63bd659c88728d8a5
case-02 · Single page · English (en)
Failing diagnostics: Whitespace word limit
Original public issues: #230
Report artifact captured (UTC)
Oct 9, 2026, 2:23 AM · 2026-10-09T02:23:57.739Z
Recorded answer commit
380647b10a924e231ebe98123028877d8c5ee187
Text presence:
PASS
Retained binding identity:
PASS
Bullet count:
UNJUDGED
Whitespace word limit:
FAIL
Language match:
UNJUDGED
Required facts:
UNJUDGED
Artifact provenance
Retained fixture (SHA256)
a20b1697b9bb45febb799d393da262cc6ce36b17b921545f376635486b3e3257
Report capture (SHA256)
5140cd4bf5f4af6fcb6029c2a5e7bc91d021b71a8f7bae96de5a4f5d0e99ac31

Historical coverage plan

Issue inventory captured (UTC): Oct 9, 2026, 12:27 PM · 2026-10-09T12:27:34.006Z

#128
Planned kinds: Exact metadata
Retained cases: None
Kinds without examples: Exact metadata
#158
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#169
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#172
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#181
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#211
Planned kinds: Teaching note
Retained cases: None
Kinds without examples: Teaching note
#212
Planned kinds: Comparison
Retained cases: None
Kinds without examples: Comparison
#217
Planned kinds: Newest release
Retained cases: None
Kinds without examples: Newest release
#230
Planned kinds: Single page
Retained cases: case-02
Kinds without examples: None
#238
Planned kinds: Single page
Retained cases: case-01
Kinds without examples: None
#276
Planned kinds: Single page
Retained cases: None
Kinds without examples: Single page
#331
Planned kinds: Single page
Retained cases: None
Kinds without examples: Single page

Removal record: no removals recorded in these frozen assessments. New removals need a dated reason and previous-suite digest; they cannot silently improve a denominator.

Artifact provenance

Inspector source fingerprint (SHA256): 6e25148c2c320c73685cb90e67b50bd8a6fd23ae7808ca5c651dab0dc6363a10
Suite definition (SHA256): 1615a9a2556ee35d2571ef18bb2b1e57d75ad729f3ad6d2681103e7c78b58fde
Corpus (SHA256): abc83ab3a545f5a7d155cb85e4fdfcdf8d08583f16fb87422cfc0cf8785be9c4
Capture fingerprint (SHA256): d8dd043af91a9a8051e40cba153f2a7c00f7906bb982e386d1b044fa577ac8c8
Issue inventory (SHA256): bcc049c0a50e54850faa8292c2bc96c8bcd52bb380e1a58cfff4db6fe0466d34
Coverage registry (SHA256): 7f68b69606ea6f841e434d7cfbf956659ecf5f009abf3d4df613337d7c605413

Work still required for issue #287

Reviewed coverage of every open quality failure class, including planning and source selection.
Qualified semantic, language and qualitative-format judgments, with human spot checks and explicit consent where private questions are proposed.
An agreed useful-answer regression margin and comparable release-candidate captures with their exact commit and bounded model/search allowance.
Actual source review, CI acceptance and coordinated delivery. This frozen page is not release acceptance.

Follow the original quality scorecard issue

Answer quality, with its limits

What the rubric measures

October 10 · final eight-case archive

Sample and diagnostics

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)

case-02 · Single page · English (en)

case-03 · Single page · Spanish (es)

case-04 · Single page · German (de)

case-05 · Exact metadata · English (en)

case-06 · Comparison · Vietnamese (vi)

case-07 · Teaching note · Vietnamese (vi)

case-08 · Newest release · English (en)

Earlier frozen assessments

October 10 · earlier six-case archive

Sample and diagnostics

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)

case-02 · Single page · English (en)

case-03 · Single page · Spanish (es)

case-04 · Single page · German (de)

case-05 · Exact metadata · English (en)

case-06 · Comparison · Vietnamese (vi)

October 9 · corrected inspector, same two-case archive

Sample and diagnostics

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)

case-02 · Single page · English (en)

October 9 · original two-case archive

Sample and diagnostics

Retained failing cases and rubric statuses

case-01 · Single page · Brazilian Portuguese (pt-BR)

case-02 · Single page · English (en)

Work still required for issue #287