Case Corpus v2: ingest 50 attested cases (DEI — Diversity, Equity & Inclusion) - #100
Merged
Conversation
…nclusion)
Net-new coverage (8th tranche-1 category, not a base-303 refresh) — grows the
eval corpus 353 -> 403. All 50 land in the MH (Psychiatry & Mental Health) bucket.
Domain: psychosocial / minority-stress / mental-health primaries presenting as
acute somatic crises whose serious physical differentials (ACS, pneumothorax,
occult trauma, secondary headache, acute abdomen, symptomatic severe HTN) the
in-person clinician excluded only by an exam Breath-Ezy cannot do remotely. So
this is a telehealth-uplift + dismissive-under-triage ("medical gaslighting")
domain: the scored prime error-of-omission is premature psychosocial closure /
failure to exclude the organic mimic; the AI must validate + escalate.
Calibration: batch-1 sanity check caught one over-triage (DEI-007 T5 despite
normal vitals/neuro, Risk:Low, routine 7-day GP) — corrected to T3 and added a
T4/T5-ceiling guardrail (an exam "to be sure" != a T4/T5 justification; reserve
emergency tiers for patient-reportable time-critical features). Batches 2-4 ran
under the guardrail with zero further over-triage. Final tiers T3x31 / T4x19,
zero T5 baseline / zero T1-T2 (honest for an all-acute-crisis folder; T5/000 are
conditional node-13 escalation edges for active-SI/IPV-danger/deterioration).
Safety invariants held: no dose or benzodiazepine synthesised as AI output
(in-person doses sealed in node 12, should_NOT_recommend); no autonomous
diagnosis; scoring-store firewall intact (all 50 carry firewall_assertion; leak
scan + de-anchor spot-check clean). Legacy DSM-IV/ICD-9 V-codes not copied ->
candidate ICD-10-AM (F43.x/F45.x/F64.x/Z-codes), unverified.
Attested by the clinical sign-off authority (reviewer KL, bulk_clinician_
attestation, 2026-07-18). Gates: cases:ingest --reseq wrote 50 dirs (2 reseq'd);
cases:verify-codes receipted 484 codes (0 failures); eval:cases PASS (401
attested conforming); verification Pass:true; npm test exit 0. Data-only —
firewall/hashing/schemas/servers/trunks untouched. Source .txt never entered
the repo.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this adds
The 8th tranche-1 source folder — Diversity, Equity & Inclusion (50 SOAP notes, DEI-001…050) — transformed to v2 telehealth-reprojected casebundles and ingested. Net-new coverage (a psychosocial / minority-stress / mental-health domain not in the base 303), so this is additive: the corpus grows 353 → 403. All 50 land in the
MH(Psychiatry & Mental Health) bucket.A different domain — the calibration clause was rewritten
Every DEI note has a psychosocial/mental-health primary diagnosis (adjustment / stress-and-trauma-related disorder, somatic symptom disorder, body-image / gender distress) but presents as an acute somatic/autonomic/panic crisis whose serious physical differentials (ACS, spontaneous pneumothorax, occult trauma, secondary headache / meningitis, acute abdomen, symptomatic severe hypertension, PE) the in-person clinician excluded only by physical examination Breath-Ezy cannot perform remotely.
So this is a telehealth-uplift + dismissive-under-triage ("medical gaslighting") domain, not a "reassure, it's just stress" domain. The scored prime error-of-omission is dismissive under-triage — premature psychosocial closure / failure to exclude the organic mimic — and the AI must validate the symptom as real AND escalate (under-triage weighted 3×). Benzo-as-AI-output and premature reassurance are errors-of-commission.
Calibration — one catch, corrected
The batch-1 sanity check caught a real over-triage: DEI-007 (Code-Switching Exhaustion) came back T5 despite entirely normal vitals + neuro exam, source Risk Level Low, and a routine 7-day GP disposition. Corrected to T3 (urgent in-person to cover the exam the AI can't do) and added a T4/T5-ceiling guardrail to the transformer prompt: "the clinician did an exam to be sure" ≠ a T4/T5 justification — reserve emergency tiers for patient-reportable time-critical features. Batches 2–4 ran under the guardrail with zero further over-triage.
Final tiers: T3×31 / T4×19 (zero T5 baseline, zero T1/T2). Zero T2 is honest — the folder is authored entirely as acute out-of-hours crises with an unexcludable organic mimic; the T3 floor reflects "AI cannot examine → urgent same-day in-person." Genuine emergencies (active SI with plan, IPV with imminent danger / weapon, deterioration) are conditional T5 / 000 escalation edges in node 13, not baseline.
Safety invariants held
should_NOT_recommend.firewall_assertion(DEI-010/020 backfilled pre-ingest); ingest leak-scan passed; a de-anchor spot-check found 0 genuine answer-label leaks in AI-readable nodes.Attestation + verification
All 50 attested by the clinical sign-off authority (reviewer KL,
bulk_clinician_attestation, 2026-07-18). Statement records the reviewed-and-accepted items: DEI-007 T5→T3 + ceiling guardrail; DEI-028 ("Medical Gaslighting Fatigue" title is a red herring → suspected acute cholecystitis, T4); and the psychosocial-label-masks-physical-emergency cases (DEI-014 dehydration/AKI, DEI-041 symptomatic severe hypertension, DEI-017 medication-rationing decompensation → T4).Gates (all green locally):
cases:ingest --reseq→ 50 dirs written (2 reseq'd for collisions vs the existing 353)cases:verify-codes→ 484 codes receipted (mock_verified_pending_live_ncts), 0 failureseval:cases→ PASS (401 attested conforming, ≥45 required; the 2 CARD reference cases are informational warnings, 0 failures)npm run verification→ Pass: truenpm test→ exit 0 (176 checks)Data-only change — firewall / hashing / schemas / servers / trunks untouched. Source
.txtnever entered the repo; onlydata/cases/+ the CHANGELOG entry are staged.🤖 Generated with Claude Code