← ObservatoryThe RecordFR-AI-0008
PROG-AI
FR-AI-0008

AI Medical Imaging Diagnosis — Specialist-Level Accuracy on Defined Tasks

AI-assisted medical diagnosis achieves specialist-level accuracy on defined imaging tasks.

FragmentingVS-05·since 2024-01-15
Verification Matrix
VS-01
Assertion
VS-02
Published
VS-03
Audit
VS-04
Replication
VS-05
Operation
2024-01-15 — present
State reached Current state Not yet reached
State Warrant
Current stateFragmentingVS-05
Why this state?The claim's surface assertion — specialist-level accuracy on defined imaging tasks — is confirmed on curated research datasets across multiple imaging domains and by regulatory validation in prospective settings for specific cleared devices. The surface layer is advancing: AI medical imaging achieves specialist-level performance on well-defined tasks under controlled conditions. The surface claim is in ESCALATING territory. The claim fragments at the depth layer — specifically, at the boundary between research-dataset accuracy and real-world clinical deployment. Systematic deployment-gap studies (INST-003) document that accuracy measured on curated, single-site datasets does not reliably generalise across scanners, acquisition protocols, or patient demographics, and prospective trials (INST-004) show a heterogeneous picture — some deployed systems retain specialist-level accuracy, others do not. The pressure state is FRAGMENTING: the surface claim is confirmed and advancing, but the depth question — whether research-dataset accuracy is a valid proxy for clinical deployment accuracy — remains open (BN-001), pending further validation of the foundation-model generalisation trend (INST-005).
In this state since2024-01-15
Stage provenanceRatified VS-05; stored historical code VS-03 preserved.
Record Lineage — Chronological
2024-01-15
Record opened — Fragmenting
The claim's surface assertion — specialist-level accuracy on defined imaging tasks — is confirmed on curated research datasets across multiple imaging domains and by regulatory validation in prospective settings for specific cleared devices. The surface layer is advancing: AI medical imaging achieves specialist-level performance on well-defined tasks under controlled conditions. The surface claim is in ESCALATING territory. The claim fragments at the depth layer — specifically, at the boundary between research-dataset accuracy and real-world clinical deployment. Systematic deployment-gap studies (INST-003) document that accuracy measured on curated, single-site datasets does not reliably generalise across scanners, acquisition protocols, or patient demographics, and prospective trials (INST-004) show a heterogeneous picture — some deployed systems retain specialist-level accuracy, others do not. The pressure state is FRAGMENTING: the surface claim is confirmed and advancing, but the depth question — whether research-dataset accuracy is a valid proxy for clinical deployment accuracy — remains open (BN-001), pending further validation of the foundation-model generalisation trend (INST-005).
Verification Stage: VS-05 after ratified review (stored code VS-03 preserved).
Mutation Log
MutationDateFieldPrior valueCurrent value
M-0062026-07-09description_reorderedDESCRIPTION-REORDERED
M-0052024-01-15diagnosis_heldDIAGNOSIS-HELD
M-0042024-01-15mechanisms_recordedMECHANISMS-RECORDED
M-0032024-01-15assessment_issuedASSESSMENT-ISSUED
M-0022024-01-15instances_loggedINSTANCES-LOGGED
M-0012024-01-15record_createdRECORD-CREATED
Evidence Sources
5 instances on recordShow sources ↓Hide ↑
IN-001Landmark studies — dermatology, diabetic retinopathy, chest X-raysupportive
IN-002FDA clearances and real-world deployment — regulatory validationsupportive
IN-003Deployment gap studies — research accuracy fails to generalisecontesting
IN-004Prospective deployment studies — mixed real-world performancepartial
IN-005GPT-4V and foundation models — generalisation capability shiftpartial