{
  "abstract": "Objective To assess whether an artificial intelligence (AI) tool improves the accuracy, speed and confidence of general radiologists, emergency clinicians and radiographers in detecting critical non-contrast CT head (NCCTH) abnormalities and to evaluate its stand-alone performance and factors influencing diagnostic accuracy.Methods and analysis A retrospective dataset of 150 NCCTH (52 normal and 98 with critical abnormalities) was reviewed by 30 readers (10 radiologists, 15 emergency clinicians and 5 radiographers) from four National Health Service trusts. Each interpreted scan is performed unaided and then with the qER EU 2.0 AI tool, separated by a 2-week washout period. Ground truth was established by two neuroradiologists. We measured the AI’s stand-alone performance and its effect on reader accuracy, confidence and speed.Results The qER algorithm showed strong diagnostic performance (area under the receiver operator curve 0.821–0.976). With AI, pooled reader sensitivity for critical abnormalities increased from 82.8% to 89.7% (+6.9%, p<0.001) and for intracranial haemorrhage from 84.6% to 91.6% (+7.0%, p<0.001), while specificity decreased from 84.5% to 78.9% (–5.5%, p=0.046). Reader confidence did not change significantly. Emergency department (ED) clinicians with AI achieved sensitivity similar to unaided radiologists.Conclusion AI assistance increased sensitivity for detecting critical abnormalities on NCCTH but reduced specificity. AI-enabled ED clinicians to achieve diagnostic sensitivity comparable to radiologists, supporting its potential to enhance non-radiologist performance. Further studies are needed to confirm these findings in clinical practice.Trial registration number NCT06018545.",
  "authors": [
    {
      "affiliations": [
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK",
        "Emergency Medicine Research Oxford, Oxford University Hospitals NHS Foundation Trust, Oxford, UK"
      ],
      "name": "Alex Novak"
    },
    {
      "affiliations": [
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK",
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, UK"
      ],
      "name": "Ruchir Shah"
    },
    {
      "affiliations": [
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK",
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, UK"
      ],
      "name": "Abdala T Espinosa Morgado"
    },
    {
      "affiliations": [
        "Qure.ai, Bangalore, India"
      ],
      "name": "Dennis Robert"
    },
    {
      "affiliations": [
        "Qure.ai Technologies Limited, London, UK"
      ],
      "name": "Shamie Kumar"
    },
    {
      "affiliations": [
        "Department of Primary Health Care Sciences, University of Oxford, Oxford, UK"
      ],
      "name": "Jason Oke"
    },
    {
      "affiliations": [
        "Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK"
      ],
      "name": "Kanika Bhatia"
    },
    {
      "affiliations": [
        "Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK"
      ],
      "name": "Andrea Romsauerova"
    },
    {
      "affiliations": [
        "Department of Clinical Radiology, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK"
      ],
      "name": "Tilak Das"
    },
    {
      "affiliations": [
        "Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK"
      ],
      "name": "The AI-REACT Reader Study Group"
    },
    {
      "affiliations": [
        "Guy's and St Thomas’ NHS Foundation Trust, London, England, UK"
      ],
      "name": "Mariapaola Narbone"
    },
    {
      "affiliations": [
        "Northumbria Healthcare NHS Foundation Trust, North Shields, England, UK"
      ],
      "name": "Rahul Dharmadhikari"
    },
    {
      "affiliations": [
        "Emergency Department, Northumbria Specialist Emergency Care Hospital, Cramlington, UK"
      ],
      "name": "Mark Harrison"
    },
    {
      "affiliations": [
        "Guy's and St Thomas’ NHS Foundation Trust, London, UK"
      ],
      "name": "Kavitha Vimalesvaran"
    },
    {
      "affiliations": [
        "College of Health, Psychology & Social Care, University of Derby, Derby, UK"
      ],
      "name": "Jane Gooch"
    },
    {
      "affiliations": [
        "University College London NHS Foundation Trust, London, UK",
        "School of Allied and Public Health Professions, Canterbury Christ Church University, Canterbury, UK"
      ],
      "name": "Nick Woznitza"
    },
    {
      "affiliations": [
        "Digital Health Validation Lab, University of Glasgow, Glasgow, UK",
        "Emergency Department, NHS Greater Glasgow & Clyde, Glasgow, UK"
      ],
      "name": "David Lowe"
    },
    {
      "affiliations": [
        "Guy's and St Thomas’ NHS Foundation Trust, London, England, UK"
      ],
      "name": "Haris Shuaib"
    },
    {
      "affiliations": [
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, England, UK",
        "Oxford Clinical Artificial Intelligence Research (OxCAIR), Oxford University Hospitals NHS Foundation Trust, Oxford, UK"
      ],
      "name": "Sarim Ather"
    }
  ],
  "title": "Artificial intelligence-assisted reader evaluation in acute CT head interpretation (AI-REACT): a multireader multicase study",
  "uid": "3e4c9d0b-0ecf-5ee5-93cc-3a7c1a32d4a5"
}