{
  "abstract": "ObjectivesTo assess whether local artificial intelligence updates for diabetic retinopathy screening that improve image-level probabilities also improve patient-level detection, flagging and net benefit.\n\nMethodsThis retrospective evaluation used four systems, BRSET source data and two external cohorts, mBRSET and DeepDRiD, with separate audit and evaluation patients. Updates were fitted and selected on audits of 25-200 patients; probability recalibration and operating policies were selected separately. Outcomes included Brier loss, patient detection, flags and net benefit at four threshold probabilities (p=0.05-0.30). Comparators were no update, flag all and flag none. Conditional patient-cluster intervals compared updates with no update; simple-policy comparisons were descriptive.\n\nResultsAt audit budget 200, mean Brier loss improved in all eight cohort-system comparisons. In mBRSET, flags rose from 154-442 to 809-951 per 1,000 patients and missed positives fell from 51-133 to 2-14 (5.69-9.48 additional flags per additional detection). In mBRSET at p=0.05, three of four updates had lower mean net benefit than flag all; at p=0.20, all four exceeded flag all but remained below no update. In DeepDRiD at p=0.20, the APTOS update increased mean net benefit by 0.0510 over no update and exceeded both simple policies.\n\nDiscussionImage-level improvement did not ensure patient-level benefit. Flag increases were consistent with image-level targets applied to patients with about four images.\n\nConclusionLocal updates should be judged on patient-level detection, flags and net benefit against unchanged, flag-all and flag-none policies, not on image-level metrics alone.\n\nKEY MESSAGESO_ST_ABSWhat is already known on this topicC_ST_ABSO_LIRetinal AI performance can change between settings, and local recalibration or threshold adjustment can improve conventional evaluation metrics. C_LI\n\nWhat this study addsO_LILocal updates improved image-level Brier loss in all eight cohort-system comparisons, but in mBRSET at p=0.20 all four lowered mean patient-level net benefit, adding 5.7-9.5 positive flags per additional detection. Whether an update outperformed the unchanged, flag-all and flag-none policies depended on the cohort and threshold probability. C_LI\n\nHow this study might affect research, practice or policyO_LIBefore adopting a local update, services can compare patient detection, positive flags and net benefit with the unchanged, flag-all and flag-none policies on held-out patients. C_LI",
  "abstract_shown": true,
  "affiliations": [
    "School of Biomedical Engineering, Capital Medical University"
  ],
  "article_type": "PUBLISHAHEADOFPRINT",
  "arxiv": null,
  "author_total": 6,
  "authors": [
    {
      "name": "R. Li"
    },
    {
      "name": "T. Ma"
    },
    {
      "name": "L. Tang"
    },
    {
      "name": "S. Li"
    },
    {
      "name": "Y. Wu"
    },
    {
      "affs": [
        0
      ],
      "name": "H. Xia"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/15vjjexxwv7t7.bib",
  "cited_by": 0,
  "doi": "10.64898/2026.10.23.26366103",
  "fulltext_url": "https://www.medrxiv.org/content/10.64898/2026.10.23.26366103v1.full",
  "id": "15vjjexxwv7t7",
  "issns": [],
  "landing_url": "https://www.medrxiv.org/content/10.64898/2026.10.23.26366103v1",
  "language": null,
  "licence": "CC-BY-NC",
  "licence_label": "CC BY-NC",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by-nc/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "medrxiv",
      "ophthalmology"
    ],
    [
      "openalex",
      "2741|Retinal Imaging and Analysis"
    ]
  ],
  "openalex": "W7223705376",
  "pdf_url": "https://www.medrxiv.org/content/10.64898/2026.10.23.26366103v1.full.pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-23",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/15vjjexxwv7t7.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:21:51Z",
      "native_id": "10.64898/2026.10.23.26366103",
      "source": "medrxiv",
      "url": "https://www.medrxiv.org/content/10.64898/2026.10.23.26366103v1"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2741|Retinal Imaging and Analysis",
      "subfield": "imaging"
    }
  ],
  "title": "Patient-level consequences of local updates to retinal AI for diabetic retinopathy screening: a retrospective two-cohort evaluation",
  "title_text": "Patient-level consequences of local updates to retinal AI for diabetic retinopathy screening: a retrospective two-cohort evaluation",
  "type": "preprint",
  "updated_at": "2026-10-30T12:21:51Z",
  "url": "https://research.draconitic.com/paper/15vjjexxwv7t7",
  "venue": "medRxiv",
  "versions": []
}