A Scalable Predictive Modeling Approach to Duplicate Detection in Pharmacovigilance: Algorithm Development and Validation Study
- 1Uppsala Monitoring Centre Uppsala, Uppsala Sweden
Abstract
Background: Adverse event reports referring to the same case but treated as independent can negatively impact statistical analysis and may mislead clinical assessment. Pharmacovigilance relies on large databases of adverse event reports to discover potential new causal associations. Their size necessitates computational methods to identify duplicates at scale. The current state-of-the-art is statistical record linkage which outperforms rule-based approaches. In particular, vigiMatch is in routine use for VigiBase, the World Health Organization global database of adverse event reports, and represents the first statistical duplicate detection approach in pharmacovigilance deployed at scale. Originally developed for both drugs and vaccines, its application to vaccines has been limited due to inconsistent performance across countries.
Objective: This study aims to advance the state-of-the-art for duplicate detection in large-scale pharmacovigilance databases and achieve more consistent performance across adverse event reports from different countries.
Methods: This paper extends vigiMatch from probabilistic record linkage to predictive modeling, refining features for drugs, vaccines, and adverse events using country-specific reporting rates, extracting dates from free text, and training separate support vector machine classifiers for drugs and vaccines. Recall was evaluated using 5 independent reference sets. Precision was assessed by annotating random selections of report pairs classified as duplicates.
Results: Precision for the new method was 92% for vaccines and 54% for drugs, compared with 41% for a previous generation method. Recall ranged from 80% to 85% across test sets for vaccines and from 40% to 86% for drugs, compared with 24%-53% for the comparator method.
Conclusions: Predictive modeling, use of free text, and country-specific features advance state-of-the-art for duplicate detection in pharmacovigilance.
Related
- Development and validation of a nomogram-based predictive model for infectious diseases of the spine utilizing peripheral blood laboratory parameters
- Development and Validation of a Predictive Model for 6-Month All-Cause Mortality in Pulmonary Embolism.
- Development and internal validation of a clinical risk score for early delirium detection in older emergency department patients
- Development and validation of a predictive model for delayed emergence from anesthesia in elderly patients undergoing video-assisted thoracoscopic surgery: a retrospective study.
- Development and validation of an artificial intelligence model for basal cell carcinoma detection and section completeness assessment in Mohs micrographic surgery in an Asian cohort
BibTeX
@article{barrett2026scalable,
title = {{A Scalable Predictive Modeling Approach to Duplicate Detection in Pharmacovigilance: Algorithm Development and Validation Study}},
author = {Jim W Barrett and Nils Erlanson and Joana Félix China and G Niklas Norén},
journal = {JMIR AI},
year = {2026},
month = aug,
doi = {10.2196/95282},
url = {https://doi.org/10.2196/95282},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - A Scalable Predictive Modeling Approach to Duplicate Detection in Pharmacovigilance: Algorithm Development and Validation Study
AU - Jim W Barrett
AU - Nils Erlanson
AU - Joana Félix China
AU - G Niklas Norén
PY - 2026
DA - 2026/08/06
JO - JMIR AI
DO - 10.2196/95282
UR - https://doi.org/10.2196/95282
AB - Background: Adverse event reports referring to the same case but treated as independent can negatively impact statistical analysis and may mislead clinical assessment. Pharmacovigilance relies on large databases of adverse event reports to discover potential new causal associations. Their size necessitates computational methods to identify duplicates at scale. The current state-of-the-art is statistical record linkage which outperforms rule-based approaches. In particular, vigiMatch is in routine use for VigiBase, the World Health Organization global database of adverse event reports, and represents the first statistical duplicate detection approach in pharmacovigilance deployed at scale. Originally developed for both drugs and vaccines, its application to vaccines has been limited due to inconsistent performance across countries. Objective: This study aims to advance the state-of-the-art for duplicate detection in large-scale pharmacovigilance databases and achieve more consistent performance across adverse event reports from different countries. Methods: This paper extends vigiMatch from probabilistic record linkage to predictive modeling, refining features for drugs, vaccines, and adverse events using country-specific reporting rates, extracting dates from free text, and training separate support vector machine classifiers for drugs and vaccines. Recall was evaluated using 5 independent reference sets. Precision was assessed by annotating random selections of report pairs classified as duplicates. Results: Precision for the new method was 92% for vaccines and 54% for drugs, compared with 41% for a previous generation method. Recall ranged from 80% to 85% across test sets for vaccines and from 40% to 86% for drugs, compared with 24%-53% for the comparator method. Conclusions: Predictive modeling, use of free text, and country-specific features advance state-of-the-art for duplicate detection in pharmacovigilance.
SN - 2817-1705
ER -