Validated Semantic Scoring Improves Filtering Generic Concepts from Knowledge-Graphs for Drug Repurposing Queries
- 1Oregon State University
Abstract
When an ontology-based biomedical knowledge graph (a KG, containing information about genes, pathways, phenotypes, and molecular interactions) is analyzed using a computational reasoning system, the system can return unwanted generic concepts. Such generic concepts, in the context of a query about potential drug treatments for a disease, might include 'pharmaceutical preparations' or 'antibiotics'. Answers can be filtered based on hand-curated block-lists or ontology Information Content (IC), but to our knowledge, (1) neither filtering method has been validated against expert judgments of generality, and (2) IC is not available for the majority of nodes in the representative KG used in this work. In this study, three domain experts rated representative lists of KG concepts for generality. We built a semantic precision score (SPS) from a concept's name and description alone, using a biomedical language model (BioLORD). For the purpose of filtering generic answers from biomedical query results, we compared (using queries for 200 diseases) the SPS against a curated concept block-list and two IC thresholds. IC agreed moderately with the experts (Spearman's {rho} = 0.59), but correlations were negligible or negative within IC bands. The SPS was well-correlated with the experts ({rho} = 0.76) globally and within SPS bands, and remained informative on concepts without IC ({rho} = 0.59). Hard filtering of query results using the SPS removed 1,502 of 33,161 query answers, nearly three times the block-list's 513, while removing fewer of the query-specific DrugCentral indications. Hard filtering by IC removed either few answers or many approved drugs. We additionally compared the filtering methods' performance on an independent evaluation set of queries for 200 diseases. The SPS filter removed 5,135 of 91,203 answers compared with the block-list's 1,419 and lost none of 1,296 indications compared with 17. Further, SPS filtering removed approved drugs no more often from the half of DrugCentral not used in training than from the half used in training. Semantic meaning captures expert judgments of specificity more faithfully than ontology position, and semantic scoring can replace IC and manually maintained block-lists for filtering drug-repurposing results.
Related
- SpliceCOV: Supervised Filtering of RNA-Seq-Derived Transcript Features Improves Transcriptome Assembly
- Every Cure Knowledge Graph: A Unified Biomedical Knowledge Graph for Drug Repurposing
- Heterogeneous graph neural networks with biological prior knowledge for interpretable drug repurposing in triple-negative breast cancer
- Prompting Beyond Pairs: Decoupled Semantic Supervision for Knowledge-Guided Multiplex Virtual Staining
- A trustworthy semantic knowledge network linking data-driven cell phenotypes to diseases and drugs
BibTeX
@misc{hodges2026validated,
title = {{Validated Semantic Scoring Improves Filtering Generic Concepts from Knowledge-Graphs for Drug Repurposing Queries}},
author = {F. Hodges and S. A. Ramsey and D. Koslicki and A. Bazarkulov and J. Roach},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.29.755063},
url = {https://www.biorxiv.org/content/10.64898/2026.09.29.755063v1},
note = {CC BY-NC},
}
RIS
TY - UNPB
TI - Validated Semantic Scoring Improves Filtering Generic Concepts from Knowledge-Graphs for Drug Repurposing Queries
AU - F. Hodges
AU - S. A. Ramsey
AU - D. Koslicki
AU - A. Bazarkulov
AU - J. Roach
PY - 2026
DA - 2026/09/29
PB - bioRxiv
DO - 10.64898/2026.09.29.755063
UR - https://www.biorxiv.org/content/10.64898/2026.09.29.755063v1
AB - When an ontology-based biomedical knowledge graph (a KG, containing information about genes, pathways, phenotypes, and molecular interactions) is analyzed using a computational reasoning system, the system can return unwanted generic concepts. Such generic concepts, in the context of a query about potential drug treatments for a disease, might include 'pharmaceutical preparations' or 'antibiotics'. Answers can be filtered based on hand-curated block-lists or ontology Information Content (IC), but to our knowledge, (1) neither filtering method has been validated against expert judgments of generality, and (2) IC is not available for the majority of nodes in the representative KG used in this work. In this study, three domain experts rated representative lists of KG concepts for generality. We built a semantic precision score (SPS) from a concept's name and description alone, using a biomedical language model (BioLORD). For the purpose of filtering generic answers from biomedical query results, we compared (using queries for 200 diseases) the SPS against a curated concept block-list and two IC thresholds. IC agreed moderately with the experts (Spearman's {rho} = 0.59), but correlations were negligible or negative within IC bands. The SPS was well-correlated with the experts ({rho} = 0.76) globally and within SPS bands, and remained informative on concepts without IC ({rho} = 0.59). Hard filtering of query results using the SPS removed 1,502 of 33,161 query answers, nearly three times the block-list's 513, while removing fewer of the query-specific DrugCentral indications. Hard filtering by IC removed either few answers or many approved drugs. We additionally compared the filtering methods' performance on an independent evaluation set of queries for 200 diseases. The SPS filter removed 5,135 of 91,203 answers compared with the block-list's 1,419 and lost none of 1,296 indications compared with 17. Further, SPS filtering removed approved drugs no more often from the half of DrugCentral not used in training than from the half used in training. Semantic meaning captures expert judgments of specificity more faithfully than ontology position, and semantic scoring can replace IC and manually maintained block-lists for filtering drug-repurposing results.
ER -