Towards Retrieval Augmented Generation in High-Energy and Astroparticle Physics
Abstract
The high-energy and astroparticle physics literature has grown into an enormous body of knowledge. Gaining a comprehensive understanding of this literature is an important step in research, but is a challenging task. Before making meaningful advances, it is important to establish what has already been done and identify open questions. However, this process is becoming increasingly difficult given the sheer volume of publications. Conducting a focused literature survey on a narrow topic is particularly challenging. We develop an open-source Retrieval Augmented Generation (RAG) pipeline to produce concise, targeted summary reports with citations, grounded in the database of arXiv papers, enabling researchers, editors, and referees to rapidly orient themselves within any corner of the field. Specifically, we embed approximately 230K hep-ph and astro-ph.HE papers to enable a hybrid retrieval that captures both keyword matches and semantic similarity. The fused candidate set is then refined using a cross-encoder reranker. Following retrieval, the papers are passed to a Large Language Model (LLM), for which we use Google DeepMind's open-source Gemma-4-E4B model. The LLM first acts as a judge to evaluate the relevance and then synthesizes a coherent and grounded report with references. This modern AI-driven approach allows us to go beyond the capabilities of classical keyword search on arXiv or Inspire-HEP.
Related
- A Missing Latent, Not a Missing Simulator: Radius-Augmented Inference for Real JWST Retrieval
- ASTRA: An Autonomous Framework for Physics-Validated Analysis and Hypothesis Generation in Astrophysics
- Promoting Green Computing in High Energy Physics and Astrophysics
- Cosmic Colliders in Binary Blazars Probing Ultra-High-Energy Particle Physics
- Reconstructing the generalized Barrow holographic dark energy with physics-informed neural networks
BibTeX
@misc{kumar2026towards,
title = {{Towards Retrieval Augmented Generation in High-Energy and Astroparticle Physics}},
author = {Jacky Kumar and Sajan Kumar},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.00891},
eprint = {2610.00891},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.00891},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Towards Retrieval Augmented Generation in High-Energy and Astroparticle Physics
AU - Jacky Kumar
AU - Sajan Kumar
PY - 2026
DA - 2026/10/01
PB - arXiv
DO - 10.48550/arxiv.2610.00891
UR - https://arxiv.org/abs/2610.00891
AB - The high-energy and astroparticle physics literature has grown into an enormous body of knowledge. Gaining a comprehensive understanding of this literature is an important step in research, but is a challenging task. Before making meaningful advances, it is important to establish what has already been done and identify open questions. However, this process is becoming increasingly difficult given the sheer volume of publications. Conducting a focused literature survey on a narrow topic is particularly challenging. We develop an open-source Retrieval Augmented Generation (RAG) pipeline to produce concise, targeted summary reports with citations, grounded in the database of arXiv papers, enabling researchers, editors, and referees to rapidly orient themselves within any corner of the field. Specifically, we embed approximately 230K hep-ph and astro-ph.HE papers to enable a hybrid retrieval that captures both keyword matches and semantic similarity. The fused candidate set is then refined using a cross-encoder reranker. Following retrieval, the papers are passed to a Large Language Model (LLM), for which we use Google DeepMind's open-source Gemma-4-E4B model. The LLM first acts as a judge to evaluate the relevance and then synthesizes a coherent and grounded report with references. This modern AI-driven approach allows us to go beyond the capabilities of classical keyword search on arXiv or Inspire-HEP.
ER -