Self-Driving Microscopy with Agents: Progress and Prospects
- 1Center for Nanophase Materials Sciences
- 2Oak Ridge National Laboratory
Abstract
Agentic AI, powered by large language models, has increasingly been applied within self-driving laboratories and here we review its emerging role in self-driving microscopy. Microscopy is an unusually demanding target as each experiment is a sequence of interdependent decisions about where to measure, at what resolution, through which modality, and often on ambiguous evidence. We review recent demonstrations across atomic force, scanning tunneling, and transmission electron microscopy and examine how agentic systems can lower the expertise barrier to advanced characterization, transfer strategies between platforms, mine laboratory records for reusable protocols, generate and screen hypotheses, and bring simulation into the experimental loop. We also highlight and examine the limitations that currently constrain these systems. Agents can lose track of the scientific goal as a session outgrows their context window. They also remain poor judges of their own competence, making failure particularly difficult to anticipate in open-ended research. Flexible reasoning must therefore sit on deterministic, physically constrained control, with safety limits enforced outside the model. Human oversight can be the safeguard, but a human acting only as an approval or rejection gate risks forfeiting what scientists contribute most — questioning how the problem was framed in the first place. Designing agentic systems that preserve that contribution and address the current limitations is, in our view, the defining challenge for the field.
Related
- Bismuth Chalcogenide‐Based Photocatalysts for Nitrogen Reduction: Recent Progress and Prospects
- Recent advances in waste-derived sorbents for oil sorption and oil–water separation: progress and future prospects
- Breaking the Triple “Skeleton–Liquid Loading–Liquid Lock” Barrier: Research Progress and Integrated Prospects for Surfactants for Repairing Deep Natural Gas Reservoirs
- What Can the Records of Published Self-Driving Laboratories Predict About a New Platform? A Step-Level Database and Explorer
- A sustainability-aware self-driving laboratory
BibTeX
@misc{chowdhury2026selfdriving,
title = {{Self-Driving Microscopy with Agents: Progress and Prospects}},
author = {Jawad Chowdhury and Sumner B Harris and Ganesh Narasimha and Ondrej Dyck and Panchapakesan Ganesh and Ruben Millan Solsona and Marti Checa and Liam Collins and Soumendu Bagchi and Rama Vasudevan and Yongtao Liu},
howpublished = {ChemRxiv},
year = {2026},
month = oct,
doi = {10.26434/chemrxiv.15011161/v1},
url = {https://chemrxiv.org/doi/full/10.26434/chemrxiv.15011161/v1},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - Self-Driving Microscopy with Agents: Progress and Prospects
AU - Jawad Chowdhury
AU - Sumner B Harris
AU - Ganesh Narasimha
AU - Ondrej Dyck
AU - Panchapakesan Ganesh
AU - Ruben Millan Solsona
AU - Marti Checa
AU - Liam Collins
AU - Soumendu Bagchi
AU - Rama Vasudevan
AU - Yongtao Liu
PY - 2026
DA - 2026/10/27
PB - ChemRxiv
DO - 10.26434/chemrxiv.15011161/v1
UR - https://chemrxiv.org/doi/full/10.26434/chemrxiv.15011161/v1
AB - Agentic AI, powered by large language models, has increasingly been applied within self-driving laboratories and here we review its emerging role in self-driving microscopy. Microscopy is an unusually demanding target as each experiment is a sequence of interdependent decisions about where to measure, at what resolution, through which modality, and often on ambiguous evidence. We review recent demonstrations across atomic force, scanning tunneling, and transmission electron microscopy and examine how agentic systems can lower the expertise barrier to advanced characterization, transfer strategies between platforms, mine laboratory records for reusable protocols, generate and screen hypotheses, and bring simulation into the experimental loop. We also highlight and examine the limitations that currently constrain these systems. Agents can lose track of the scientific goal as a session outgrows their context window. They also remain poor judges of their own competence, making failure particularly difficult to anticipate in open-ended research. Flexible reasoning must therefore sit on deterministic, physically constrained control, with safety limits enforced outside the model. Human oversight can be the safeguard, but a human acting only as an approval or rejection gate risks forfeiting what scientists contribute most — questioning how the problem was framed in the first place. Designing agentic systems that preserve that contribution and address the current limitations is, in our view, the defining challenge for the field.
ER -