Gaussian-splatting ptychography via explicit and interpretable primitives
Abstract
Ptychography overcomes the limits of lenses by co-designing optics and computation. Yet prevailing implementations reconstruct on a pixel grid, where weakly-constrained modes drift and recovery demands redundant data. Here we introduce Gaussian-splatting ptychography, representing object and probe as Gaussian primitives. Relocation concentrates primitives where structure is dense, and overlapping primitives couple neighbouring pixels to suppress mode drift. The scheme unexpectedly restores the low-frequency phase that conventional approaches lose, enabling uniform phase transfer across spatial frequencies. The probe is represented and updated in its pupil plane from a random start. In Fourier ptychography, the pupil-plane model recovers severe aberrations where pixel-grid solvers fail. In conventional optical, X-ray and electron ptychography, the pupil-plane primitives also recover the real-space probes with no model of beam-forming optics. The representation cuts memory up to 14-fold and recovers specimens from fewer acquisitions. At electron wavelengths, it resolves atomic structure at tens of electrons per square angstrom.
Related
- P^2-Gaussian: Prior-Driven and Projection-Guided Gaussian Splatting for Sparse-View Cone-Beam CT Reconstruction
- Scaling Density Functional Theory with Gaussian Splatting
- DoReMe: Dual optimization of Reconstruction and Motion estimation for self-navigated free-breathing abdominal MRI using Gaussian Splatting
- A differentiable Lagrangian-coupled 3D Gaussian Splatting-SPH model for forward simulation and inverse analysis in solid mechanics
- Structured Illumination improves Multislice Ptychography
BibTeX
@misc{zhao2026gaussiansplatting,
title = {{Gaussian-splatting ptychography via explicit and interpretable primitives}},
author = {Qianhao Zhao and Zhixuan Hong and David Brady and Changhuei Yang and Andrew Maiden and Zhongtian Zheng and Ruihai Wang and Daniel Gage and Mary Lipton and Christopher Anderton and Arunima Bhattacharjee and Guoan Zheng},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.14891},
eprint = {2609.14891},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.14891},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Gaussian-splatting ptychography via explicit and interpretable primitives
AU - Qianhao Zhao
AU - Zhixuan Hong
AU - David Brady
AU - Changhuei Yang
AU - Andrew Maiden
AU - Zhongtian Zheng
AU - Ruihai Wang
AU - Daniel Gage
AU - Mary Lipton
AU - Christopher Anderton
AU - Arunima Bhattacharjee
AU - Guoan Zheng
PY - 2026
DA - 2026/09/14
PB - arXiv
DO - 10.48550/arxiv.2609.14891
UR - https://arxiv.org/abs/2609.14891
AB - Ptychography overcomes the limits of lenses by co-designing optics and computation. Yet prevailing implementations reconstruct on a pixel grid, where weakly-constrained modes drift and recovery demands redundant data. Here we introduce Gaussian-splatting ptychography, representing object and probe as Gaussian primitives. Relocation concentrates primitives where structure is dense, and overlapping primitives couple neighbouring pixels to suppress mode drift. The scheme unexpectedly restores the low-frequency phase that conventional approaches lose, enabling uniform phase transfer across spatial frequencies. The probe is represented and updated in its pupil plane from a random start. In Fourier ptychography, the pupil-plane model recovers severe aberrations where pixel-grid solvers fail. In conventional optical, X-ray and electron ptychography, the pupil-plane primitives also recover the real-space probes with no model of beam-forming optics. The representation cuts memory up to 14-fold and recovers specimens from fewer acquisitions. At electron wavelengths, it resolves atomic structure at tens of electrons per square angstrom.
ER -