Sample complexity of weak-signal latent-variable models
Abstract
We study parametric estimation in latent-variable models in the weak-signal regime, where a small signal-strength parameter β controls the dependence of the observations on the unknown parameter. At β=0, this dependence disappears, so all parameter values induce the same observed distribution, which we call the null law. We develop a unified framework for analyzing sample complexity in the weak-signal regime by expanding the likelihood ratio around this shared null law in powers of β. We prove that if the unknown parameter is first globally identifiable at order r in this expansion, then estimation to fixed accuracy requires at least on the order of β−2r samples. We further identify a likelihood-separation stability condition that is necessary for any estimator to attain this rate and, under mild regularity conditions, sufficient for both maximum likelihood and method-of-moments estimators to attain it. We also study the regime in which the target accuracy vanishes together with the signal strength, and show that global localization and local refinement may be governed by different likelihood orders, leading to distinct statistical scales. Finally, we apply our framework to broad classes of algebraically structured latent-variable models, including additive-noise channels and exponential-family models.
Related
- On the sample complexity of the generalized hidden shift problem over arbitrary finite groups
- Large Network limit for Latent Variable Process Models with Endogeneously Evolving Interactions among Multiple Types
- Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models
- The LQ Digital Mode Family: Protocol Architecture and Reference Specification for Weak-Signal Communications
- A Geometric Analysis of Initialization Bias in Spherical K-means in the Weak Signal Regime
BibTeX
@misc{balanov2026sample,
title = {{Sample complexity of weak-signal latent-variable models}},
author = {Amnon Balanov and Tamir Bendory and Dan Edidin},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.24770},
eprint = {2610.24770},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.24770},
}
RIS
TY - UNPB
TI - Sample complexity of weak-signal latent-variable models
AU - Amnon Balanov
AU - Tamir Bendory
AU - Dan Edidin
PY - 2026
DA - 2026/10/17
PB - arXiv
DO - 10.48550/arxiv.2610.24770
UR - https://arxiv.org/abs/2610.24770
AB - We study parametric estimation in latent-variable models in the weak-signal regime, where a small signal-strength parameter β controls the dependence of the observations on the unknown parameter. At β=0, this dependence disappears, so all parameter values induce the same observed distribution, which we call the null law. We develop a unified framework for analyzing sample complexity in the weak-signal regime by expanding the likelihood ratio around this shared null law in powers of β. We prove that if the unknown parameter is first globally identifiable at order r in this expansion, then estimation to fixed accuracy requires at least on the order of β^−2r samples. We further identify a likelihood-separation stability condition that is necessary for any estimator to attain this rate and, under mild regularity conditions, sufficient for both maximum likelihood and method-of-moments estimators to attain it. We also study the regime in which the target accuracy vanishes together with the signal strength, and show that global localization and local refinement may be governed by different likelihood orders, leading to distinct statistical scales. Finally, we apply our framework to broad classes of algebraically structured latent-variable models, including additive-noise channels and exponential-family models.
ER -