Skip to content
DraconiticResearch
Search Sources API
197,768 studies31 sourcesUpdated 24 min ago
Peer-reviewedCC BY 4.0Test

Selective inference for false discovery proportion in a hidden Markov model

Abstract

We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal work of Sun and Cai (2009). While previous work has concentrated on deriving specific procedures with a controlled False Discovery Rate (FDR) under this model, following a recent trend in selective inference, we consider the problem of establishing confidence bounds on the false discovery proportion (FDP), for a user-selected set of hypotheses that can depend on the observed data in an arbitrary way. We develop a methodology to construct such confidence bounds first when the HMM model is known, then when its parameters are unknown and estimated, including the data distribution under the null and the alternative, using a nonparametric approach. In the latter case, we propose a bootstrap-based methodology to take into account the effect of parameter estimation error. We show that taking advantage of the assumed HMM structure allows for a substantial improvement of confidence bound sharpness over existing agnostic (structure-free) methods, as witnessed both via numerical experiments and real data examples.

Related

  1. Posterior Regimes and Latent Deception: Variational Bayesian Inference in Hidden Markov Models for Sequential Fraud Detection in Financial Transactions
    Joseph Uririoghene Obukofe, Anthony O'Hare, Chioma Sandra Dike
    arXivPreprintarXiv licenceFull textStatisticsarXiv
  2. Gated Spatial Hidden Markov Models for Classification in Histological Samples, With Application to Muscle Fiber‐Typing
    Tilman M. Davies
    Statistics in medicinePeer-reviewedCC BY-NCFull textStatisticsEurope PMC
  3. Accumulated-Variance Functionals of Hidden Markov and Semi-Markov Processes: Finite-Sample Upper and Lower Bounds
    Wilson Andres Lombardo
    HALPreprintCC BY 4.0Full textProbabilityHAL
  4. Generalized Infinite Hidden Markov Models
    Giuseppe Mignemi, Daniele Tancini, Francesco Bartolucci
    arXivPreprintCC BY 4.0Full textStatisticsarXiv
  5. Equilibrium prices under hidden Markov fundamentals
    Henri Pagès, Dylan Possamaï, Mateo Rodriguez Polo
    arXivPreprintarXiv licenceFull textProbabilityarXiv
BibTeX
@article{perrotdockes2026selective,
  title = {{Selective inference for false discovery proportion in a hidden Markov model}},
  author = {Marie Perrot-Dockès and Gilles Blanchard and Pierre Neuvial and Etienne Roquain},
  journal = {Test},
  year = {2026},
  month = sep,
  doi = {10.1007/s11749-023-00886-7},
  eprint = {2105.00288},
  archivePrefix = {arXiv},
  url = {https://hal.science/hal-03214472v2},
  note = {CC BY 4.0},
}
RIS
TY  - JOUR
TI  - Selective inference for false discovery proportion in a hidden Markov model
AU  - Marie Perrot-Dockès
AU  - Gilles Blanchard
AU  - Pierre Neuvial
AU  - Etienne Roquain
PY  - 2026
DA  - 2026/09/03
JO  - Test
DO  - 10.1007/s11749-023-00886-7
UR  - https://hal.science/hal-03214472v2
AB  - We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal work of Sun and Cai (2009). While previous work has concentrated on deriving specific procedures with a controlled False Discovery Rate (FDR) under this model, following a recent trend in selective inference, we consider the problem of establishing confidence bounds on the false discovery proportion (FDP), for a user-selected set of hypotheses that can depend on the observed data in an arbitrary way. We develop a methodology to construct such confidence bounds first when the HMM model is known, then when its parameters are unknown and estimated, including the data distribution under the null and the alternative, using a nonparametric approach. In the latter case, we propose a bootstrap-based methodology to take into account the effect of parameter estimation error. We show that taking advantage of the assumed HMM structure allows for a substantial improvement of confidence bound sharpness over existing agnostic (structure-free) methods, as witnessed both via numerical experiments and real data examples.
SN  - 1133-0686
SN  - 1863-8260
ER  -