Fast probabilistic whitening transformation for ultra-high dimensional genetic data
4 affiliations
- 1Center for Disease Neurogenomics, Icahn School of Medicine at Mount Sinai, New York, New York, United States of America
- 2Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York, United States of America
- 3Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, United States of America
- 4Center for Precision Medicine and Translational Therapeutics, James J. Peters VA Medical Center, Bronx, New York, United States of America
Abstract
Statistical methods often make assumptions about independence between the samples or features of a dataset, yet correlation structure is ubiquitous in real data. In statistical genetics, correlation between regression summary statistics due to linkage disequilibrium (LD) between nearby variants complicates downstream analysis. Many methods use LD reference panels to account for this correlation. Whitening transformations comprise a family of methods to remove correlation structure, and are used implicitly by many common models. Here we propose a probabilistic model for data whitening, and propose parameter estimates and efficient algorithms to improve statistical and computational performance. In an application to impute z-statistics from unobserved genetic variants from a genome-wide association study of schizophrenia, the probabilistic whitening transformation, had the lowest mean square error while being up to an order of magnitude faster than other methods. Using this approach, we also identify tandem repeats that explain genetic regulatory signals for disease-relevant genes. Analyses are implemented in our novel open source R packages decorrelate and imputez. Author summary: Many statistical methods for analysis of regression summary statistics from genome-wide association statistics incorporate linkage disequilibrium matrices from a reference panel. Here, we examine whitening transformations, a general family of linear algebra operations that account for correlation structure. By examining the statistical properties and computational limitations of existing whitening transforms, we propose a novel approach to improve statistical performance and computational efficiency.
Related
- Two D-loop resolution systems enable natural genetic transformation in bacteria.
- A Novel Rubodvirus Associated with Progressive Leaf Whitening Disease in Bougainvillea: Genomic Insights and Phylogenetic Relationships.
- Advancing genetic pathogenicity prediction with three-dimensional proteoform-phenotype analysis
- Decision pathways for genetically modified phosphate-solubilizing bacteria: a four-dimensional synergistic decision-making framework from genetic targets to field deployment
- Probabilistic inference of homonymous and heteronymous recurrent inhibition in human muscles from large-scale motor neuron recordings
BibTeX
@article{hoffman2026fast,
title = {{Fast probabilistic whitening transformation for ultra-high dimensional genetic data}},
author = {Gabriel E. Hoffman and Christian P. Dillard and Kiran Girdhar and Panos Roussos},
journal = {PLOS Genetics},
year = {2026},
month = oct,
doi = {10.1371/journal.pgen.1012320},
url = {https://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1012320},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Fast probabilistic whitening transformation for ultra-high dimensional genetic data
AU - Gabriel E. Hoffman
AU - Christian P. Dillard
AU - Kiran Girdhar
AU - Panos Roussos
PY - 2026
DA - 2026/10/28
JO - PLOS Genetics
DO - 10.1371/journal.pgen.1012320
UR - https://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1012320
AB - Statistical methods often make assumptions about independence between the samples or features of a dataset, yet correlation structure is ubiquitous in real data. In statistical genetics, correlation between regression summary statistics due to linkage disequilibrium (LD) between nearby variants complicates downstream analysis. Many methods use LD reference panels to account for this correlation. Whitening transformations comprise a family of methods to remove correlation structure, and are used implicitly by many common models. Here we propose a probabilistic model for data whitening, and propose parameter estimates and efficient algorithms to improve statistical and computational performance. In an application to impute z-statistics from unobserved genetic variants from a genome-wide association study of schizophrenia, the probabilistic whitening transformation, had the lowest mean square error while being up to an order of magnitude faster than other methods. Using this approach, we also identify tandem repeats that explain genetic regulatory signals for disease-relevant genes. Analyses are implemented in our novel open source R packages decorrelate and imputez. Author summary: Many statistical methods for analysis of regression summary statistics from genome-wide association statistics incorporate linkage disequilibrium matrices from a reference panel. Here, we examine whitening transformations, a general family of linear algebra operations that account for correlation structure. By examining the statistical properties and computational limitations of existing whitening transforms, we propose a novel approach to improve statistical performance and computational efficiency.
SN - 1553-7404
ER -