Improving the selection-function-based sensitivity analysis for publication bias with restricted maximum likelihood
Abstract
In random-effects meta-analysis, the between-study variance quantifies the heterogeneity among studies. Without selective publication, the restricted maximum likelihood (REML) method is recommended for this variance, since the maximum likelihood (ML) method underestimates it when the number of studies is small. However, under selective publication, referred to as publication bias (PB), the published studies no longer follow the normal-normal model, and the REML cannot be directly applied. Thus, the existing sensitivity analysis methods for PB based on selection functions estimate the between-study variance by the ML conditional on published studies and inherit its underestimation. This underestimation also affects the estimate of the common effect and its confidence interval. To improve the estimation of the common effect and the heterogeneity, we propose a REML-type estimator of the between-study variance for the selection-function-based sensitivity analysis. It centers the profile score by its approximate mean and reduces exactly to the REML without PB. The proposed sensitivity analysis method is a more accurate alternative to the ML-based sensitivity analysis in meta-analyses with a small number of studies, and it is the first REML-type estimator in the presence of PB. Simulation studies substantiate that the proposed method reduces the median bias of the between-study variance and improves the estimation error and coverage probability for the common effect compared with the conditional ML. We illustrate the proposed method with two meta-analyses on high maintenance-dose clopidogrel and nicotine gum for smoking cessation. The proposed method would give useful guidance on the between-study heterogeneity in sensitivity analysis for PB.
Related
- Restricted Maximum Likelihood Estimation in Generalized Linear Mixed Models
- Asymptotic Theory for Restricted Maximum Likelihood Estimators in Generalized Linear Mixed Models
- A hybrid GPU/CPU implementation of the average information restricted maximum likelihood algorithm for fitting multivariate linear mixed models
- Improving the Sensitivity of Gravitational Wave Detection with Weighted Conformal Prediction
- Sensitivity Analysis for Trials with Irregular and Informative Assessment Times: Marginal Mean Models and Sensitivity Parameter Selection
BibTeX
@misc{hu2026improving,
title = {{Improving the selection-function-based sensitivity analysis for publication bias with restricted maximum likelihood}},
author = {Taojun Hu and Yi Zhou and Xiao-Hua Zhou and Satoshi Hattori},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.02665},
eprint = {2611.02665},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.02665},
note = {CC BY-NC-SA 4.0},
}
RIS
TY - UNPB
TI - Improving the selection-function-based sensitivity analysis for publication bias with restricted maximum likelihood
AU - Taojun Hu
AU - Yi Zhou
AU - Xiao-Hua Zhou
AU - Satoshi Hattori
PY - 2026
DA - 2026/11/02
PB - arXiv
DO - 10.48550/arxiv.2611.02665
UR - https://arxiv.org/abs/2611.02665
AB - In random-effects meta-analysis, the between-study variance quantifies the heterogeneity among studies. Without selective publication, the restricted maximum likelihood (REML) method is recommended for this variance, since the maximum likelihood (ML) method underestimates it when the number of studies is small. However, under selective publication, referred to as publication bias (PB), the published studies no longer follow the normal-normal model, and the REML cannot be directly applied. Thus, the existing sensitivity analysis methods for PB based on selection functions estimate the between-study variance by the ML conditional on published studies and inherit its underestimation. This underestimation also affects the estimate of the common effect and its confidence interval. To improve the estimation of the common effect and the heterogeneity, we propose a REML-type estimator of the between-study variance for the selection-function-based sensitivity analysis. It centers the profile score by its approximate mean and reduces exactly to the REML without PB. The proposed sensitivity analysis method is a more accurate alternative to the ML-based sensitivity analysis in meta-analyses with a small number of studies, and it is the first REML-type estimator in the presence of PB. Simulation studies substantiate that the proposed method reduces the median bias of the between-study variance and improves the estimation error and coverage probability for the common effect compared with the conditional ML. We illustrate the proposed method with two meta-analyses on high maintenance-dose clopidogrel and nicotine gum for smoking cessation. The proposed method would give useful guidance on the between-study heterogeneity in sensitivity analysis for PB.
ER -