Dynamic Extended Generalized Many-Facet Rasch Model: A Unified Approach to Rater-Mediated Assessment
Abstract
Rating procedures are crucial in psychological and medical diagnosis, educational assessment, peer review, and grant evaluation. A major methodological challenge is disentangling multiple sources of variability in ratings, such as subject ability, rater behavior, and item characteristics. Item Response Theory-based models, most notably many-facet Rasch models and hierarchical rater models, have been widely adopted for jointly estimating subject, rater, and item effects, while retaining high interpretability. We introduce the Dynamic Extended Generalized Many-Facet Rasch model, a general class of Bayesian semiparametric models that integrate and extend existing approaches. Its measurement model allows location and discrimination parameters to depend jointly on item and rater characteristics and incorporates subject-item and rater-subject variation. The dynamic extension introduces a rater-specific cross-lagged effect capturing dependence on the previously rated subject, and a Bayesian P-spline capturing systematic changes in discrimination over the rating sequence, accounting for learning, fatigue, or adaptation effects. Subject heterogeneity is addressed through Bayesian nonparametric mixtures, flexibly learning the latent ability distribution without strict parametric assumptions and enabling model-based subject clustering. We also derive a closed-form, model-based inter-rater consensus coefficient and study its characteristics. We discuss theoretical properties, develop posterior computation strategies, and evaluate the model in simulation studies and two real-data applications.
Related
- On the Unified Generalized q-Stirling Matrices and Their Matrix Decompositions
- Generalized Rank Weight and Extended Generalized Poset Weight Defined For Codes Over Rings: A Galois Connection Approach
- A unified approach to fluctuations of LES of time-dependent generalized patterned random matrices
- Extended Generalized Contractions, Metric Completeness, and Applications to Solving Nonlinear Diophantine Equations
- Long-Term Tail Modeling in Survival Analysis via Extended Generalized Pareto Distributions
BibTeX
@misc{mignemi2026dynamic,
title = {{Dynamic Extended Generalized Many-Facet Rasch Model: A Unified Approach to Rater-Mediated Assessment}},
author = {Giuseppe Mignemi and Patrícia Martinková and Sally Paganin},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.14199},
eprint = {2610.14199},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.14199},
}
RIS
TY - UNPB
TI - Dynamic Extended Generalized Many-Facet Rasch Model: A Unified Approach to Rater-Mediated Assessment
AU - Giuseppe Mignemi
AU - Patrícia Martinková
AU - Sally Paganin
PY - 2026
DA - 2026/10/09
PB - arXiv
DO - 10.48550/arxiv.2610.14199
UR - https://arxiv.org/abs/2610.14199
AB - Rating procedures are crucial in psychological and medical diagnosis, educational assessment, peer review, and grant evaluation. A major methodological challenge is disentangling multiple sources of variability in ratings, such as subject ability, rater behavior, and item characteristics. Item Response Theory-based models, most notably many-facet Rasch models and hierarchical rater models, have been widely adopted for jointly estimating subject, rater, and item effects, while retaining high interpretability. We introduce the Dynamic Extended Generalized Many-Facet Rasch model, a general class of Bayesian semiparametric models that integrate and extend existing approaches. Its measurement model allows location and discrimination parameters to depend jointly on item and rater characteristics and incorporates subject-item and rater-subject variation. The dynamic extension introduces a rater-specific cross-lagged effect capturing dependence on the previously rated subject, and a Bayesian P-spline capturing systematic changes in discrimination over the rating sequence, accounting for learning, fatigue, or adaptation effects. Subject heterogeneity is addressed through Bayesian nonparametric mixtures, flexibly learning the latent ability distribution without strict parametric assumptions and enabling model-based subject clustering. We also derive a closed-form, model-based inter-rater consensus coefficient and study its characteristics. We discuss theoretical properties, develop posterior computation strategies, and evaluate the model in simulation studies and two real-data applications.
ER -