Efficient Screening Designs for Expensive Black-box Models with Qualitative and Quantitative Factors
Abstract
Computationally expensive black-box models often involve a large number of input factors with complex interactions and varying importance. Experimental design techniques can be used for quickly identifying the important factors, which can make the optimization of a complex computer model or the training of an expensive machine learning model more efficient. Existing screening designs for black-box models focus mainly on continuous factors, with the maximum one-factor-at-a-time (MOFAT) design being a recent example. In this work, we extend the design to incorporate multiple types of factors, including nominal, ordinal, and discrete-numeric. We first identify the properties leading to optimal screening, where qualitative and quantitative factors should be treated differently. Based on these properties, we propose practical algorithms to efficiently construct MOFAT designs for all types of factors. The usefulness of the design is demonstrated by both numerical experiments and an application to hyperparameter tuning in machine learning models.
Related
- Efficient lifts into odd dimensions of Spherical $5$- and $7$-designs with Balanced Halves
- Semiparametric Efficient Inference under Non-Informative Complex Survey Designs
- New Qualitative and Quantitative Estimates for Neumann Eigenvalues toward Pólya's Conjecture
- Qualitative-to-quantitative regularity for degenerate equations
- Triangulating Careless Responding: Quantitative Models Meet Qualitative Insights on Response Processes
BibTeX
@misc{song2026efficient,
title = {{Efficient Screening Designs for Expensive Black-box Models with Qualitative and Quantitative Factors}},
author = {Difan Song and V. Roshan Joseph},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.02087},
eprint = {2609.02087},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.02087},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Efficient Screening Designs for Expensive Black-box Models with Qualitative and Quantitative Factors
AU - Difan Song
AU - V. Roshan Joseph
PY - 2026
DA - 2026/09/02
PB - arXiv
DO - 10.48550/arxiv.2609.02087
UR - https://arxiv.org/abs/2609.02087
AB - Computationally expensive black-box models often involve a large number of input factors with complex interactions and varying importance. Experimental design techniques can be used for quickly identifying the important factors, which can make the optimization of a complex computer model or the training of an expensive machine learning model more efficient. Existing screening designs for black-box models focus mainly on continuous factors, with the maximum one-factor-at-a-time (MOFAT) design being a recent example. In this work, we extend the design to incorporate multiple types of factors, including nominal, ordinal, and discrete-numeric. We first identify the properties leading to optimal screening, where qualitative and quantitative factors should be treated differently. Based on these properties, we propose practical algorithms to efficiently construct MOFAT designs for all types of factors. The usefulness of the design is demonstrated by both numerical experiments and an application to hyperparameter tuning in machine learning models.
ER -