Energy-performance tradeoffs in server farms with batch services and setup times
Abstract
Data centers consume a large amount of energy, much of which is wasted due to idle servers. Turning off idle servers might be an effective power-saving solution; however, there is a trade-off between energy savings and system performance. Hence, we propose a setup queueing model with a batching policy that allows servers to process a set of jobs simultaneously to minimize power consumption while maintaining acceptable performance. We consider an M/M/c/SET--BATCH queue, a multi-server batch service queue with a fixed batch size and setup times, and some variants, including systems in which idle servers delay before turning off or systems in which the batch size is dynamic. We analyze the steady-state probabilities and system performance of the M/M/c/SET--BATCH system and its variants. Our analysis of the M/M/c/SET--BATCH system with lower computational complexity is made possible by utilizing the special structure of the model. In addition, we use simulations to compare the M/M/c/SET--BATCH model with some other variants with different setup time distributions. The results suggest that the model performs better when the setup time has a larger coefficient of variation. Our results indicate that the batching policy enhances the system performance, especially when we allow servers to be idle before turning them off.
Versions
Related
- Whittle index approach to multi-server scheduling with convex delay costs and impatient customers
- Relative-Error Composite Federated Optimization with One Server-Side Proximal Step per Round
- Capacity Control in a Single-Server Diagnostic--Treatment Queue with Heterogeneous Treatment Modes
- PockFlex: a web server for flexibility-aware binding site identification and prioritisation from structural ensembles
- Low-Rank Masking for Single-Server Matrix Multiplication
BibTeX
@misc{leanh2026energyperformance,
title = {{Energy-performance tradeoffs in server farms with batch services and setup times}},
author = {Thu Le-Anh and Tuan Phung-Duc},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.04881},
eprint = {2610.04881},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.04881},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Energy-performance tradeoffs in server farms with batch services and setup times
AU - Thu Le-Anh
AU - Tuan Phung-Duc
PY - 2026
DA - 2026/10/04
PB - arXiv
DO - 10.48550/arxiv.2610.04881
UR - https://arxiv.org/abs/2610.04881
AB - Data centers consume a large amount of energy, much of which is wasted due to idle servers. Turning off idle servers might be an effective power-saving solution; however, there is a trade-off between energy savings and system performance. Hence, we propose a setup queueing model with a batching policy that allows servers to process a set of jobs simultaneously to minimize power consumption while maintaining acceptable performance. We consider an M/M/c/SET--BATCH queue, a multi-server batch service queue with a fixed batch size and setup times, and some variants, including systems in which idle servers delay before turning off or systems in which the batch size is dynamic. We analyze the steady-state probabilities and system performance of the M/M/c/SET--BATCH system and its variants. Our analysis of the M/M/c/SET--BATCH system with lower computational complexity is made possible by utilizing the special structure of the model. In addition, we use simulations to compare the M/M/c/SET--BATCH model with some other variants with different setup time distributions. The results suggest that the model performs better when the setup time has a larger coefficient of variation. Our results indicate that the batching policy enhances the system performance, especially when we allow servers to be idle before turning them off.
ER -