Decision Making Needs Uncertainty Quantification [Lecture Notes]
Abstract
Many signal processing systems ultimately exist to act. Whenever the state variable that determines the action to be taken by a decision maker, or agent, is uncertain, the way that uncertainty is represented decides how well the agent performs and how much its performance can be trusted. This lecture note develops, from first principles and within a single decision-theoretic setting, the link between the {objective} and the knowledge of an agent and the form of uncertainty representation that is sufficient to act optimally. To start, assuming a known environment distribution, we show that a risk-neutral agent needs the posterior distribution over the state, whereas a risk-averse agent can rely without loss of optimality on a {prediction set} and a worst-case decision rule. We then turn to the case in which the environment is unknown, and identify three complementary approaches to address the resulting epistemic uncertainty: calibration of a fixed predictor, credal (ambiguity) sets with distributionally robust optimization, and Bayesian inference over model parameters. The common thread is that reliable decisions require an uncertainty representation matched to the decision objective and to the knowledge profile of the agent, together with a guarantee that certifies the utility the agent will actually obtain.
Related
- Integrating Machine Learning and Uncertainty Quantification for Real-Time Decision-Making in Digital Twins: A System-Centric Review and Perspective
- Aggregation Consistency in collective decision-making under uncertainty
- A decision-theoretic framework for uncertainty quantification in epidemiological modelling
- The First Step of Decision Making: Alignment under Semantic Uncertainty for Automated Operations Research
- Classes of Aggregation Rules for Ethical Decision Making in Automated Systems
BibTeX
@misc{simeone2026decision,
title = {{Decision Making Needs Uncertainty Quantification [Lecture Notes]}},
author = {Osvaldo Simeone},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2607.14407},
eprint = {2607.14407},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2607.14407},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Decision Making Needs Uncertainty Quantification [Lecture Notes]
AU - Osvaldo Simeone
PY - 2026
DA - 2026/09/06
PB - arXiv
DO - 10.48550/arxiv.2607.14407
UR - https://arxiv.org/abs/2607.14407
AB - Many signal processing systems ultimately exist to act. Whenever the state variable that determines the action to be taken by a decision maker, or agent, is uncertain, the way that uncertainty is represented decides how well the agent performs and how much its performance can be trusted. This lecture note develops, from first principles and within a single decision-theoretic setting, the link between the {objective} and the knowledge of an agent and the form of uncertainty representation that is sufficient to act optimally. To start, assuming a known environment distribution, we show that a risk-neutral agent needs the posterior distribution over the state, whereas a risk-averse agent can rely without loss of optimality on a {prediction set} and a worst-case decision rule. We then turn to the case in which the environment is unknown, and identify three complementary approaches to address the resulting epistemic uncertainty: calibration of a fixed predictor, credal (ambiguity) sets with distributionally robust optimization, and Bayesian inference over model parameters. The common thread is that reliable decisions require an uncertainty representation matched to the decision objective and to the knowledge profile of the agent, together with a guarantee that certifies the utility the agent will actually obtain.
ER -