Calibration in One Go: Jointly Learning Accurate and Calibrated Neural Networks
Research paper by Nektarios Kalampalikis and collaborators. arXiv record dated 2026-10-09. Research area: Machine learning.
Resource information
- Authors
- Nektarios Kalampalikis, Pablo M. Olmos, Isabel Valera
- Research area
- Machine learning
- Application domain
- General AI research
- AI methods
- Neural networks
- Research topics
- cs.LG, cs.AI, stat.ML
- arXiv record date
- 2026-10-09
- Publication
- arXiv
- Upstream last modified
- Oct 12, 2026
- License
- CC BY-SA 4.0
- Last record update
- Nov 4, 2026
Abstract
Neural networks (NNs), while highly flexible and versatile, are often poorly calibrated. Post-hoc calibration methods adjust the outputs of an already trained model using a separate calibration dataset and additional calibration parameters. This process adds overhead that requires separate optimization of the calibrator and subsequent model selection. In this paper, we show that standard (post-hoc) calibrators can be trained end-to-end with the backbone via a bilevel Stackelberg formulation. This formulation eliminates the need for a separate calibration set or a dedicated calibration loss by jointly optimizing accuracy and calibration using cross-entropy, introducing only one additional hyperparameter: the calibrator learning rate. Although our framework supports calibrators ranging from temperature and matrix scaling to NN layers, our results show that using the final classification layer itself as the calibrator yields accurate, well-calibrated models with no additional parameters. Our approach outperforms SOTA calibrators with minimal added complexity, while also avoiding the multiplicative overhead of separate calibration components in settings such as multi-task learning.