Calibration in Neural Networks: Understanding, Measuring & Improving it
Abstract: A calibrated machine learning model produces probabilistic predictions that are well-aligned with real probabilities: it tends to be more certain when it is correct. Unfortunately, the unique characteristics of modern neural networks, e.g. over-parametrization or iterative training dynamics, can often result in overfitting the training data and generating over-confident predictions. The goal of this … Read more








