Calibration Error (ECE) Calculator
Estimate expected calibration error from a forecast log.
Inputs
Adjust liveCalculator setup
Enter your assumptions and this tool will update immediately.
Result
InstantPrimary output
0.3725
ECE
20-30% bucket
n=1, avg confidence=29.0%, accuracy=0.0%
40-50% bucket
n=1, avg confidence=41.0%, accuracy=0.0%
50-60% bucket
n=1, avg confidence=58.0%, accuracy=100.0%
60-70% bucket
n=1, avg confidence=63.0%, accuracy=100.0%
Notes
Sample size is sparse relative to the number of bins.
Related Tools
Keep the workflow moving with the next most relevant calculators.
Brier Score Calculator
Score single predictions or batches of forecasts with Brier loss.
Log Loss Calculator
Evaluate forecast quality with ignorance score / log loss.
Brier Skill Score Calculator
Measure your Brier improvement versus a baseline forecast.
Sharpness (Entropy) Calculator
Measure how concentrated or timid your forecasts are on average.