Skip to main content

Ctrl+K

eval-toolkit

Getting Started
What’s new
Examples
Worked example: metrics + bootstrap CIs
Worked example: slice-aware evaluate harness

GitHub
PyPI

GitHub
PyPI

Section Navigation

eval_toolkit.metrics.DEFAULT_ASSUMED_PRIORS
eval_toolkit.metrics.ThresholdResult
eval_toolkit.metrics.brier_decomposition
eval_toolkit.metrics.brier_score
eval_toolkit.metrics.expected_calibration_error
eval_toolkit.metrics.expected_calibration_error_debiased
eval_toolkit.metrics.expected_calibration_error_equal_mass
eval_toolkit.metrics.expected_calibration_error_l2
eval_toolkit.metrics.expected_calibration_error_l2_debiased
eval_toolkit.metrics.headline_metrics
eval_toolkit.metrics.metrics_at_threshold
eval_toolkit.metrics.pr_auc
eval_toolkit.metrics.precision_at_prior
eval_toolkit.metrics.quantile_stratified_pr_auc
eval_toolkit.metrics.quantile_stratified_report
eval_toolkit.metrics.roc_auc
eval_toolkit.metrics.score_distribution_summary
eval_toolkit.metrics.single_class_threshold_metrics
eval_toolkit.metrics.stratified_recall

eval_toolkit.metrics
eval_toolkit.metrics.headline_metrics

eval_toolkit.metrics.headline_metrics#

.. currentmodule:: eval_toolkit.metrics

.. autofunction:: headline_metrics

previous

eval_toolkit.metrics.expected_calibration_error_l2_debiased

next

eval_toolkit.metrics.metrics_at_threshold

© Copyright 2026, Brandon Behring.

Created using Sphinx 9.1.0.

Built with the PyData Sphinx Theme 0.17.1.