eval_toolkit.analysis#

CsvPredictionReader

Read CSV prediction files into a column-oriented mapping.

JsonlPredictionReader

Read JSON Lines prediction files into a column-oriented mapping.

PredictionArrays

Numeric arrays loaded from a prediction artifact.

bootstrap_metric_from_predictions

Compute a PR-AUC bootstrap CI from one prediction ref.

load_prediction_arrays

Load labels and scores from a prediction artifact reference.

paired_diff_from_prediction_refs

Compute paired PR-AUC delta from two prediction refs.