eval_toolkit.artifacts#

MetricState

Structured state for metrics that may be unavailable or invalid.

PredictionArtifactRef

Manifest reference to a retained prediction artifact.

PredictionColumns

Column mapping for a retained prediction artifact.

error_metric

Return a structured errored-metric payload.

sanitize_for_json

Return a strict-JSON-safe copy of payload.

skipped_metric

Return a structured skipped-metric payload.

validate_manifest

Validate a serialized RunManifest payload.

validate_payload

Validate a payload against a bundled schema.

validate_prediction_artifact_ref

Validate a single serialized PredictionArtifactRef payload.

validate_results

Validate a serialized RunResult payload against results.v1.json.

write_json_strict

Write strict RFC 8259 JSON after sanitizing non-finite values.