Conformal 0.2.0 splitconformal - CyrilB1531/lodestar GitHub Wiki

Lodestar.Conformal 0.2.0. This page is frozen at that release. Read the current documentation for what main says now. A link to a decision or a migration page follows main, and leaves the archive.

Home › Split conformal prediction

SplitConformal

An interval instead of a point, a set instead of a class — and a coverage guarantee attached to each. Static, stateless, and it never sees your model.

Members

Member What it does
SplitConformal.Quantile The calibrated quantile: the k-th smallest calibration score.
ConformalQuantileRule Which order statistic Quantile reads: the ceiling rank, or MAPIE's classification quantile.
SplitConformal.AbsoluteResiduals A regressor's calibration scores, |y − ŷ|.
SplitConformal.Interval [ŷ − q, ŷ + q] around a point prediction.
SplitConformal.NormalisedResiduals A regressor's scores divided by a predicted residual, |y − ŷ| / r̂.
SplitConformal.NormalisedInterval [ŷ − q·r̂, ŷ + q·r̂], whose width varies with the input.
SplitConformal.LeastAmbiguousScores A classifier's LAC calibration scores, 1 − p̂(true class).
SplitConformal.PredictionSet Every class whose probability clears 1 − q. Possibly none.