compute_metrics

Calculate model performance metrics, given ground truth and prediction data.

model_prediction

Generate predictions on a given mlflow model for supported tasks.

model_prediction_with_container

Optimized Distributed inference component for LLMs.