Creates a custom metric by providing Python code that defines a metric_func(output, expected) -> float function. Supports auto-generated metrics, custom code metrics, and LLM judge metrics.
API key for authentication. Obtain from your DimRed dashboard. The organization context is automatically derived from the API key.
Project identifier
Python code defining metric_func(output, expected) -> float
Name of the metric (auto-generated if not provided)
Description of the metric
Additional configuration
Dataset schema for context
Metadata for auto-generation (e.g., creation_method, schema_key)
Metric created successfully
Unique identifier for the metric
Name of the metric
Description of the metric
The code definition
How the metric is stored
Status of the metric creation
Status message
Validation results
Whether metadata was auto-generated
How the metric was created
auto_selection, custom_code, llm_judge