Skip to content

Parameters

Supported evaluation parameters:

  • e2e_response_time
  • turn_by_turn_latency
  • hallucination
  • extraction_variables
  • interruption_behavior

Use enum constants from EvaluationParameter:

from prodloop import EvaluationParameter

params = [
    EvaluationParameter.E2E_RESPONSE_TIME,
    EvaluationParameter.HALLUCINATION,
]

Extraction Variables

If you include extraction_variables, pass both:

  • extraction_schema (what fields to extract)
  • bot_captured_variables (what your bot captured for validation)
extraction_schema = {
    "customer_name": "string",
    "budget_mentioned": "int",
}

bot_captured_variables = {
    "customer_name": "ram",
    "budget_mentioned": 12000,
}