Parameters¶
Supported evaluation parameters:
e2e_response_timeturn_by_turn_latencyhallucinationextraction_variablesinterruption_behavior
Use enum constants from EvaluationParameter:
from prodloop import EvaluationParameter
params = [
EvaluationParameter.E2E_RESPONSE_TIME,
EvaluationParameter.HALLUCINATION,
]
Extraction Variables¶
If you include extraction_variables, pass both:
extraction_schema(what fields to extract)bot_captured_variables(what your bot captured for validation)
extraction_schema = {
"customer_name": "string",
"budget_mentioned": "int",
}
bot_captured_variables = {
"customer_name": "ram",
"budget_mentioned": 12000,
}