API reference

The following pages are generated with Sphinx autodoc.

• Core modules
  • Sample
  • Completion
  • BotResult
  • MetricResult
  • Evaluator
• Bot modules
  • BaseBot
  • FullContextBot
  • StrictSemanticMatchBot
  • BotFactory
• Configuration modules
  • ModelConfig
  • JudgeConfig
  • load_model_config()
  • load_judge_config()
  • build_chat_client()
  • build_judge_metric()
  • build_bot_from_config()
• Metric modules
  • ExactMatchMetric
  • KeywordRecallMetric
  • AnswerLengthMetric
  • PolitenessMetric
  • LLMJudgeMetric
  • build_default_metrics()
• I/O and utility modules
  • load_samples_from_csv()
  • write_rows_csv()
  • write_rows_jsonl()
  • summarize_by_bot()
  • resolve_env()
  • load_json()
  • load_text()
  • render_template()