Issues

• parse_boolean_response substring fallback parses negated judge replies ("not true") as True, silently flipping LLM-judge verdicts

  TonicAI/tonic_validate#249 · Filter by author shaurya416 opened on Sep 30, 2026

• Proposal: tonic_validate ↔ EvalPort adapter (portable RAG eval datasets/results)

  TonicAI/tonic_validate#248 · Filter by author adhabnr-ux opened on Aug 29, 2026

• A possible typo in README

  TonicAI/tonic_validate#244 · Filter by author terilias opened on Feb 20, 2025

• Support ndcg metric for contexts ranking

  TonicAI/tonic_validate#230 · Filter by author ycjcl868 opened on Aug 14, 2024

• Integration with Ragas in not working

  TonicAI/tonic_validate#222 · Filter by author Jeerhz opened on Aug 2, 2024

• Running local LLM with tonic_validate_evaluator

  TonicAI/tonic_validate#218 · Filter by author SalwaMostafa opened on Jul 26, 2024

• ModuleNotFoundError

  TonicAI/tonic_validate#166 · Filter by author Timmy-485 opened on May 7, 2024
  1

• Support fine-grained metrics

  TonicAI/tonic_validate#150 · Filter by author ghost opened on Apr 29, 2024

• Add multiple runs per question and report average/stdev

  TonicAI/tonic_validate#149 · Filter by author ghost opened on Apr 29, 2024
  

• Metric classes for metrics that do and do not use LLM assisted evaluation

  TonicAI/tonic_validate#86 · Filter by author joeferraratonic opened on Mar 6, 2024

• Update LlamaIndex quickstart notebook

  TonicAI/tonic_validate#50 · Filter by author joeferraratonic opened on Feb 16, 2024