llm-eval-simple is a simple LLM evaluation framework with intermediate actions and prompt pattern selection
-
Updated
Feb 28, 2026 - Python
#
llm-evaluation-benchmark
Here are 11 public repositories matching this topic...
Synthetic datasets, experiment protocols, and evaluation code for "Governed Memory: A Production Architecture for Multi-Agent Workflows"
-
Updated
Mar 18, 2026
Experiments and Analyses for FilBench: An Open LLM Leaderboard for Filipino (EMNLP Main '25)
-
Updated
Sep 6, 2026 - Python
Official repository for "CausalDS: Benchmarking Causal Reasoning in Data-Science Agents"
agent benchmark causal-inference causal causal-reasoning llm-eval llm-evaluation llm-evaluation-framework agentic-ai llm-evals causal-ai llm-evaluation-benchmark
-
Updated
Jul 17, 2026 - Python
Failed-subscription recovery agent for Indian payment rails. Benchmarked against 6 strategies and a hidden oracle over 200 paired seeds; derives the exact regulatory penalty (₹888.67/violation) at which compliance starts paying.
python payments dunning ai-agents subscription-billing fastapi llm-evaluation rbi-compliance revenue-recovery llm-evaluation-benchmark razorpay-buildathon-2026 failed-subscription-recovery-agent
-
Updated
Sep 5, 2026 - Python
ArxivRoll tells you “How much of your score is real, and how much is cheating?” AAAI'26 Code of paper: How Much Do Large Language Model Cheat on Evaluation? Benchmarking Overestimation under the One-Time-Pad-Based Framework
-
Updated
May 24, 2026 - Python
Governed autonomous research agent for evaluating fine-tuned reasoning critics — sandboxed execution, provenance tracking, and blinded adjudication.
reproducible-research sandbox autonomous-agents ai-safety mlops research-tools llm-evaluation-benchmark
-
Updated
Sep 8, 2026 - Python
Reproducible benchmark framework for testing hypotheses about AI coding agents
coding-agents ai-agent-evaluation claude-code agentic-coding swe-bench context-engineering llm-evaluation-benchmark llm-benchmark
-
Updated
Mar 4, 2026 - Shell
Evaluating a RAG pipeline with DeepEval — Answer Relevancy, Faithfulness, Contextual Precision, Recall & Relevancy scored by an LLM judge
rag langchain retrieval-augmented-generation llm-evaluation llm-evaluation-metrics llm-as-judge deepeval llm-evaluation-benchmark
-
Updated
Aug 19, 2026 - Jupyter Notebook
An automated LLM evaluation and benchmarking framework using LangChain, DeepEval, and PostgreSQL. Features a real-time Streamlit dashboard to analyze model accuracy, latency, token usage, and hallucination rates.
python benchmarking postgresql ai-engineering langchain llmops llm-evaluation llm-evaluation-framework ragas deepeval llm-evaluation-benchmark
-
Updated
Sep 6, 2026 - Python
Benchmark and evaluation harness for LLM-based parallel code translation across CUDA, OpenMP, OpenCL, and OpenMP target offload (NeurIPS 2026)
benchmarking benchmark hpc opencl openmp parallel-computing cuda benchmark-framework code-translation llm-evaluation llm-evaluation-toolkit llm-evaluation-framework llm-evaluation-benchmark
-
Updated
Aug 26, 2026 - Python
Add this topic to your repo
To associate your repository with the llm-evaluation-benchmark topic, visit your repo's landing page and select "manage topics."