evaluation-benchmark

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

Official repository for the "VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Bias" paper.

[COLING 2025] NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models

Benchmark evaluating LLM responses across 9 safety/quality dimensions — rule-based checks + validated LLM-judge ensemble, free-tier APIs

Stakeholder-defined evaluation of candidate LLMs for a university student wellbeing signposting chatbot. 11 scenarios, 74 practitioner criteria, dual cross-provider LLM judges.

Policy-constrained autonomous software-engineering runtime — multi-turn tool loops, sandboxed execution, 100% benchmark resolution, and Next.js mission control

Hybrid Network Evaluation Protocol — multi-method evaluation for hybrid quantum-classical ML models. Classifies your quantum component as Genuine, Regularizer, Ignored, or Dead Weight with bootstrap confidence intervals.

A from-scratch implementation of a T5 model modified with Rotary Position Embeddings (RoPE). This project includes the code for pre-training on the C4 dataset in streaming mode with Flash Attention 2.

私有化 RAG 落地套件：表格保真检索 + 121 题真实基准 + 私有化算力 TCO 测算（Streamlit 可交互看板）

Sovereign, agent-driven LLM evaluation harness forked from deepseek-harness (dsh) — Cordis plugin architecture, EntheAI backends, and multi-model benchmarking