专业知识库与评测机构
专业知识库与评测机构(知识库、基准与公共评测)共收录 117 条资料,分属 15 个二级来源。收录较多的二级来源有独立目录页,每页 15 条。本类权威分层:A2–B。收录机制:核心资料全收;按各二级来源自身的数据库、方法、版本与榜单结构收录,不设跨机构统一评分机制。
各来源代表资料
- MITRE ATLAS(4 条):MITRE ATLAS:AI 对抗威胁知识库;MITRE ATLAS Fact Sheet;MITRE ATLAS Data 等
- OWASP GenAI Security Project(8 条):OWASP GenAI LLM Top 10 2026;OWASP Top 10 for Agentic Applications 2026;Agent Control Standard(ACS) 等
- AI Incident Database(5 条):AI Incident Database;AI Incident Roundup:2026 年 5–7 月;AIID Taxonomies 等
- MIT AI Risk Repository(7 条):MIT AI Risk Repository;MIT AI Risk Mitigation Map;MIT AI Risk Initiative 数据与研究中心 等
- MLCommons(14 条):MLCommons Benchmark Suites;MLPerf Training;MLPerf Inference 等
- METR(8 条):Measuring AI Ability to Complete Long Software Tasks;Task-Completion Time Horizons of Frontier AI Models;Frontier Risk Report(2026 年 2–3 月) 等
- ARC Prize Foundation(8 条):ARC-AGI-3:交互式推理基准;ARC-AGI-3 Technical Report;ARC-AGI Official Leaderboard 等
- Stanford CRFM / HELM(12 条):HELM:Holistic Evaluation of Language Models;2025 Foundation Model Transparency Index;HELM Capabilities 等
- LMArena(原 LMSYS / Arena)(10 条):Arena:How It Works;Arena Leaderboard Policy;Agent Arena:Causal Evaluation of Agents in the Real World 等
- Artificial Analysis(12 条):Artificial Analysis Models Comparison;Artificial Analysis Intelligence Benchmarking Methodology;Artificial Analysis API Performance Benchmarking Methodology 等
- OpenCompass 司南(6 条):OpenCompass 大模型公开学术榜单;CompassAcademic 榜单结果复现指南;OpenCompass 评测框架总览 等
- SuperCLUE(4 条):SuperCLUE 通用榜;SuperCLUE 大模型评测体系;SuperCLUE Agent Benchmark 2025H1 等
- FlagEval(智源)(5 条):FlagEval 天秤平台用户手册与评测入口;FlagEval 天秤评测体系;FlagEval 评测操作流程 等
- SWE-bench(7 条):SWE-bench Official Leaderboards;SWE-bench:真实 GitHub Issue 修复基准;SWE-bench Dataset Catalog 等
- Berkeley BFCL(7 条):Berkeley Function Calling Leaderboard V4;Berkeley Function-Calling Leaderboard Methodology;BFCL V4:Agentic Evaluation 等