conftrace_

benchmark construction

14 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) multimodal large language model (3) video understanding (2) electromagnetic signal (1) compound divergence (1) atom divergence (1) difficulty estimation (1) error attribution (1) fact extraction (1) benchmark creation (1)

Papers

CheckMIABench: Firm Foundations For Membership Inference Attacks on Language Models ACL 2026 HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarks CVPR 2026 MERLIN: Building Low-SNR Robust Multimodal LLMs for Electromagnetic Signals CVPR 2026 SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models ACL 2026 AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge ACL 2025 AutoBencher: Towards Declarative Benchmark Construction ICLR 2025 Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond EMNLP 2025 Estimating Machine Translation Difficulty EMNLP 2025 Evaluation and Incident Prevention in an Enterprise AI Assistant AAAI 2025 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs ICLR 2025 See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models ACL 2025 AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction Benchmark ACL 2022 Ontologue: Declarative Benchmark Construction for Ontological Multi-Label Classification NeurIPS 2022 Measuring Compositional Generalization: A Comprehensive Method on Realistic Data ICLR 2020