capability evaluation

Towards Capable and Secure Autonomous Computer-Use Agents (Student Abstract) AAAI 2026 AI Sandbagging: Language Models can Strategically Underperform on Evaluations ICLR 2025 AutoBencher: Towards Declarative Benchmark Construction ICLR 2025 CDT: A Comprehensive Capability Framework for Large Language Models Across Cognition, Domain, and Task EMNLP 2025 Line of Duty: Evaluating LLM Self-Knowledge via Consistency in Feasibility Boundaries NAACL 2025 LLMs Can Covertly Sandbag on Capability Evaluations Against Chain-of-Thought Monitoring IJCNLP 2025 LLM The Genius Paradox: A Linguistic and Math Expert’s Struggle with Simple Word-based Counting Problems NAACL 2025 StringLLM: Understanding the String Processing Capability of Large Language Models ICLR 2025 FAC2E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition EMNLP 2024 Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey ACL 2024 How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench EMNLP 2023 Not a Number: Identifying Instance Features for Capability-Oriented Evaluation IJCAI 2022