conftrace_

performance evaluation

53 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation methodology (109) natural language processing (2034) benchmark dataset (635) multilingual evaluation (104) performance metric (24) prompt engineering (1135) multilingual nlp (1426) statistical significance (26)

Papers

Comparing Text Compression Capabilities of Large Language Models with Traditional Compression Algorithms EACL 2026
AssetOpsBench-Live: Privacy-Aware Online Evaluation of Multi-Agent Performance in Industrial Operations AAAI 2026
The Curse of Verbalization: How Presentation Order Constrains LLM Reasoning EACL 2026
ProSkill: Segment-Level Skill Assessment in Procedural Videos WACV 2026
Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages AAAI 2025
BoN Appetit Team at LeWiDi-2025: Best-of-N Test-time Scaling Can Not Stomach Annotation Disagreements (Yet) EMNLP 2025
GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human COLING 2025
Dialetto, ma Quanto Dialetto? Transcribing and Evaluating Dialects on a Continuum NAACL 2025
ARC ‘Challenge’ Is Not That Challenging ACL 2025
Know Your RAG: Dataset Taxonomy and Generation Strategies for Evaluating RAG Systems COLING 2025
LogiDebrief: A Signal-Temporal Logic Based Automated Debriefing Approach with Large Language Models Integration IJCAI 2025
The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs EMNLP 2025
A Survey of Optimization Modeling Meets LLMs: Progress and Future Directions IJCAI 2025
Investigating Omission as a Latency Reduction Strategy in Simultaneous Speech Translation IJCNLP 2025
Test Set Quality in Multilingual LLM Evaluation IJCNLP 2025
How well do LLMs reason over tabular data, really? ACL 2025
The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism NAACL 2025
Using Contextually Aligned Online Reviews to Measure LLMs’ Performance Disparities Across Language Varieties NAACL 2025
(Dis)improved?! How Simplified Language Affects Large Language Model Performance across Languages ACL 2025
What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluations EMNLP 2024
Transcendence: Generative Models Can Outperform The Experts That Train Them NIPS 2024
Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps EMNLP 2024
Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization? EMNLP 2024
On the Worst Prompt Performance of Large Language Models NIPS 2024
Unexpected Phenomenon: LLMs’ Spurious Associations in Information Extraction ACL 2024