conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking COLING 2024
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation NIPS 2024
Human-Centered Design Recommendations for LLM-as-a-judge ACL 2024
Benchmarking Fish Dataset and Evaluation Metric in Keypoint Detection - Towards Precise Fish Morphological Assessment in Aquaculture Breeding IJCAI 2024
POSIX: A Prompt Sensitivity Index For Large Language Models EMNLP 2024
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL 2024
Keyphrase Generation: Lessons from a Reproducibility Study COLING 2024
chrF-S: Semantics Is All You Need EMNLP 2024
Towards Human-aligned Evaluation for Linear Programming Word Problems COLING 2024
Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NIPS 2024
Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024
MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality EMNLP 2024
Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metric EMNLP 2024
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges EMNLP 2024
Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis EMNLP 2024
ICE-Score: Instructing Large Language Models to Evaluate Code EACL 2024
Reference-based Metrics Disprove Themselves in Question Generation EMNLP 2024
MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task EMNLP 2024
ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion Models AAAI 2024
Combining Multiple Metrics for Evaluating Retrieval-Augmented Conversations NAACL 2024
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation EMNLP 2024
PEDANTS: Cheap but Effective and Interpretable Answer Equivalence EMNLP 2024
Machine Unlearning: Challenges in Data Quality and Access IJCAI 2024
REMATCH: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity NAACL 2024
TOWER: Tree Organized Weighting for Evaluating Complex Instructions EMNLP 2024