conftrace_

performance evaluation

53 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation methodology (109) natural language processing (2034) benchmark dataset (635) multilingual evaluation (104) performance metric (24) prompt engineering (1135) multilingual nlp (1426) statistical significance (26)

Papers

Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performance EMNLP 2024
Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization? EMNLP 2024
RoDLA: Benchmarking the Robustness of Document Layout Analysis Models CVPR 2024
A Method for Evaluating Hyperparameter Sensitivity in Reinforcement Learning NIPS 2024
Unexpected Phenomenon: LLMs’ Spurious Associations in Information Extraction ACL 2024
How Does Quantization Affect Multilingual LLMs? EMNLP 2024
Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps EMNLP 2024
Evaluation of a Forensic Automatic Speaker Recognition System with Emotional Speech Recordings INTERSPEECH 2023
On Text-based Personality Computing: Challenges and Future Directions ACL 2023
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions NIPS 2022
Out of a Hundred Trials, How Many Errors Does Your Speaker Verifier Make? INTERSPEECH 2021
Benchmarking: Past, Present and Future ACL 2021
Benchmarking: Past, Present and Future IJCNLP 2021
NLPStatTest: A Toolkit for Comparing NLP System Performance AACL 2020
Evaluating the Performance of Reinforcement Learning Algorithms ICML 2020
Is Big Data Performance Reproducible in Modern Cloud Networks? NSDI 2020
Semantic Complexity in End-to-End Spoken Language Understanding INTERSPEECH 2020
ObjectNet: A large-scale bias-controlled dataset for pushing the limits of object recognition models NIPS 2019
Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward AAAI 2019
Efficient Benchmarking of NLP APIs using Multi-armed Bandits EACL 2017
An Audio Based Piano Performance Evaluation Method Using Deep Neural Network Based Acoustic Modeling INTERSPEECH 2017
Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging EMNLP 2017
Group MAD Competition - A New Methodology to Compare Objective Image Quality Models CVPR 2016
The HCI Stereo Metrics: Geometry-Aware Performance Analysis of Stereo Algorithms ICCV 2015