conftrace_

empirical evaluation

35 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) in-context learning (1405) natural language processing (2034) contextual bandit (381) recurrent neural network (1790) language model (4599) pretrained language model (1030) dialogue system (1667)

Papers

A Large-Scale Real-World Evaluation of an LLM-Based Virtual Teaching Assistant ACL 2025
Can LLMs Help Uncover Insights about LLMs? A Large-Scale, Evolving Literature Analysis of Frontier LLMs ACL 2025
Do Influence Functions Work on Large Language Models? EMNLP 2025
Assessing the Limits of In-Context Learning beyond Functions using Partially Ordered Relation AACL 2025
A Comparative Evaluation of Quantification Methods JMLR 2025
Empirical Evaluation of Loss Masking to Selectively Prevent Memorization ACL 2025
CausalEval: Towards Better Causal Reasoning in Language Models NAACL 2025
A Knapsack by Any Other Name: Presentation impacts LLM performance on NP-hard problems EMNLP 2025
Prompting Large Language Models for Counterfactual Generation: An Empirical Study COLING 2024
Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective IJCAI 2024
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages ACL 2024
Estimating the Replication Probability of Significant Classification Benchmark Experiments JMLR 2024
Can CLIP Count Stars? An Empirical Study on Quantity Bias in CLIP EMNLP 2024
The Effect of Sampling Temperature on Problem Solving in Large Language Models EMNLP 2024
Evaluating the Deductive Competence of Large Language Models NAACL 2024
Are Language Models Actually Useful for Time Series Forecasting? NIPS 2024
Robustness of Algorithms for Causal Structure Learning to Hyperparameter Choice CLEAR 2024
Parallel Empirical Evaluations: Resilience despite Concurrency AAAI 2024
Is ChatGPT a General-Purpose Natural Language Processing Task Solver? EMNLP 2023
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models NAACL 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models EMNLP 2022
The Impact of Task Underspecification in Evaluating Deep Reinforcement Learning NIPS 2022
A Contextual Bandit Bake-off JMLR 2021
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference? ACL 2021
Heisenbot: A Rule-Based Game Agent for Gin Rummy AAAI 2021