Lora Aroyo
14 papers · 2018–2024 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+7 more ↓ Show less ↑
π Interdisciplinary Bridge π Conference Polyglot (6) π Academic Marathon (6) π Renaissance Researcher (7) πΊοΈ Taxonomy Completionist (28)
π
Conference Polyglot
(6)
π
Academic Marathon
(6)
π
Renaissance Researcher
(7)
π₯
Mega-Team
(47)
π
Century Club
(14)
ποΈ
Keyword Collector
(61)
β
The Questioner
Conferences
COLING (4)
EMNLP (3)
ACL (2)
NAACL (2)
NIPS (2)
IJCNLP (1)
Top co-authors
Keywords
text classification
(2)
annotation quality
(2)
inter-rater reliability
(2)
conversational ai
(2)
safety evaluation
(2)
ai safety
(2)
human perception
(1)
label propagation
(1)
statistical analysis
(1)
data quality
(1)
statistical hypothesis testing
(1)
statistical evaluation
(1)
image labeling
(1)
regression analysis
(1)
class imbalance
(1)
group fairness
(1)
bias mitigation
(1)
model evaluation
(1)
model comparison
(1)
crowdsourcing annotation
(1)
Papers
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
NAACL 2024
Is a picture of a bird a bird? A mixed-methods approach to understanding diverse human perspectives and ambiguity in machine vision models
COLING 2024
Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI
COLING 2024
Diversity-Aware Annotation for Conversational AI Safety
COLING 2024
DataPerf: Benchmarks for Data-Centric AI Development
NIPS 2023
Follow the leader(board) with confidence: Estimating p-values from a single test set with item and response variance
ACL 2023
DICES Dataset: Diversity in Conversational AI Evaluation for Safety
NIPS 2023
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications
EMNLP 2023
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability
ACL 2021
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability
IJCNLP 2021
A Crowdsourced Frame Disambiguation Corpus with Ambiguity
NAACL 2019
Homonym Detection For Humor Recognition In Short Text
EMNLP 2018
Crowdsourcing Semantic Label Propagation in Relation Classification
EMNLP 2018
Scoring and Classifying Implicit Positive Interpretations: A Challenge of Class Imbalance
COLING 2018