Evaluation

A Challenge Set Approach to Evaluating Machine Translation EMNLP 2017 Adversarial Examples for Evaluating Reading Comprehension Systems EMNLP 2017 AIDE: An algorithm for measuring the accuracy of probabilistic inference algorithms NeurIPS 2017 A method for in-depth comparative evaluation: How (dis)similar are outputs of pos taggers, dependency parsers and coreference resolvers really? EACL 2017 Annotating Derivations: A New Evaluation Strategy and Dataset for Algebra Word Problems EACL 2017 A Parallel Corpus for Evaluating Machine Translation between Arabic and European Languages EACL 2017 Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation ACL 2017 Empirical Evaluation of Resampling Procedures for Optimising SVM Hyperparameters JMLR 2017 Evaluating Compound Splitters Extrinsically with Textual Entailment ACL 2017 Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation EACL 2017 Finite Sample Analysis of the GTD Policy Evaluation Algorithms in Markov Setting NeurIPS 2017 Fisher Consistency for Prior Probability Shift JMLR 2017 Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation EMNLP 2017 Improving Evaluation of Document-level Machine Translation Quality Estimation EACL 2017 Improving ROUGE for Timeline Summarization EACL 2017 Inference is Everything: Recasting Semantic Resources into a Unified Evaluation Framework IJCNLP 2017 JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction EACL 2017 Level Playing Field for Million Scale Face Recognition CVPR 2017 Online control of the false discovery rate with decaying memory NeurIPS 2017 On Optimal Generalizability in Parametric Learning NeurIPS 2017 On the Need of Cross Validation for Discourse Relation Classification EACL 2017 Re-evaluating Automatic Metrics for Image Captioning EACL 2017 Rescale-Invariant SVM for Binary Classification IJCAI 2017 Time for a Change: a Tutorial for Comparing Multiple Classifiers Through Bayesian Analysis JMLR 2017 Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses ACL 2017