Skip to content
conftrace_
2023 EMNLP EMNLP 2023

Embed_Llama: Using LLM Embeddings for the Metrics Shared Task

Abstract

AbstractEmbed_llama is an assessment metric for language translation that hinges upon the utilization of the recently introduced Llama 2 Large Language Model (LLM), specifically, focusing on its embedding layer, with the aim of transforming sentences into a vector space that establishes connections between geometric and semantic proximities

Authors

Sören Dreano, Derek Molloy, Noel Murphy

Topics

Natural Language Processing > Applications > Machine Translation Natural Language Processing > Resources & Methods > Large Language Models

Keywords

semantic similarity sentence embedding llama model translation quality metric
Download PDF

More from EMNLP 2023

All EMNLP 2023 papers →
ACES: Translation Accuracy Challenge Sets at WMT 2023
Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective
Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative
eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings
Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics
MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task