Jan Niehues

Early-Exit and Instant Confidence Translation Quality Estimation EACL 2026 BOOM: Beyond Only One Modality KIT’s Multimodal Multilingual Lecture Companion EACL 2026 Beyond Transcripts: A Renewed Perspective on Audio Chaptering ACL 2026 Sigmoid Head for Quality Estimation under Language Ambiguity ACL 2026 Enhance Contextual Learning in ASR for Endangered Low-resource Languages NAACL 2025 How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representations NAACL 2025 Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs ACL 2025 Can a Large Language Model Keep My Secrets? A Study on LLM-Controlled Agents ACL 2025 Contrastive Learning for Task-Independent SpeechLLM-Pretraining ACL 2025 Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025 NUTSHELL: A Dataset for Abstract Generation from Scientific Talks ACL 2025 Quality-Aware Decoding: Unifying Quality Estimation and Decoding ACL 2025 KIT’s Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization ACL 2025 KIT’s Offline Speech Translation and Instruction Following Submission for IWSLT 2025 ACL 2025 Findings of the IWSLT 2025 Evaluation Campaign ACL 2025 COMET-poly: Machine Translation Metric Grounded in Other Candidates EMNLP 2025 Conditions for Catastrophic Forgetting in Multilingual Translation EMNLP 2025 Summarizing Speech: A Comprehensive Survey EMNLP 2025 Do Slides Help? Multi-modal Context for Automatic Transcription of Conference Talks EMNLP 2025 Are Generative Models Underconfident? Better Quality Estimation with Boosted Model Probability EMNLP 2025 Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation COLING 2024 How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models? EACL 2024 Benchmarking Diffusion Models for Machine Translation EACL 2024 FINDINGS OF THE IWSLT 2024 EVALUATION CAMPAIGN ACL 2024 Blending LLMs into Cascaded Speech Translation: KIT’s Offline Speech Translation System for IWSLT 2024 ACL 2024 The KIT Speech Translation Systems for IWSLT 2024 Dialectal and Low-resource Track ACL 2024 Recent Highlights in Multilingual and Multimodal Speech Translation ACL 2024 Charles Locock, Lowcock or Lockhart? Offline Speech Translation: Test Suite for Named Entities ACL 2024 Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking across Diverse Vocabularies EMNLP 2024 Evaluating and Training Long-Context Large Language Models for Question Answering on Scientific Papers EMNLP 2024 Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing NAACL 2024 Language-Independent Representations Improve Zero-Shot Summarization NAACL 2024 Speech Recognition Corpus of the Khinalug Language for Documenting Endangered Languages COLING 2024 SciEx: Benchmarking Large Language Models on Scientific Exams with Human Expert Grading and Automatic Grading EMNLP 2024 Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach EMNLP 2024 The First Parallel Corpus and Neural Machine Translation Model of Western Armenian and English COLING 2024 End-to-End Evaluation for Low-Latency Simultaneous Speech Translation EMNLP 2023 Analyzing Challenges in Neural Machine Translation for Software Localization EACL 2023 Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages EACL 2023 Towards continually learning new languages INTERSPEECH 2023 FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN ACL 2023 Evaluating Multilingual Speech Translation under Realistic Conditions with Resegmentation and Terminology ACL 2023 KIT’s Multilingual Speech Translation System for IWSLT 2023 ACL 2023 Towards Efficient Simultaneous Speech Translation: CUNI-KIT System for Simultaneous Track at IWSLT 2023 ACL 2023 Adaptive multilingual speech recognition with pretrained models INTERSPEECH 2022 Findings of the IWSLT 2022 Evaluation Campaign ACL 2022 Effective combination of pretrained models - KIT@IWSLT2022 ACL 2022 CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022 ACL 2022 Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation EMNLP 2022 Unsupervised Machine Translation On Dravidian Languages EACL 2021 Tutorial: End-to-End Speech Translation EACL 2021 Continuous Learning in Neural Machine Translation using Bilingual Dictionaries EACL 2021 FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN ACL 2021 Maastricht University’s Multilingual Speech Translation System for IWSLT 2021 ACL 2021 Improving Zero-Shot Translation by Disentangling Positional Information IJCNLP 2021 FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN IJCNLP 2021 Maastricht University’s Multilingual Speech Translation System for IWSLT 2021 IJCNLP 2021 Improving Zero-Shot Translation by Disentangling Positional Information ACL 2021 Maastricht University’s Large-Scale Multilingual Machine Translation System for WMT 2021 EMNLP 2021 Relative Positional Encoding for Speech Recognition and Direct Translation INTERSPEECH 2020 Adapting End-to-End Speech Recognition for Readable Subtitles ACL 2020 FINDINGS OF THE IWSLT 2020 EVALUATION CAMPAIGN ACL 2020 Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selection INTERSPEECH 2020 Improving Zero-shot Translation with Language-Independent Constraints ACL 2019 Survey Talk: A Survey on Speech Translation INTERSPEECH 2019 Incremental processing of noisy user utterances in the spoken language understanding task EMNLP 2019 Very Deep Self-Attention Networks for End-to-End Speech Recognition INTERSPEECH 2019 Low-Latency Neural Speech Translation INTERSPEECH 2018 The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018 EMNLP 2018 KIT’s IWSLT 2018 SLT Translation System EMNLP 2018 The IWSLT 2018 Evaluation Campaign EMNLP 2018 KIT Lecture Translator: Multilingual Speech Translation with One-Shot Learning COLING 2018 Towards one-shot learning for rare-word translation with external experts ACL 2018 Term Extraction via Neural Sequence Labeling a Comparative Evaluation of Strategies Using Recurrent Neural Networks INTERSPEECH 2018 Self-Attentional Acoustic Models INTERSPEECH 2018 Robust and Scalable Differentiable Neural Computer for Question Answering ACL 2018 Neural Lattice-to-Sequence Models for Uncertain Inputs EMNLP 2017 NMT-Based Segmentation and Punctuation Insertion for Real-Time Spoken Language Translation INTERSPEECH 2017 Comparison of Decoding Strategies for CTC Acoustic Models INTERSPEECH 2017 Pre-Translation for Neural Machine Translation COLING 2016 Dynamic Transcription for Low-Latency Speech Translation INTERSPEECH 2016 Lecture Translator - Speech translation framework for simultaneous lecture translation NAACL 2016 Lightly Supervised Quality Estimation COLING 2016 Tight Integration of Speech Disfluency Removal into SMT EACL 2014