Findings of the IWSLT 2024 Evaluation Campaign

Ibrahim Said Ahmad†, Antonios Anastasopoulos††††, Ondřej Bojar¶, Claudia Borg††, Marine Carpuat‡, Roldano Cattoni§, Mauro Cettolo§, William Chen‡‡, Qianqian Dong¶¶, Marcello Federico§§, Barry Haddow‡‡‡, Dávid Javorsky¶, Mateusz Krubiński¶, Tsz Kin Lam‡‡‡, Xutai Ma‡‡§, Prashant Mathur§§, Evgeny Matusov¶¶¶, Chandresh Kumar Maurya¶¶†, John P. McCrae†††, Kenton Murray†††, Satoshi Nakamura§§§, Matteo Negri§, Jan Niehues††¶, Xing Niu§§, Atul Kr. Ojha†††, John Ortega†¶, Sara Papi§, Peter Polák¶, Adam Pospíšil¶, Pavel Pecina¶, Elizabeth Salesky†††, Nivedita Sethiya¶¶†, Balaram Sarkar¶¶†, Jiatong Shi†‡, Clayton Sikansote†‡, Matthias Sperber, Sebastian Stüker‡¶, Katsuhito Sudoh§§§†§, Brian Thompson§§, Marco Turchi‡¶, Alex Waibel‡‡, Shinji Watanabe‡‡, Patrick Wilken‡‡, Petr Zemánek¶, Rodolfo Zevallos§¶

This paper reports on the shared tasks organized by the 21st IWSLT Conference. The shared tasks address 7 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, dialect and low-resource speech translation, and Indic languages. The shared tasks attracted 18 teams whose submissions are documented in 26 system papers. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia.

† Northeastern University
†††† GMU
¶ Charles University
†† University of Malta
‡ UMD
§ FBK
‡‡ Meta
¶¶ ByteDance
§§ Amazon
‡‡‡ University of Edinburgh
¶¶¶ AppTek
¶¶† IIT Indore
††† JHU
§§§ NAIST
††¶ KIT
†¶ University of Galway
†‡ University of Zambia
ঠZoom
‡‡ CMU
§¶ Pompeu Fabra University
†§ Nara Women’s University