Describing and evaluating MT results from small and resource-poor languages: A translation didactic orientated case study of Galician-German touristic texts
-
Sheila Gondar Tubío
und
Christine Paasch-Kaiser
Abstract
This article assesses the performance of four neural machine translation engines using the DQF-MQM methodology, focusing on the challenges inherent in using machine translation while working with resource-limited or minority languages such as Galician. The study examines translations between German and Galician in both directions, specifically within the context of touristic texts. The research considers different categories of errors, including accuracy, fluency and cultural references, to provide a comprehensive evaluation of the performance of the engines. By highlighting the pedagogical importance of these findings, the study aims to contribute to the training of students and future translators, equipping them with the skills needed to navigate the complexities of working with lesser-known languages. Furthermore, the results are intended to stimulate discussion on the wider implications of using machine translation in such language pairs, thereby enriching the ongoing discourse on the application of machine translation in diverse linguistic contexts.
References
Apertium (2023): Machine translation: List of language pairs of the Apertium project. https://apertiumtrad.tuxfamily.org/listepaires.php (17 April 2024).Suche in Google Scholar
Berlin-Brandenburgischen Akademie der Wissenschaften (2024): DWDS – Digitales Wörterbuch der deutschen Sprache. Das Wortauskunftssystem zur deutschen Sprache in Geschichte und Gegenwart.https://www.dwds.de/ (17 April 2024).Suche in Google Scholar
Brinker, Klaus/Pappert, Steffen/Cölfen, Hermann (2024): Linguistische Textanalyse: Eine Einführung in Grundbegriffe und Methoden. 10th new revised edition. Berlin: ESV.Suche in Google Scholar
Clúster Turismo de Galicia (CTG) (2023): Galicia registra este verano las cifras de demanda turística más altas de la historia. https://clusterturismogalicia.com/galicia-registra-este-verano-las-cifras-de-demanda-turistica-mas-altas-de-la-historia/ (17 April 2024).Suche in Google Scholar
Cronin, Michael (2013): Translation in the digital age. New perspectives in translations Studies. New York: Routledge.Suche in Google Scholar
Dias Esqueda, Marileide (2021): Machine translation: Teaching and learning issues. Trabalhos em Linguística Aplicada, 60(1), 282–299. https://doi.org/10.1590/01031813932001520210212.Suche in Google Scholar
ELIS (2024): ELIS 2024 – EUROPEAN LANGUAGE INDUSTRY SURVEY 2024. Trends, expectations and concerns of the European language industry. Results. https://elis-survey.org/wp-content/uploads/2024/03/ELIS-2024-Results.pdf (17 April 2024).Suche in Google Scholar
Garrido, Carlos (2024): Traduçom comentada de textos didáticos e divulgadores. Um modelo orientativo para o tradutor em formaçom. Vigo: Servizo de Publicación da Universidade de Vigo.Suche in Google Scholar
González González, María (dir.) (2024): Dicionario da Real Academia Galega (DRAG). https://academia.gal/dicionario (17 April 2024).Suche in Google Scholar
González Pastor, Diana (2021): Introducing machine translation in the translation classroom: A survey on students’ attitudes and perceptions. Tradumàtica. Tecnologies de la Traducció 19, 47–65. https://doi.org/10.5565/rev/tradumatica.273.Suche in Google Scholar
Instituto Nacional de Estadística (INE) (2024): Turistas en el extranjero de residentes en España desglosados por ccaa/provincia/municipio en el período de referencia. https://ine.es/experimental/turismo_moviles/experimental_turismo_moviles.htm (17 April 2024).Suche in Google Scholar
ISO 5060 (2024): DIN ISO 5060:2024–06, Translation services – Evaluation of translation output – General guidance. ISO Copyright Office.Suche in Google Scholar
Khanna, Tanmai/Washington, Jonathan N./Tyers, Francis/Bayatlı, Sevilay/Swanson, Daniel/Pirinen, Tommi A./Tang, Irene/Alòs i Font, Héctor (2021): Recent advances in Apertium, a free/open-source rule-based machine translation platform for low-resource languages. Machine Translation 35, 475–502. https://doi.org/10.1007/s10590-021-09260-6.10.1007/s10590-021-09260-6Suche in Google Scholar
Lommel, Arle/Uszkoreit, Hans/Burchardt, Aljoscha (2014): MQM: A framework for declaring and describing translation quality metrics. Tradumàtica: tecnologies de la traducció 12, 455–463. https://doi.org/10.5565/rev/tradumatica.77.Suche in Google Scholar
MQM-Council (2025): MQM History. https://themqm.org/mqm-history/ (11 February 2025).Suche in Google Scholar
Nord, Christiane (2001): Lernziel: Professionelles Übersetzen Spanisch-Deutsch. Ein Einführungskurs in 15 Lektionen. Wilhelmsfeld: Egert Verlag.Suche in Google Scholar
Paasch-Kaiser, Christine/Hoberg, Felix (2020): La traducció automàtica en l'ensenyament de la traducció del català vers l'alemany: anàlisi dels resultats de les eines Google Translate i Bing Microsoft Translator. Resercle 1, 66–89. https://doi.org/10.31009/resercle.2020.i1.05.10.31009/resercle.2020.i1.05Suche in Google Scholar
Paasch-Kaiser, Christine/Hoberg, Felix (2021): Maschinelle Übersetzung und romanische Minderheitensprachen. Translation und Technologie. https://lingdrafts.hypotheses.org/1917 (17 April 2024).Suche in Google Scholar
Šorak, Vanessa (forthcoming): Neural machine translation in pandemic-related health communication: A case study on risks and potentials in the context of the Covid-19 pandemic. In: Atayan, Vahram/Choffat, Delphine/Czachur, Waldemar/Felder, Ekkehard/Pasques, Delphine (Eds.): Diskursanalytische Perspektiven auf medizinische Fachkommunikation im europäischen Kontext. Heidelberg: Universitätsverlag Winter.Suche in Google Scholar
TAUS (2025): Error annotation based on DQF-MQM. https://www.taus.net/data-solutions/dqf-mqm-error-annotation (11 February 2025).Suche in Google Scholar
Universidade de Vigo (2011–2021): Galnet project. https://ilg.usc.gal/digalnet/ (11 February 2025).Suche in Google Scholar
Xunta de Galicia / Universidade de Santiago de Compostela (2024): Proxecto Nós. https://nos.gal/gl/proxecto-nos (11 February 2025).Suche in Google Scholar
© 2025 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Frontmatter
- Introduction to the special issue
- Implementing generative artificial intelligence technologies in language industry workflows – A competence perspective
- Prolegomena zu einer an Embodiment orientierten Fachkommunikationswissenschaft
- Using think-aloud, screen recording, and questionnaire data to gauge translation student application and perception of ChatGPT
- Kontrastive Analyse maschinell generierter Fachtranslate (EN-DE) im Strafrecht
- Literarisches Übersetzen im KI-Zeitalter: Überlegungen zu einer nachhaltigen Markttransformation
- Zu Einschätzung und Akzeptanz von KI-Technologien in der AVT-Branche: Die Perspektive der Verbände
- Weitere Themen Additional Topics
- Translation of compound terms: Cognitive insights
- Translating non-binary narratives
- Calibrating the passive: An experimental approach to plain languages rules
- Analyzing metaphors in the English translation of the Chinese novel Sandalwood Death from cognitive perspectives: A multi-level model
- La imagen del vikingo a través del análisis de la terminología meta en las traducciones de textos en inglés antiguo al inglés moderno
- Describing and evaluating MT results from small and resource-poor languages: A translation didactic orientated case study of Galician-German touristic texts
- Nachruf für Gerd Wotjak
Artikel in diesem Heft
- Frontmatter
- Frontmatter
- Introduction to the special issue
- Implementing generative artificial intelligence technologies in language industry workflows – A competence perspective
- Prolegomena zu einer an Embodiment orientierten Fachkommunikationswissenschaft
- Using think-aloud, screen recording, and questionnaire data to gauge translation student application and perception of ChatGPT
- Kontrastive Analyse maschinell generierter Fachtranslate (EN-DE) im Strafrecht
- Literarisches Übersetzen im KI-Zeitalter: Überlegungen zu einer nachhaltigen Markttransformation
- Zu Einschätzung und Akzeptanz von KI-Technologien in der AVT-Branche: Die Perspektive der Verbände
- Weitere Themen Additional Topics
- Translation of compound terms: Cognitive insights
- Translating non-binary narratives
- Calibrating the passive: An experimental approach to plain languages rules
- Analyzing metaphors in the English translation of the Chinese novel Sandalwood Death from cognitive perspectives: A multi-level model
- La imagen del vikingo a través del análisis de la terminología meta en las traducciones de textos en inglés antiguo al inglés moderno
- Describing and evaluating MT results from small and resource-poor languages: A translation didactic orientated case study of Galician-German touristic texts
- Nachruf für Gerd Wotjak
