Abstract
Machine translation from small into big languages, in our case a transfer from Slovak into German, has not yet undergone thorough research. Our goal is an analysis and comparison of machine translation (MT) and post-edited machine translation (PEMT) errors with human translation (HT) as well as detecting the efficiency rate of post-editing within that mentioned comparison. Hereby we apply a method of automatic and manual metrics by percentages and evaluation numbers. Results indicate that post-editing is more efficient which however does not mean that human translation has a lower quality. A higher degree of freedom of HT allows for more creative solutions contrasting with post-edited MT in the results.
Danksagung
Die im vorliegenden Beitrag diskutierten Ergebnisse wurden im Rahmen eines Forschungsprojektes erarbeitet, das von der Agentur für die Förderung der Forschung und Entwicklung (Vertrag Nr. APVV-18–0473) gefördert wird.
Literaturverzeichnis
Allen, Jeffrey, H. (2003): “Post-editing”. Computers and translation. A translator's guide. Amsterdam/Philadelphia: John Benjamins, 297–317.10.1075/btl.35.19allSearch in Google Scholar
Baker, Mona (1996): Corpus-based translation studies: The challenges that lie ahead. In: Somers, H. (Ed.): Terminology, LSP and translation: Studies in language engineering in honour of Juan C. Sager. Benjamins Translation Library 18, 175–186. Amsterdam, Philadelphia.10.1075/btl.18.17bakSearch in Google Scholar
Beaugrande, Robert A. de/Dressler, Wolfgang U. (1981): Einführung in die Textlinguistik. Tübingen: Niemeyer.10.1515/9783111349305Search in Google Scholar
Carl, Michael/Schaeffer, Moritz J. (2017): Why translation is difficult: A corpus-based study of non-literality in post-editing and from-scratch translation. Hermes – Journal of Language and Communication in Business 56, 43–57. https://tidsskrift.dk/her/article/view/97201/146007 (30.05.2023).10.7146/hjlcb.v0i56.97201Search in Google Scholar
Castilho, Sheila/Moorkens, Joss/Gaspari, Federico/Sennrich, Rico/Way, Andy/Georgakopoulo, Panayota (2018): Evaluating MT for massive open online courses: A multifaceted comparison between PBSMT and NMT systems. Machine Translation 32(1), 1–27. https://doi.org/10.1007/s10590-018-9221-y.10.1007/s10590-018-9221-ySearch in Google Scholar
Chatzikoumi, Erini (2019): How to evaluate machine translation: A review of automated and human metrics. Natural Language Engineering 26, 1–25. 10.1017/S1351324919000469Search in Google Scholar
Cvrček, Václav/Chlumská, Lucie (2015): Simplification in translated Czech: A new approach to type-token ratio. Russian Linguistics 39, 309–325. https://doi.org/10.1007/s11185-015-9151–8.10.1007/s11185-015-9151-8Search in Google Scholar
De Almeida, Giselle/O’Brien, Sharon (2010): Analysing post-editing performance: Correlations with years of translation experience. In: Yvon, François/Hansen, Viggo (Hg.): Proceedings of the 14th annual conference of the European Association for Machine Translation. European Association for Machine Translation. https://aclanthology.org/2010.eamt-1.19.pdf (30.05.2023).Search in Google Scholar
Green, Spence/Heer, Jeffrey/Manning, Christopher D. (2013): The efficacy of human post-editing for language translation. In: Proceedings of the 2013 SIGCHI conference on human factors in computing systems, 439–448. https://doi.org/10.1145/2470654.247071810.1145/2470654.2470718Search in Google Scholar
House, Juliane (2015): Translation quality assessment: Past and present. New York: Routledge.10.1057/9781137025487_13Search in Google Scholar
Jia, Ye/Weiss, Ron J./Biadsy, Fadi/Macherey, Wolfgang/Johnson, Melvin/Chen, Zhifeng/Wu, Yonghui (2019): Direct speech-to-speech translation with a sequence-to-sequence model. arXiv. https://arxiv.org/pdf/1904.06037v2.pdf.10.21437/Interspeech.2019-1951Search in Google Scholar
Koby, Geoffrey, S./Fields, Paul, J./Hague, Daryl/Lommel, Arle/Melby, Alan (2014): Defining translation quality. Revista Tradumática 12, 413–420. https://ddd.uab.cat/pub/tradumatica/tradumatica_a2014n12/tradumatica_a2014n12p413.pdf (30.05.2023).10.5565/rev/tradumatica.76Search in Google Scholar
Koponen, Maarit (2016): Is machine translation post-editing worth the effort? A survey of research into post-editing and effort. Journal of Specialized Translation 25, 131–148. https://www.jostrans.org/issue25/art_koponen.pdf (30.05.2023).Search in Google Scholar
Leiva Rojo, Jorge (2018): Aspects of human translation: the current situation and an emerging trend. Hermēneus. Revista de traducción e interpretación 20, 257–294. https://doi.org/10.24197/her.20.2018.257–294.10.24197/her.20.2018.257-294Search in Google Scholar
Lommel, Arle (2018): Metrics for translation quality assessment: A case for standardising error typologies. In: Moorkens, Joss/Castilho, Sheila/ Gaspari, Federico/Doherty, Stephen (Hg.): Translation quality assessment: From principles to practice. Cham: Springer, 109–127. https://doi.org/10.1007/978-3-319-91241-7_6.10.1007/978-3-319-91241-7_6Search in Google Scholar
Munková, Daša/Munk, Michal (2016): Evalvácia strojového prekladu. Nitra: Univerzita Konštantína Filozofa.Search in Google Scholar
Munková, Daša/Wrede, Oľga/Absolon, Jakub (2019): Vergleich der menschlichen, maschinellen und Post-Editing-Übersetzung aus dem Slowakischen ins Deutsche mittels automatischer Evaluation. Zeitschrift für Slawistik 64 (2), 231–261. https://doi.org/10.1515/slaw-2018–0042.10.1515/slaw-2018-0042Search in Google Scholar
Munková, Dáša/Pánisová Ľudmila/Welnitzová Katarína (2022): A human evaluation of English-Slovak machine translation. Perspectives (Ahead-of-Print). https://doi.org/10.1080/0907676X.2022.2116989.10.1080/0907676X.2022.2116989Search in Google Scholar
Newmark, Peter (1991): About translation: Multilingual matters. Philadelphia – Adelaide: Multilingual Matters Ltd.Search in Google Scholar
Nord, Christiane (1997): Translating as a purposeful activity: Functionalist approaches explained. Manchester: St. Jerome.Search in Google Scholar
O’Brien, Sharon/Moorkens, Joss (2014): Towards intelligent post-editing interfaces. In: Proceedings of FIT XXth World Congress 2014. https://doras.dcu.ie/20136/ (30.05.2023).Search in Google Scholar
Olohan, Maeve (2016): Scientific and technical translation. New York: Routledge.10.4324/9781315679600Search in Google Scholar
Papineni, Kishore/Roukos, Salim/Ward, Todd/Zhu, Wei-Jing (2002): BLEU: A method for automatic evaluation of machine translation. In: Isabelle, Pierre/Charniak, Eugene/Lin, Dekang (Hg.): Proceedings of the 40th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 311–318. http://dx.doi.org/10.3115/1073083.1073135.10.3115/1073083.1073135Search in Google Scholar
Popovič, Anton (1975): Teória umeleckého prekladu. Bratislava, Tatran.Search in Google Scholar
Popovic, Maja (2018): Error classification and analysis for machine translation quality assessment. In: Moorkens, Joss/Castilho, Sheila/ Gaspari, Federico/Doherty, Stephen (Hg.): Translation quality assessment: From principles to practice. Cham: Springer, 129–158. https://doi.org/10.1007/978-3-319-91241-7_7.10.1007/978-3-319-91241-7_7Search in Google Scholar
Reiss, Katharina et al. (2014): Translation criticism – The potentials and limitations. London: Routledge. https://doi.org/10.4324/9781315760407.10.4324/9781315760407Search in Google Scholar
Scott, Mike (2015): Wordsmith tools manual.https://lexically.net/downloads/version7/HTML/ index.html (30.05.2023).Search in Google Scholar
Snover, Matthew/Dorr, Bonnie/Schwartz, Richard/Micciulla, Linnea/Makhoul, John (2006): A study of translation edit rate with targeted human annotation. In: Habash, Nizar/Lavie, Alon (Hg.): Proceedings of the 7th conference of the Association for Machine Translation in the Americas. The Association for Machine Translation in the Americas, 223–231. https://aclanthology.org/2006.amta-papers.25/ (30.05.2023).Search in Google Scholar
Specia, Lucia/Raj, Dhwaj/Turchi, Marco (2010): Machine translation evaluation versus quality estimation. Machine Translation 24(1), 39–50. https://doi.org/10.1007/s10590-010-9077–2.10.1007/s10590-010-9077-2Search in Google Scholar
Toral, Antonio (2019): Post-editese: An exacerbated translationese. In: Forcada, Mikel/Way, Andy/Haddow, Barry/Sennrich, Rico (Hg.): Proceedings of machine translation summit XVII: Research track. European Association for Machine Translation, 273–281. https://aclanthology.org/W19-6627/ (30.05.2023).Search in Google Scholar
Vanmassenhove, Eva/Shterionov, Dimitar/Gwilliam, Matthew (2021): Machine translationese: Effects of algorithmic bias on linguistic complexity in machine translation. In: Merlo, Paola/Tiedemann, Jörg/Tsarfaty, Reut (Eds.): Proceedings of the 16th conference of the European chapter of the Association for Computational Linguistics: Main volume. Association for Computational Linguistics, 2203–2213. http://dx.doi.org/10.18653/v1/2021.eacl-main.188.10.18653/v1/2021.eacl-main.188Search in Google Scholar
Varga, Dániel/ Halácsy, Péter/Kornai, András/Nagy, Viktor/Németh, László/Trón, Viktor (2005): Parallel corpora for medium density languages. In: Nicolov, Nicolas/Bontcheva, Kalina/Angelova, Galia/Mitkov, Ruslan (Hg.): Recent advances in natural language processing IV: Selected papers from RANLP 2005, 590–596. https://doi.org/10.1075/cilt.292.32var.10.1075/cilt.292.32varSearch in Google Scholar
Volkart, Lise/Bouillon, Pierrette (2022): Studying post-editese in a professional context: A pilot study. In: Moniz, Helena/Macken, Lieve/Rufener, Andrew/Barrault, Loïc/Costa-jussà, Marta R./Declercq, Christophe/Koponen, Maarit/Kemp, Ellie/Pilos, Spyridon/Forcada, Mikel L./Scarton, Carolina/Van den Bogaert, Joachim/Daems, Joke/Tezcan, Arda/Vanroy, Bram/Fonteyne, Margot (Hg.): Proceedings of the 23rd annual conference of the European Association for machine translation. European Association for Machine Translation, 71–79. https://aclanthology.org/2022.eamt-1 (30.05.2023).Search in Google Scholar
Wallberg, Ilona (2020): Post-Editing und Projektmanagement – Fähigkeiten und Fertigkeiten jenseits der Uni-Ausbildung.https://astt.fb06.uni-mainz.de/files/2019/11/2020-01-29-Wallberg-in-Germersheim.pdf (30.05.2023).Search in Google Scholar
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Frontmatter
- Hektik pur: zu den unflektierten nachgestellten Adjektiven im Deutschen und zu deren Wiedergabe im Italienischen
- Cognitive and pragmatic features of Anglicisms in Kazakh media text
- The portrayal of women in Jordanian proverbial expressions: A thematic analysis
- Direktionalität im Konferenzdolmetschen: eine terminologische Vorbereitungsmethode für die Sprachrichtung A-B
- Las asimetrías entre los procesos penales español y alemán y cómo abordarlos mediante una traducción transparente basada en el derecho comparado
- La diversidad terminológica dentro del mismo ordenamiento jurídico como problema de traducción: el subdominio jurídico de las parejas de hecho en España
- Maschinelle, posteditierte und menschliche Übersetzung publizistischer und populärwissenschaftlicher Texte aus dem Slowakischen ins Deutsche
- Artificial intelligence literacy for the language industry – with particular emphasis on recent large language models such as GPT-4
- Rezensionen
- Cognola, Federica/Moroni, Manuela Caterina (2022): Le particelle modali del tedesco. Caratteristiche formali, proprietà pragmatiche ed equivalenti funzionali in italiano. Roma: Carocci, 240 S., ISBN 9788843094509.
- Evrin, Feyza/Meyer, Bernd (2023): Sprachmittlung in öffentlichen Einrichtungen. Handreichungen für die Praxis. Berlin: Peter Lang. 172 S., ISBN 9783631890035.
Articles in the same Issue
- Frontmatter
- Frontmatter
- Hektik pur: zu den unflektierten nachgestellten Adjektiven im Deutschen und zu deren Wiedergabe im Italienischen
- Cognitive and pragmatic features of Anglicisms in Kazakh media text
- The portrayal of women in Jordanian proverbial expressions: A thematic analysis
- Direktionalität im Konferenzdolmetschen: eine terminologische Vorbereitungsmethode für die Sprachrichtung A-B
- Las asimetrías entre los procesos penales español y alemán y cómo abordarlos mediante una traducción transparente basada en el derecho comparado
- La diversidad terminológica dentro del mismo ordenamiento jurídico como problema de traducción: el subdominio jurídico de las parejas de hecho en España
- Maschinelle, posteditierte und menschliche Übersetzung publizistischer und populärwissenschaftlicher Texte aus dem Slowakischen ins Deutsche
- Artificial intelligence literacy for the language industry – with particular emphasis on recent large language models such as GPT-4
- Rezensionen
- Cognola, Federica/Moroni, Manuela Caterina (2022): Le particelle modali del tedesco. Caratteristiche formali, proprietà pragmatiche ed equivalenti funzionali in italiano. Roma: Carocci, 240 S., ISBN 9788843094509.
- Evrin, Feyza/Meyer, Bernd (2023): Sprachmittlung in öffentlichen Einrichtungen. Handreichungen für die Praxis. Berlin: Peter Lang. 172 S., ISBN 9783631890035.