Author:
Chen Jiangping,Ding Ren,Jiang Shan,Knudson Ryan
Abstract
PurposeThe purpose of this study is to evaluate freely available machine translation (MT) services' performance in translating metadata records.Design/methodology/approachRandomly selected metadata records were translated from English into Chinese using Google, Bing, and SYSTRAN MT systems. These translations were then evaluated using a five point scale for both fluency and adequacy. Missing count (words not translated) and incorrect count (words incorrectly translated) were also recorded.FindingsConcerning both fluency and adequacy, Google and Bing's translations of more than 70 percent of test data received scores equal to or greater than three, representative of “non‐native Chinese” and “much coverage,” respectively. SYSTRAN scored lowest in both measures. However, these differences were not statistically significant. A Pearson correlation analysis demonstrated a strong relationship (r=0.86) between fluency and adequacy. Missing count and incorrect count strongly correlated with fluency and adequacy.Originality/valueMost existing digital collections can be accessed in English alone. Few digital collections in the USA support multilingual information access (MLIA) that enables users of differing languages to search, browse, recognize and use information in the collections. Human translation is one solution, but it is neither time nor cost effective for most libraries. This study serves as a first step to understand the performance of current MT systems and to design effective and efficient MLIA services for digital collections.
Subject
Library and Information Sciences,Computer Science Applications
Reference34 articles.
1. Akiba, Y., Watanabe, T. and Sumita, E. (2002), “Using language and translation models to select the best among outputs from multiple MT systems”, 19th International Conference on Computational Linguistics, Taipei, Taiwan, 24 August‐1 September, Assocation for Computational Linguistics (ACL), available at: www.aclweb.org/anthology/C/C02/C02‐1076.pdf.
2. Arms, W.Y. (2000), “Automated digital libraries: how effectively can computers be used for the skilled tasks of professional librarianship?”, D‐Lib Magazine, Vol. 6 Nos 7/8, available at: www.dlib.org/dlib/july00/arms/07arms.html.
3. Bederson, B. (2009), “Translation by iterative collaboration between monolingual users”, Google Tech Talk, 24 September, available at: www.youtube.com/watch?v=rMj1PnrZphg.
4. Borgman, C.L. (1999), “Discussion: what are digital libraries? Competing visions”, Information Processing and Management, Vol. 35 No. 3, pp. 227‐43.
5. Callison‐Burch, C. and Flournoy, R.S. (2001), “A program for automatically selecting the best output from multiple machine translation engines”, Machine Translation Summit VIII, Santiago de Compostela, Spain, 18‐23 September, pp. 63‐6, available at: www.mt‐archive.info/MTS‐2001‐Callison.pdf.
Cited by
9 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献