Study and Comparison of Rule-Based and Statistical Catalan-Spanish Machine Translation Systems

Authors

  • Marta R. Costa-Jussà Barcelona Media Innovation Center
  • Mireia Farrús Universidad Oberta de Catalunya
  • José B. Mariño Universitat Politècnica de Catalunya
  • José A.R. Fonollosa Universitat Politècnica de Catalunya

Keywords:

Rule-based machine translation, statistical machine translation, Catalan, Spanish

Abstract

Machine translation systems can be classified into rule-based and corpus-based approaches, in terms of their core methodology. Since both paradigms have been largely used during the last years, one of the aims in the research community is to know how these systems differ in terms of translation quality. To this end, this paper reports a study and comparison of several specific Catalan-Spanish machine translation systems: two rule-based and two corpus-based (particularly, statistical-based) systems, all of them freely available on the web. The translation quality analysis is performed under two different domains: journalistic and medical. The systems are evaluated by using standard automatic measures, as well as by native human evaluators. In addition to these traditional evaluation procedures, this paper reports a novel linguistic evaluation, which provides information about the errors encountered at the orthographic, morphological, lexical, semantic and syntactic levels. Results show that while rule-based systems provide a better performance at orthographic and morphological levels, statistical systems tend to commit less semantic errors. Furthermore, results show all the evaluations performed are characterised by some degree of correlation, and human evaluators tend to be specially critical with semantic and syntactic errors.

Downloads

Download data is not yet available.

Downloads

Published

2012-07-18

How to Cite

Costa-Jussà, M. R., Farrús, M., Mariño, J. B., & Fonollosa, J. A. (2012). Study and Comparison of Rule-Based and Statistical Catalan-Spanish Machine Translation Systems. COMPUTING AND INFORMATICS, 31(2), 245–270. Retrieved from http://www.cai.sk/ojs/index.php/cai/article/view/940

Most read articles by the same author(s)