МЕТОД СИСТЕМНОЇ ІНЖЕНЕРІЇ СИСТЕМ НЕЙРОННОГО МАШИННОГО ПЕРЕКЛАДУ

Павло Павлович Маслянко; Євгеній Петрович Сєльський

doi:10.20535/kpisn.2021.2.236939

Vol. · Issue 2 · 2021 Aug 31, 2021 article

METHOD OF SYSTEM ENGINEERING OF NEURAL MACHINE TRANSLATION SYSTEMS

Pavlo P. Maslianko Corresponding Igor Sikorsky Kyiv Polytechnic Institute, Ukraine Ukraine

Yevhenii P. Sielskyi ENSTAIPParis, France Ukraine

PublishedAug 31, 2021

PDF (Ukrainian)

KPISN 2 VOL · 2

VOL · ISS 2 · 2021 View issue

Abstract

Background. There are not many machine translation companies on the market whose products are in demand. These are, for example, free and commercial products such as “ GoogleTranslate” , “DeepLTranslator” , “ModernMT” , “Apertium” , “Trident” , to name a few. To implement a more efficient and productive process for developing high-quality neural machine translation systems (NMTS), appropriate scientifically based methods of NMTS engineering are needed in order to get a high-quality and competitive product as quickly as possible. Objective. The purpose of this article is to apply the Eriksson-Penker business profile to the development and formalization of a method for system engineering of NMTS. Methods. The idea behind the neural machine translation system engineering method is to apply the Eriksson-Penker system engineering methodology and business profile to formalize an ordered way to develop NMT systems. Results. The method of developing NMT systems based on the use of system engineering techniques consists of three main stages. At the first stage, the structure of the NMT system is modelled in the form of an Eriksson-Penker business profile. At the second stage, a set of processes is determined that is specific to the class of Data Science systems, and the international CRISP-DM standard. At the third stage, verification and validation of the developed NMTS is carried out. Conclusions. The article proposes a method of system engineering of NMTS based on the modified Erickson-Penker business profile representation of the system at the meta-level, as well as international process standards of Data Science and Data Mining. The effectiveness of using this method was studied on the example of developing a bidirectional English-Ukrainian NMTS EUMT (English-Ukrainian Machine Translator) and it was found that the EUMT system is at least as good as the quality of English-Ukrainian translation of the popular Google Translate translator. The full version code of the EUMT system is published on the GitHub platform and is available at: https://github.com/EugeneSel/EUMT .

Keywords

#method #neural machine translation system #system engineering #Erickson-Penker method

References

H.-E. Eriksson and M. Penker, Business modeling with UML. New York: John Wiley & Sons, 2000, 459 p.
A. Kossiakoff et al., Systems Engineering Principles and Practice, V.K. Batovrin, Ed. Moscow, Russia: DMK Press, 2014, 624 p.
D.K. Hitchins, Systems Engineering: A 21st Century Systems Methodology. Wiley, 2007, 528 p.
S. Krymskyi, “Metod,” in Filosofskyi Entsyklopedychnyi Slovnyk, V.I. Shynkaruk, Ed. Kyiv, Ukraine: Abrys, 2002, 742 p.
P.Р. Maslyanko and O.S. Maystrenko, “The system engineering of organizational system informatization projects,” KPI Sci. News, no. 6, pp. 34–42, 2008.
C. O'Neil and R. Schutt, Doing data science: Straight talk from the frontline. O'Reilly Media, Inc., 2013, 406 p.
F. Provost and T. Fawcett, Data science for business: What you need to know about data mining and data-analytic thinking. O'Reilly Media, Inc., 2013.
D. Bahdanau et al., “Neural machine translation by jointly learning to align and translate,” in 3rd International Conference on Learning Representations, San Diego, United States, 2014.
J. Gehring et al. (2016). A convolutional encoder model for neural machine translation [Online]. Available: https://arxiv.org/pdf/1611.02344.pdf
A. Vaswani et al., “Attention is all you need,” in 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA, 2017.
P. Bojanowski et al., “Enriching word vectors with subword information,” Trans. Assoc. Computation. Ling., vol. 5, pp. 135–146, 2017.
D.P. Kingma and J.L. Ba. (2014). Adam: A method for stochastic optimization [Online]. Available: https://arxiv.org/pdf/1412.6980.pdf?source=post_page
C. Szegedy et al. (2016). Rethinking the inception architecture for computer vision [Online]. Available: https://arxiv.org/pdf/1512.00567.pdf
K. Papineni et al. “Bleu: A method for automatic evaluation of machine translation,” in Proc. 40th Annual Meeting of the Association for Computational Linguistics (ACL), Philadelphia, 2002, pp. 311–318.
J. Tiedemann. (2012). Parallel data, tools and interfaces in OPUS [Online]. Available: http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf
M. Johnson et al. (2017). Google’s multilingual neural machine translation system: Enabling zero-shot translation [Online]. Available: https://arxiv.org/pdf/1611.04558.pdf
S. Holger et al. (2019). WikiMatrix: Mining 135M parallel sentences in 1620 language pairs from Wikipedia [Online]. Available: https://arxiv.org/pdf/1907.05791.pdf
A. El-Kishky et al. (2021). XLEnt: Mining Cross-lingual Entities with Lexical-Semantic-Phonetic Word Alignment [Online]. Available: http://data.statmt.org/xlent/elkishky_XLEnt.pdf
A. Abdelali et al., “The AMARA Corpus: Building parallel language resources for the educational domain,” in Proc. 9th International Conference on Language Resources and Evaluation (LREC'14), Reykjavik, Iceland, 2014, p. 1856–1862.

Previous in issue CHOOSING A QUALITY CRITERION FOR EVALUATING THE FORECAST OF NONLINEAR NON-STATIONARY PROCESSES Next in issue SORTING APPROACHES IN THE HEURISTIC BASED ON REMAINING AVAILABLE AND PROCESSING PERIODS TO MINIMIZE TOTAL WEIGHTED TARDINESS IN PROGRESSIVE IDLING-FREE 1-MACHINE PREEMPTIVE SCHEDULING

§ 06 — Related

[1] H.-E. Eriksson and M. Penker, Business modeling with UML. New York: John Wiley & Sons, 2000, 459 p.

[2] A. Kossiakoff et al., Systems Engineering Principles and Practice, V.K. Batovrin, Ed. Moscow, Russia: DMK Press, 2014, 624 p.

[3] D.K. Hitchins, Systems Engineering: A 21st Century Systems Methodology. Wiley, 2007, 528 p.

[4] S. Krymskyi, “Metod,” in Filosofskyi Entsyklopedychnyi Slovnyk, V.I. Shynkaruk, Ed. Kyiv, Ukraine: Abrys, 2002, 742 p.

[5] P.Р. Maslyanko and O.S. Maystrenko, “The system engineering of organizational system informatization projects,” KPI Sci. News, no. 6, pp. 34–42, 2008.

[6] C. O'Neil and R. Schutt, Doing data science: Straight talk from the frontline. O'Reilly Media, Inc., 2013, 406 p.

[7] F. Provost and T. Fawcett, Data science for business: What you need to know about data mining and data-analytic thinking. O'Reilly Media, Inc., 2013.

[8] D. Bahdanau et al., “Neural machine translation by jointly learning to align and translate,” in 3rd International Conference on Learning Representations, San Diego, United States, 2014.

[9] J. Gehring et al. (2016). A convolutional encoder model for neural machine translation [Online]. Available: https://arxiv.org/pdf/1611.02344.pdf

[10] A. Vaswani et al., “Attention is all you need,” in 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA, 2017.

[11] P. Bojanowski et al., “Enriching word vectors with subword information,” Trans. Assoc. Computation. Ling., vol. 5, pp. 135–146, 2017.

[12] D.P. Kingma and J.L. Ba. (2014). Adam: A method for stochastic optimization [Online]. Available: https://arxiv.org/pdf/1412.6980.pdf?source=post_page

[13] C. Szegedy et al. (2016). Rethinking the inception architecture for computer vision [Online]. Available: https://arxiv.org/pdf/1512.00567.pdf

[14] K. Papineni et al. “Bleu: A method for automatic evaluation of machine translation,” in Proc. 40th Annual Meeting of the Association for Computational Linguistics (ACL), Philadelphia, 2002, pp. 311–318.

[15] J. Tiedemann. (2012). Parallel data, tools and interfaces in OPUS [Online]. Available: http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf

[16] M. Johnson et al. (2017). Google’s multilingual neural machine translation system: Enabling zero-shot translation [Online]. Available: https://arxiv.org/pdf/1611.04558.pdf

[17] S. Holger et al. (2019). WikiMatrix: Mining 135M parallel sentences in 1620 language pairs from Wikipedia [Online]. Available: https://arxiv.org/pdf/1907.05791.pdf

[18] A. El-Kishky et al. (2021). XLEnt: Mining Cross-lingual Entities with Lexical-Semantic-Phonetic Word Alignment [Online]. Available: http://data.statmt.org/xlent/elkishky_XLEnt.pdf

[19] A. Abdelali et al., “The AMARA Corpus: Building parallel language resources for the educational domain,” in Proc. 9th International Conference on Language Resources and Evaluation (LREC'14), Reykjavik, Iceland, 2014, p. 1856–1862.

METHOD OF SYSTEM ENGINEERING OF NEURAL MACHINE TRANSLATION SYSTEMS

Abstract

Keywords

References

Similar articles in this journal

AN APPROACH TO CONSTRUCTING AN INFORMATIVE FEATURE SPACE OF TECHNICAL INDICATORS FOR FINANCIAL PROCESSES BASED ON NEURAL NETWORK MODELS

METHODS FOR ENSURING THE INTEGRITY OF DATA PROCESSING AND TRANSMISSION IN INDUSTRIAL AUTOMATION SYSTEMS

METHODOLOGY FOR THE PARAMETRIC SYNTHESIS OF ZOOM-AFOCAL SYSTEMS BASED ON FIXED VARIOFOCAL LENSES

Similar Articles

Similar Articles

MACHINE LEARNING MODEL FOR RECOGNITION OF UKRAINIAN SIGN LANGUAGE HAND CONFIGURATIONS

DEEP REINFORCEMENT LEARNING-BASED MAPLESS NAVIGATION ALGORITHM FOR HUSKY ROBOT WITH ADAPTIVE CURRICULUM LEARNING

SIMULATION MODEL OF A DIGITAL TWIN FOR AN NPP POWER UNIT TECHNOLOGICAL PROCESS

AUTONOMOUS INDEX RECOMMENDATION SYSTEM FOR RELATIONAL DATABASES BASED ON COST-MODEL AND PLAN COVERING

MICROSERVICE ARCHITECTURE AND ALGORITHMS OF A MODULAR AUTOMATION SYSTEM FOR SMALL BUSINESS TECHNOLOGICAL PROCESSES

METHODOLOGY FOR SELECTING THE TRANSMISSION PATH STRUCTURE IN FUSION POWER PLANTS

MODIFICATION OF THE SEPARABLE PHYSICS-INFORMED NEURAL NETWORK METHOD FOR THE APPROXIMATE SOLUTION OF A MIXED PROBLEM FOR THE HEAT CONDUCTION EQUATION IN AN ELLIPTICAL DOMAIN

ANALYSIS OF APPLICATION OF NEURAL NETWORKS TO IMPROVE THE RELIABILITY OF ACTIVE THERMAL NDT

SIMPLIFICATION OF THE MEASUREMENT MODEL IN ALGORITHM OF THE STRAPDOWN ATTITUDE AND HEADING REFERENCE SYSTEM BASED ON THE QUATERNION KALMAN FILTER

CALIBRATION METHOD FOR ANGULAR PARAMETERS OF THE EARTH’S REMOTE SENSING SCANNERS