Machine Translation Evaluation Metric Based on Dependency Parsing Model

doi:10.1145/3312573

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	Machine Translation Evaluation Metric Based on Dependency Parsing Model
	Yu, Hui 1; Xu, Weizhi 2; Lin, Shouxun 3; Liu, Qun 4
刊名	ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING
	2019-08-01
卷号	18 期号:4 页码:15
关键词	Automatic evaluation metric dependency parsing model machine translation
ISSN号	2375-4699
DOI	10.1145/3312573
英文摘要	Most of the syntax-based metrics obtain the similarity by comparing the sub-structures extracted from the trees of hypothesis and reference. These sub-structures cannot represent all the information in the trees because their lengths are limited. To sufficiently use the reference syntax information, a new automatic evaluation metric is proposed based on the dependency parsing model. First, a dependency parsing model is trained using the reference dependency tree for each sentence. Then, the hypothesis is parsed by this dependency parsing model and the corresponding hypothesis dependency tree is generated. The quality of hypothesis can be judged by the quality of the hypothesis dependency tree. Unigram F-score is included in the new metric so that lexicon similarity is obtained. According to experimental results, the proposed metric can perform better than METEOR and BLEU on system level and get comparable results with METEOR on sentence level. To further improve the performance, we also propose a combined metric which gets the best performance on the sentence level and on the system level.
资助项目	Science Foundation Ireland as part of the ADAPT Centre[13/RC/2106] ; NSFC[61379086] ; NSFC[61602284] ; NSFC[61602285] ; NSFC[61602282] ; Shandong Provincial Natural Science Foundation, China[ZR2015FQ009]
WOS研究方向	Computer Science
语种	英语
出版者	ASSOC COMPUTING MACHINERY
WOS记录号	WOS:000495430700011
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/14814]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yu, Hui
作者单位	1.Shandong Normal Univ, Business Sch, 88 East Wenhua Rd, Jinan 250014, Shandong, Peoples R China 2.Shandong Normal Univ, Sch Informat Sci & Engn, Jinan, Shandong, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 4.Huawei Noahs Ark Lab, Hong Kong, Peoples R China
推荐引用方式 GB/T 7714	Yu, Hui,Xu, Weizhi,Lin, Shouxun,et al. Machine Translation Evaluation Metric Based on Dependency Parsing Model[J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,2019,18(4):15.
APA	Yu, Hui,Xu, Weizhi,Lin, Shouxun,&Liu, Qun.(2019).Machine Translation Evaluation Metric Based on Dependency Parsing Model.ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,18(4),15.
MLA	Yu, Hui,et al."Machine Translation Evaluation Metric Based on Dependency Parsing Model".ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING 18.4(2019):15.