一种高效的基于启发式规则和词典相结合的双语词对齐方法

双语词对齐是指在互译的双语句对中找到词汇级的对译关系,是自然语言处理领域一个非常有用而又比较困难的研究课题。本文在对当前主流的词对齐方法进行实验分析的基础上,综合考虑了各种因素,提出了基于启发式统计规则和词典相结合的方法,该方法充分利用现有资源,同时考虑到了后续的应用问题。实验表明,该方法在训练语料规模较小的情况下,取得了较好的对齐结果。

A high efficient word alignment approach based on heuristic rule and lexicon

Bilingual Word Alignment,which can be defined as an object to indicate the corresponding words in a parallel sentence pair which have been aligned in the parallel text,is a very useful and difficult research topic in NLP.Considering various factors,comparing the word alignment results obtained from the current mainstream methods,this paper proposed a method combined heuristic rule and lexicon,the method is making full use of existing resources,taking into the application subsequently.Experiments show that the proposed method achieved good performance based on a small training corpus.