Reordering Constraints
Since reordering in phrase-based and word-based models leads to an exponential growth of the search space, reordering constraints are introduced for efficient decoding.
Reordering Constraints is the main subject of 10 publications. 9 are discussed here.
Publications
Matusov et al. (2005) constrain reordering when the input word sequence was consistently translated monotone in the training data.
Zens, Richard and Ney, Hermann (2003):
A Comparative Study on Reordering Constraints in Statistical Machine Translation, Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics
@inproceedings{Zens:2003,
author = {Zens, Richard and Ney, Hermann},
title = {A Comparative Study on Reordering Constraints in Statistical Machine Translation},
booktitle = {Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics},
editor = {Erhard Hinrichs and Dan Roth},
url = {
http://www.aclweb.org/anthology/P03-1019.pdf},
pages = {144--151},
year = 2003
}
Zens and Ney (2003);
Zens, Richard and Ney, Hermann and Watanabe, Taro and Sumita, Eiichiro (2004):
Reordering Constraints for Phrase-Based Statistical Machine Translation , Proceedings of Coling 2004
@inproceedings{Zens:2004b,
author = {Zens, Richard and Ney, Hermann and Watanabe, Taro and Sumita, Eiichiro},
title = {Reordering Constraints for Phrase-Based Statistical Machine Translation },
url = {
http://acl.ldc.upenn.edu/C/C04/C04-1030.pdf},
googlescholar = {5056740342534410730},
booktitle = {Proceedings of Coling 2004 },
editor = {{}},
month = {Aug 23--Aug 27},
address = {Geneva, Switzerland},
publisher = {COLING},
pages = {205--211},
year = 2004
}
Zens et al. (2004);
Kanthak, Stephan and Vilar, David and Matusov, Evgeny and Zens, Richard and Ney, Hermann (2005):
Novel Reordering Approaches in Phrase-Based Statistical Machine Translation, Proceedings of the ACL Workshop on Building and Using Parallel Texts
@InProceedings{kanthak-EtAl:2005:WPT,
author = {Kanthak, Stephan and Vilar, David and Matusov, Evgeny and Zens, Richard and Ney, Hermann},
title = {Novel Reordering Approaches in Phrase-Based Statistical Machine Translation},
booktitle = {Proceedings of the ACL Workshop on Building and Using Parallel Texts},
month = {June},
address = {Ann Arbor, Michigan},
publisher = {Association for Computational Linguistics},
pages = {167--174},
url = {
http://www.aclweb.org/anthology/W/W05/W05-0831},
year = 2005
}
Kanthak et al. (2005) compare different reordering constraints and their effect on translation performance, including the formal grammar ITG constraint, which may be further restricted by insisting on a match to source side syntax
Yamamoto, Hirofumi and Okuma, Hideo and Sumita, Eiichiro (2008):
Imposing Constraints from the Source Tree on ITG Constraints for SMT, Proceedings of the ACL-08: HLT Second Workshop on Syntax and Structure in Statistical Translation (SSST-2)
@InProceedings{yamamoto-okuma-sumita:2008:SSST,
author = {Yamamoto, Hirofumi and Okuma, Hideo and Sumita, Eiichiro},
title = {Imposing Constraints from the Source Tree on {ITG} Constraints for {SMT}},
booktitle = {Proceedings of the ACL-08:~HLT Second Workshop on Syntax and Structure in Statistical Translation (SSST-2)},
month = {June},
address = {Columbus, Ohio},
publisher = {Association for Computational Linguistics},
pages = {1--9},
url = {
http://www.aclweb.org/anthology/W/W08/W08-0401},
year = 2008
}
(Yamamoto et al., 2008).
Similarly, reordering may be restricted to syntactically cohesion
Cherry, Colin (2008):
Cohesive Phrase-Based Decoding for Statistical Machine Translation, Proceedings of ACL-08: HLT
@InProceedings{cherry:2008:ACLMain,
author = {Cherry, Colin},
title = {Cohesive Phrase-Based Decoding for Statistical Machine Translation},
booktitle = {Proceedings of ACL-08: HLT},
month = {June},
address = {Columbus, Ohio},
publisher = {Association for Computational Linguistics},
pages = {72--80},
url = {
http://www.aclweb.org/anthology/P/P08/P08-1009},
year = 2008
}
(Cherry, 2008).
Ge, Niyu and Ittycheriah, Abraham and Papineni, Kishore (2008):
Multiple Reorderings in Phrase-Based Machine Translation, Proceedings of the ACL-08: HLT Second Workshop on Syntax and Structure in Statistical Translation (SSST-2)
@InProceedings{ge-ittycheriah-papineni:2008:SSST,
author = {Ge, Niyu and Ittycheriah, Abraham and Papineni, Kishore},
title = {Multiple Reorderings in Phrase-Based Machine Translation},
booktitle = {Proceedings of the ACL-08:~HLT Second Workshop on Syntax and Structure in Statistical Translation (SSST-2)},
month = {June},
address = {Columbus, Ohio},
publisher = {Association for Computational Linguistics},
pages = {61--68},
url = {
http://www.aclweb.org/anthology/W/W08/W08-0408},
year = 2008
}
Ge et al. (2008) integrate other linguistically inspired reordering models into a phrase-based decoder.
Dreyer, Markus and Hall, Keith and Khudanpur, Sanjeev (2007):
Comparing Reordering Constraints for SMT Using Efficient BLEU Oracle Computation, Proceedings of SSST, NAACL-HLT 2007 / AMTA Workshop on Syntax and Structure in Statistical Translation
@InProceedings{dreyer-hall-khudanpur:2007:SSST,
author = {Dreyer, Markus and Hall, Keith and Khudanpur, Sanjeev},
title = {Comparing Reordering Constraints for {SMT} Using Efficient {BLEU} Oracle Computation},
booktitle = {Proceedings of SSST, NAACL-HLT 2007 / AMTA Workshop on Syntax and Structure in Statistical Translation},
month = {April},
address = {Rochester, New York},
publisher = {Association for Computational Linguistics},
pages = {103--110},
url = {
http://www.aclweb.org/anthology/W/W07/W07-0414},
year = 2007
}
Dreyer et al. (2007) compare reordering constraints in terms of oracle BLEU, i.e., the maximum possible BLEU score.
Chooi-Ling Goh and Takashi Onishi and Eiichiro Sumita (2011):
Rule-based Reordering Constraints for Phrase-based SMT, Proceedings of the 15th International Conference of the European Association for Machine Translation (EAMT)
@inproceedings{eamt11:Goh,
author = {Chooi-Ling Goh and Takashi Onishi and Eiichiro Sumita},
title = {Rule-based Reordering Constraints for Phrase-based {SMT}},
url = {
http://mt-archive.info/EAMT-2011-Goh.pdf},
googlescholar = {13488968312707614244},
pages = {113--120},
booktitle = {Proceedings of the 15th International Conference of the European Association for Machine Translation (EAMT)},
location = {Leuven, Belgium},
editor = {Mikel L. Forcada and Heidi Depraetere and Vincent Vandeghinste},
year = 2011
}
Goh et al. (2011) use constraints based on part-of-speech patterns mostly along clause boundaries to improve Japansese-English patent translation.
Benchmarks
Discussion
Related Topics
Instead of hard limits on reordering, reordering models may inform search.
New Publications
Li, Junhui and Marton, Yuval and Resnik, Philip and Daumé III, Hal (2014):
A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation, Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
@InProceedings{li-EtAl:2014:P14-12,
author = {Li, Junhui and Marton, Yuval and Resnik, Philip and Daum\'{e} III, Hal},
title = {A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation},
booktitle = {Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
month = {June},
address = {Baltimore, Maryland},
publisher = {Association for Computational Linguistics},
pages = {1123--1133},
url = {
http://www.aclweb.org/anthology/P14-1106},
year = 2014
}
Li et al. (2014)