Multi-Threading for Various Training Steps

Participants: Barry Haddow, Ceslav Przywara

The development of computing hardware currently progresses towards multi-core processors with increasing number of cores.

The Moses decoder is support exploitation of such machines with multi-threading for almost all aspects, but most other processes are single-threaded.

In this project, we will add multi-threading to a number of processing steps:

  • extracting and scoring of phrase pairs
  • minimum error rate training
  • others

Knowledge of C++ is essential, but knowledge of multi-threading not.

Progress

  • Ceslav is looking at parallelisation of scoring
  • Barry is looking at parallelisation of mert
Page last modified on September 07, 2011, at 06:48 AM