We implemented an offline version of converting translation memory matches into very large hierarchical rules (Koehn and Senellart, 2010). It should not be too hard to integrate this into the decoder on top of the suffix array phrase table implementation.