Moses::PhraseDictionaryGroup Class Reference

#include <PhraseDictionaryGroup.h>

Inheritance diagram for Moses::PhraseDictionaryGroup:

Collaboration diagram for Moses::PhraseDictionaryGroup:

List of all members.

Public Member Functions

PhraseDictionaryGroup (const std::string &line)

void Load (AllOptions::ptr const &opts)

override to load model files

TargetPhraseCollection::shared_ptr CreateTargetPhraseCollection (const ttasksptr &ttask, const Phrase &src) const

std::vector< std::vector< float > > getWeights (size_t numWeights, bool normalize) const

void CacheForCleanup (TargetPhraseCollection::shared_ptr tpc)

void CleanUpAfterSentenceProcessing (const InputType &source)

void CleanUpComponentModels (const InputType &source)

void GetTargetPhraseCollectionBatch (const ttasksptr &ttask, const InputPathList &inputPathQueue) const

TargetPhraseCollection::shared_ptr GetTargetPhraseCollectionLEGACY (const Phrase &src) const

find list of translations that can translates src. Only for phrase input

TargetPhraseCollection::shared_ptr GetTargetPhraseCollectionLEGACY (const ttasksptr &ttask, const Phrase &src) const

void InitializeForInput (ttasksptr const &ttask)

Create entry for translation of source to targetPhrase.

ChartRuleLookupManager * CreateRuleLookupManager (const ChartParser &, const ChartCellCollectionBase &, std::size_t)

Create a sentence-specific manager for SCFG rule lookup.

void SetParameter (const std::string &key, const std::string &value)

Protected Types

typedef std::vector
< TargetPhraseCollection::shared_ptr > PhraseCache

typedef PhraseCache SentenceCache

Protected Member Functions

PhraseCache & GetPhraseCache ()

Protected Attributes

std::vector< std::string > m_memberPDStrs

std::vector< PhraseDictionary * > m_memberPDs

std::vector< FeatureFunction * > m_pdFeature

size_t m_numModels

size_t m_totalModelScores

boost::dynamic_bitset m_seenByAll

bool m_phraseCounts

bool m_wordCounts

bool m_modelBitmapCounts

bool m_restrict

bool m_haveDefaultScores

std::vector< float > m_defaultScores

bool m_defaultAverageOthers

size_t m_scoresPerModel

bool m_haveMmsaptLrFunc

std::vector< LexicalReordering ** > m_mmsaptLrFuncs

SentenceCache m_sentenceCache

Detailed Description

Combines multiple phrase tables into a single interface. Each member phrase table scores each phrase and a single set of translations/scores is returned. If a phrase is not in one of the tables, its scores are zero-filled unless otherwise specified. See model combination section of Moses advanced feature documentation.

Definition at line 61 of file PhraseDictionaryGroup.h.

Member Typedef Documentation

typedef std::vector<TargetPhraseCollection::shared_ptr > Moses::PhraseDictionaryGroup::PhraseCache [protected]

Definition at line 113 of file PhraseDictionaryGroup.h.

typedef PhraseCache Moses::PhraseDictionaryGroup::SentenceCache [protected]

Definition at line 118 of file PhraseDictionaryGroup.h.

Constructor & Destructor Documentation

Moses::PhraseDictionaryGroup::PhraseDictionaryGroup ( const std::string & line )

Member Function Documentation

void Moses::PhraseDictionaryGroup::CacheForCleanup ( TargetPhraseCollection::shared_ptr tpc )

Definition at line 378 of file PhraseDictionaryGroup.cpp.

References GetPhraseCache().

Referenced by GetTargetPhraseCollectionLEGACY().

Here is the call graph for this function:

Here is the caller graph for this function:

void Moses::PhraseDictionaryGroup::CleanUpAfterSentenceProcessing ( const InputType & source ) [virtual]

Reimplemented from Moses::PhraseDictionary.

Definition at line 386 of file PhraseDictionaryGroup.cpp.

References CleanUpComponentModels(), and GetPhraseCache().

Here is the call graph for this function:

void Moses::PhraseDictionaryGroup::CleanUpComponentModels ( const InputType & source )

Definition at line 392 of file PhraseDictionaryGroup.cpp.

References m_memberPDs, and m_numModels.

Referenced by CleanUpAfterSentenceProcessing().

Here is the caller graph for this function:

ChartRuleLookupManager* Moses::PhraseDictionaryGroup::CreateRuleLookupManager	(	const ChartParser &	,
		const ChartCellCollectionBase &	,
		std::size_t
	)			`[virtual]`

Create a sentence-specific manager for SCFG rule lookup.

Implements Moses::PhraseDictionary.

TargetPhraseCollection::shared_ptr Moses::PhraseDictionaryGroup::CreateTargetPhraseCollection	(	const ttasksptr &	ttask,
		const Phrase &	src
	)			const

Definition at line 183 of file PhraseDictionaryGroup.cpp.

References Moses::ScoreComponentCollection::Assign(), Moses::TargetPhrase::EvaluateInIsolation(), Moses::TargetPhrase::GetExtraScores(), Moses::FeatureFunction::GetNumScoreComponents(), Moses::TargetPhrase::GetScoreBreakdown(), Moses::ScoreComponentCollection::GetScoresForProducer(), Moses::Phrase::GetSize(), Moses::PhraseDictionary::GetTargetPhraseCollectionLEGACY(), Moses::ScoreComponentCollection::InvertDenseFeatures(), m_defaultAverageOthers, m_defaultScores, m_haveMmsaptLrFunc, m_memberPDs, m_mmsaptLrFuncs, m_modelBitmapCounts, m_numModels, m_pdFeature, m_phraseCounts, m_restrict, Moses::PDGroupPhrase::m_scores, m_scoresPerModel, Moses::PDGroupPhrase::m_seenBy, m_seenByAll, Moses::PDGroupPhrase::m_targetPhrase, m_totalModelScores, m_wordCounts, NULL, Moses::TargetPhrase::SetExtraScores(), and Moses::ScoreComponentCollection::ZeroDenseFeatures().

Referenced by GetTargetPhraseCollectionLEGACY().

Here is the call graph for this function:

Here is the caller graph for this function:

PhraseCache& Moses::PhraseDictionaryGroup::GetPhraseCache ( ) [inline, protected]

Definition at line 122 of file PhraseDictionaryGroup.h.

References get_id(), and m_sentenceCache.

Referenced by CacheForCleanup(), and CleanUpAfterSentenceProcessing().

Here is the call graph for this function:

Here is the caller graph for this function:

void Moses::PhraseDictionaryGroup::GetTargetPhraseCollectionBatch	(	const ttasksptr &	ttask,
		const InputPathList &	inputPathQueue
	)			const `[virtual]`

Reimplemented from Moses::PhraseDictionary.

Definition at line 145 of file PhraseDictionaryGroup.cpp.

References Moses::InputPath::GetPhrase(), GetTargetPhraseCollectionLEGACY(), m_memberPDs, NULL, Moses::PhraseDictionary::PrefixExists(), and Moses::InputPath::SetTargetPhrases().

Here is the call graph for this function:

TargetPhraseCollection::shared_ptr Moses::PhraseDictionaryGroup::GetTargetPhraseCollectionLEGACY	(	const ttasksptr &	ttask,
		const Phrase &	src
	)			const `[virtual]`

Reimplemented from Moses::PhraseDictionary.

Definition at line 172 of file PhraseDictionaryGroup.cpp.

References CacheForCleanup(), CreateTargetPhraseCollection(), and Moses::PhraseDictionary::m_tableLimit.

Here is the call graph for this function:

TargetPhraseCollection::shared_ptr Moses::PhraseDictionaryGroup::GetTargetPhraseCollectionLEGACY ( const Phrase & src ) const [virtual]

find list of translations that can translates src. Only for phrase input

Reimplemented from Moses::PhraseDictionary.

Definition at line 164 of file PhraseDictionaryGroup.cpp.

References UTIL_THROW2.

Referenced by GetTargetPhraseCollectionBatch().

Here is the caller graph for this function:

std::vector<std::vector<float> > Moses::PhraseDictionaryGroup::getWeights	(	size_t	numWeights,
		bool	normalize
	)			const

void Moses::PhraseDictionaryGroup::InitializeForInput ( ttasksptr const & ttask ) [virtual]

Create entry for translation of source to targetPhrase.

Reimplemented from Moses::PhraseDictionary.

Definition at line 140 of file PhraseDictionaryGroup.cpp.

void Moses::PhraseDictionaryGroup::Load ( AllOptions::ptr const & opts ) [virtual]

override to load model files

Reimplemented from Moses::FeatureFunction.

Definition at line 76 of file PhraseDictionaryGroup.cpp.

References Moses::PhraseDictionary::GetColl(), Moses::FeatureFunction::GetNumScoreComponents(), Moses::FeatureFunction::GetScoreProducerDescription(), m_defaultAverageOthers, m_defaultScores, Moses::FeatureFunction::m_description, m_haveDefaultScores, m_haveMmsaptLrFunc, m_memberPDs, m_memberPDStrs, m_mmsaptLrFuncs, m_modelBitmapCounts, m_numModels, Moses::FeatureFunction::m_numScoreComponents, Moses::FeatureFunction::m_options, m_pdFeature, m_phraseCounts, m_scoresPerModel, m_totalModelScores, m_wordCounts, Moses::PhraseDictionary::SetFeaturesToApply(), and UTIL_THROW_IF2.

Here is the call graph for this function:

void Moses::PhraseDictionaryGroup::SetParameter	(	const std::string &	key,
		const std::string &	value
	)			`[virtual]`

Reimplemented from Moses::PhraseDictionary.

Member Data Documentation

bool Moses::PhraseDictionaryGroup::m_defaultAverageOthers [protected]

Definition at line 106 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

std::vector<float> Moses::PhraseDictionaryGroup::m_defaultScores [protected]

Definition at line 104 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

bool Moses::PhraseDictionaryGroup::m_haveDefaultScores [protected]

Definition at line 103 of file PhraseDictionaryGroup.h.

Referenced by Load().

bool Moses::PhraseDictionaryGroup::m_haveMmsaptLrFunc [protected]

Definition at line 109 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

std::vector<PhraseDictionary*> Moses::PhraseDictionaryGroup::m_memberPDs [protected]

Definition at line 89 of file PhraseDictionaryGroup.h.

Referenced by CleanUpComponentModels(), CreateTargetPhraseCollection(), GetTargetPhraseCollectionBatch(), and Load().

std::vector<std::string> Moses::PhraseDictionaryGroup::m_memberPDStrs [protected]

Definition at line 88 of file PhraseDictionaryGroup.h.

Referenced by Load().

std::vector<LexicalReordering**> Moses::PhraseDictionaryGroup::m_mmsaptLrFuncs [protected]

Definition at line 111 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

bool Moses::PhraseDictionaryGroup::m_modelBitmapCounts [protected]

Definition at line 99 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

size_t Moses::PhraseDictionaryGroup::m_numModels [protected]

Definition at line 91 of file PhraseDictionaryGroup.h.

Referenced by CleanUpComponentModels(), CreateTargetPhraseCollection(), and Load().

std::vector<FeatureFunction*> Moses::PhraseDictionaryGroup::m_pdFeature [protected]

Definition at line 90 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

bool Moses::PhraseDictionaryGroup::m_phraseCounts [protected]

Definition at line 95 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

bool Moses::PhraseDictionaryGroup::m_restrict [protected]

Definition at line 101 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection().

size_t Moses::PhraseDictionaryGroup::m_scoresPerModel [protected]

Definition at line 107 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

boost::dynamic_bitset Moses::PhraseDictionaryGroup::m_seenByAll [protected]

Definition at line 93 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection().

SentenceCache Moses::PhraseDictionaryGroup::m_sentenceCache [protected]

Definition at line 120 of file PhraseDictionaryGroup.h.

Referenced by GetPhraseCache().

size_t Moses::PhraseDictionaryGroup::m_totalModelScores [protected]

Definition at line 92 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

bool Moses::PhraseDictionaryGroup::m_wordCounts [protected]

Definition at line 97 of file PhraseDictionaryGroup.h.

Referenced by CreateTargetPhraseCollection(), and Load().

The documentation for this class was generated from the following files:

/disk4/html/www/moses/doxygen/mosesdecoder/moses/TranslationModel/PhraseDictionaryGroup.h
/disk4/html/www/moses/doxygen/mosesdecoder/moses/TranslationModel/PhraseDictionaryGroup.cpp


Public Member Functions
	PhraseDictionaryGroup (const std::string &line)
void	Load (AllOptions::ptr const &opts)
	override to load model files
TargetPhraseCollection::shared_ptr	CreateTargetPhraseCollection (const ttasksptr &ttask, const Phrase &src) const
std::vector< std::vector< float > >	getWeights (size_t numWeights, bool normalize) const
void	CacheForCleanup (TargetPhraseCollection::shared_ptr tpc)
void	CleanUpAfterSentenceProcessing (const InputType &source)
void	CleanUpComponentModels (const InputType &source)
void	GetTargetPhraseCollectionBatch (const ttasksptr &ttask, const InputPathList &inputPathQueue) const
TargetPhraseCollection::shared_ptr	GetTargetPhraseCollectionLEGACY (const Phrase &src) const
	find list of translations that can translates src. Only for phrase input
TargetPhraseCollection::shared_ptr	GetTargetPhraseCollectionLEGACY (const ttasksptr &ttask, const Phrase &src) const
void	InitializeForInput (ttasksptr const &ttask)
	Create entry for translation of source to targetPhrase.
ChartRuleLookupManager *	CreateRuleLookupManager (const ChartParser &, const ChartCellCollectionBase &, std::size_t)
	Create a sentence-specific manager for SCFG rule lookup.
void	SetParameter (const std::string &key, const std::string &value)
Protected Types
typedef std::vector < TargetPhraseCollection::shared_ptr >	PhraseCache
typedef PhraseCache	SentenceCache
Protected Member Functions
PhraseCache &	GetPhraseCache ()
Protected Attributes
std::vector< std::string >	m_memberPDStrs
std::vector< PhraseDictionary * >	m_memberPDs
std::vector< FeatureFunction * >	m_pdFeature
size_t	m_numModels
size_t	m_totalModelScores
boost::dynamic_bitset	m_seenByAll
bool	m_phraseCounts
bool	m_wordCounts
bool	m_modelBitmapCounts
bool	m_restrict
bool	m_haveDefaultScores
std::vector< float >	m_defaultScores
bool	m_defaultAverageOthers
size_t	m_scoresPerModel
bool	m_haveMmsaptLrFunc
std::vector< LexicalReordering ** >	m_mmsaptLrFuncs
SentenceCache	m_sentenceCache