Moses::ProbingPT Class Reference

#include <ProbingPT.h>

Inheritance diagram for Moses::ProbingPT:

Collaboration diagram for Moses::ProbingPT:

List of all members.

Public Member Functions

ProbingPT (const std::string &line)

~ProbingPT ()

void Load (AllOptions::ptr const &opts)

override to load model files

void InitializeForInput (ttasksptr const &ttask)

Create entry for translation of source to targetPhrase.

void SetParameter (const std::string &key, const std::string &value)

void GetTargetPhraseCollectionBatch (const InputPathList &inputPathQueue) const

virtual ChartRuleLookupManager * CreateRuleLookupManager (const ChartParser &, const ChartCellCollectionBase &, std::size_t)

Create a sentence-specific manager for SCFG rule lookup.

TO_STRING ()

Protected Types

typedef boost::unordered_map
< uint64_t,
TargetPhraseCollection * > CachePb

Protected Member Functions

void CreateAlignmentMap (const std::string path)

TargetPhraseCollection::shared_ptr CreateTargetPhrase (const Phrase &sourcePhrase) const

std::pair< bool, uint64_t > GetKey (const Phrase &sourcePhrase) const

void GetSourceProbingIds (const Phrase &sourcePhrase, bool &ok, uint64_t probingSource[]) const

uint64_t GetSourceProbingId (const Word &word) const

uint64_t GetSourceProbingId (const Factor *factor) const

TargetPhraseCollection * CreateTargetPhrases (const Phrase &sourcePhrase, uint64_t key) const

TargetPhrase * CreateTargetPhrase (const char *&offset) const

const Factor * GetTargetFactor (uint32_t probingId) const

Protected Attributes

probingpt::QueryEngine * m_engine

uint64_t m_unkId

std::vector< uint64_t > m_sourceVocab

std::vector< const Factor * > m_targetVocab

std::vector< const
AlignmentInfo * > m_aligns

util::LoadMethod load_method

boost::iostreams::mapped_file_source file

const char * data

CachePb m_cachePb

Friends

std::ostream & operator<< (std::ostream &, const ProbingPT &)

Detailed Description

Definition at line 21 of file ProbingPT.h.

Member Typedef Documentation

typedef boost::unordered_map<uint64_t, TargetPhraseCollection*> Moses::ProbingPT::CachePb [protected]

Definition at line 60 of file ProbingPT.h.

Constructor & Destructor Documentation

Moses::ProbingPT::ProbingPT ( const std::string & line )

Definition at line 14 of file ProbingPT.cpp.

References Moses::DecodeFeature::m_input, Moses::DecodeFeature::m_output, and Moses::FeatureFunction::ReadParameters().

Here is the call graph for this function:

Moses::ProbingPT::~ProbingPT ( )

Definition at line 25 of file ProbingPT.cpp.

References m_engine.

Member Function Documentation

void Moses::ProbingPT::CreateAlignmentMap ( const std::string path ) [protected]

Definition at line 98 of file ProbingPT.cpp.

References Moses::AlignmentInfoCollection::Instance(), m_aligns, m_engine, and NULL.

Referenced by Load().

Here is the call graph for this function:

Here is the caller graph for this function:

ChartRuleLookupManager * Moses::ProbingPT::CreateRuleLookupManager	(	const ChartParser &	,
		const ChartCellCollectionBase &	,
		std::size_t
	)			`[virtual]`

Create a sentence-specific manager for SCFG rule lookup.

Implements Moses::PhraseDictionary.

Definition at line 356 of file ProbingPT.cpp.

References NULL.

TargetPhrase * Moses::ProbingPT::CreateTargetPhrase ( const char *& offset ) const [protected]

Definition at line 279 of file ProbingPT.cpp.

References Moses::Phrase::AddWord(), Moses::FloorScore(), Moses::TargetPhrase::GetScoreBreakdown(), GetTargetFactor(), m_aligns, m_engine, Moses::DecodeFeature::m_output, Moses::ScoreComponentCollection::PlusEquals(), Moses::TargetPhrase::SetAlignTerm(), Moses::TransformScore(), and UTIL_THROW_IF2.

Here is the call graph for this function:

TargetPhraseCollection::shared_ptr Moses::ProbingPT::CreateTargetPhrase ( const Phrase & sourcePhrase ) const [protected]

Definition at line 163 of file ProbingPT.cpp.

References CreateTargetPhrases(), GetKey(), Moses::Phrase::GetSize(), and m_cachePb.

Referenced by CreateTargetPhrases(), and GetTargetPhraseCollectionBatch().

Here is the call graph for this function:

Here is the caller graph for this function:

TargetPhraseCollection * Moses::ProbingPT::CreateTargetPhrases	(	const Phrase &	sourcePhrase,
		uint64_t	key
	)			const `[protected]`

Definition at line 245 of file ProbingPT.cpp.

References Moses::TargetPhraseCollection::Add(), CreateTargetPhrase(), data, Moses::TargetPhrase::EvaluateInIsolation(), Moses::PhraseDictionary::GetFeaturesToApply(), m_engine, Moses::PhraseDictionary::m_tableLimit, NULL, and Moses::TargetPhraseCollection::Prune().

Referenced by CreateTargetPhrase().

Here is the call graph for this function:

Here is the caller graph for this function:

std::pair< bool, uint64_t > Moses::ProbingPT::GetKey ( const Phrase & sourcePhrase ) const [protected]

Definition at line 187 of file ProbingPT.cpp.

References Moses::Phrase::GetSize(), GetSourceProbingIds(), and m_engine.

Referenced by CreateTargetPhrase().

Here is the call graph for this function:

Here is the caller graph for this function:

uint64_t Moses::ProbingPT::GetSourceProbingId ( const Factor * factor ) const [protected]

uint64_t Moses::ProbingPT::GetSourceProbingId ( const Word & word ) const [protected]

Definition at line 227 of file ProbingPT.cpp.

References Moses::Factor::GetId(), Moses::DecodeFeature::m_input, m_sourceVocab, and m_unkId.

Referenced by GetSourceProbingIds().

Here is the call graph for this function:

Here is the caller graph for this function:

void Moses::ProbingPT::GetSourceProbingIds	(	const Phrase &	sourcePhrase,
		bool &	ok,
		uint64_t	probingSource[]
	)			const `[protected]`

Definition at line 208 of file ProbingPT.cpp.

References Moses::Phrase::GetSize(), GetSourceProbingId(), Moses::Phrase::GetWord(), and m_unkId.

Referenced by GetKey().

Here is the call graph for this function:

Here is the caller graph for this function:

const Factor* Moses::ProbingPT::GetTargetFactor ( uint32_t probingId ) const [inline, protected]

Definition at line 78 of file ProbingPT.h.

References m_targetVocab, and NULL.

Referenced by CreateTargetPhrase().

Here is the caller graph for this function:

void Moses::ProbingPT::GetTargetPhraseCollectionBatch ( const InputPathList & inputPathQueue ) const [virtual]

Reimplemented from Moses::PhraseDictionary.

Definition at line 147 of file ProbingPT.cpp.

References CreateTargetPhrase(), Moses::InputPath::GetPhrase(), Moses::Phrase::GetSize(), Moses::FeatureFunction::m_options, NULL, and Moses::InputPath::SetTargetPhrases().

Here is the call graph for this function:

void Moses::ProbingPT::InitializeForInput ( ttasksptr const & ttask ) [virtual]

Create entry for translation of source to targetPhrase.

Reimplemented from Moses::PhraseDictionary.

Definition at line 142 of file ProbingPT.cpp.

void Moses::ProbingPT::Load ( AllOptions::ptr const & opts ) [virtual]

override to load model files

Reimplemented from Moses::FeatureFunction.

Definition at line 30 of file ProbingPT.cpp.

References Moses::FactorCollection::AddFactor(), CreateAlignmentMap(), data, file, Moses::Factor::GetId(), Moses::FactorCollection::Instance(), load_method, m_engine, Moses::PhraseDictionary::m_filePath, Moses::FeatureFunction::m_options, m_sourceVocab, m_targetVocab, m_unkId, Moses::PhraseDictionary::SetFeaturesToApply(), Moses::Tokenize(), and UTIL_THROW_IF2.

Here is the call graph for this function:

void Moses::ProbingPT::SetParameter	(	const std::string &	key,
		const std::string &	value
	)			`[virtual]`

Reimplemented from Moses::PhraseDictionary.

Definition at line 120 of file ProbingPT.cpp.

References util::LAZY, load_method, util::PARALLEL_READ, util::POPULATE_OR_LAZY, util::POPULATE_OR_READ, util::READ, and UTIL_THROW2.

Moses::ProbingPT::TO_STRING ( )

Friends And Related Function Documentation

std::ostream& operator<<	(	std::ostream &	,
		const ProbingPT &
	)			`[friend]`

Member Data Documentation

const char* Moses::ProbingPT::data [protected]

Definition at line 57 of file ProbingPT.h.

Referenced by CreateTargetPhrases(), and Load().

boost::iostreams::mapped_file_source Moses::ProbingPT::file [protected]

Definition at line 56 of file ProbingPT.h.

Referenced by Load().

util::LoadMethod Moses::ProbingPT::load_method [protected]

Definition at line 54 of file ProbingPT.h.

Referenced by Load(), and SetParameter().

std::vector<const AlignmentInfo*> Moses::ProbingPT::m_aligns [protected]

Definition at line 53 of file ProbingPT.h.

Referenced by CreateAlignmentMap(), and CreateTargetPhrase().

CachePb Moses::ProbingPT::m_cachePb [protected]

Definition at line 61 of file ProbingPT.h.

Referenced by CreateTargetPhrase().

probingpt::QueryEngine* Moses::ProbingPT::m_engine [protected]

Definition at line 48 of file ProbingPT.h.

Referenced by CreateAlignmentMap(), CreateTargetPhrase(), CreateTargetPhrases(), GetKey(), Load(), and ~ProbingPT().

std::vector<uint64_t> Moses::ProbingPT::m_sourceVocab [protected]

Definition at line 51 of file ProbingPT.h.

Referenced by GetSourceProbingId(), and Load().

std::vector<const Factor*> Moses::ProbingPT::m_targetVocab [protected]

Definition at line 52 of file ProbingPT.h.

Referenced by GetTargetFactor(), and Load().

uint64_t Moses::ProbingPT::m_unkId [protected]

Definition at line 49 of file ProbingPT.h.

Referenced by GetSourceProbingId(), GetSourceProbingIds(), and Load().

The documentation for this class was generated from the following files:

/disk4/html/www/moses/doxygen/mosesdecoder/moses/TranslationModel/ProbingPT.h
/disk4/html/www/moses/doxygen/mosesdecoder/moses/TranslationModel/ProbingPT.cpp


Public Member Functions
	ProbingPT (const std::string &line)
	~ProbingPT ()
void	Load (AllOptions::ptr const &opts)
	override to load model files
void	InitializeForInput (ttasksptr const &ttask)
	Create entry for translation of source to targetPhrase.
void	SetParameter (const std::string &key, const std::string &value)
void	GetTargetPhraseCollectionBatch (const InputPathList &inputPathQueue) const
virtual ChartRuleLookupManager *	CreateRuleLookupManager (const ChartParser &, const ChartCellCollectionBase &, std::size_t)
	Create a sentence-specific manager for SCFG rule lookup.
	TO_STRING ()
Protected Types
typedef boost::unordered_map < uint64_t, TargetPhraseCollection * >	CachePb
Protected Member Functions
void	CreateAlignmentMap (const std::string path)
TargetPhraseCollection::shared_ptr	CreateTargetPhrase (const Phrase &sourcePhrase) const
std::pair< bool, uint64_t >	GetKey (const Phrase &sourcePhrase) const
void	GetSourceProbingIds (const Phrase &sourcePhrase, bool &ok, uint64_t probingSource[]) const
uint64_t	GetSourceProbingId (const Word &word) const
uint64_t	GetSourceProbingId (const Factor *factor) const
TargetPhraseCollection *	CreateTargetPhrases (const Phrase &sourcePhrase, uint64_t key) const
TargetPhrase *	CreateTargetPhrase (const char *&offset) const
const Factor *	GetTargetFactor (uint32_t probingId) const
Protected Attributes
probingpt::QueryEngine *	m_engine
uint64_t	m_unkId
std::vector< uint64_t >	m_sourceVocab
std::vector< const Factor * >	m_targetVocab
std::vector< const AlignmentInfo * >	m_aligns
util::LoadMethod	load_method
boost::iostreams::mapped_file_source	file
const char *	data
CachePb	m_cachePb
Friends
std::ostream &	operator<< (std::ostream &, const ProbingPT &)