MosesTraining::Syntax::TreeFragmentTokenizer Class Reference

#include <tree_fragment_tokenizer.h>

Collaboration diagram for MosesTraining::Syntax::TreeFragmentTokenizer:

[legend]

List of all members.

Public Member Functions
	TreeFragmentTokenizer ()
	TreeFragmentTokenizer (const StringPiece &)
const TreeFragmentToken &	operator* () const
const TreeFragmentToken *	operator-> () const
TreeFragmentTokenizer &	operator++ ()
TreeFragmentTokenizer	operator++ (int)
Friends
bool	operator== (const TreeFragmentTokenizer &, const TreeFragmentTokenizer &)
bool	operator!= (const TreeFragmentTokenizer &, const TreeFragmentTokenizer &)

---

Detailed Description

Definition at line 43 of file tree_fragment_tokenizer.h.

---

Constructor & Destructor Documentation

MosesTraining::Syntax::TreeFragmentTokenizer::TreeFragmentTokenizer

(

)

Definition at line 17 of file tree_fragment_tokenizer.cc.

MosesTraining::Syntax::TreeFragmentTokenizer::TreeFragmentTokenizer

(

const StringPiece &

s

)

Definition at line 21 of file tree_fragment_tokenizer.cc.

---

Member Function Documentation

const TreeFragmentToken& MosesTraining::Syntax::TreeFragmentTokenizer::operator*

(

)

const [inline]

Definition at line 48 of file tree_fragment_tokenizer.h.

TreeFragmentTokenizer MosesTraining::Syntax::TreeFragmentTokenizer::operator++

(

int

)

Definition at line 68 of file tree_fragment_tokenizer.cc.

TreeFragmentTokenizer & MosesTraining::Syntax::TreeFragmentTokenizer::operator++

(

)

Definition at line 30 of file tree_fragment_tokenizer.cc.

References StringPiece::substr(), MosesTraining::Syntax::TreeFragmentToken_EOS, MosesTraining::Syntax::TreeFragmentToken_LSB, MosesTraining::Syntax::TreeFragmentToken_RSB, and MosesTraining::Syntax::TreeFragmentToken_WORD.

Here is the call graph for this function:

const TreeFragmentToken* MosesTraining::Syntax::TreeFragmentTokenizer::operator->

(

)

const [inline]

Definition at line 49 of file tree_fragment_tokenizer.h.

---

Friends And Related Function Documentation

bool operator!=	(	const TreeFragmentTokenizer &	lhs,
		const TreeFragmentTokenizer &	rhs
	)			[friend]

Definition at line 84 of file tree_fragment_tokenizer.cc.

bool operator==	(	const TreeFragmentTokenizer &	lhs,
		const TreeFragmentTokenizer &	rhs
	)			[friend]

Definition at line 74 of file tree_fragment_tokenizer.cc.

---

The documentation for this class was generated from the following files:

• /disk4/html/www/moses/doxygen/mosesdecoder/phrase-extract/syntax-common/tree_fragment_tokenizer.h
• /disk4/html/www/moses/doxygen/mosesdecoder/phrase-extract/syntax-common/tree_fragment_tokenizer.cc