#include <tokenize_piece.hh>
Public Member Functions | |
BoolCharacter () | |
BoolCharacter (const bool *delimiter) | |
StringPiece | Find (const StringPiece &in) const |
Static Public Member Functions | |
template<unsigned Length> | |
static void | Build (const char(&characters)[Length], bool(&out)[256]) |
Definition at line 61 of file tokenize_piece.hh.
util::BoolCharacter::BoolCharacter | ( | ) | [inline] |
Definition at line 63 of file tokenize_piece.hh.
util::BoolCharacter::BoolCharacter | ( | const bool * | delimiter | ) | [inline, explicit] |
Definition at line 65 of file tokenize_piece.hh.
static void util::BoolCharacter::Build | ( | const char(&) | characters[Length], | |
bool(&) | out[256] | |||
) | [inline, static] |
Definition at line 74 of file tokenize_piece.hh.
Referenced by lm::builder::CorpusCount::Run().
StringPiece util::BoolCharacter::Find | ( | const StringPiece & | in | ) | const [inline] |
Definition at line 67 of file tokenize_piece.hh.
References StringPiece::data(), and StringPiece::size().