#include <vocab.hh>
Public Member Functions | |
template<class NewWordConstruct > | |
GrowableVocab (WordIndex initial_size, const NewWordConstruct &new_word_construct=NewWordAction()) | |
WordIndex | Index (const StringPiece &str) const |
WordIndex | FindOrInsert (const StringPiece &word) |
WordIndex | Size () const |
Static Public Member Functions | |
static std::size_t | MemUsage (WordIndex content) |
Definition at line 237 of file vocab.hh.
lm::ngram::GrowableVocab< NewWordAction >::GrowableVocab | ( | WordIndex | initial_size, | |
const NewWordConstruct & | new_word_construct = NewWordAction() | |||
) | [inline] |
Definition at line 244 of file vocab.hh.
References lm::ngram::GrowableVocab< NewWordAction >::FindOrInsert().
WordIndex lm::ngram::GrowableVocab< NewWordAction >::FindOrInsert | ( | const StringPiece & | word | ) | [inline] |
Definition at line 256 of file vocab.hh.
References StringPiece::data(), util::AutoProbing< EntryT, HashT, EqualT >::FindOrInsert(), lm::ngram::ProbingVocabularyEntry::Make(), util::MurmurHashNative(), lm::ngram::GrowableVocab< NewWordAction >::Size(), StringPiece::size(), and UTIL_THROW_IF.
Referenced by lm::ngram::GrowableVocab< NewWordAction >::GrowableVocab(), and lm::builder::CorpusCount::Run().
WordIndex lm::ngram::GrowableVocab< NewWordAction >::Index | ( | const StringPiece & | str | ) | const [inline] |
Definition at line 251 of file vocab.hh.
References util::AutoProbing< EntryT, HashT, EqualT >::Find(), and lm::ngram::detail::HashForVocab().
Referenced by lm::builder::CorpusCount::Run().
static std::size_t lm::ngram::GrowableVocab< NewWordAction >::MemUsage | ( | WordIndex | content | ) | [inline, static] |
Definition at line 239 of file vocab.hh.
References util::AutoProbing< ProbingVocabularyEntry, util::IdentityHash >::MemUsage().
WordIndex lm::ngram::GrowableVocab< NewWordAction >::Size | ( | ) | const [inline] |
Definition at line 266 of file vocab.hh.
References util::AutoProbing< EntryT, HashT, EqualT >::Size().
Referenced by lm::ngram::GrowableVocab< NewWordAction >::FindOrInsert(), and lm::builder::CorpusCount::Run().