#include <Vocabulary.h>
Public Member Functions | |
WORD_ID | StoreIfNew (const WORD &) |
WORD_ID | GetWordID (const WORD &) |
std::vector< WORD_ID > | Tokenize (const char[]) |
WORD & | GetWord (WORD_ID id) const |
Public Attributes | |
std::map< WORD, WORD_ID > | lookup |
std::vector< WORD > | vocab |
Definition at line 23 of file Vocabulary.h.
Definition at line 31 of file Vocabulary.h.
References vocab.
Referenced by tmmt::SuffixArray::CompareWord(), tmmt::SentenceAlignment::getTargetString(), and tmmt::FuzzyMatchWrapper::letter_sed().
Definition at line 35 of file Vocabulary.cpp.
Referenced by Tokenize().
vector< WORD_ID > tmmt::Vocabulary::Tokenize | ( | const char | input[] | ) |
Definition at line 13 of file Vocabulary.cpp.
References StoreIfNew().
std::map<WORD, WORD_ID> tmmt::Vocabulary::lookup |
std::vector< WORD > tmmt::Vocabulary::vocab |