lm::ngram::ProbingVocabulary Class Reference

#include <vocab.hh>

Inheritance diagram for lm::ngram::ProbingVocabulary:

Inheritance graph
[legend]
Collaboration diagram for lm::ngram::ProbingVocabulary:

Collaboration graph
[legend]

List of all members.

Public Member Functions

 ProbingVocabulary ()
WordIndex Index (const StringPiece &str) const
WordIndex Bound () const
void SetupMemory (void *start, std::size_t allocated)
void SetupMemory (void *start, std::size_t allocated, std::size_t, const Config &)
void Relocate (void *new_start)
void ConfigureEnumerate (EnumerateVocab *to, std::size_t max_entries)
WordIndex Insert (const StringPiece &str)
template<class Weights >
void FinishedLoading (Weights *)
std::size_t UnkCountChangePadding () const
bool SawUnk () const
void LoadedBinary (bool have_words, int fd, EnumerateVocab *to, uint64_t offset)

Static Public Member Functions

static uint64_t Size (uint64_t entries, float probing_multiplier)
static uint64_t Size (uint64_t entries, const Config &config)


Detailed Description

Definition at line 156 of file vocab.hh.


Constructor & Destructor Documentation

lm::ngram::ProbingVocabulary::ProbingVocabulary (  ) 

Definition at line 248 of file vocab.cc.


Member Function Documentation

WordIndex lm::ngram::ProbingVocabulary::Bound (  )  const [inline]

Definition at line 170 of file vocab.hh.

void lm::ngram::ProbingVocabulary::ConfigureEnumerate ( EnumerateVocab to,
std::size_t  max_entries 
)

Definition at line 270 of file vocab.cc.

References lm::EnumerateVocab::Add().

Here is the call graph for this function:

template<class Weights >
void lm::ngram::ProbingVocabulary::FinishedLoading ( Weights *   )  [inline]

Definition at line 184 of file vocab.hh.

WordIndex lm::ngram::ProbingVocabulary::Index ( const StringPiece str  )  const [inline, virtual]

Implements lm::base::Vocabulary.

Definition at line 160 of file vocab.hh.

References util::ProbingHashTable< EntryT, HashT, EqualT, ModT >::Find(), and lm::ngram::detail::HashForVocab().

Referenced by LoadedBinary().

Here is the call graph for this function:

Here is the caller graph for this function:

WordIndex lm::ngram::ProbingVocabulary::Insert ( const StringPiece str  ) 

void lm::ngram::ProbingVocabulary::LoadedBinary ( bool  have_words,
int  fd,
EnumerateVocab to,
uint64_t  offset 
)

void lm::ngram::ProbingVocabulary::Relocate ( void *  new_start  ) 

Definition at line 265 of file vocab.cc.

References ALIGN8, and util::ProbingHashTable< EntryT, HashT, EqualT, ModT >::Relocate().

Referenced by lm::ngram::detail::HashedSearch< Value >::InitializeFromARPA().

Here is the call graph for this function:

Here is the caller graph for this function:

bool lm::ngram::ProbingVocabulary::SawUnk (  )  const [inline]

Definition at line 190 of file vocab.hh.

void lm::ngram::ProbingVocabulary::SetupMemory ( void *  start,
std::size_t  allocated,
std::size_t  ,
const Config  
) [inline]

Definition at line 174 of file vocab.hh.

References SetupMemory().

Here is the call graph for this function:

void lm::ngram::ProbingVocabulary::SetupMemory ( void *  start,
std::size_t  allocated 
)

Definition at line 258 of file vocab.cc.

References ALIGN8.

Referenced by SetupMemory().

Here is the caller graph for this function:

uint64_t lm::ngram::ProbingVocabulary::Size ( uint64_t  entries,
const Config config 
) [static]

Definition at line 254 of file vocab.cc.

References lm::ngram::Config::probing_multiplier, and Size().

Here is the call graph for this function:

uint64_t lm::ngram::ProbingVocabulary::Size ( uint64_t  entries,
float  probing_multiplier 
) [static]

Definition at line 250 of file vocab.cc.

References ALIGN8, and util::ProbingHashTable< ProbingVocabularyEntry, util::IdentityHash >::Size().

Referenced by Size().

Here is the call graph for this function:

Here is the caller graph for this function:

std::size_t lm::ngram::ProbingVocabulary::UnkCountChangePadding (  )  const [inline]

Definition at line 188 of file vocab.hh.

Referenced by lm::ngram::detail::HashedSearch< Value >::InitializeFromARPA().

Here is the caller graph for this function:


The documentation for this class was generated from the following files:

Generated on Thu Jul 6 00:32:46 2017 for Moses by  doxygen 1.5.9