interplm Class Reference

#include <interplm.h>

Inheritance diagram for interplm:

Collaboration diagram for interplm:

List of all members.

Public Member Functions

interplm (char *ngtfile, int depth=0, TABLETYPE tt=FULL)

int prunesingletons (int flag=-1)

int prunetopsingletons (int flag=-1)

void gencorrcounts ()

void gensuccstat ()

virtual int dub ()

virtual int dub (int value)

int setusmooth (int v=0)

double setepsilon (double v=1.0)

void trainunigr ()

double unigr (ngram ng)

double zerofreq (int lev)

int lmsize ()

int obswrd ()

virtual int train ()

virtual void adapt (char *ngtfile, double w)

virtual double prob (ngram ng, int size)

virtual double boprob (ngram ng, int size)

void test_ngt (ngramtable &ngt, int sz=0, int backoff=0, int checkpr=0)

void test_txt (char *filename, int sz=0, int backoff=0, int checkpr=0, char *outpr=NULL)

void test (char *filename, int sz, int backoff=0, int checkpr=0, char *outpr=NULL)

virtual int discount (ngram ng, int size, double &fstar, double &lambda, int cv=0)

virtual int savebin (char *filename, int lmsize=2)

virtual int netsize ()

void lmstat (int level)

virtual ~interplm ()

Public Attributes

int backoff

ngramtable * unitbl

Detailed Description

Definition at line 33 of file interplm.h.

Constructor & Destructor Documentation

interplm::interplm	(	char *	ngtfile,
		int	depth = `0`,
		TABLETYPE	tt = `FULL`
	)

Definition at line 79 of file interplm.cpp.

References dictionary::BoS(), dictionary::decode(), ngramtable::dict, dictionary::encode(), dictionary::freq(), ngramtable::maxlevel(), NULL, dictionary::oovcode(), and unitbl.

Here is the call graph for this function:

virtual interplm::~interplm ( ) [inline, virtual]

Definition at line 105 of file interplm.h.

Member Function Documentation

virtual void interplm::adapt	(	char *	ngtfile,
		double	w
	)			`[inline, virtual]`

Definition at line 85 of file interplm.h.

virtual double interplm::boprob	(	ngram	ng,
		int	size
	)			`[inline, virtual]`

Definition at line 89 of file interplm.h.

virtual int interplm::discount	(	ngram	ng,
		int	size,
		double &	fstar,
		double &	lambda,
		int	cv = `0`
	)			`[inline, virtual]`

Reimplemented in linearwb, mdiadaptlm, mixture, shiftone, shiftbeta, symshiftbeta, and mshiftbeta.

Definition at line 97 of file interplm.h.

Referenced by mixture::discount(), mdiadaptlm::foreunig(), and mixture::train().

Here is the caller graph for this function:

virtual int interplm::dub ( int value ) [inline, virtual]

Reimplemented in mixture.

Definition at line 65 of file interplm.h.

References ngramtable::dict, and dictionary::dub().

Here is the call graph for this function:

virtual int interplm::dub ( ) [inline, virtual]

Reimplemented in mixture.

Definition at line 63 of file interplm.h.

References ngramtable::dict, and dictionary::dub().

Referenced by mixture::dub(), main(), and mixture::train().

Here is the call graph for this function:

Here is the caller graph for this function:

void interplm::gencorrcounts ( )

Definition at line 146 of file interplm.cpp.

References dictionary::BoS(), ngramtable::btotfreq(), CONT, ngram::containsWord(), ngramtable::corrcounts, ngramtable::dict, dictionary::encode(), ngramtable::freq(), ngram::freq, ngramtable::getfreq(), INIT, ngram::link, ngramtable::maxlevel(), dictionary::oovcode(), ngram::pinfo, ngram::pushw(), ngramtable::put(), ngramtable::scan(), ngramtable::setfreq(), dictionary::size(), ngram::size, and ngram::wordp().

Referenced by mshiftbeta::train().

Here is the call graph for this function:

Here is the caller graph for this function:

void interplm::gensuccstat ( )

Definition at line 108 of file interplm.cpp.

References CONT, ngramtable::corrcounts, ngramtable::dict, ngram::freq, ngramtable::getfreq(), INIT, ngram::link, ngram::pinfo, ngram::pushc(), ngramtable::scan(), ngramtable::succ1(), ngramtable::succ2(), and ngramtable::succscan().

Referenced by mshiftbeta::train(), and linearwb::train().

Here is the call graph for this function:

Here is the caller graph for this function:

int interplm::lmsize ( ) [inline]

Definition at line 79 of file interplm.h.

Referenced by mdiadaptlm::adapt(), mdiadaptlm::compute_backoff(), mshiftbeta::discount(), mixture::loadpar(), mshiftbeta::mfreq(), mdiadaptlm::saveARPA(), mdiadaptlm::saveASR(), mdiadaptlm::saveMT(), mixture::savepar(), shiftbeta::shiftbeta(), test(), mshiftbeta::train(), shiftbeta::train(), and mixture::train().

Here is the caller graph for this function:

void interplm::lmstat ( int level ) [inline]

Definition at line 103 of file interplm.h.

References ngramtable::stat().

Referenced by main().

Here is the call graph for this function:

Here is the caller graph for this function:

virtual int interplm::netsize ( ) [inline, virtual]

Reimplemented in mdiadaptlm.

Definition at line 101 of file interplm.h.

int interplm::obswrd ( ) [inline]

Definition at line 81 of file interplm.h.

References ngramtable::dict, and dictionary::size().

Referenced by test_ngt(), and test_txt().

Here is the call graph for this function:

Here is the caller graph for this function:

virtual double interplm::prob	(	ngram	ng,
		int	size
	)			`[inline, virtual]`

Reimplemented in mdiadaptlm.

Definition at line 87 of file interplm.h.

Referenced by test_ngt(), and test_txt().

Here is the caller graph for this function:

int interplm::prunesingletons ( int flag = -1 ) [inline]

Definition at line 51 of file interplm.h.

Referenced by mshiftbeta::discount(), shiftbeta::discount(), linearwb::discount(), and main().

Here is the caller graph for this function:

int interplm::prunetopsingletons ( int flag = -1 ) [inline]

Definition at line 55 of file interplm.h.

Referenced by mshiftbeta::discount(), and main().

Here is the caller graph for this function:

virtual int interplm::savebin	(	char *	filename,
		int	lmsize = `2`
	)			`[inline, virtual]`

Reimplemented from ngramtable.

Definition at line 99 of file interplm.h.

double interplm::setepsilon ( double v = 1.0 ) [inline]

Definition at line 69 of file interplm.h.

int interplm::setusmooth ( int v = 0 ) [inline]

Definition at line 67 of file interplm.h.

void interplm::test	(	char *	filename,
		int	sz,
		int	backoff = `0`,
		int	checkpr = `0`,
		char *	outpr = `NULL`
	)

Definition at line 336 of file interplm.cpp.

References mfstream::close(), COUNT, lmsize(), NULL, test_ngt(), and test_txt().

Referenced by main().

Here is the call graph for this function:

Here is the caller graph for this function:

void interplm::test_ngt	(	ngramtable &	ngt,
		int	sz = `0`,
		int	backoff = `0`,
		int	checkpr = `0`
	)

Definition at line 434 of file interplm.cpp.

References dictionary::BoS(), CONT, ngramtable::dict, dictionary::dub(), dictionary::encode(), ngram::freq, INIT, ngramtable::maxlevel(), obswrd(), dictionary::oovcode(), prob(), ngramtable::scan(), dictionary::size(), ngram::size, ngram::trans(), and ngram::wordp().

Referenced by test().

Here is the call graph for this function:

Here is the caller graph for this function:

void interplm::test_txt	(	char *	filename,
		int	sz = `0`,
		int	backoff = `0`,
		int	checkpr = `0`,
		char *	outpr = `NULL`
	)

Definition at line 361 of file interplm.cpp.

References dictionary::BoS(), mfstream::close(), ngramtable::dict, dictionary::dub(), dictionary::encode(), obswrd(), dictionary::oovcode(), prob(), dictionary::size(), ngram::size, and ngram::wordp().

Referenced by test().

Here is the call graph for this function:

Here is the caller graph for this function:

virtual int interplm::train ( ) [inline, virtual]

Reimplemented in linearwb, mixture, shiftone, shiftbeta, and mshiftbeta.

Definition at line 83 of file interplm.h.

Referenced by main(), mdiadaptlm::scalefact(), and mixture::train().

Here is the caller graph for this function:

void interplm::trainunigr ( )

Definition at line 35 of file interplm.cpp.

References ngramtable::dict, dictionary::dub(), dictionary::encode(), dictionary::freq(), dictionary::getcode(), dictionary::incfreq(), dictionary::OOV(), dictionary::oovcode(), dictionary::size(), and dictionary::totfreq().

Referenced by mshiftbeta::train(), shiftbeta::train(), shiftone::train(), and linearwb::train().

Here is the call graph for this function:

Here is the caller graph for this function:

double interplm::unigr ( ngram ng )

Definition at line 70 of file interplm.cpp.

References ngramtable::dict, dictionary::freq(), dictionary::size(), dictionary::totfreq(), and ngram::wordp().

Referenced by symshiftbeta::discount(), shiftbeta::discount(), shiftone::discount(), and linearwb::discount().

Here is the call graph for this function:

Here is the caller graph for this function:

double interplm::zerofreq ( int lev )

Definition at line 320 of file interplm.cpp.

References CONT, ngramtable::dict, ngram::freq, INIT, dictionary::oovcode(), ngramtable::scan(), and ngram::wordp().

Referenced by mixture::train().

Here is the call graph for this function:

Here is the caller graph for this function:

Member Data Documentation

int interplm::backoff

Definition at line 47 of file interplm.h.

Referenced by mdiadaptlm::bodiscount(), mdiadaptlm::compute_backoff(), mdiadaptlm::prob(), and mixture::train().

ngramtable* interplm::unitbl

Definition at line 71 of file interplm.h.

Referenced by interplm().

The documentation for this class was generated from the following files:

irstlm/src/interplm.h
irstlm/src/interplm.cpp


Public Member Functions
	interplm (char *ngtfile, int depth=0, TABLETYPE tt=FULL)
int	prunesingletons (int flag=-1)
int	prunetopsingletons (int flag=-1)
void	gencorrcounts ()
void	gensuccstat ()
virtual int	dub ()
virtual int	dub (int value)
int	setusmooth (int v=0)
double	setepsilon (double v=1.0)
void	trainunigr ()
double	unigr (ngram ng)
double	zerofreq (int lev)
int	lmsize ()
int	obswrd ()
virtual int	train ()
virtual void	adapt (char *ngtfile, double w)
virtual double	prob (ngram ng, int size)
virtual double	boprob (ngram ng, int size)
void	test_ngt (ngramtable &ngt, int sz=0, int backoff=0, int checkpr=0)
void	test_txt (char filename, int sz=0, int backoff=0, int checkpr=0, char outpr=NULL)
void	test (char filename, int sz, int backoff=0, int checkpr=0, char outpr=NULL)
virtual int	discount (ngram ng, int size, double &fstar, double &lambda, int cv=0)
virtual int	savebin (char *filename, int lmsize=2)
virtual int	netsize ()
void	lmstat (int level)
virtual	~interplm ()
Public Attributes
int	backoff
ngramtable *	unitbl