Search Descriptions

Main Topics

Search Publications


author

title

other

year

Use of Morphology in Language Models

Especially for morphologically rich languages, basing language models only on the surface form of words may lead to sparse data problems. For such languages it may be beneficial to make explicit use of the morphological analysis of words.

Morphological Language Models is the main subject of 3 publications.

Topics in LanguageModels

N Gram Language Models | Targeted Language Models | Morphological Language Models | Very Large Language Models

Publications

Factored language models were also used in statistical machine translation systems (Kirchhoff and Yang, 2005). For morphologically rich languages, better language models may predict individual morphemes. Sarikaya and Deng (2007) propose a joint morphological-lexical language model that uses maximum entropy classifiers to predict each morpheme.
Factored translation models (Koehn and Hoang, 2007) allow for the use of sequence models over part-of-speech or morphological tags.

Benchmarks

Discussion

Related Topics

New Publications

Actions

Download

Contribute