Transliteration with Finite State Machines

Since transliteration is a monotone process without reordering, finite state machines have been used in early work.

Transliteration With FSM is the main subject of 9 publications. 8 are discussed here.

Publications

Knight and Graehl (1997) present a model that maps between letters and phoneme representations. Such models may be extended by using a larger Markov window during mappings, i.e. using a larger context (Jung et al., 2000). Schafer (2006) compares a number of different finite state transducer architectures. For closely related language pairs, such as Hindi–Urdu, deterministic finite state machines may suffice (Malik et al., 2008). Transliteration may use either phonetic representation to match characters of different writing systems (Knight and Graehl, 1997) or map characters directly (Zhang et al., 2004). Phoneme and grapheme information may be combined (Bilac and Tanaka, 2004). Given small training corpora, using phonetic representations may be more robust (Yoon et al., 2007).

Benchmarks

Discussion

Related Topics

New Publications

• Knight, Kevin (2009): Automata for Transliteration and Machine Translation, Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009)

  DELETEIntroduction   ResearchGroups   AvailableSoftware   SpeechTranslation   SignLanguage   ComputerAidedTranslation   OtherApproaches   Deployment Data   ParallelCorpora   ComparableCorpora   Dictionaries   CorpusCleaning   SentenceAlignment   Truecasing   WordSegmentation   SpellingCorrection   SparseData   PivotLanguages   DomainAdaptation WordBasedModels   IBMModels   Symmetrization   WordAlignment     WordAlignmentBasedOnCoocurrence     WordAlignmentWithLinguisticAnnotation     WordAlignmentForSyntaxBasedModels     DiscriminativeWordAlignment     WordAlignmentCombination     WordAlignmentEvaluation     AlignmentOfSubsententialUnits   DictionariesFromComparableCorpora   LexicalChoice   MTWithoutWordAlignment PhraseBasedModels   PhraseBasedModelTraining   PhraseBasedModelEM   PhraseBasedModelRefinement   ContextFeatures   Smoothing   Paraphrasing   PruningLargeModels   SuffixArrays   ReorderingModels   PhraseBasedVsEBMT SyntaxBasedModels   InversionTransductionGrammars   HierarchicalModels   StringToTree   TreeToString   TreeToTree   BinarizingSCFG   GenerativeSyntaxModels   DependencyStructure   DeepSyntax   ParseQuality   ParallelTreebanks   SyntacticCoherence LinguisticProblems   UnknownWords   Morphology   GeneratingRichMorphology   FactoredTranslationModels   Compounds   TranslatingTenseCaseMarkers   TranslatingChunksAndClauses   DocumentLevelAspects   Transliteration     TransliterationWithFSM     TransliterationWithOtherMethods     ForwardTransliteration     TransliterationTrainingData     IntegratingTransliteration   SyntacticPrereordering   POSChunkPrereordering   SyntacticReranking   IntegratingSyntacticFeatures LanguageModels   NGramLanguageModels   TargetedLanguageModels   MorphologicalLanguageModels   VeryLargeLanguageModels Decoding   StackDecoding   ReorderingConstraints   WordBasedDecoding   FiniteStateMachines   DecodingComplexity   SyntaxModelDecoding Evaluation   EvaluationCampaigns   ManualMetrics   TaskBasedMetrics   EditRateMetrics   NGramMetrics   SyntaxBasedMetrics   CorrelationOfMetrics   TrainedMetrics   TranslationDifficulty   StatisticalSignificance MachineLearning   WordGraphs   ParameterTuning   Reranking   LargeScaleDiscriminativeTraining   MinimumBayesRisk   ConfidenceMeasures   SystemCombination   IncrementalUpdating NeuralNetworkModels   NeuralLanguageModels   AttentionModel   Training   Inference   Coverage   Vocabulary   Embeddings   MultilingualWordEmbeddings   MonolingualData   Adaptation   LinguisticAnnotation   MultilingualMultimodalMultitask   AlternativeArchitectures   AnalysisAndVisualization   NeuralComponentsInStatisticalMachineTranslation add

  

  @InProceedings{knight:2009:NEWS,
  author = {Knight, Kevin},
  title = {Automata for Transliteration and Machine Translation},
  booktitle = {Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009)},
  month = {August},
  address = {Suntec, Singapore},
  publisher = {Association for Computational Linguistics},
  pages = {27},
  url = {http://www.aclweb.org/anthology/W/W09/W09-3503},
  year = 2009
  }
  Knight (2009)