A language model is actually a probabilistic model of a pure language.[1] In 1980, the main considerable statistical language model was proposed, and during the ten years IBM executed ‘Shannon-fashion’ experiments, in which prospective sources for language modeling improvement were d