A language model is usually a probabilistic model of a pure language.[1] In 1980, the first important statistical language model was proposed, And through the ten years IBM performed ‘Shannon-type’ experiments, through which probable sources for language modeling advancement have been determined by observing and examining the effectiveness of h