Lemmatization and stemming processes in automatic morphological analysis of Uzbek mants

In the field of natural language processing, the stages of graphematic analysis (tokenization), morphological analysis (lemmatization and stemming), syntactic analysis (parsing), and semantic analysis are important for almost all areas of NLP. It is possible to create many software applications from processed natural language for digital technology. In NLP, the lemmatization and stemming technologies of morphological analysis are common to all languages, and they determine the normal form of word forms in the dictionary. Although the task of lemmatization and stemming is the same, they differ in terms of producing the result. While stemming is valuable as a fast process, lemmatization is considered important in terms of providing a clear linguistic result. Although lemmatization with the feature of determining inflection was intended for inflectional languages, it is currently also used for agglutinative languages. Both technologies are important in the processing of the Uzbek language. This article discusses the similarities and differences between lemmatization and stemming, the use of both technologies in the Uzbek language, and the distinction between the term "morphological analysis" in NLP and Uzbek linguistics.

Hali tarjima qilinmagan