Asosiy kontentga oʻtish
Preprint

Text classification dataset and analysis for Uzbek language

Elmurod KuriyozovUrgench State University , 14 , Kh.Alimdjan str , Urgench city , 220100 , UzbekistanUlugbek SalaevUrgench State University , 14 , Kh.Alimdjan str , Urgench city , 220100 , UzbekistanSanatbek MatlatipovNational University of Uzbekistan named after Mirzo Ulugbek , 4 Universitet St , Tashkent , 100174 , UzbekistanGayrat MatlatipovUrgench State University , 14 , Kh.Alimdjan str , Urgench city , 220100 , Uzbekistan
2023en
ABI

Annotatsiya

Text classification is an important task in Natural Language Processing (NLP), where the goal is to categorize text data into predefined classes. In this study, we analyse the dataset creation steps and evaluation techniques of multi-label news categorisation task as part of text classification. We first present a newly obtained dataset for Uzbek text classification, which was collected from 10 different news and press websites and covers 15 categories of news, press and law texts. We also present a comprehensive evaluation of different models, ranging from traditional bag-of-words models to deep learning architectures, on this newly created dataset. Our experiments show that the Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) based models outperform the rule-based models. The best performance is achieved by the BERTbek model, which is a transformer-based BERT model trained on the Uzbek corpus. Our findings provide a good baseline for further research in Uzbek text classification.

Hali tarjima qilinmagan

Identifikatorlar

Iqtiboslar va manbalar

1 ta iqtibos0 ta foydalanilgan manba