A comparative analysis of text data classification accuracy and speed using neural networks, Bloom filter and naive Bayes
Year:
2021Published in:
Technology Center PCThe object of research is the methods of fast classification for solving text data classification problems. The need for this study is due to the rapid growth of textual data, both in digital and printed forms. Thus, there is a need to process such data using software, since human resources are not able to process such an amount of data in full. A large number of data classification approaches have been developed. The conducted research is based on the application of the following methods of classification of text data: Bloom filter, naive Bayesian classifier and neural networks to a set of text data in order to classify them into categories. Each method has both disadvantages and advantages. This paper will reflect the strengths and weaknesses of each method on a specific example. These algorithms were comparatively among themselves in terms of speed and efficiency, that is, the accuracy of determining the belonging of a text to a certain class of classification. The work of each method was considered on the same data sets with a change in the amount of training and test data, as well as with a change in the number of classification groups. The dataset used contains the following classes: world, business, sports, and science and technology. In real conditions of the classification of such data, the number of categories is much larger than that considered in the work, and may have subcategories in its composition. In the course of this study, each method was analyzed using different parameter values to obtain the best result. Analyzing the results obtained, the best results for the classification of text data were obtained using a neural network.
Related by author
12 publications found
The development of an electronic circuit simulation system using variable tabular bases
Publisher: Technology Center PC
Authors: Vadym Yaremenko, Bogdan Bulakh, Yaroslav Kornachevskyy, Oleksandr Beznosyk, Kostyantyn Kharchenko
A theoretically proposed algorithm in a decision tree format for choosing an efficient storage type of large datasets
Publisher: Technology Center PC
Authors: Sofiia Materynska, Vadym Yaremenko, Walery Rogoza
МОДЕЛЬ МУЛЬТИАГЕНТНОЇ СИСТЕМИ ДЛЯ СЕМАНТИЧНОГО АНАЛІЗУ ТЕКСТІВ
Publisher: Луцький національний технічний університет
Authors: Vadym Yaremenko, Andrii Khudiakov
COMPARATIVE ANALYSIS OF SOFTWARE LIBRARIES FOR THE CLASSIFICATION OF TEXT DATA USING ARTIFICIAL NEURAL NETWORKS
Publisher: Таврійський національний університет ім. В.І. Вернадського
Authors: Vadym Yaremenko, Mykola Tarasenko
Development of a Multi‑Agent System for Solving Domain Dictionary Construction Problem
Publisher: SSRN
Authors: Vadym Yaremenko, Oleksandr Syrotiuk
Forecasting software development costs in scrum iterations using ordinary least squares method
Publisher: Technology Center PC
Authors: Vadym Yaremenko, Kostyantyn Kharchenko, Oleksandr Beznosyk, Bogdan Bulakh, Bogdan Kyriusha
Використання штучних нейронних мереж для визначення наявності сердцево‑судинних хвороб та захворювань печінки при малих наборах даних.
Publisher: Луцький національний технічний університет
Authors: Vadym Yaremenko, Sofiia Materynska
Підхід до використання фільтра блума для багатокласової класифікації текстових даних в режимі реального часу.
Publisher: Technology Center PC
Authors: Vadym Yaremenko, Dmytro Budonnyi
Neural Networks and Monte‑Carlo Method Usage in Multi‑Agent Systems for Sudoku Problem Solving
Publisher: SSRN
Authors: Vadym Yaremenko, Kateryna Poloziuk
Mobile Driving License System Deployment Model With Security Enhancement
Publisher: Theoretical and cryptographic problems of cybersecurity
Authors: Vadym Yaremenko, V. Blynkov