APPLICATION OF MACHINE LEARNING ALGORITHMS FOR PROCESSING COMMENTS FROM THE YOUTUBE VIDEO HOSTING UNDER TRAINING VIDEOS
Keywords:natural language processing, unstructured data, comments, classification, logistic regression, support vector ma-chine, stochastic gradient descent, random forest, strengthening the gradient, cross-validation
Purpose. Detecting toxic comments on YouTube video hosting under training videos by classifying unstructured text using a combination of machine learning methods. Methodology. To work with the specified type of data, machine learning methods were used for cleaning, normalizing, and presenting textual data in a form acceptable for processing on a computer. Directly to classify comments as “toxic”, we used a logistic regression classifier, a linear support vector classification method without and with a learning method – stochastic gradient descent, a random forest classifier and a gradient enhancement classifier. In order to assess the work of the classifiers, the methods of calculating the matrix of errors, accuracy, completeness and F-measure were used. For a more generalized assessment, a cross-validation method was used. Python programming language. Findings. Based on the assessment indicators, the most optimal methods were selected – support vector machine (Linear SVM), without and with the training method using stochastic gradient descent. The described technologies can be used to analyze the textual comments under any training videos to detect toxic reviews. Also, the approach can be useful for identifying unwanted or even aggressive information on social networks or services where reviews are provided. Originality. It consists in a combination of methods for preprocessing a specific type of text, taking into account such features as the possibility of having a timecode, emoji, links, and the like, as well as in the adaptation of classification methods of machine learning for the analysis of Russian-language comments. Practical value. It is about optimizing (simplification) the comment analysis process. The need for this processing is due to the growing volumes of text data, especially in the field of education through quarantine conditions and the transition to distance learning. The volume of educational Internet content already needs to automate the processing and analysis of feedback, over time this need will only grow.
Russell, M., & Klassen, M. (2020). Data Mining. Extracting information from Facebook, Twitter, Linkedln, Instagram, GitHub. St. Petersburg: Piter. (in Russan)
Anand, M., & Eswari, R. (2019). Classification of Abusive Comments in Social Media using Deep Learning. In 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC) (pp. 974-977). Erode, India. DOI: https://doi.org/10.1109/iccmc.2019.8819734 (in English)
Andročec, D. (2020). Machine learning methods for toxic comment classification: a systematic review. Acta Univ. Sapientiae Informatica, 12(2), 205-216. (in English)
Casselman, I., & Heinrich, M. (2011). Novel use patterns of Salvia divinorum: Unobtrusive observation using YouTube™. Journal of Ethnopharmacology, 138(3), 662-667. DOI: https://doi.org/10.1016/j.jep.2011.07.065 (in English)
Chakrabarty, N. (2019). A Machine Learning Approach to Comment Toxicity Classification. Advances in Intelli-gent Systems and Computing (pp. 183-193). DOI: https://doi.org/10.1007/978-981-13-9042-5_16 (in English)
Chary, M., Park, E. H., McKenzie, A., Sun, J., Manini, A. F., & Genes, N. (2014). Signs & Symptoms of Dextrome-thorphan Exposure from YouTube. PLoS ONE, 9(2), 1-10. DOI: https://doi.org/10.1371/journal.pone.0082452 (in English)
Hsu, C.-F., Caverlee, J., & Khabiri, E. (2011). Hierarchical comments-based clustering. SAC'11: Proceedings of the 2011 ACM Symposium on Applied Computing (рр. 1130-1137). DOI: https://doi.org/10.1145/1982185.1982434 (in English)
Jiang, M., Liang, Y., Feng, X., Fan, X., Pei, Z., Xue, Y., & Guan, R. (2016). Text classification based on deep belief network and softmax regression. Neural Computing and Applications, 29(1), 61-70. DOI: https://doi.org/10.1007/s00521-016-2401-x (in English)
Khabiri, E., Caverlee, J., & Hsu, C.-F. (2011). Summarizing User-Contributed Comments. Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media (рр. 354-357). (in English)
Srivastava, S., Khurana, P., & Tewari, V. (2018). Identifying Aggression and Toxicity in Comments using Capsule Network. Proceedings of the First Workshop on Trolling, Aggression and Cyberbullying (TRAC-2018) (рр. 98-105). (in English)
Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to Fine-Tune BERT for Text Classification? In Lecture Notes in Computer Science (pp. 194-206). DOI: https://doi.org/10.1007/978-3-030-32381-3_16 (in English)
Zaheri, S. Leath, J., & Stroud, D. (2020). Toxic Comment Classification. SMU Data Science Review, 3(1), 1-13. (in English)
How to Cite
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).