Sentiment Analysis of Review Data: A Deep Learning Approach Using User-Generated Content
DOI:
https://doi.org/10.51983/ajes-2023.12.2.4119Keywords:
Sentiment Analysis, Assamese, Natural Language Processing, Convolution Neural Network, LSTM, Keras Word EmbeddingAbstract
As information technology progresses rapidly, social media platforms are experiencing exponential growth, accompanied by a surge in online content. Sentiment analysis (SA) of online evaluations has piqued the interest of researchers from various organizations, including academia, government, and private industry. It has become an increasingly hot area of study in the fields of Machine Learning (ML) and natural language processing (NLP). Deep Learning (DL) algorithms are currently being utilized in the same field to achieve remarkable results. Much SA research has been conducted in different languages such as English, Chinese, and Spanish, as well as various Indian languages like Hindi, Malayalam, and Bengali. However, languages like Assamese have received very little attention in this field of research. Hence, this research work provides a novel approach to sentiment analysis by demonstrating the effectiveness of deep neural network models for the less explored and scarce resource language, Assamese. This paper introduces a hybrid model, combining Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM), termed LSTM-CNN, for Sentiment Analysis (SA). Keras word embeddings are employed for vectorization of the data. To achieve outcomes, our proposed models have employed dropout, max pooling, and batch normalization techniques. Experimental analysis is carried out on user-generated review content by translating the Bengali dataset into Assamese. Comparison and evaluation of the built models have been done with traditional machine learning models in predicting sentiment polarity. Comparative analysis shows that all the proposed models outperform with an accuracy of more than 98%.
References
K. Lyu and H. Kim, “Sentiment Analysis Using Word Polarity of Social Media,” Wireless Pers Commun, vol. 89, no. 3, pp. 941-958, Aug. 2016.
G. Wang, P. Pu, and Y. Liang, “Topic and Sentiment Words Extraction in Cross-Domain Product Reviews,” Wireless Pers Commun, vol. 102, no. 2, pp. 1773-1783, Sep. 2018.
F. Xu, Z. Pan, and R. Xia, “E-commerce product review sentiment classification based on a naïve Bayes continuous learning framework,” Information Processing & Management, vol. 57, no. 5, pp. 102221, Sep. 2020.
L. Zhang, S. Wang, and B. Liu, “Deep learning for sentiment analysis: A survey,” WIREs Data Min & Knowl, vol. 8, no. 4, pp. e1253, Jul. 2018.
H. N. Mhaskar, “Neural networks and approximation theory,” Neural Networks, vol. 9, no. 4, pp. 721-722, Jun. 1996.
E. Hossain, O. Sharif, M. M. Hoque, and I. H. Sarker, “SentiLSTM: A Deep Learning Approach for Sentiment Analysis of Restaurant Reviews,” in Hybrid Intelligent Systems, vol. 1375, A. Abraham, T. Hanne, O. Castillo, N. Gandhi, T. Nogueira Rios, and T.-P. Hong, Eds., Cham: Springer International Publishing, pp. 193-203, 2021.
B. Liu, Sentiment analysis: mining opinions, sentiments, and emotions, Second edition. in Studies in natural language processing. Cambridge ; New York: Cambridge University Press, 2020.
G. Goswami and J. Tamuli, “Asamiya,” in The Indo-Aryan languages, 391-443.
T. Mandhula, S. Pabboju, and N. Gugulotu, “Predicting the customer’s opinion on amazon products using selective memory architecture-based convolutional neural network,” J Supercomput, vol. 76, no. 8, pp. 5923-5947, Aug. 2020.
F. Tavazoee, C. Conversano, and F. Mola, “Recurrent random forest for the assessment of popularity in social media: 2016 US election as a case study,” Knowl Inf Syst, vol. 62, no. 5, pp. 1847-1879, May 2020.
O. Araque, I. Corcuera-Platas, J. F. Sánchez-Rada, and C. A. Iglesias, “Enhancing deep learning sentiment analysis with ensemble techniques in social applications,” Expert Systems with Applications, vol. 77, pp. 236-246, Jul. 2017.
M. Tsytsarau and T. Palpanas, “Survey on mining subjective data on the web,” Data Min Knowl Disc, vol. 24, no. 3, pp. 478-514, May 2012.
P.-J. Chen, J.-J. Ding, H.-W. Hsu, C.-Y. Wang, and J.-C. Wang, “Improved convolutional neural network-based scene classification using long short-term memory and label relations,” in 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Hong Kong, Hong Kong: IEEE, Jul. 2017, pp. 429-434.
M. V. Mäntylä, D. Graziotin, and M. Kuutila, “The evolution of sentiment analysis - A review of research topics, venues, and top cited papers,” Computer Science Review, vol. 27, pp. 16-32, Feb. 2018.
M. Hoq, P. Haque, and M. N. Uddin, “Sentiment Analysis of Bangla Language Using Deep Learning Approaches,” in Computing Science, Communication and Security, N. Chaubey, S. Parikh, and K. Amin, Eds., in Communications in Computer and Information Science. Cham: Springer International Publishing, 2021, pp. 140-151.
K. Sarkar, “Sentiment Analysis of Bengali Tweets Using Deep Learning,” in Computational Intelligence in Data Science, vol. 578, A. Chandrabose, U. Furbach, A. Ghosh, and A. Kumar M., Eds., Cham: Springer International Publishing, 2020, pp. 71-84.
R. K. Das, M. Islam, M. M. Hasan, S. Razia, M. Hassan, and S. A. Khushbu, “Sentiment analysis in multilingual context: Comparative analysis of machine learning and hybrid deep learning models,” Heliyon, vol. 9, no. 9, pp. e20281, Sep. 2023.
S. Mboutayeb, A. Majda, and N. S. Nikolov, “Multilingual Sentiment Analysis: A Deep Learning Approach:,” in Proceedings of the 2nd International Conference on Big Data, Modelling and Machine Learning, Kenitra, Morocco: SCITEPRESS - Science and Technology Publications, 2021, pp. 27-32.
Md. S. Mahmud, Md. T. Islam, A. J. Bonny, R. K. Shorna, J. H. Omi, and Md. S. Rahman, “Deep Learning Based Sentiment Analysis from Bangla Text Using Glove Word Embedding along with Convolutional Neural Network,” in 2022 13th International Conference on Computing Communication and Networking (ICCCNT), Oct. 2022, pp. 1-6.
B. K. Shrivash, D. K. Verma, and P. Pandey, “An Effective Framework for Sentiment Analysis Using RNN and LSTM-Based Deep Learning Approaches,” in Advances in Computing and Data Sciences, vol. 1848, M. Singh, V. Tyagi, P. K. Gupta, J. Flusser, and T. Ören, Eds., Cham: Springer Nature Switzerland, 2023, pp. 340-350.
P. C. Shilpa, R. Shereen, S. Jacob, and P. Vinod, “Sentiment Analysis Using Deep Learning,” in 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Feb. 2021, pp. 930-937.
L. Senevirathne, P. Demotte, B. Karunanayake, U. Munasinghe, and S. Ranathunga, “Sentiment Analysis for Sinhala Language using Deep Learning Techniques,” 2020.
X. Wang, W. Jiang, and Z. Luo, “Combination of Convolutional and Recurrent Neural Network for Sentiment Analysis of Short Texts,” in Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Y. Matsumoto and R. Prasad, Eds., Osaka, Japan: The COLING 2016 Organizing Committee, Dec. 2016, pp. 2428-2437. Accessed: Feb. 10, 2024. [Online]. Available: https://aclanthology.org/C16-1229
E. Sezgen, K. J. Mason, and R. Mayer, “Voice of airline passenger: A text mining approach to understand customer satisfaction,” Journal of Air Transport Management, vol. 77, pp. 65-74, Jun. 2019.
S. Banerjee and A. Y. K. Chua, “In search of patterns among travellers’ hotel ratings in TripAdvisor,” Tourism Management, vol. 53, pp. 125-131, Apr. 2016.
S. Kumar and M. Zymbler, “A machine learning approach to analyze customer satisfaction from airline tweets,” J Big Data, vol. 6, no. 1, pp. 62, Dec. 2019.
Q. Ye, H. Li, Z. Wang, and R. Law, “The Influence of Hotel Price on Perceived Service Quality and Value in E-Tourism: An Empirical Investigation Based on Online Traveler Reviews,” Journal of Hospitality & Tourism Research, vol. 38, no. 1, pp. 23-39, Feb. 2014.
L.-C. Chen, C.-M. Lee, and M.-Y. Chen, “Exploration of social media for sentiment analysis using deep learning,” Soft Comput, vol. 24, no. 11, pp. 8187-8197, Jun. 2020.
L. Dey, S. Chakraborty, A. Biswas, B. Bose, and S. Tiwari, “Sentiment Analysis of Review Datasets Using Naive Bayes and K-NN Classifier,” IJIEEB, vol. 8, no. 4, pp. 54-62, Jul. 2016.
P.-J. Lee, Y.-H. Hu, and K.-T. Lu, “Assessing the helpfulness of online hotel reviews: A classification-based approach,” Telematics and Informatics, vol. 35, no. 2, pp. 436-445, May 2018.
Y. Guo, S. J. Barnes, and Q. Jia, “Mining meaning from online ratings and reviews: Tourist satisfaction analysis using latent dirichlet allocation,” Tourism Management, vol. 59, pp. 467-483, Apr. 2017.
M. Siering, A. V. Deokar, and C. Janze, “Disentangling consumer recommendations: Explaining and predicting airline recommendations based on online reviews,” Decision Support Systems, vol. 107, pp. 52-63, Mar. 2018.
A. U. Rehman, A. K. Malik, B. Raza, and W. Ali, “A Hybrid CNN-LSTM Model for Improving Accuracy of Movie Reviews Sentiment Analysis,” Multimed Tools Appl, vol. 78, no. 18, pp. 26597-26613, Sep. 2019.
K. Shrivastava and S. Kumar, “A Sentiment Analysis System for the Hindi Language by Integrating Gated Recurrent Unit with Genetic Algorithm,” IAJIT, vol. 17, no. 6, pp. 954-964, Nov. 2020.
N. R. Bhowmik, M. Arifuzzaman, and M. R. H. Mondal, “Sentiment analysis on Bangla text using extended lexicon dictionary and deep learning algorithms,” Array, vol. 13, p. 100123, Mar. 2022.
R. R. Chowdhury, M. Shahadat Hossain, S. Hossain, and K. Andersson, “Analyzing Sentiment of Movie Reviews in Bangla by Applying Machine Learning Techniques,” in 2019 International Conference on Bangla Speech and Language Processing (ICBSLP), Sylhet, Bangladesh: IEEE, Sep. 2019, pp. 1-6.
C. Dev and A. Ganguly, “Sentiment Analysis of Assamese Text Reviews: Supervised Machine Learning Approach with Combined n-gram and TF-IDF Feature,” ADBU Journal of Electrical and Electronics Engineering (AJEEE), vol. 5, no. 2, pp. 18-30, Sep. 2023. Accessed: Feb. 10, 2024. [Online]. Available: https://journals.dbuniversity.ac.in/ojs/index.php/AJEEE/article/view/4134
T. Stérin, N. Farrugia, and V. Gripon, “An Intrinsic Difference Between Vanilla RNNs and GRU Models,” Feb. 2017. Accessed: Feb. 10, 2024. [Online]. Available: https://www.semanticscholar.org/ paper/An-Intrinsic-Difference-Between-Vanilla-RNNs-and-St% C3%A9rin-Farrugia/f2a4a7e9c295a682b9d4b304fd5a02566995766d
P. K. Jain, V. Saravanan, and R. Pamula, “A Hybrid CNN-LSTM: A Deep Learning Approach for Consumer Sentiment Analysis Using Qualitative User-Generated Contents,” ACM Trans. Asian Low-Resour. Lang. Inf. Process., vol. 20, no. 5, pp. 1-15, Sep. 2021.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 The Research Publication
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
