Application of Natural Language Processing for Emotion Detection and Motivational Response Generation in Indonesian Text using the CRISP-DM Method

Jefri Yushendri, Purnawarman Musa

Abstract


The rapid growth of social media has encouraged teenagers to express their emotions through text-based social media posts. However, existing systems still face limitations in understanding emotional meaning and providing appropriate responses. This study aims to develop a Natural Language Processing (NLP)-based system for detecting emotions in Indonesian-language text and generating contextual motivational responses. The research methodology employed the Cross Industry Standard Process for Data Mining (CRISP-DM), which consists of business understanding, data understanding, data preparation, modeling, evaluation, and deployment stages. Text processing was conducted through tokenizing, filtering, stemming using the Enhanced Confix Stripping algorithm, negation checking, and matching with an emotion lexicon based on Plutchik's Wheel of Emotions classification. The dataset consisted of 14,182 emotion lexicon entries used as reference data and 100 emotional expression sentences collected from 100 respondents as testing data. Evaluation using the Weighted F1-score produced a result of 87%. These findings indicate that the proposed system is capable of identifying emotions and generating relevant motivational responses. The integration of emotion detection and response generation within a single system enables outputs that are adaptive to users’ emotional conditions. However, the system still has limitations in detecting non-standard language and slang expressions, indicating that further lexicon enrichment and more adaptive methods are still required.

Keywords


Natural Language Processing; Text Mining; Deteksi Emosi; Kalimat Motivasi; Klasifikasi Plutchik

Full Text:

PDF

References


R. Amalia and S. T. Hati, “Perubahan Sosial Budaya: Curhat Publik sebagai Bentuk Ekspresi Emosional dalam Masyarakat Digital,” RIGGS: Journal of Artificial Intelligence and Digital Business, Vol. 4, No. 4, pp. 14518–14524, 2026, DOI: 10.31004/riggs.v4i4.6031.

Chiara Ruini and Cristina C. Mortara, “Writing Technique Across Psychotherapies—From Traditional Expressive Writing to New Positive Psychology Interventions: A Narrative Review,” Journal of Contemporary Psychotherapy, Vol. 52, No. 1, pp. 23–34, 2022, DOI: 10.1007/s10879-021-09520-9.

T. Gutentag, Elise K. Kalokerinos, Yael Millgram, Paul M. Garrett, Rachel Sobel, and Maya Tamir, “Motivational Intensity in Emotion Regulation,” Personality and Social Psychology Bulletin, Vol. 52, No. 1, 2024, DOI: 10.1177/01461672241273273.

T. St Quinton, B. Morris, M. J. Barwood, and M. Conner, “Promoting Physical Activity Through Text Messages: The Impact of Attitude and Goal Priority Messages,” Health Psychology and Behavioral Medicine, Vol. 9, No. 1, pp. 165–181, 2021, DOI: 10.1080/21642850.2021.1891073.

Y. Sun, “A Qualitative Study of the Psychological Effects of Motivational Quotes,” Communications in Humanities Research, Vol. 33, No. 1, pp. 27–33, 2024, DOI: 10.54254/2753-7064/33/20240042.

G. D. Lestari, W. Widodo, A. Yusuf, and M. Widyaswari, “Implementasi Komunikasi Positif dalam meningkatkan Motivasi Belajar Anak Usia Dini,” Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, Vol. 7, No. 4, pp. 4791–4802, 2023, DOI: 10.31004/obsesi.v7i4.4896.

W. Anggriyani and M. Fakhriza, “Analisis Sentimen Program Makan Gratis pada Media Sosial X menggunakan Metode NLP,” Journal of Computer System and Informatics (JoSYC), Vol. 5, No. 4, pp. 1033–1042, 2024, DOI: 10.47065/josyc.v5i4.5826.

M. A. Riza and N. Charibaldi, “Emotion Detection in Twitter Social Media Using Long Short-Term Memory (LSTM) and Fast Text,” International Journal of Artificial Intelligence & Robotics (IJAIR), Vol. 3, No. 1, pp. 15–26, 2021, DOI: 10.25139/ijair.v3i1.3827.

A. S. Aribowo and S. Khomsah, “Implementation of Text Mining for Emotion Detection using The Lexicon Method (Case Study: Tweets About Covid-19),” Telematika: Jurnal Informatika dan Teknologi Informasi, Vol. 18, No. 1, pp. 49–60, 2021, DOI: 10.31315/telematika.v18i1.4341.

Dr. V. Geetha, Dr C K Gomathy, Mr.D.Sri Datta Vallab Yaratha Yagn Sai Praneesh, "The Role of Natural Language Processing," International Journal of Scientific Research in Engineering and Management, Vol. 7, No. 11, Nov 2023. https://doi.org/10.55041/IJSREM27094

J. Song, “A Review of the Application of Natural Language Processing in Human-Computer Interaction,” Applied and Computational Engineering, Vol. 106, No. 1, pp. 111–117, 2024, DOI: 10.54254/2755-2721/106/20241328.

D. A. Sulistyo, F. A. Ahda, and V. A. Fitria, “Epistomologi dalam Natural Language Processing,” Jurnal Inovasi Teknik dan Edukasi Teknologi, Vol. 1, No. 9, pp. 652–664, 2021, DOI: 10.17977/um068v1i92021p652-664.

A. Badawi, “The Effectiveness of Natural Language Processing (NLP) as a Processing Solution and Semantic Improvement,” International Journal of Economic, Technology and Social Sciences (Injects), Vol. 2, No. 1, pp. 36–44, 2021, DOI: 10.53695/injects.v2i1.194.

A. A. Ghirrid, R. T. K. Sari, and R. T. Aldisa, “Algoritma Natural Language Processing untuk Aplikasi Penerjemah (Indonesia–Jawa) menggunakan Metode Speech Processing,” Jurnal Teknologi Informasi dan Komunikasi (JTIK), Vol. 8, No. 3, pp. 746–759, 2024, DOI: 10.35870/jtik.v8i3.2244.

Salamun, A. Aprialdo, and Sukri, “Optimasi Chatbot dengan Pemanfaatan Natural Language Processing,” Jurnal Komputer Terapan, Vol. 10, No. 1, pp. 17–26, 2024, DOI: 10.35143/jkt.v10i1.6181.

J. Yushendri, A. R. Hanif e A. A. Putri, “A Speech Intelligence Conversation Bot for Interactive Media Information,” em Second International Conference on Informatics and Computing (ICIC), Jayapura, Indonesia, 2017.

F. Rumaisa, Y. Puspitarani, A. Rosita, A. Zakiah, and S. Violina, “Penerapan Natural Language Processing (NLP) di bidang pendidikan,” Jurnal Inovasi Masyarakat, Vol. 1, No. 3, pp. 232–235, 2021, DOI: 10.33197/jim.vol1.iss3.2021.799.

M. I. Tri Khaqiqi and N. H. Harani, “Peningkatan Kinerja Chatbot NLP Asisten: Tinjauan Literatur tentang Metode dan Akurasi dalam Aplikasi berbasis Percakapan,” Jurnal Informatika dan Teknologi Komputer (J-ICOM), Vol. 5, No. 1, pp. 50–59, 2024, DOI: 10.55377/j-icom.v5i1.8242.

H. P. Tarigan, “Integration of NLP-based Chatbot on University Academic Service System,” Jurnal Komputer, Vol. 3, No. 1, pp. 13–18, 2024, DOI: 10.70963/jk.v3i1.110.

T. Pólya and I. Csertő, “Emotion Recognition based on the Structure of Narratives,” Electronics, Vol. 12, No. 4, p. 919, 2023, DOI: 10.3390/electronics12040919.

S. Mohammad, “Best Practices in the Creation and use of Emotion Lexicons,” in Findings of the Association for Computational Linguistics: EACL 2023, Stroudsburg, PA, USA: Association for Computational Linguistics, 2023, pp. 1825–1836, DOI: 10.18653/v1/2023.findings-eacl.136.

S. M. Mohammad and P. D. Turney, “Crowdsourcing a Word–Emotion Association Lexicon,” Computational Intelligence, Vol. 29, No. 3, pp. 436–465, 2013.

D. Kodati and C. M. Dasari, “Negative Emotion Detection on Social Media During the Peak Time of COVID-19 Through Deep Learning with an Auto-Regressive Transformer,” Engineering Applications of Artificial Intelligence, Vol. 127, p. 107361, 2024, DOI: 10.1016/j.engappai.2023.107361.

F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, “Transformer Models for Text-based Emotion Detection: A Review of BERT-based Approaches,” Artificial Intelligence Review, Vol. 54, No. 8, pp. 5789–5829, 2021, DOI: 10.1007/s10462-021-09958-2.

C. Schröer, F. Kruse, and J. M. Gómez, “A Systematic Literature Review on Applying CRISP-DM Process Model” Procedia Computer Science, Vol. 181, pp. 526–534, 2021, DOI: 10.1016/j.procs.2021.01.199.

TenHouten, W. D., “Basic Emotion Theory, Social Constructionism, and the Universal Ethogram,” Social Science Information, Vol. 60, No. 4, pp. 593–618, 2021, DOI: 10.1177/05390184211046481.

Li, Y., Thomas, M., & Liu, D. (2021). From Semantics to Pragmatics: where IS can Lead in Natural Language Processing (NLP) Research. European Journal of Information Systems, 30(5), 569–590.

Ahda, F. A., A. P. Wibawa, D. D. Prasetya, and D. A. Sulistyo, “Minangkabau Language Stemming: A New Approach with Modified Enhanced Confix Stripping,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), Vol. 9, No. 3, pp. 677–687, 2025, DOI: 10.29207/resti.v9i3.6511.

P. K. Singh and S. Paul, “Deep Learning Approach for Negation Handling in Sentiment Analysis,” IEEE Access, Vol. 9, pp. 102579–102592, 2021, DOI: 10.1109/ACCESS.2021.3095412.

M. Li, “Improving ChatGPT’s Emotional Intelligence Through Large Language Model Evaluation,” Master’s thesis, Université du Québec à Montréal (UQAM), Montreal, QC, Canada, 2023. [Online]. Available: https://archipel.uqam.ca/17338/1/M18333.pdf

S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, “Deep Learning--based Text Classification,” ACM Computing Surveys, Vol. 54, No. 3, pp. 1–40, Apr. 2021, DOI: 10.1145/3439726.

H. T. Y. Achsan, H. Suhartanto, W. C. Wibowo, D. A. Dewi, and K. Ismed, “Automatic Extraction of Indonesian Stopwords,” International Journal of Advanced Computer Science and Applications (IJACSA), Vol. 14, No. 2, pp. 166–171, 2023, DOI: 10.14569/IJACSA.2023.0140221.

Z. Abidin, A. Junaidi, and Wamiliana, “Text Stemming and Lemmatization of Regional Languages in Indonesia: A Systematic Literature Review,” Journal of Information Systems Engineering and Business Intelligence, Vol. 10, No. 2, pp. 217–231, 2024, DOI: 10.20473/jisebi.10.2.217-231

M. C. Hinojosa Lee, J. Braet, and J. Springael, “Performance Metrics for Multilabel Emotion Classification: Comparing Micro, Macro, and Weighted F1-Scores,” Applied Sciences, Vol. 14, No. 21, p. 9863, Oct. 2024, DOI: 10.3390/app14219863.

M. M. Imran, “Emotion Classification in Software Engineering Texts: A Comparative Analysis of Pre-trained Transformers Language Models,” in Proc. IEEE/ACM Int. Workshop on Natural Language-Based Software Engineering (NLBSE), ICSE 2024, Lisbon, Portugal, 2024, pp. 73–80. DOI: 10.1145/3643787.3648034.

J. Li and P. Washington, “A Comparison of Personalized and Generalized Approaches to Emotion Recognition using Consumer Wearable Devices: Machine Learning Study,” arXiv preprint arXiv:2308.14245, 2023, DOI: 10.48550/arXiv.2308.14245.

G. Giansante et al., “Neuronal Network Activity and Connectivity are Impaired in a Conditional Knockout Mouse Model with PCDH19 Mosaic Expression,” Molecular Psychiatry, Vol. 29, No. 6, pp. 1710–1725, Mar. 2023, DOI: 10.1038/s41380-023-02022-1.

Christine P. Chai and Hussein A. Abbas, “Comparison of Text Preprocessing Methods,” Natural Language Engineering, Vol. 29, No. 3, pp. 509–553, 2023, DOI: 10.1017/S1351324922000213.

Rianto, Achmad Benny Mutiara, Eri Prasetyo Wibowo, and Paulus Insap Santosa, “Improving the Accuracy of Text Classification using Stemming Method, a Case of Non-formal Indonesian Conversation,” Journal of Big Data, Vol. 8, No. 26, 2021, DOI: 10.1186/s40537-021-00413-1.

L. B. Ilmawan, Muladi, and D. D. Prasetya, “Negation Handling for Sentiment Analysis Task: Approaches and Performance Analysis,” International Journal of Electrical and Computer Engineering (IJECE), Vol. 14, No. 3, pp. 3382–3393, 2024, DOI: 10.11591/ijece.v14i3.pp3382-3393.

N. Punetha and G. Jain, “Advancing Sentiment Analysis by Addressing Negation Handling Challenge via Unsupervised Mathematical Approach,” Social Network Analysis and Mining, Vol. 15, 2025, DOI: 10.1007/s13278-025-01416-z.

A. Harutyunyan and S. Kumar, “Fine-Grained Emotion Detection on GoEmotions: Experimental Comparison of Classical Machine Learning, BiLSTM, and Transformer Models,” arXiv, 2026. [Online]. Available: https://arxiv.org/abs/2601.18162




DOI: https://doi.org/10.32520/stmsi.v15i5.6334

Article Metrics

Abstract view : 37 times
PDF - 10 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.