Intelligent Web-Based Virtual Assistant for Klabat University Using Retrieval-Augmented Generation (RAG) and Text-to-Speech (TTS) Integrated with Large Language Models
DOI:
https://doi.org/10.31154/isc12.v12i7.222.1390-1400Keywords:
Asisten Virtual, Sistem Informasi, Large Language Model, Retrieval-Augmented Generation, Speech-to-Text, Text-to-SpeechAbstract
The development of information technology has brought significant changes in the world of education, including at Klabat University. To increase accessibility and ease of obtaining information, a web-based virtual assistant system was developed that utilizes Retrieval-Augmented Generation (RAG) and Text-to-Speech (TTS) technologies. This research aims to implement RAG and TTS technology in a virtual assistant system in order to provide faster and more interactive answers to users. With this system, users can get information faster. The methodology used is Extreme Programming (XP), with an iterative approach in software development. The development process includes planning, design, coding, testing, and continuous feature enhancement. The results showed that the implementation of RAG and TTS improved efficiency in information delivery. Users can ask questions and receive answers in the form of text and voice, making information search more interactive. This system is expected to be an innovative solution for information services at Klabat University and can continue to be developed in the future.
References
[1] S. G. B. Aan Kanivia1, Dewi Anggun Puspitarini2, Dessy Kumala Dewi3, Safitri Akbari4, Aditya Kurniawan Chandra5, “IMPLEMENTASI TEKNOLOGI INFORMASI TERHADAP KUALITAS AUDIT INTERNAL,” vol. 14, pp. 170–178, 2024.
[2] K. Anjelina, “Pengembangan Produk Virtual Reality Dengan Kemajuan Teknologi.” Feb. 13, 2025.
[3] M. R. Nur Inayah1, Nurhayadi2, Mustamin Idris3, “PENGARUH PEMANFAATAN TEKNOLOGI INFORMASI TERHADAP PEMAHAMAN KONSEP MATEMATIS SISWA SMP NEGERI 9 KOTA PALU KELAS VIII,” vol. 7, pp. 707–717, 2024.
[4] L. S. Fitriawati, A. Bijaksana, P. Negara, and R. D. Nyoto, “Implementasi Text To Speech Pada Website Menggunakan Metode Shallow Parsing,” InfoTekJar J. Nas. Inform. dan Teknol. Jar., vol. 5, no. 1, pp. 61–69, 2020.
[5] J. Kreativitas and M. Informatika, “ARTIFICIAL INTELLIGENCE VISION DALAM,” pp. 169–172, 2023.
[6] A. R. Pratama, F. Wabula, H. Ilmandry, M. L. Isabela, and R. Sianipar, “Literature Review The Impact of Machine Learning in Modern Industries,” no. 2021, 2025.
[7] S. Alifianda and R. Djutalov, “Perancangan Sistem Informasi E-Commerce Berbasis Web Untuk PT Sentra Meta Fiber Dengan Metode Agile,” Bul. Ilm. Ilmu Komput. dan Multimed., vol. 1, no. 5, pp. 683–693, 2024.
[8] T. Susilawati, F. Yuliansyah, M. Romzi, and R. Aryani, “Membangun Website Toko Online Pempek Nthree Menggunakan Php Dan Mysql,” J. Tek. Inform. Mahakarya, vol. 3, no. 1, pp. 35–44, 2020.
[9] W. Andriyan, S. S. Septiawan, and A. Aulya, “Perancangan Website sebagai Media Informasi dan Peningkatan Citra Pada SMK Dewi Sartika Tangerang,” J. Teknol. Terpadu, vol. 6, no. 2, pp. 79–88, 2020, doi: 10.54914/jtt.v6i2.289.
[10] A. A. Arifiyanti, R. Permatasari, A. Rezha, and E. Najaf, “KLIK: Kajian Ilmiah Informatika dan Komputer Asisten Virtual sebagai Pusat Layanan Informasi pada Perguruan Tinggi di Indonesia-A Systematic Literature Review,” Media Online), vol. 4, no. 2, pp. 740–745, 2023, doi: 10.30865/klik.v4i2.1222.
[11] Abdul Azis and P. Pramono, “Optimalisasi Potensi Digital Menuju Era Industri 5.0 dengan Asisten Virtual,” J. Kaji. dan Penal. Ilmu Manaj., vol. 2, no. 2, pp. 46–53, 2024, doi: 10.59031/jkpim.v2i2.400.
[12] A. Soetiyono, Y. Kurnia, and R. Kurnia, “Pengaruh Penggunaan Chatbot dan Asisten Virtual terhadap Peningkatkan Kepuasan Pelanggan serta Dampaknya terhadap Pengambilan Keputusan Pembelian,” eCo-Buss, vol. 6, no. 3, pp. 1367–1381, 2024, doi: 10.32877/eb.v6i3.1169.
[13] Z. Lu, “Large Language Models : Development in Model Scale and Challenges,” vol. 0, pp. 154–161, 2024, doi: 10.54254/2755-2721/114/2024.18276.
[14] Y. Gao et al., “Retrieval-Augmented Generation for Large Language Models: A Survey,” pp. 1–21, 2023, [Online]. Available: http://arxiv.org/abs/2312.10997
[15] Q. Leng, J. Portes, S. Havens, M. Zaharia, and M. Carbin, “Long Context RAG Performance of Large Language Models,” no. NeurIPS, 2024, [Online]. Available: http://arxiv.org/abs/2411.03538
[16] P. Lewis et al., “Retrieval-augmented generation for knowledge-intensive NLP tasks,” Adv. Neural Inf. Process. Syst., vol. 2020-Decem, 2020.
[17] D. C. Youvan, “Retrieval-Augmented Generation (RAG): Advancing AI with Dynamic Knowledge Integration,” no. January, 2025, doi: 10.13140/RG.2.2.30888.89606.
[18] S. Thombre, P. Bhattacharyya, and P. Jyothi, “Survey: Text-to-Speech Synthesis”, [Online]. Available: https://en.wikipedia.org/wiki/Speech_synthesis
[19] P. Millett, “Accuracy of Speech-to-Text Captioning for Students Who are Deaf or Hard of Hearing,” J. Educ. Pediatr. Habilit. Audiol. , vol. 25, pp. 1–13, 2021, [Online]. Available: https://www.edaud.org/journal/2021/1-article-21.pdf
[20] L. M. Rodríguez and C. Cox, “Speech-to-text recognition for multilingual spoken data in language documentation,” Comput. 2023 - 6th Work. Use Comput. Methods Study Endanger. Lang. Proc. Work., pp. 118–123, 2023.
[21] E. Nurlailah and K. R. Nova Wardani, “Perancangan Website Sebagai Media Informasi Dan Promosi Oleh-Oleh Khas Kota Pagaralam,” JIPI (Jurnal Ilm. Penelit. dan Pembelajaran Inform., vol. 8, no. 4, pp. 1175–1185, 2023, doi: 10.29100/jipi.v8i4.4006.
