Evaluating the Usability and User Experience of an Augmented Reality Application for Kaba-Kaba Tourism Village, Tabanan, Bali Using SUS and UEQ

I Made Dedi Suardika; Made Ratna Witari; Ni Made Asri Sasmita

doi:10.55537/cosie.v5i3.1763

Authors

I Made Dedi Suardika Universitas Ngurah Rai Denpasar
Made Ratna Witari Universitas Ngurah Rai Denpasar
Ni Made Asri Sasmita Universitas PGRI Mahadewa Indonesia

DOI:

https://doi.org/10.55537/cosie.v5i3.1763

Keywords:

Augmented Reality, Usability, User Experience, SUS, UEQ, Tourism Village

Abstract

This study explores the growing use of Augmented Reality (AR) in the tourism sector, while addressing the limited integration of usability and user experience evaluations in village based tourism applications. It presents an evaluation of the AR application for Kaba-Kaba Tourism Village as a medium for visualization and digital promotion. The evaluation was conducted using the System Usability Scale (SUS) and the User Experience Questionnaire (UEQ), involving 30 respondents representing typical AR technology users. The results indicate that the application achieved a SUS score of 63.58, which falls into the marginal acceptability category (grade D), suggesting that the system is usable but not yet optimal. Furthermore, the UEQ results show that the dimensions of Attractiveness (0.878), Stimulation (0.875), and Novelty (0.800) are rated positively, while Perspicuity (0.417), Efficiency (0.650), and Dependability (0.408) remain at a neutral level. These findings suggest that the application demonstrates strong hedonic quality, particularly in delivering engaging and innovative experiences, but still exhibits weaknesses in pragmatic quality aspects such as ease of use, efficiency, and system reliability. This study contributes by providing an empirical evaluation of AR implementation in village-based tourism and recommends an iterative user-centered design approach to improve usability and user experience in a sustainable manner

Downloads

Download data is not yet available.

References

[1] A. Chatsiopoulou and P. D. Michailidis, “Augmented Reality in Cultural Heritage: A Narrative Review of Design, Development and Evaluation Approaches,” 2025. doi: 10.3390/heritage8100421.

[2] T. M. Wut and M. L. P. Ng, “Virtual Reality and Augmented Reality of Tourism Research: A Review and Research Agenda,” Journal of Quality Assurance in Hospitality and Tourism, 2024, doi: 10.1080/1528008X.2024.2338774.

[3] W. F. Setiawan, A. Amirullah, and S. Rochimah, “Enhancing User Experience through UI Redesign Using the UEQ+ Method,” International Journal on Informatics Visualization, vol. 9, no. 6, 2025, doi: 10.62527/joiv.9.6.3596.

[4] J. Bata, “Evaluasi Usabilitas Aplikasi Augmented Reality Sebagai Media Pembelajaran Sekolah Dasar: Sebuah Pilot Studi,” JIIP - Jurnal Ilmiah Ilmu Pendidikan, vol. 8, no. 4, 2025, doi: 10.54371/jiip.v8i4.7517.

[5] A. Dillen et al., “User Evaluation of a Shared Robot Control System Combining BCI and Eye Tracking in a Portable Augmented Reality User Interface,” Sensors, vol. 24, no. 16, 2024, doi: 10.3390/s24165253.

[6] M. F. A. Nasrullah and I. Octaviani, “Media Pembelajaran Interaktif Augmented Reality untuk Materi Substansi Genetika pada Siswa SMA Berbasis Model ADDIE,” MULTINETICS, vol. 11, no. 1, 2025, doi: 10.32722/multinetics.v11i1.7512.

[7] Moh. Dasuki, M. Rahman, and I. Saifudin, “Evaluasi Usability Media Pembelajaran Alfabet Berbasis Augmented Re-ality Menggunakan Metode Addie Dan Human-Centered Design,” JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), vol. 9, no. 4, 2024, doi: 10.29100/jipi.v9i4.6664.

[8] F. M. Tambajong, R. Sengkey, and S. D. E. Paturusi, “System Usability Scale Method,” Jurnal Teknik Informatika, vol. 19, no. 3, 2024.

[9] A. Prayoga, C W Kusuma, M Christy, and R Andika, “Analisis User Experience Jogjakita Menggunakan User Experience Questionnaire(UEQ),” TEKNIMEDIA: Teknologi Informasi dan Multimedia, vol. 4, no. 1, 2023, doi: 10.46764/teknimedia.v4i1.98.

[10] M. A. Memon, R. Thurasamy, H. Ting, and J. H. Cheah, “Purposive Sampling: A Review And Guidelines For Quantitative Research,” Journal of Applied Structural Equation Modeling, vol. 9, no. 1, 2025, doi: 10.47263/JASEM.9(1)01.

[11] A. A. S. Maharani, I. P. A. Swastika, and N. L. P. N. S. P. Astawa, “Analisis Kualitas Pelayanan Elektronik (E-SERVQUAL): Berfokus pada Website ZuBlu,” Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika (KARMAPATI), vol. 12, no. 1, 2023.

[12] P. Weichbroth and M. Giedrowicz, “SUS-Lib: An automated tool for usability evaluation based on the Software Usability Scale from user feedback,” Oct. 2024, [Online]. Available: http://arxiv.org/abs/2410.09534

[13] J. Lorincz, K. Barišić, and V. Vlahović, “Usability Testing and the System Usability Scale Effectiveness Assessment on Different Sensing Devices of Prototype and Live Web System Counterpart,” Sensors, vol. 26, no. 2, 2026, doi: 10.3390/s26020679.

[14] I. K. R. Janardana, “Analisis Usability Dan User Experience Aplikasi Spotify Dengan Metode System Usability Scale dan UEQ,” Jurnal Informatika dan Teknik Elektro Terapan, vol. 13, no. 2, Apr. 2025, doi: 10.23960/jitet.v13i2.6442.

[15] J. Cui, F. Mantelet, C. Jean, R. Lou, and F. Segonds, “Exploring the usability and creativity enhancement of augmented reality in additive manufacturing-based product design,” Computers in Human Behavior Reports, vol. 20, 2025, doi: 10.1016/j.chbr.2025.100816.

[16] G. P. Putra, M. Noor, and A. Azam, “Analisis Usability Dan User Experience Pada Aplikasi Musea Ar Dengan Metode System Usability Scale Dan User Experience Questionnaire,” Jurnal Mahasiswa Teknik Informatika, vol. 7, no. 3, 2023, Accessed: Jul. 02, 2026. [Online]. Available: doi.org/10.36040/jati.v7i3.7043

[17] S. Kurniawan, A. P. I, and A. Ependi, “Analisis Usability Aplikasi C-Access Commuterline Menggunakan System Usability Scale (Sus),” Jurnal Syntax Admiration, vol. 4, no. 7, 2023, doi: 10.46799/jsa.v4i7.671.

[18] A. M. Klein, J. Kollmorgen, A. Hinderks, M. Schrepp, M. Rauschenberger, and M. J. Escalona, “Validation of the UEQ+ Scales for Voice Quality,” Comput. Stand. Interfaces, vol. 93, 2025, doi: 10.1016/j.csi.2024.103971.