Evaluating User Experience and User Engagement of the AstraPay Mobile Wallet Using UEQ+ and UES

Kelvin Isaiah Sitorus; Afen Prana Utama Sembiring; Yuni Marlina Saragih

doi:10.55537/cosie.v5i3.1786

Authors

Kelvin Isaiah Sitorus Universitas Mikroskil
Afen Prana Utama Sembiring Universitas Mikroskil
Yuni Marlina Saragih Universitas Mikroskil

DOI:

https://doi.org/10.55537/cosie.v5i3.1786

Keywords:

User Experience, User Engagement, AstraPay, UEQ+, UES

Abstract

This study was conducted to see the extent of user experience (User Experience) and user engagement (User Engagement) on the AstraPay digital wallet application, considering that these two things are important keys that determine the success and sustainability of a digital application in the eyes of its users, where user experience is measured using the User Experience Questionnaire Plus (UEQ+) and user engagement is measured through the User Engagement Scale (UES), through a quantitative approach by distributing online questionnaires to 405 AstraPay users in Indonesia whose data is then analyzed using validity and reliability tests, calculating the average for each scale, Spearman correlation tests, to simple linear regression. The results, all UEQ+ scales show positive evaluations with Usefulness and Clarity recording the highest scores, while in the UES the Aesthetic Elements and Reward Factor scales performed very well, while Perceived Usability is the aspect with the lowest score. Regression analysis shows a determination coefficient value of R² = 0.251 with a regression coefficient B = 0.275 (p < 0.001), so that user experience has a positive and significant effect on user engagement, which means that the better the quality of experience perceived by users, the higher their level of engagement with the AstraPay application

Downloads

Download data is not yet available.

References

[1] W. D. Sari and Benardin, “Pengaruh Keamanan, Kemudahan Dan Perilaku Konsumen Terhadap Keputusan Penggunaan Dompet Digital Dana Di Kota Bengkulu,” Jurnal Ekonomi Manajemen Sistem Informasi, vol. 6, no. 2, pp. 900–909, Nov. 2024, doi: 10.38035/jemsi.v6i2.3415.

[2] S. Marti’ah and B. D. Theodora, “Perbandingan Transaksi Uang Eelektronik Secara Regional di Indonesia,” Juremi: Jurnal Riset Ekonomi, vol. 5, no. 2, pp. 873–880, Sep. 2025, doi: 10.53625/juremi.v5i2.11290.

[3] A. N. Darmawan, A. Faroqi, and A. Pratama, “Evaluation of Student UX on E-Learning Web Using User Experience Questionnaire (UEQ),” bit-Tech, vol. 8, no. 1, pp. 1120–1130, Aug. 2025, doi: 10.32877/bt.v8i1.2860.

[4] N. Ahmad and A. Abdullah, “Web Engagement Strategies In Business, Government And Education Sector: Review,” International Journal of Software Engineering and Computer Systems (IJSECS), vol. 7, no. 1, pp. 12–23, Feb. 2021, doi: 10.15282/ijsecs.7.1.2021.2.0078.

[5] J. Kollmorgen, A. Hinderks, and J. Thomaschewski, “Selecting The Appropriate User Experience Questionnaire And Guidance For Interpretation: The UEQ Family,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 9, no. 4, pp. 126–139, Aug. 2024, doi: 10.9781/ijimai.2024.08.005.

[6] H. L. O’Brien, P. Cairns, and M. Hall, “A Practical Approach to Measuring User Engagement With the Refined User Engagement Scale (UES) and New UES short form,” Int. J. Hum. Comput. Stud., vol. 112, pp. 28–39, Jan. 2018, doi: 10.1016/j.ijhcs.2018.01.004.

[7] C. P. N. Yahya and S. Sugiyanto, “Analisis Pengalaman Pengguna Aplikasi ShopeePay: Implementasi Metode UEQ untuk Optimalisasi Layanan,” JTIM : Jurnal Teknologi Informasi dan Multimedia, vol. 7, no. 2, pp. 264–273, Mar. 2025, doi: 10.35746/jtim.v7i2.678.

[8] C. Putri, D. Setiawan, and Y. Noverina, “Implementasi User Experience Questionnaire dan System Usability Scale pada Pengalaman Pengguna Applikasi Gopay,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 9, no. 5, pp. 7531–7537, Jul. 2025, doi: 10.36040/jati.v9i5.14754.

[9] K. Angkasa, E. Eveline, Z. Silalahi, F. Halim, and S. H. Marpaung, “Evaluasi Pengalaman dan Keterlibatan Pengguna Pada Aplikasi Pembelian Tiket Bioskop M-Tix dengan Metode UEQ+ dan UES,” Jurnal Ilmiah Teknik Informatika, vol. 14, no. 1, pp. 53–65, Jan. 2025, doi: 10.22441/format.2025.v14.i1.005.

[10] S. Lemeshow, D. W. Hosmer Jr, and J. Klar, Adequacy of Sample Size in Health Studies. World Health Organization, 1997.

[11] M. Schrepp and J. Thomaschewski, Handbook For The Modular Extension Of The User Experience Questionnaire, 6th ed. 2023. Accessed: Oct. 13, 2025. [Online]. Available: https://ueqplus.ueq-research.org/

[12] F. Yusup, “Uji Validitas dan Reliabilitas Instrumen Penelitian Kuantitatif,” Jurnal Tarbiyah : Jurnal Ilmiah Kependidikan, vol. 7, no. 1, pp. 17–23, Jul. 2018, doi: 10.18592/tarbiyah.v7i1.2100.

[13] P. G. Subhaktiyasa, “Evaluasi Validitas dan Reliabilitas Instrumen Penelitian Kuantitatif: Sebuah Studi Pustaka,” Journal of Education Research, vol. 5, no. 4, pp. 5599–5609, Nov. 2024, doi: 10.37985/jer.v5i4.1747.

[14] M. Sanjaya, R. Putra, L. R. Sulaaeman, R. Ilyasa, and C. J. Kumoro, “Analisis Peningkatan Literasi Digital dan Kemampuan Produksi Konten Berbasis Kecerdasan Buatan pada Siswa SMK melalui Pelatihan Terstruktur,” BALQIS: Journal of Business Innovation and Digital Marketing, vol. 1, no. 2, pp. 161–168, Dec. 2025, doi: 10.30983/balqis.v1i2.10484.

[15] E. Roflin, Rohana, and F. Riana, Analisis Korelasi dan Regresi, 1st ed. Pekalongan: PT. Nasya Expanding Management, 2022.