Development of Airfield Lighting System Digital Learning Media: An Application Usability Testing

Authors

  • Direstu Amalia Politeknik Penerbangan Palembang
  • Asep Muhamad Soleh Politeknik Penerbangan Palembang
  • Adha Febriansyah Politeknik Penerbangan Palembang
  • Rio Rizko Politeknik Penerbangan Palembang
  • Siti Salbiah Politeknik Penerbangan Palembang
  • Viktor Suryan Politeknik Penerbangan Palembang
  • Virma Septiani Politeknik Penerbangan Palembang

DOI:

https://doi.org/10.31851/jmksp.v9i1.13571

Keywords:

Airfield Lighting, Learning Media, UEQ, Usability Test, User Experience

Abstract

This study aims to evaluate the usefulness of a game-based learning tool called the airfield lighting system that uses both VR and AR technology in the classroom. The quantitative research method uses a survey to gather data and test the application in two classes. The application’s usability is represented by data analysis that uses the User Experience Questionnaire (UEQ) model to quantify two aspects: hedonic and pragmatic quality. The study’s findings display the means of the positive value scales, indicating that the pragmatic quality score was 2.538 and the hedonic quality score was 2.548. In addition, To gain a more comprehensive understanding of a product’s quality, we also assess the product’s measured user experience by contrasting it with the outcomes of other well-known products. The results are interpreted within the 10 percent best results range, indicating “excellent” for five instruments and “above average” for novelty instruments. The result presents six instruments of usability level: efficiency, perspicuity, dependability, stimulation, and novelty. This usability test suggests using the airfield lighting system application as the learning medium for student-centered learning.

References

Alawiyah, F. F., & Canta, D. S. (2022). Evaluation of User Experience on the Shopee Application Using Methods User Experience Questionnaire (UEQ). Journal of Information System Research (JOSH), 3(4). https://doi.org/10.47065/josh.v3i4.1574

Amalia, D., & Nugraha, W. (2021). A Study of Student Learning Attitude Towards E-Learning In The Pandemic Era. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 6(2), 336–351. https://doi.org/10.31851/JMKSP.V6I2.5725

Björn, M. (2022). Development of an effective pedagogical EEG simulator: design-based research project among biomedical laboratory science students. https://dspace.uef.fi/bitstream/handle/123456789/27018/urn_isbn_978-952-61-4454-2.pdf?sequence=1&isAllowed=y

Bonett, D., T. W.-J. (2014). Cronbach’s alpha reliability: Interval estimation, hypothesis testing, and sample size planning. Wiley Online Library, 36(1), 3–15. https://doi.org/10.1002/job.1960

Cheliotis, K. (2021). ABMU: An Agent-Based Modelling Framework for Unity3D. SoftwareX, 15. https://doi.org/10.1016/j.softx.2021.100771

Coman, C., Gabriel, iu T., Meses, L., Stanciu, C., & Cristina Bularca, M. (2020). Online Teaching and Learning in Higher Education during the Coronavirus Pandemic: Students’ Perspective. Mdpi.Com. https://doi.org/10.3390/su122410367

Du Toit, J., & Verhoef, A. H. (2018). Embodied digital technology and transformation in higher education. Transformation in Higher Education, 3. https://doi.org/10.4102/the.v2i0.52

Elmqaddem, N. (2019). Augmented Reality and Virtual Reality in Education. Myth or reality? International Journal of Emerging Technologies in Learning, 14(3), 234–242. https://doi.org/10.3991/ijet.v14i03.9289

Elnasr, A., Sobaih, E., Hasanein, A. M., & Elnasr, A. E. A. (2020). Responses to COVID-19 in Higher Education: Social Media Usage for Sustaining Formal Academic Communication in Developing Countries. Mdpi.Com. https://doi.org/10.3390/su12166520

Excellence, B. B.-C. F. T., Military, U. S., & 2017, undefined. (2017). Virtual Reality and Augmented Reality in Education. Westpoint.Edu. Retrieved February 28, 2023, from https://www.westpoint.edu/sites/default/files/inline-images/centers_research/center_for_teching_excellence/PDFs/mtp_project_papers/Boyles_17.pdf

Fadillah, M. A., Yunus, A., & Budianto, A. E. (2022). Analisis User Experience pada Augmented Reality Organology Menggunakan User Experience Questionnaire (UEQ). JATI (Jurnal Mahasiswa Teknik Informatika), 6(2). https://doi.org/10.36040/jati.v6i2.4888

Fauzi, R., Smaragdina, A. A., Alqodri, F., & Wibowo, F. S. (2021). Benchmarking the User Experience of SIONLAP (Sistem Informasi Online Laboratorium Pendidikan) an IT-based Laboratory Management System. 7th International Conference on Electrical, Electronics and Information Engineering: Technological Breakthrough for Greater New Life, ICEEIE 2021. https://doi.org/10.1109/ICEEIE52663.2021.9616704

González-Zamar, M. D., & Abad-Segura, E. (2020). Implications of virtual reality in arts education: Research analysis in the context of higher education. Education Sciences, 10(9). https://doi.org/10.3390/educsci10090225

Hariyanto, B., MZ, I., SU, W., & Rindawati. (2022). 4D Model Learning Device Development Method of the Physical Geography Field Work Guidance Book. MATEC Web of Conferences, 372. https://doi.org/10.1051/matecconf/202237205008

Hashim, H. (2018). Application of Technology in the Digital Era Education. International Journal of Research in Counseling and Education, 1(2), 1. https://doi.org/10.24036/002ZA0002

Herdianingsih, S., & Cahya, O. D. (2023). User Experience of Online Sim Extension Users for Digital Traffic Corps Applications Using UEQ. IJCIT (Indonesian Journal on Computer and Information Technology), 8(1). https://doi.org/10.31294/ijcit.v8i1.13247

Indryani, L., Saputra, H., Azro, I. (2022). Making Virtual Reality-Based Learning Media About 6-Axis Arm Robots in the Robotics Course in the Department of Computer Engineering. Jurnal Laporan Akhir Teknik Komputer, 2(1).

Kassim, M., & Bakar, A. S. A. A. (2021). The Design Of Augmented Reality Using Unity 3d Image Marker Detection For Smart Bus Transportation. International Journal of Interactive Mobile Technologies, 15(17). https://doi.org/10.3991/ijim.v15i17.22071

Khan, T., Johnston, K., & Ophoff, J. (2019). The Impact of an Augmented Reality Application on Learning Motivation of Students. Advances in Human-Computer Interaction, 2019. https://doi.org/10.1155/2019/7208494

Komalasari, Y., Kristiawan, M., Danim, S., & Badeni, B. (2023). Lecturers’ Pedagogic Competence Profile of Politeknik Penerbangan Palembang. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 8(1). https://doi.org/10.31851/jmksp.v8i1.9901

Lallemand, C., Gronier, G., Behavior, V. K.-C. in H., & 2015, undefined. (2015). User experience: A concept without consensus? Exploring practitioners’ perspectives through an international survey. Elsevier. https://doi.org/10.1016/j.chb.2014.10.048

Lasawali, A. A., Susilo, A., Irawan, Y., Mayasari, R., & Nugraha, B. (2022). User Experience Analysis with User Experience Questionnaire (UEQ) in Academic Information Systems. Systematics, 4(3).

Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5298 LNCS. https://doi.org/10.1007/978-3-540-89350-9_6

Lazo-Amado, M., Cueva-Ruiz, L., & Andrade-Arenas, L. (2022). Designing a Mobile Application using Augmented Reality: The Case of Children with Learning Disabilities. International Journal of Advanced Computer Science and Applications, 13(6). https://doi.org/10.14569/IJACSA.2022.01306101

Motejlek, J., arXiv:1906.12051, E. A. preprint, & 2019, undefined. (2019). A taxonomy for virtual and augmented reality in education. Arxiv.Org. Retrieved February 28, 2023, from https://arxiv.org/abs/1906.12051

N.K.S. Widarini, I.N.A.J. Putra, & N.P.E. Marsakawati. (2021). Teachers Strategies in Online Learning During Covid Pandemic. Jurnal Pendidikan Bahasa Inggris Indonesia, 9(2), 82–89. https://doi.org/10.23887/jpbi.v9i2.487

Noueihed, H., Harb, H., & Tekli, J. (2022). Knowledge-Based Virtual Outdoor Weather Event Simulator using Unity 3D. Journal of Supercomputing, 78(8). https://doi.org/10.1007/s11227-021-04212-6

Nugraha, W., Amalia, D., Parjan, P., & Abdullah, A. (2023). FITERN: Firefighting Tactic and Technique Application as A Web-Based Learning Media Integrated with A Robotic Simulator. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 8(1), 631–641. https://doi.org/10.31851/JMKSP.V8I1.13114

Omar, I. M., Zulazmi, N. I. L., & Ladin, C. A. (2019). Effect of Lecturer’s Transformational Leadership on Students’ Employability: Malaysian Technical and Vocational Education & Training Institutions. Malaysian Online Journal of Educational Management, 7(2). https://doi.org/10.22452/mojem.vol7no2.4

Pelargos, P., Nagasawa, D., Lagman, C., S. T.-J. of clinical, & 2017, undefined. (2017). Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Elsevier. Retrieved February 28, 2023, from https://www.sciencedirect.com/science/article/pii/S0967586816303162

Pratama, A., Faroqi, A., & Mandyartha, E. P. (2022). Evaluation of User Experience in Integrated Learning Information Systems Using User Experience Questionnaire (UEQ). Journal of Information Systems and Informatics, 4(4). https://doi.org/10.51519/journalisi.v4i4.394

Puentedura, R. (2006). Transformation, Technology, and Education. In Strengthening Your District Through Technology.

Roda-Segarra, J., Mengual-Andres, S., & Martinez-Roig, R. (2022). Using Virtual Reality in Education: A Bibliometric Analysis. Campus Virtuales, 11(1). https://doi.org/10.54988/cv.2022.1.1006

Saab, M. M., Hegarty, J., Murphy, D., & Landers, M. (2021). Incorporating Virtual Reality in Nurse Education: A Qualitative Study of Nursing Students’ Perspectives. Nurse Education Today, 105. https://doi.org/10.1016/j.nedt.2021.105045

Schleicher, A. (2020). The Impact of COVID-19 on Education: Insights from Education at a Glance 2020. OECD Journal: Economic Studies, 1–31.

Schölkopf, L., Heyde, C. G. von der, A. S.-M. (2022). Reducing the Gap between Mental Models of Truck Drivers and Adaptive User Interfaces in Commercial Vehicles. Mdpi.Com. https://doi.org/10.3390/mti6020014

Schrepp, M., Hinderks, A., & Thomaschewski, J. (2017a). Construction of a Benchmark for the User Experience Questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence, 4(4), 40. https://doi.org/10.9781/ijimai.2017.445

Schrepp, M., Hinderks, A., & Thomaschewski, J. (2017b). Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence, 4(6). https://doi.org/10.9781/ijimai.2017.09.001

Shenkoya, T., & Kim, E. (2023). Sustainability in Higher Education: Digital Transformation of the Fourth Industrial Revolution and Its Impact on Open Knowledge. Sustainability (Switzerland), 15(3). https://doi.org/10.3390/su15032473

Soleh, A. M., Gauthama, W., Suhanto, S., Rifai, M., & Alddi, M. D. B. (2023). Development of Learning Media Portable Wind Direction Indicators as Visual Aids for Flight Navigation. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 8(1). https://doi.org/10.31851/jmksp.v8i1.9676

Stamm, O., Dahms, R., Reithinger, N., Ruß, A., & Müller-Werdan, U. (2022). Virtual reality exergame for supplementing multimodal pain therapy in older adults with chronic back pain: a randomized controlled pilot study. Virtual Reality. https://doi.org/10.1007/S10055-022-00629-3

Suryan, V., Amalia, D., Septiani, V., Sukahir, S., Nurfitri, M. A., & Chandra, P. W. A. (2023). Airport Runway Defect Detection Device: A Project-Based Learning Media. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 8(1), 642–650. https://doi.org/10.31851/JMKSP.V8I1.13185

Ullah, O., Khan, W., Sci, A. K.-P.-H. S., (2017). Students’ attitude towards online learning at tertiary level. Academia.Edu. Retrieved June 10, 2021, from https://www.academia.edu/download/55550632/PUTAJ_2017.pdf

Wang, J., & Zeng, W. (2019). Research on the realization method of augmented reality based on unity3d. Journal of Robotics, Networking and Artificial Life, 6(3). https://doi.org/10.2991/jrnal.k.191203.004

Yang, Y., & Cornelious, L. F. (2004). Ensuring Quality in Online Education Instruction: What Instructors Should Know? Background of the problem. In ERIC. Retrieved June 10, 2021, from https://eric.ed.gov/?id=ED484990

Yuniar, D. C., Munir, M. S., Febiyanti, H., & Anwar, S. (2023). Development of X-Ray Simulator Learning Media in Junior Aviation Security Course Based on MOOCS. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 8(1). https://doi.org/10.31851/jmksp.v8i1.10438

Zhu, M., Berri, S., & Zhang, K. (2021). Effective instructional strategies and technology use in blended learning: A case study. Education and Information Technologies, 26(5). https://doi.org/10.1007/s10639-021-10544-w

Downloads

Published

2024-01-20

How to Cite

Amalia, D., Soleh, A. M., Febriansyah, A., Rizko, R., Salbiah, S., Suryan, V., & Septiani, V. (2024). Development of Airfield Lighting System Digital Learning Media: An Application Usability Testing. JMKSP (Jurnal Manajemen, Kepemimpinan, Dan Supervisi Pendidikan), 9(1), 240–255. https://doi.org/10.31851/jmksp.v9i1.13571