Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Developing An ODL Technological Readiness Instrument

Mohd Lokman Abdullah, Zahari Hamidon, Sya Azmeela Shariff

http://dx.doi.org/10.6007/IJARPED/v13-i2/21351

Open access

Open and distance learning (ODL) provides accessible and customisable educational experiences. Its success depends on the technological preparation of learners, i.e., their skills, knowledge, attitudes, and digital tools. High-quality outcomes require precise tools to assess learner readiness. This study aims to develop and validate a modified version of the Parasuraman Technology Readiness Index (TRI) tailored to assess the technological readiness of ODL. It includes a detailed account of the development process, feedback from experts on content and language, and modifications for greater transparency and precision. Using a mixed-methods psychometric analysis, this study describes the steps taken to customise the instrument. These include item selection and adaptation (by the researcher), expert review of item content, item redesign (by the researcher), and statistical validation of the items (using CVI scoring) specifically for the ODL context. Through continuous refinement based on expert opinion, the instrument was refined to ensure accuracy, clarity, and representation of the intended constructs. The final version of the instrument has strong content validity (s-CVI=0.95, i-CVI/Ave=0.95, and s-CVI/UA=0.88) and effectively measures the dimensions of technology readiness (optimism, innovation readiness, discomfort, and insecurity) in the context of ODL.

Ab Rahman, A. H., A. Samad, N. S., Abdullah, A., Yasoa’, M. R., Muhamad, S. F., Bahari, N., & Mohamad, S. R. (2022). E-Learning and Sustainability of Pondok Schools: A Case Study on Post-COVID-19 E-Learning Implementation among Students of Pondok Sungai Durian, Kelantan, Malaysia. Sustainability, 14(18), 11385–10395. https://doi.org/10.3390/SU141811385
Al-Fraihat, D., Joy, M., Masa, ed, & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in Human Behavior, 102(1), 67–86. https://doi.org/10.1016/j.chb.2019.08.004
Almanasreh, E., Moles, R., & Chen, T. F. (2019, February 1). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy; Elsevier. https://doi.org/10.1016/J.SAPHARM.2018.03.066
Bessadok, A. (2015). (PDF) Classification of Student’s Belief based on their Technology Readiness for an E-learning System. Conference: INASE 2015 Recent Advances on Education and Educational Technologies, 1–10.
https://www.researchgate.net/publication/281002809_Classification_of_Student’s_Belief_based_on_their_Technology_Readiness_for_an_E-learning_System
Blut, M., & Wang, C. (2020). Technology readiness: a meta-analysis of conceptualizations of the construct and its impact on technology usage. Journal of the Academy of Marketing Science, 48(4), 649–669. https://doi.org/10.1007/S11747-019-00680-8/TABLES/5
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Frontiers in Public Health, 6, 366616.
https://doi.org/10.3389/FPUBH.2018.00149/BIBTEX
Bordoloi, R. (2018). Transforming and empowering higher education through Open and Distance Learning in India. Asian Association of Open Universities Journal, 13(1), 24–36. https://doi.org/10.1108/AAOUJ-11-2017-0037/FULL/PDF
Canals, L. (2017). Instruments for gathering data. Qualitative Approaches to Research on Plurilingual Education, 1(1), 390–401.
https://doi.org/10.14705/rpnet.2017.emmd2016.637
Chung, E., Subramaniam, G., & Dass, L. C. (2020). Online learning readiness among university students in Malaysia amidst Covid-19. Asian Journal of University Education, 16(2), 45–58. https://doi.org/10.24191/AJUE.V16I2.10294
Connell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., Barkham, M., Robotham, D., Rose, D., & Brazier, J. (2018). The importance of content and face validity in instrument development: Lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL). Quality of Life Research, 27(7), 1893–1902. https://doi.org/10.1007/S11136-018-1847-Y/TABLES/2
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly: Management Information Systems, 13(3), 319–339. https://doi.org/10.2307/249008
Ediyanto, E., Sunandar, A., Ramadhani, R. S., & Aqilah, T. S. (2022). Sustainable Instrument Development in Educational Research. Discourse and Communication for Sustainable Education, 13(1), 37–47. https://doi.org/10.2478/dcse-2022-0004
Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275–285. https://doi.org/10.1016/J.SUSOC.2022.05.004
Hung, M. L., Chou, C., Chen, C. H., & Own, Z. Y. (2010). Learner readiness for online learning: Scale development and student perceptions. Computers & Education, 55(3), 1080–1090. https://doi.org/10.1016/J.COMPEDU.2010.05.004
Kampa, R. K. (2023). Combining technology readiness and acceptance model for investigating the acceptance of m-learning in higher education in India. Asian Association of Open Universities Journal, ahead-of-print(ahead-of-print). https://doi.org/10.1108/AAOUJ-10-2022-0149/FULL/PDF
Basar, M. Z., Mansor, A. N., Jamaludin, K. A., & Alias, B. S. (2021). The Effectiveness and Challenges of Online Learning for Secondary School Students-A Case Study. Asian Journal of University Education (AJUE), 17(3), 1–11.
https://doi.org/10.24191/ajue.v17i3.14514
Mugahed Al-Rahmi, W., Alias, N., Othman, M. S., Alzahrani, A. I., Alfarraj, O., Ali Saged, A., & Abdul Rahman, N. S. (2018). Use of E-Learning by University Students in Malaysian Higher Educational Institutions: A Case in Universiti Teknologi Malaysia. IEEE Access, 6, 14268–14276. https://doi.org/10.1109/ACCESS.2018.2802325
Noh, N. H. M., Raju, R., Eri, Z. D., & Ishak, S. N. H. (2021). Extending technology acceptance model (TAM) to measure the students’ acceptance of using digital tools during open and distance learning (ODL). IOP Conf. Series: Materials Science and Engineering, 1–11. https://doi.org/10.1088/1757-899X/1176/1/012037
Obilor, E. I., & Miwari, G. U. (2022). Content Validity in Educational Assessment. International Journal of Innovative Education Research, 10(2), 57–69. www.seahipaj.org
OECD. (2016). Innovating Education and Educating for Innovation.
https://doi.org/10.1787/9789264265097-en
Parasuraman, A. (2000). Technology Readiness Index (TRI): A Multiple-Item Scale to Measure Readiness to Embrace New Technologies. Journal of Service Research, 2(4), 307–320. https://doi.org/10.1177/109467050024001
Pentang, J. T. (2023). Quantitative Research Instrumentation for Educators. Lecture Series on Research Process and Publication.
https://www.researchgate.net/publication/369119498_Quantitative_Research_Instrumentation_for_Educators
Shi, J., Mo, X., & Sun, Z. (2012, February). Content validity index in scale development. Journal of Central South University Medical Sciences; Zhong Nan Da Xue Xue Bao Yi Xue Ban. https://doi.org/10.3969/J.ISSN.1672-7347.2012.02.007
Taherdoost, H. (2021). Data Collection Methods and Tools for Research: A Step-by-Step Guide to Choose Data Collection Technique for Academic and Business Research Projects. International Journal of Academic Research in Management (IJARM), 10(1), 10–38. https://hal.science/hal-03741847
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54.
https://doi.org/10.21315/eimj2019.11.2.6
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017
Zuhairi, A., Karthikeyan, N., & Priyadarshana, S. T. (2020). Supporting students to succeed in open and distance learning in the Open University of Sri Lanka and Universitas Terbuka Indonesia. Asian Association of Open Universities Journal, 15(1), 13–35. https://doi.org/10.1108/AAOUJ-09-2019-0038/FULL/PDF

(Abdullah et al., 2024)
Abdullah, M. L., Hamidon, Z., & Shariff, S. A. (2024). Developing An ODL Technological Readiness Instrument. International Journal of Academic Research in Progressive Education and Development, 13(2), 289–301.