ISSN: 2222-6990
Open access
This research aims to evaluate the validity of the Competency Instrument for lecturers in the Construction Technology program in the context of Outcome-Based Education (OBE) at Malaysian Vocational Colleges. This evaluation measures the instrument's effectiveness in assessing the three elements of competence: knowledge, skills, and attitudes. Outcome-based education has been adopted by the Vocational College since the introduction of the diploma program in 2014. Seven experts reviewed each item of the instrument, and the Fleiss Kappa coefficient value was used to analyze the findings. The resulting Kappa values were k=0.83 for the knowledge construct, k=0.83 for the skills construct, and k=0.91 for the attitudes construct, with an overall Fleiss Kappa value of k=0.85, indicating that the instrument is at a good level. The study's findings suggest that the instrument is suitable for implementing a pilot study and can effectively measure the competence of lecturers in the Construction Technology program within the OBE framework. Furthermore, this instrument can serve as a useful reference for evaluating lecturer practices in other Higher Education Institutions.
Raof, S. A., Jamal, A. H. M. @., & Saipudin, N. A. (2022). Analysis on the readiness of Vocational college lecturers to implement OBE approach. International Journal of Academic Research in Business & Social Sciences, 12(1), 1489-1505. https://doi.org/10.6007/ijarbss/v12-i1/12061
Damit, M. A. A., Omar, M. K., & Puad, M. H. M. (2021). Issues and Challenges of Outcome-based Education (OBE) Implementation among Malaysian Vocational College Teachers. International Journal of Academic Research in Business & Social Sciences, 11(3), 197-211. https://doi.org/10.6007/ijarbss/v11-i3/8624
Agir, N., Effendi, M., Matore, M. E. E. M., Faamanatu-Eteuati, N., & Márquez, N. (2023). Outcome-Based assessment in the evaluation of education Programs through a systematic literature review. International Journal of Academic Research in Progressive Education and Development, 12(2), 2662-2677. https://doi.org/10.6007/ijarped/v12-i2/18095
Akbari, R., & Yazdanmehr, E. (2014). A critical analysis of the selection criteria of expert teachers in ELT. Theory and Practice in Language Studies, 4(8), 1653-1658. https://doi.org/10.4304/tpls.4.8.1653-1658
Ortega, R. A. A., & Cruz, R. A. O. (2016). Educators’ Attitude towards Outcomes-Based Educational Approach in English Second Language Learning. American Journal of Educational Research, 4(8), 597–601. https://doi.org/10.12691/education-4-8-3
Arifin, M. A., & Rasdi, R. M. (2017). The Competent Vocational College Teacher: A proposed model for Effective Job performance. International Journal of Academic Research in Business and Social Sciences, 7(2), 829-837. https://doi.org/10.6007/IJARBSS/v7-i2/2719
Baguio, J. B. (2019). Outcomes-Based Education: Teachers’ attitude and implementation. Academe, 7(1), 110–127. https://doi.org/10.15631/ubmrj.v7i1.113
Berawi, F. M. (2018). Metodologi Penyelidikan: Panduan Menulis Tesis (1st ed.). Universiti Utara Malaysia.
Cabaces, J., Blanco, A. J. S., Cabanas, J. E. A., Casapao, C. G., Guzman, J. P. De, Villa, M. A. C. De, & Derla, R. V. R. (2014). Perception and Awareness of Nigerian Students towards Outcome-Based Education. International Journal of Academic Research in Progressive Education and Development, 3(1), 208–219. https://doi.org/10.6007/ijarped/v3-i1/761
Chráska, M., & Chrásková, M. (2016). Semantic Differential and its Risks in the Measurement of Students’ Attitudes. Procedia - Social and Behavioral Sciences, 217, 820–829. https://doi.org/10.1016/j.sbspro.2016.02.155
Creswell, J. W. (2014). Research Design: Qualitative, Quantitative, and Mixed Method Approaches (4th ed.). SAGE Publications.
Davies, M., & Fleiss, J. L. (1982). Measuring agreement for multinomial data. Biometrics, 38(4), 1047-1051. https://doi.org/10.2307/2529886
Dawes, J. (2008). Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10- point scales. International Journal of Market Research, 50(1). https://doi.org/10.1177/147078530805000106
Dayananda, P., Latte, M. V., Raisinghani, M. S., & Cn, S. (2020). New approach for target setting mechanism of course outcomes in higher education accreditation. Journal of Economic and Administrative Sciences, 37(1), 79–89. https://doi.org/10.1108/jeas-03-2020-0024
Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378–382. https://doi.org/10.1037/h0031619
Halibas, A. S., Mehtab, S., Al-Attili, A., Alo, B., Cordova, R. S., & Cruz, M. E. L. T. (2020). A thematic analysis of the quality audit reports in developing a framework for assessing the achievement of the graduate attributes. International Journal of Educational Management, 34(5), 917–935. https://doi.org/10.1108/ijem-07-2019-0251
Hapinat, H. L. (2023). Practices on the outcomes-based education (OBE) implementation in select HEI graduate school programs in the Philippines as input to institutionalizing mandatory accreditation. International Journal of Advanced and Applied Sciences, 10(3), 167–182. https://doi.org/10.21833/ijaas.2023.03.021
Hassan, N., Puteh, S., & Sanusi, A. B. M. (2019). Fleiss’s Kappa: Assessing the concept of Technology Enabled Active Learning (TEAL). Journal of Technical Education and Training, 11(1), 109-118. https://doi.org/10.30880/jtet.2019.11.01.014
Ismail, A. E., Hassan, R., Bakar, A. A., Hanipah, H., Hanafiah, M. A. M., & Asary, L. H. (2018). The development of tvet educator competencies for quality educator. Journal of Technical Education and Training, 10(2), 38-48.
https://doi.org/10.30880/jtet.2018.10.02.004
Ismail, K., Omar, M. K., & Abdullah, A. (2019). Professional management competency for TVET teachers in Engineering faculty at vocational college. International Journal of Academic Research in Progressive Education and Development, 8(4), 33-46.
https://doi.org/10.6007/ijarped/v8-i4/6433
Lam, K. W., Hassan, A., Sulaiman, T., & Kamarudin, N. (2018). Evaluating the face and content validity of an instructional Technology competency instrument for university lecturers in Malaysia. International Journal of Academic Research in Business & Social Sciences, 8(5), 376-385. https://doi.org/10.6007/ijarbss/v8-i5/4108
Kob, C. G. C., Osman, M. Z., & Ghafar, N. F. A. (2017). Kompetensi tenaga pengajar dalam pengajaran Amali pembuatan perabot di Malaysia. The Emerging Trends of TVET and Social Sciences in Asia Pacific Countries, 10(3–3), 25-32.
https://doi.org/10.11113/sh.v10n3-3.1512
Laguador, J. M., & Dotong, C. I. (2014). Knowledge versus Practice on the Outcomes-Based Education Implementation of the Engineering Faculty Members in LPU. International Journal of Academic Research in Progressive Education and Development, 3(1), 66–79. https://doi.org/10.6007/ijarped/v3-i1/640
Sern, L. C., Hamisu, M., & Salleh, K. M. (2018). Determining the elements of TVET teachers competency for Nigerian higher learning institutions. Journal of Physics: Conference Series, 1049, 012078. https://doi.org/10.1088/1742-6596/1049/1/012078
Landis, J. R., & Koch, G. G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1), 159–174. https://doi.org/doi.org/10.2307/2529310
Latif, N. A. A., & Nor, M. Y. M. (2021). Continuous Quality Improvement (CQI) Practice in Vocational Colleges. International Journal of Modern Education, 3(8), 211–225. https://doi.org/10.35631/ijmoe.380017
Luque-Vara, T., Linares-Manrique, M., Fernández-Gómez, E., Martín-Salvador, A., Sánchez?Ojeda, M. A., & Enrique-Mirón, C. (2020). Content Validation of an Instrument for the Assessment of School Teachers’ Levels of Knowledge of Diabetes through Expert Judgment. International Journal of Environmental Research and Public Health, 17(22), 8605. https://doi.org/10.3390/ijerph17228605
Syeed, M. M. M., Shihavuddin, A., Uddin, M. F., Hasan, M., & Khan, R. H. (2022). Outcome Based Education (OBE): Defining the process and practice for engineering education. IEEE Access, 10, 119170–119192. https://doi.org/10.1109/access.2022.3219477
Ministry of Education. (2017). Dasar pendidikan kebangsaan (4th ed.). Kementerian Pendidikan Malaysia.
Ministry of Education. (2018). Garis Panduan Pembangunan Program Akademik Universiti Awam (2nd ed.). Kementerian Pendidikan Malaysia.
Mohamad, M. S., Lian, O. C., Zain, M. M., Yunus, B. M., & Sidek, N. (2021). Student Attainment Measurement System in Civil Engineering Undergraduate Programme: Asian Journal of University Education, 17(2), 191-202. https://doi.org/10.24191/ajue.v17i2.13397
Moons, F., & Vandervieren, E. (2023). Measuring agreement among several raters classifying subjects into one-or-more (hierarchical) nominal categories. A generalisation of Fleiss’ kappa. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.12502
Omar, M. K., Zahar, F. N., & Rashid, A. M. (2020). Knowledge, skills, and attitudes as predictors in determining teachers’ competency in Malaysian TVET institutions. Universal Journal of Educational Research, 8(3C), 95–104. https://doi.org/10.13189/ujer.2020.081612
Osman, M. Z., Kob, C. G. C., & Abdullah, S. S. S. (2019). Competency of teachers in teaching practical implementation of subject Furniture Manufacturing for Malaysian Skills Certification Program. International Journal of Academic Research in Business & Social Sciences, 9(5), 78-89. https://doi.org/10.6007/ijarbss/v9-i5/5841
Saibon, R. A., & Kamis, A. (2019). Employability Skills in Business Management Graduate and Role of Malaysian Vocational College. International Journal of Academic Research in Business and Social Sciences, 9(2), 1175–1192. https://doi.org/10.6007/ijarbss/v9-i2/5674
Sekaran, U., & Bougie, R. (2016). Research Method for Business: A Skill Building Approach (7th ed.). John Wiley & Sons Ltd.
Spencer, L. M., & Spencer, S. M. (1993). Competence at Work. Wiley.
Stemler, S. (2001). An overview of content analysis. Practical Assessment, Research, and Evaluation, 7(17), 1–6. https://doi.org/doi.org/10.7275/z6fm-2e34
Wong, S.-C. (2020). Competency Definitions, Development and Assessment: A Brief Review. International Journal of Academic Research in Progressive Education and Development, 9(3), 95–114. https://doi.org/10.6007/ijarped/v9-i3/8223
Yusof, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Yusof, R., Othman, N., Norwani, N. M., Ahmad, N. L., & Jalil, N. B. A. (2017). Implementation of Outcome- based Education (OBE) in accounting programme in higher education. International Journal of Academic Research in Business & Social Sciences, 7(6), 1186-1200. https://doi.org/10.6007/ijarbss/v7-i6/3352
(Sobry et al., 2024)
Sobry, H. C., Kob, C. G. C., & Rokeman, N. R. M. (2024). The Validity of the Competency Instrument for Construction Technology Program Lecturers in the Practice of Outcome-based Education (OBE). International Journal of Academic Research in Business and Social Sciences, 14(2), 981–996.
Copyright: © 2024 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seenavc at: http://creativecommons.org/licences/by/4.0/legalcode