Journal Screenshot

International Journal of Academic Research in Business and Social Sciences

Open Access Journal

ISSN: 2222-6990

Assessing the Relationship between Kirkpatrick Level 4 Assessment Model and Ideological and Political Theory Courses on Meaning of Life among Chinese University Students: A Quantitative Study

Liu Bin, Ratna Roshida Binti Ab Razak, Lee Yok Fee, Mohd Sabri Md. Nor

http://dx.doi.org/10.6007/IJARBSS/v14-i6/21643

Open access

This quantitative study investigates the relationship between the Kirkpatrick Level 4 Assessment Model, ideological and political theory courses, and the meaning of life among Chinese university students. A sample of 90 participants from three universities (Tsinghua University, Peking University, and Fudan University) completed measures assessing educational effectiveness, ideological endorsement, and perceptions of the meaning of life. Descriptive statistics, correlation analysis, regression analysis, and mediation analysis were conducted to examine the relationships among variables. Additionally, comparisons were made across universities, genders, and age groups. The results revealed significant positive correlations between the Kirkpatrick model and Marx's theory, as well as between ideological endorsement and perceptions of the meaning of life. Both the Kirkpatrick model and Marx's theory emerged as significant predictors of meaning in life, with age also playing a significant role. Furthermore, mediation analysis indicated indirect effects of the Kirkpatrick model and Marx's theory on the relationship between ideological education and perceptions of the meaning of life. Peking University consistently exhibited the highest mean scores across variables, suggesting potential differences in educational approaches and ideological climates among universities. Gender differences were non-significant, but age emerged as a significant predictor of existential perceptions. This research enriches our comprehension of the intricate relationship between educational encounters, ideological frameworks, and existential viewpoints among college students.

Bond, M. H., & Hwang, K. K. (1986). The social psychology of Chinese people. In M. H. Bond (Ed.), The Psychology of the Chinese People (pp. 213–266). Oxford University Press.
Bond, M. H., & Hwang, K. K. (1986). The social psychology of Chinese people. In M. H. Bond (Ed.), The Psychology of the Chinese People (pp. 213–266). Oxford University Press.
Bukowski, M., Neufeld, S., & Bock, A. (2015). Gender Differences in the Experience of Meaning in Life. Journal of Happiness Studies, 16(4), 949–968.
Chan, J. K. (2013). Confucian Perfectionism: A Political Philosophy for Modern Times. Princeton University Press.
Cheng, C. (2019). Existential psychology and Chinese philosophy on life: A dialogue on the Chinese vision of the meaning of life. Journal of Theoretical and Philosophical Psychology, 39(1), 22–35.
DeVellis, R. F. (2016). Scale Development: Theory and Applications (4th ed.). SAGE Publications.
Erikson, E. H. (1959). Identity and the Life Cycle. New York: International Universities Press.
Fan, X. (2010). Statistical significance and effect size in education research: Two sides of a coin. Journal of Educational Research, 105(3), 241–253.
Frankl, V. E. (1985). Man's Search for Meaning. Simon and Schuster.
Hogg, M. A., & Blaylock, D. L. (2019). The Role of Ideology in Existential Beliefs and Meaning in Life. Social Psychological Bulletin, 14(3), 1-15.
Hu, Y., Gan, Y., & Zheng, Y. (2015). The Chinese version of the Meaning in Life Questionnaire: Assessing meaning in life in Chinese patients with psychiatric disorders. Psychiatry Research, 228(3), 781–786.
Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels. Berrett-Koehler Publishers.
Liu, J., Chen, X., & Chan, D. K. (2018). Exploring the roles of meaning in life and social support in the relationship between psychological capital and psychological distress among Chinese undergraduate students. Frontiers in Psychology, 9, 2353.
McLeod, S. (2020). Cross-sectional Study: Definition, Advantages, and Disadvantages. Simply Psychology. https://www.simplypsychology.org/cross-sectional.html
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
Smith, A. (2017). The Influence of Educational Quality on Ideological Beliefs: Evidence from Sub-Saharan Africa. Education Economics, 25(2), 115-132.
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006). The Meaning in Life Questionnaire: Assessing the presence of and search for meaning in life. Journal of Counseling Psychology, 53(1), 80–93.
Wang, Q., Pomerantz, E. M., & Chen, H. (2007). The role of parents’ control in early adolescents’ psychological functioning: A longitudinal investigation in the United States and China. Child Development, 78(5), 1592–1610.
Wang, Q., Pomerantz, E. M., & Chen, H. (2007). The role of parents’ control in early adolescents’ psychological functioning: A longitudinal investigation in the United States and China. Child Development, 78(5), 1592–1610.
Yang, Y., Shen, Y., & Zhu, F. (2018). Assessing meaning in life in Chinese university students: Psychometric properties of the Chinese version of the Meaning in Life Questionnaire. Journal of Pacific Rim Psychology, 12, e25.
Martela, F., & Steger, M. F. (2016). The three meanings of meaning in life: Distinguishing coherence, purpose, and significance. The Journal of Positive Psychology, 11(5), 531-545.
Schwartz, S. H. (2012). An overview of the Schwartz theory of basic values. Online readings in Psychology and Culture, 2(1), 11.
Seghezzo, L. (2009). The five dimensions of sustainability. Environmental politics, 18(4), 539-556.
Mustafa, F., Abdussaboor, M., & Ali, T. (2023). The Sufi Islam and Mysticism in Islamic Philosophy. Al-Kashaf, 3(3), 9-15.
Cooperrider, D. L., & Srivastva, S. (2013). A Contemporary Commentary on Appreciative Inquiry in Organizational LifeAppreciative Inquiry in Organizational Life? Cooperrider, D. and Srivastva, S.(1987). Appreciative inquiry in organizational life. In R. Woodman and W. Pasmore (Eds.), Research in organizational change and development, Vol. 1, pp. 129–169. In Organizational generativity: The appreciative inquiry summit and a scholarship of transformation (Vol. 4, pp. 3-67). Emerald Group Publishing Limited.
Gergen, K. J. (2001). Psychological science in a postmodern context. American psychologist, 56(10), 803.
McAdams, D. P. (1996). Personality, modernity, and the storied self: A contemporary framework for studying persons. Psychological inquiry, 7(4), 295-321.
Liu, J. (2011). Reconstructing Chinese Metaphysics. Journal of East-West Thought, 1(1), 151-63.
Hammerstrom, E. J. (2016). Buddhism and the Modern Epistemic Space: Buddhist Intellectuals in the Science and Philosophy of Life Debates. In Recovering Buddhism in Modern China (pp. 79-110). Columbia University Press.
Littlejohn, R. L. (2021). Chinese philosophy and philosophers: An introduction. Bloomsbury Publishing.
Shan, H., & Guo, S. (2014). Massification of Chinese higher education: Opportunities and challenges in a globalizing context. A Comparative Analysis of Higher Education Systems, 9-23.
Rogers, R. (2011). Critical approaches to discourse analysis in educational research. In An introduction to critical discourse analysis in education (pp. 1-20). Routledge.
Sleeter, C. E. (2002). State curriculum standards and the shaping of student consciousness. Social Justice, 29(4 (90), 8-25.
Bokhorst?Heng, W. D. (2007). Multiculturalism’s narratives in Singapore and Canada: Exploring a model for comparative multiculturalism and multicultural education. Journal of Curriculum Studies, 39(6), 629-658.
Nam, B. H., Yang, Y., & Draeger Jr, R. (2023). Intercultural communication between Chinese college students and foreign teachers through the English corner at an elite language university in Shanghai. International Journal of Intercultural Relations, 93, 101776.
Kennedy, P. E., Chyung, S. Y., Winiecki, D. J., & Brinkerhoff, R. O. (2014). Training professionals' usage and understanding of K irkpatrick's Level 3 and Level 4 evaluations. International Journal of Training and Development, 18(1), 1-21.
Cahapay, M. (2021). Kirkpatrick model: Its limitations as used in higher education evaluation. International Journal of Assessment Tools in Education, 8(1), 135-144.
Gessler, M. (2009). The correlation of participant satisfaction, learning success and learning transfer: an empirical investigation of correlation assumptions in Kirkpatrick's four-level model. International Journal of Management in Education, 3(3-4), 346-358.
Thalheimer, W. (2018). The learning-transfer evaluation model. Worklearning. com. Viewed at https://www. worklearning.com/wp-content/uploads/2018/02/Thalheimer-The-Learning-Transfer-Evaluation-Model-Report-for-LTEM-v11a-002. pdf. Visited September, 30, 2018.
Zainol, M. A., Hashim, A., & Kasim, A. Y. (2017). Application of Kirkpatrick Model for Effectiveness of Islamic Education Teacher Programme. International Journal of Academic Research in Business and Social Sciences, 7(11), 361-368.
Smidt, A., Balandin, S., Sigafoos, J., & Reed, V. A. (2009). The Kirkpatrick model: A useful tool for evaluating training outcomes. Journal of Intellectual and Developmental Disability, 34(3), 266-274.
Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3), 116.
Steensma, H., & Groeneveld, K. (2010). Evaluating a training using the “four levels model”. Journal of Workplace Learning, 22(5), 319-331.
Tamkin, P., Yarnall, J., & Kerrin, M. (2002). Kirkpatrick and Beyond: A review of models of training evaluation. Brighton, England: Institute for Employment Studies.
Yardley, S., & Dornan, T. (2012). Kirkpatrick’s levels and education ‘evidence’. Medical education, 46(1), 97-106.
Foreman, S. M. (2008). Kirkpatrick model: Training evaluation practices in the pharmaceutical industry. Capella University.
Hyslop-Margison, E. J., & Naseem, A. (2007). Scientism and education: Empirical research as neo-liberal ideology. Springer Science & Business Media.
Sandage, S. J., Jankowski, P. J., Crabtree, S. A., & Schweer-Collins, M. L. (2017). Calvinism, gender ideology, and relational spirituality: An empirical investigation of worldview differences. Journal of Psychology and Theology, 45(1), 17-32.
Barretti, M. (2004). What do we know about the professional socialization of our students?. Journal of Social Work Education, 40(2), 255-283.
Onraet, E., Van Hiel, A., Dhont, K., Hodson, G., Schittekatte, M., & De Pauw, S. (2015). The association of cognitive ability with right–wing ideological attitudes and prejudice: A meta–analytic review. European Journal of Personality, 29(6), 599-621.
Perach, R., & Wisman, A. (2019). Can creativity beat death? A review and evidence on the existential anxiety buffering functions of creative achievement. The Journal of Creative Behavior, 53(2), 193-210.
Kavale, K. A., & Mostert, M. P. (2003). River of ideology, islands of evidence. Exceptionality, 11(4), 191-208.
Jost, J. T. (2017). Ideological asymmetries and the essence of political psychology. Political psychology, 38(2), 167-208.

(Bin et al., 2024)
Bin, L., Razak, R. R. B. A., Fee, L. Y., & Nor, M. S. M. (2024). Assessing the Relationship between Kirkpatrick Level 4 Assessment Model and Ideological and Political Theory Courses on Meaning of Life among Chinese University Students: A Quantitative Study. International Journal of Academic Research in Business and Social Sciences, 14(6), 532–545.