Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

The Prospective of Situational Judgement Test in Assessing Individual Performance

Nurhafizah Abdul Musid, Mohd Effendi@Ewan Mohd Matore, Aida Hanim A. Hamid

http://dx.doi.org/10.6007/IJARPED/v11-i3/15401

Open access

The Situational Judgement Test (SJT) is one of the evaluation instruments that is often used nowadays. Usually, SJT is used for evaluating performance on an individual level. In an SJT, a hypothetical situation is presented, and the candidate is asked to rate possible responses or choose one from a list of options. There are two different categories of response options: knowledge-based and behaviour-based. Additional response formats for the SJT include rating, ranking, and multiple choice. These formats are helpful for assessments because different response formats have varying relationships with knowledge, cognitive ability, and other constructs. These relationships depend on the test's specifications as well as the context or stage of the education and training pathway that the SJT is targeting. By using SJT, it offers reliable and valid implicit evaluation. Secondly, SJT have minimal cost impact and are simple to administrate. Thirdly, SJT is a well-liked method for evaluating emotional abilities. As a result, SJT enhances assessment by providing a reliable and economical instrument for gauging non-academic abilities. Besides having numerous advantages, there are still several issues in using the SJT including gender inequalities and measurement difficulty. Therefore, future research may focus on using SJT in assessing individual performance such as leadership. In addition, SJT may also be used to assess how job seekers behave while submitting their applications. When someone applies to enroll in any college to further their education, the SJT can also be utilised to evaluate their expertise.

Ajzen, I., & Fishbein, M. (1980). Understanding Attitudes and Predicting Social Behaviour. New Jersey: Prentice Hall.
Allport, G. W. (1927). Concepts of Trait and Personality. Psychological Bulletin 24(5): 284–293.
Bardach, L., Rushby, J. V., Kim, L. E., & Klassen, R. M. (2021). Using Video- and Text-Based Situational Judgement Tests for Teacher Selection: A Quasi-Experiment Exploring the Relations between Test Format, Subgroup Differences, and Applicant Reactions. European Journal of Work and Organizational Psychology 30(2): 251–264. doi:10.1080/1359432X.2020.1736619
Benson, N. F., Floyd, R. G., Kranzler, J. H., Eckert, T. L., Fefer, S. A., & Morgan, G. B. (2019). Test Use and Assessment Practices of School Psychologists in the United States: Findings from the 2017 National Survey. Journal of School Psychology 72: 29–48.
Bruk-Lee, V., Lanz, J., Drew, E. N., Coughlin, C., Levine, P., Tuzinski, K., & Wrenn, K. (2016). Examining Applicant Reactions to Different Media Types in Character-Based Simulations for Employee Selection. International Journal of Selection and Assessment 24(1): 77–91.
Catano, V. M., Brochu, A., & Lamerson, C. D. (2012). Assessing the Reliability of Situational Judgment Tests Used in High-Stakes Situations. International Journal of Selection and Assessment 20(3): 333–346.
Chan, D., & Schmitt, N. (1997). Video-Based Versus Paper-and-Pencil Method of Assessment in Sitational Judgment Tests: Subgroup Differences in Test Performance and Face Validity Perceptions. Journal of Applied Psychology 82(1): 143–159.
Chatman, J. A. (1989). Improving Interactional Organizational Research: A Model of Person-Organization Fit. Academy of Management Review 14(3): 333–349.
Christian, M. S., Edwards, B. D., & Bradley, J. C. (2010). Situational Judgment Tests: Constructs Assessed and A Meta-Analysis of Their Criterion-Related Validity. Personnel Psychology 63(1): 83–117.
De la Croix, A., & Veen, M. (2018). The Reflective Zombie: Problematizing the Conceptual Framework of Reflection in Medical Education. Perspectives on Medical Education 7(6): 394–400.
Eagly, A. H. (1987). Sex Differences in Social Behavior: A Social-Role Interpretation. Erlbaum.
Frohlich, M., Kahmann, J., & Kadmon, M. (2017). Development and Psychometric Examination of a German Video-Based Situational Judgment Test for Social Competencies in Medical School Applicants. International Journal of Selection and Assessment 25(1): 94–110.
Heier, L., Gambashidze, N., Hammerschmidt, J., Riouchi, D., Geiser, F., & Ernstmann, N. (2022). Development and Testing of the Situational Judgement Test to Measure Safety Performance of Healthcare Professionals: An Explorative Cross-Sectional Study. Nursing Open 9(1): 684–691.
Hooper, A. C., Cullen, M. J., & Sackett, P. R. (2006). Operational Threats to the Use of SJTs: Faking, Coaching, and Retesting Issues. Dlm. Weekley (pnyt.) & Ployhart (pnyt.). Situational Judgement Tests: Theory, Measurement and Application, hlm. 205–232. Lawrence Erlbaum.
Judge, T. A., & Zapata, C. P. (2015). The Person-Situation Debate Revisited: Effect of Situation Strength and Trait Activation on the Validity of the Big Five Personality Traits in Predicting Job Performance. Academy of Management Journal 58(4): 1149–1179.
Klassen, R. M., Kim, L. E., Rushby, J., & Bardach, L. (2020). Can We Improve How We Screen Applicants for Initial Teacher Education? Teaching and Teacher Education 87(102949): 1–11.
Kret, M. E., & de Gelder, B. (2012). A Review on Sex Differences in Processing Emotional Signals. Neuropsychologia 50(7): 1211–1221.
Lievens, F. (2013). Adjusting Medical School Admission: Assessing Interpersonal Skills Using Situational Judgement Tests. Medical Education 39(4): 653–686.
Lievens, F., & Motowidlo, S. J. (2016). Situational Judgment Tests: From Measures of Situational Judgment to Measures of General Domain Knowledge. Industrial and Organizational Psychology 9(1): 3–22. doi:10.1017/iop.2015.71
Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational Judgment Tests: A Review of Recent Research. Personnel Review 37(4): 426–441.
McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb III, W. L. (2007). Situational Judgment Tests, Response Instructions and Validity: A Meta-Analysis. Personnel Psychology 60(1): 63–91.
McDaniel, M. A., & Nguyen, N. T. (2001). Situational Judgment Tests: A Review of Practice and Constructs Assessed. International Journal of Selection and Assessment 9(1/2): 103–113.
Motowidlo, S. J., & Beier, M. E. (2010). Differentiating Specific Job Knowledge from Implicit Trait Policies in Procedural Knowledge Measured by a Situational Judgment Test. Journal of Applied Psychology 95(2): 321–333.
Motowidlo, S. J., Crook, A. E., Kell, H. J., & Naemi, B. (2009). Measuring Procedural Knowledge More Simply with a Single-Response Situational Judgment Test. Journal of Business and Psychology 24(3): 281–288.
Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An Alternative Selection Procedure: The Low-Fidelity Simulation. Journal of Applied Psychology 75(6): 640–647.
Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006a). Implicit Policies about Relations between Personality Traits and Behavioral Effectiveness in Situational Judgement Tests. Journal of Applied Psychology 91(4): 749–761.
Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006b). A Theoretical Basis for Situational Judgment Tests. Situational Judgement Tests: Theory, Measurement and Application. Mahwah, New Jersey: Lawrence Erlbaum Associates.
Motowidlo, S. J., Lievens, F., & Chosh, K. (2018). Prosocial Implicit Trait Policies Underlie Performance on Different Situational Judgement Tests with Interpersonal Content. Human Performance 31(4): 238–254.
Muck, P. M. (2013). Entwicklung Von Situational Judgement Tests. Zeitschrift Für Arbeits- Und Organisations Psychologie A&O 57(4): 185–205.
Mumford, S. (2015). The Situational Judgment Test: Cognition, Constructs and Criterion Validity. University of Sheffield.
Oostrom, J. K., De Soete, B., & Lievens, F. (2015). Situational Judgment Testing: A Review and Some New Developments. Dlm. Nikolaou (pnyt.) & Oostrom (pnyt.). Employee Recruitment, Selection and Assessment: Contemporary Issues for Theory and Practice, hlm. 172–189. Sussex: Psychology Press.
Papadakis, S., Vaiopoulou, J., Kalogiannakis, M., & Stamovlasis, D. (2020). Developing and Exploring an Evaluation Tool for Educational Apps (E.T.E.A) Targeting Kindergarten Children. Sustainability 12(4201): 1–10.
Patterson, F., Galbraith, K., Flaxman, C., & Kirkpatrick, C. M. J. (2019). Evaluation of a Situational Judgement Test to Develop Non-Academic Skills in Pharmacy Students. American Journal of Pharmaceutical Education 83(10): 2092–2101. doi:10.5688/ajpe7074
Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016). How Effective are Selection Methods in Medical Education? A Systematic Review. Medical Education 50(1): 36–60.
Patterson, F., Zibarras, L., & Ashworth, V. (2016). Situational Judgement Tests in Medical Education and Training: Research, Theory and Practice: AMEE Guide No.100. Medical Teacher 3(1): 3–17.
Peterson, R. A., Rhi-Perez, P., & Albaum, G. (2014). A Cross-National Comparison of Extreme Response Style Measures. International Journal of Market Research 56(1): 89–110.
Sackett, P. R., & Lievens, F. (2008). Personnel Selection. Annual Review of Psychology 59: 419–450. doi:10.1146/annurev.psych.59.103006.093716
Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika 74(1): 107–120.
Smith, K. J., Flaxman, C., Farland, M. Z., Thomas, A., Buring, S. M., Whalen, K. & Patterson, F. (2020). Development and Validation of a Situational Judgement Test to Assess Professionalism. American Journal of Pharmaceutical Education 84(7): 985–992. doi:10.5688/ajpe7771
St-Sauveur, C., Girouard, S., & Goyette, V. (2014). Use of Situational Judgment Tests in Personnel Selection: Are the Different Methods for Scoring the Response Options Equivalent? International Journal of Selection and Assessment 22(3): 225–239.
Tett, R. P., & Burnett, D. D. (2003). A Personality Trait-Based Interactionist Model of Job Performance. Journal of Applied Psychology 88(3): 500–517.
Tiffin, P. A., Paton, L. W., O’Mara, D., MacCann, C., Lang, J. W. B., & Lievens, F. (2020). Situational Judgement Tests for Selection: Traditional vs Construct-Driven Approaches. Medical Education 54(2): 105–115. doi:10.1111/medu.14011
Upton, C. L. (2009). Virtue Ethics and Moral Psychology: The Situationism Debate. Journal of Ethics 13(2–3): 103–115.
Webster, E. S., Paton, L. W., Crampton, P. E. S., & Tiffin, P. A. (2020). Situational Judgement Test Validity for Selection: A Systematic Review and Meta-Analysis. Medical Education 54(10): 888–902. doi:10.1111/medu.14201
Whetzel, D. L., & McDaniel, M. A. (2009). Situational Judgment Tests: An Overview of Current Research. Human Resource Management Review 19(3): 188–202.
Whetzel, D. L., McDaniel, M. A., & Nguyen, N. T. (2008). Subgroup Differences in Situational Judgment Test Performance: A Meta-Analysis. Human Performance 21(3): 291–309.
Wingenbach, T. S. H., Ashwin, C., & Brosnan, M. (2018). Sex Differences in Facial Emotion Recognition Across Carrying Expression Intensity Levels from Videos. PLoS One 13(1): e0190634.

In-Text Citation: (Musid et al., 2022)
To Cite this Article: Musid, N. A., Matore, M. E. M., & Hamid, A. H. A. (2022). The Prospective of Situational Judgement Test in Assessing Individual Performance. International Journal of Academic Research in Progressive Education and Development, 11(3), 1810–1819.