ISSN: 2222-6990
Open access
This study aims to provide empirical evidence of validity and reliability of a personality instrument using the Rasch Measurement Model. Data was collected from 53 samples from a public university using the 5-Point Likert scale IPIP-NEO 120 (Johnson, 2014) questionnaire. Analysis using Rasch Measurement Model is attained through summary statistics, unidimensionality analysis and persons-items fit measures. Statistically, results from the study have shown that the items in the instrument have a high degree of validity and reliability; therefore, suitable for the measurement of personality characteristics among Malaysians. Premised on the concept item response theory, the Rasch Measurement Model is an ideal mean for instrument validation.
Andrich, D. (1988). Rasch models for measurement. Newbury Park: Sage
Aryadoust, V., Tan, H. A. H. & Ng, L. Y. (2019). A Scientometric Review of Rasch Measurement: The Rise and Progress of a Specialty. Front. Psychol. 10:2197.
Abdul Aziz, A. (2011). Rasch Model Fundamentals: Scale Construct and Measurement Structure: Integrated Advance Planning Sdn. Bhd.
Abdul Aziz, A., Masodi, M. S., & Zaharim, A. (2017). Asas Model Pengukuran Rasch: Pembentukan Skala & Struktur Pengukuran. Bangi: Penerbit Universiti Kebangsaan Malaysia.
Bond, T. G., & Fox, C. M. (2001). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Oxford: Psychology Press.
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 2nd Ed. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 3rd Ed. Oxford: Psychology Press.
Carvalho, L. F., Primi, R. & Meyer, G. J. (2012). Application of the Rasch model in measuring personality disorders. Trends Psychiatry Psychother., 34 (2):101-9.
Conrad, K. M., Conrad, K. J., Dennis, M. L., & Funk, R. (2012). Validation of the self-help improvement scale to the Rasch measurement model GAIN methods report 1.0. http://gaincc.org/_data/files/Psychometrics_and_Publications/Working_Papers/Conrad_et_al_2011_SPS_Report.pdf.
Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO Personality Inventory (NEO PI-RTM) and NEO Five-Factor Inventory (NEO-FFI): Professional manual. Odessa, FL: Psychological Assessment Resources.
Cronbach, L. J. (1984). Essentials of Psychological Testing (4th Edition). New York: Harper & Row
Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modelling to questionnaire development, evaluation and refinement. Quality Life Research, 16, 5-18.
Edelsbrunner, P. A., & Dablander, F. (2019). The psychometric modelling of scientific reasoning: A Review and Recommendations for Future Avenues. Edu. Psychol. Rev. 31, 1–34.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum.
Fisher, J. W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions 21(1): 1095.
Fraenkel, J. R., & Wallen, N. E. (1996). How to design and evaluate research in education (3rd Ed.). New York: McGraw-Hill.
Darusalam, G. (2008). Kesahan dan Kebolehpercayaan Dalam Kajian Kuantitatif and Kualitatif. Jurnal Institut Perguruan Islam. April.
Gliem J. A., & Gliem R. R. (2003). Calculating, Interpreting, and Reporting Cronbach’s Alpha Reliability Coefficient for Likert-Type Scales. 2003 Midwest Research to Practice Conference in Adult, Continuing, and Community Education, Columbus, 82-88.
Goldberg, L. R. (1972). Parameters of personality inventory construction and utilization: A comparison of prediction strategies and tactics. Multivariate Behavioral Research Monograph, 7, No. 72-2.
Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. in Mervielde, Deary, De Fruyt, & Ostendorf (Eds.), Personality Psychology in Europe, Vol. 7 (pp. 7-28). Tilburg, The Netherlands: Tilburg University Press.
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R. & Gough, H. G. (2006). The International Personality Item Pool and the future of public domain personality measures. Journal of Research in Personality, 40, 84-96.
Johnson, J. A. (2000). Web-based personality assessment. Paper presented at the 71st Annual Meeting of the Eastern Psychological Association, Baltimore, MD.
Johnson, J. A. (2001, May). Screening massively large data sets for non-responsiveness in web-based personality inventories. Invited talk to the joint Bielefeld-Groningen Personality Research Group, University of Groningen, The Netherlands. Retrieved from http://www.personal.psu.edu/~j5j/papers/ConferencePapers/2001BGPRG.pdf
Johnson, J. A. (2014). Measuring Thirty Facets of the Five Factor Model with a 120-Item Public Domain Inventory: Development of the IPIP-NEO-120, Journal of Research in Personality.
Leedy, P. D., & Ormrod, J. E. (2005). Practical research planning and design (8th ed.). Upper Saddle River, New Jersey: Pearson Prentice Hall.
Linacre, J. (2002). What do Infit and Outfit, Mean Square and Standardized mean? Rasch Measurement Transactions.
Linacre, J. M. (2003). Size vs. significance: Standardized chi-square fit statistic. Rasch Measurement Transactions, 17(1), 918.
Linacre, J. M. (2004). From Microscale to Winsteps: 20 years of Rasch software development. Rasch Measurement Transactions. 17:958.
Linacre, J. M. (2014). WINSTEPS Rasch Measurement (Version 3.81.0). Beaverton, OR: Winsteps.com.
Mohamad, M. M., Sulaiman, N. L., Sern, L. C., & Salleh, K. M. (2015). Measuring the validity and reliability of research instruments. Procedia-Social and Behavioral Sciences, 204, 164-171.
Morizot, J., Ainsworth, A. T. & Reise, S. P. (2007). Toward modern psychometrics: Application of item response theory models in personality research. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (407-423). New York: Guilford Press.
Reeve, B. B., & Fayers, P. (2005). Applying item response theory modeling for evaluating questionnaire item and scale properties. In P. Fayers and R. D. Hays (Eds.), Assessing quality of life in clinical trials: Methods of practice (2nd Ed., pp. 55-73). Oxford: Oxford University Press.
Sibley, C. G., Luyten, N., Purnomo, M., Moberly, A., Wootton, L. W., Hammond, M. D., Sengupta, N., Perry, R., West-Newman, Wilson, M. S., McLellan, L., Hoverd, W. J. & Robertson, A. (2011). The Mini-IPIP6: Validation and extension of a short measure of the Big-Six factors of personality in New Zealand. New Zealand Journal of Psychology, 40, 142-159.
Sibley, C. G. (2012). The Mini-IPIP6: Item Response Theory analysis of a short measure of the big-six factors of personality in New Zealand. New Zealand Journal of Psychology, 41, 21-31.
Sick, J. (2010). Assumptions and requirements of Rasch measurement. JALT Testing & Evaluation SIG Newsletter, 14 (2): 23-29.
Smith, E. Jr. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J. Appl. Measurement. 3, 205–231.
Wilson, M. (2005). Constructing Measures: An Item Response Modelling Approach. Mahwah, NJ: Lawrence Erlbaum Associates
Wright, B. D., Linacre, J. M., Gustafson, J. E. & Martin-Loff, P. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
Wright, B. D., & Stone, M. H. (1979). Best Test Design: Rasch Measurement. Chicago, IL: Mesa Press.
Wright, B. D., & Stone, M. H. (2004). Making Measures. Chicago: The Pheneron Press.
In-Text Citation: (Mohamed et al., 2021)
To Cite this Article: Mohamed, N., Sulaiman, W. S. W., Halim, F. wati, & Masodi, M. S. (2021). An Initial Analysis of Reliability and Validity of a Personality Instrument Using the Rasch Measurement Model. International Journal of Academic Research in Business and Social Sciences, 11(9), 1735–1755.
Copyright: © 2021 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode