Rasch Model Analysis of the Psychometric Properties of the Positive Mental Health Scale in Students

Document Type : Original Article

Authors

1 PhD in Educational Psychology, Zeynabiyeh Pishva, Farhangian University, Varamin, Iran.

2 Associate Professor, Department of Psychology, Garmsar Branch, Islamic Azad University, Garmsar, Iran.

Abstract

Introduction: Mental health encompasses more than just the absence of pathological symptoms or diseases; it also includes the presence of positive mental health indicators. The aim of the present study was to determine the psychometric properties of the Positive Mental Health Scale based on the Rasch model.
Method: This study was quantitative and descriptive, focusing on the analysis of students' responses to the Positive Mental Health Scale, which is based on the Rasch model. Therefore, the study was psychometric in nature. The sample consisted of 609 students from Farhangian University in Tehran during the academic year 2021-2022. These students were selected through convenience sampling and completed the Positive Mental Health Scale.
Results: The results of the exploratory factor analysis and parallel analysis indicated the presence of a dominant factor. Additionally, the confirmatory factor analysis corroborated the findings of the exploratory factor analysis. None of the items exhibited local dependence; therefore, the hypothesis that the scale is unifactorial was confirmed. Based on the Partial Credit Model (PCM), the values of the two Infit and Outfit indices ranged from 0.5 to 1.5, indicating a good fit of the scale items with the Rasch model. The item difficulty index was determined to be at a moderate level, ranging from -0.2008 to 0.1486. The results of the item characteristic curves indicated that all items demonstrated good suitability. Additionally, the scale exhibited measurement stability across different genders. No item differential interaction (DIF) was identified based on gender. The person-item reliability coefficient was 0.88, Cronbach's alpha was 0.86, and McDonald's omega coefficient was 0.84.
Discussion and conclusion: The results of the study indicated that the Positive Mental Health Scale is a unidimensional instrument with favorable psychometric properties for assessing positive mental health in students. It can also be utilized to evaluate interventions in this area.

Keywords

References

  1. Yousefi N, Pirkhaefi A, Borjali A.. 'Investigating the Psychometric of the Mental Health Continuum-Short Form Scale', Clinical Psychology and Personality. 2020; 18(2): 129-144. https://doi.org/‌10.22070/cpap.2020.2945 [In Persian]
  2. Dore´ I, O’Loughlin JL, Sabiston CM, Fournier L. Psychometric evaluation of the Mental Health Continuum–Short Form in French Canadian young adults. The Canadian Journal of Psychiatry. 2017; 62(4): 286–94. https://doi.org/1177/0706743716675855
  3. Keyes CL. The Nature and Importance of Positive Mental Health in America’s Adolescents. In Handbook of positive psychology in schools 2009 Mar 4; 27-42. Routledge. http://www.ldysinger.com/@books1/Snyder_Hndbk_Positive_Psych/Snyder_Lopez_Handbook_of_Positive_Psychology.pdf
  4. Keyes CLM. Mental illness and/or mental health? Investigating axioms of the complete state model of Journal of Consulting and Clinical Psychology. 2005; 73(3): 539–48. https://doi.org/10.1037/0022-006X.73.3.539
  5. Keyes CLM, Dhingra SS, Simoes EJ. Change in level of positive mental health as a predictor of future risk of mental illness. American Journal of Public Health. 2010; 100(12): 2366–71. https://doi.org/2105/AJPH.2010.192245
  6. Westerhof GJ, Keyes CLM. Mental illness and mental health: The two continua model across the lifespan. Journal of Adult Development. 2010; 17(2): 110–9. https://doi.org/1007/s10804-009-9082-y
  7. Doré I, O’Loughlin JL, Sabiston CM, Fournier L. Psychometric evaluation of the mental health continuum–short form in French Canadian young adults. The Canadian Journal of Psychiatry. 2017 Apr; 62(4): 286-94. https://doi.org/1177/0706743716675855
  8. Westerhof GJ, Keyes CL. Geestelijke gezondheid is meer dan de afwezigheid van geestelijke ziekte. 2008; 63: 808–20. https://www.researchgate.net/publication/241878819_Geestelijke_gezondheid_is_meer_dan_de_afwezigheid_van_geestelijke_ziekte
  9. Keyes CLM, Wissing M, Potgieter JP, Temane M, Kruger A, Van Rooy S. Evaluation of the mental health continuum–short form (MHC–SF) in setswana-speaking South Africans. Clinical Psychology & 2008; 15(3): 181–92. https://doi.org/10.1002/cpp.572
  10. World Health Organisation. Promoting mental health: Concepts, emerging evidence, practice. Geneva; https://iris.who.int/bitstream/handle/10665/42940/9241591595.pdf
  11. Yeo ZZ, and Suárez L, Validation of the mental health continuum-short form: The bifactor model of emotional, social, and psychological well-being. Plos one, 2022; 17(5): p.e0268232. https://doi.org/1371/journal.pone.0268232
  12. Khumalo IP, Appiah R, Fadiji AW. Measuring Positive Mental Health and Depression in Africa: A Variable-Based and Person-Centred Analysis of the Dual-Continua Model. Frontiers in Psychology. 2022; 13. https://doi.org/3389/fpsyg.2022.885278
  13. Diener E. Assessing well-being: The collected works of Ed Diener. New York: Springer; 2009 Jun 4. https://doi.org/1007/978-90-481-2354-4
  14. Fredrickson BL. Positive emotions broaden and build. InAdvances in experimental social psychology 2013 Jan 1 (Vol. 47, pp. 1-53). Academic Press. https://doi.org/1016/B978-0-12-407236-7.00001-2
  15. Fredrickson BL. The eudaimonics of positive emotions. InHandbook of eudaimonic well-being 2016; 183-190. Springer, Cham. https://doi.org/1007/978-3-319-42445-3_12
  16. Vittersø J. The feeling of excellent functioning: Hedonic and eudaimonic emotions. In Handbook of eudaimonic well-being 2016 (pp. 253-276). Springer, Cham. https://doi.org/1007/978-3-319-42445-3_17
  17. Waterman AS. When effort is enjoyed: Two studies of intrinsic motivation for personally salient activities. Motivation and emotion. 2005 Sep; 29(3): 165-88. https://doi.org/1007/s11031-005-9440-4
  18. Ryff CD. Beautiful ideas and the scientific enterprise: Sources of intellectual vitality in research on eudaimonic well-being. Handbook of eudaimonic well-being. 2016: 95-107. https://doi.org/1007/978-3-319-42445-3_6
  19. Keyes CL. The mental health continuum: From languishing to flourishing in life. Journal of health and social behavior. 2002 Jun 1: 207-22. https://doi.org/2307/3090197
  20. Trousselard M, Steiler D, Dutheil F, Claverie D, Canini F, Fenouillet F, Naughton G, Stewart-Brown S, Franck N. Validation of the Warwick-Edinburgh mental well-being scale (WEMWBS) in French psychiatric and general populations. Psychiatry research. 2016 Nov 30; 245: 282-290. https://doi.org/1016/j.psychres.2016.08.050
  21. Vaingankar JA, Subramaniam M, Chong SA, Abdin E, Orlando Edelen M, Picco L, et al. The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population. Health Qual Life Outcomes. 2011; 9: 92. https://doi.org/1186/1477-7525-9-92
  22. Lukat J, Margraf J, Lutz R, van der Veld WM, Becker ES. Psychometric properties of the positive mental health scale (PMH-scale). BMC psychology. 2016 Dec; 4(1): 1-4. https://doi.org/1186/s40359-016-0111-x
  23. Bieda A, Hirschfeld G, Schönfeld P, Brailovskaia J, Zhang XC, Margraf J. Universal happiness? Cross-cultural measurement invariance of scales assessing positive mental health. Psychological assessment. 2017 Apr; 29 (4): 408. https://doi.org/1037/pas0000353
  24. Bibi A, Lin M, Margraf J. Salutogenic constructs across Pakistan and Germany: A cross sectional study. International Journal of Clinical and Health Psychology. 2020 Jan 1; 20 (1): 1-9.  https://doi.org/1016/j.ijchp.2019.10.001
  25. Lukat J, Becker ES, Lavallee KL, van der Veld WM, Margraf J. Predictors of incidence, remission and relapse of Axis I mental disorders in young women: A transdiagnostic approach. Clinical psychology & psychotherapy. 2017 Mar; 24 (2):3 22-31. v1002/cpp.2026
  26. Streiner DL. Measure for measure: new developments in measurement and item response theory. Can J Psychiatry. 2010; 55(3): 180–6. https://doi.org/1177/070674371005500310
  27. Cantó-Cerdán M, Cacho-Martínez P, Lara-Lacárcel F, & García-Muñoz Á. Rasch analysis for development and reduction of Symptom Questionnaire for Visual Dysfunctions (SQVD). Scientific Reports, 2021; 11(1): 1-10. https://doi.org/1038/s41598-021-94166-9
  28. Bond TG. Fox CM. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. 2nd Edition, Lawrence Erlbaum Associates, Publisers. Mahwah. New Jersey. London: 2007.https://doi.org/10.4324/9781315814698
  29. Cappelleri JC, Lundy JJ, Hays RD. Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures. Clinical therapeutics. 2014 May 1; 36(5): 648-62. https://doi.org/1016/j.clinthera.2014.04.006
  30. Carrozzino D, Christensen KS, Mansueto G, Brailovskaia J, Margraf J, Cosci F. A clinimetric analysis of the euthymia, resilience, and positive mental health scales. Journal of Affective Disorders. 2021 Nov 1; 294: 71-6. https://doi.org/1016/j.jad.2021.07.001
  31. Vaganian L, Boecker M, Bussmann S, Kusch M, Labouvie H, Margraf J, Gerlach AL, Cwik JC. Psychometric evaluation of the Positive Mental Health (PMH) scale using item response theory. BMC psychiatry. 2022 Dec; 22(1): 1-1. https://doi.org/1186/s12888-022-04162-0
  32. Smith Jr EV. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of applied measurement. 2002 Jan 1; 3(2): 205-31. https://www.researchgate.net/publication/11359111_Detecting_and_evaluating_the_impact_of_multidimensionality_using_item_fit_statistics_and_principal_component_analysis_of_residuals
  33. Brailovskaia J, Teismann T, Margraf J. Positive mental health, stressful life events, and suicide ideation: A 2-year follow-up study. Crisis: The Journal of Crisis Intervention and Suicide Prevention. 2020; 41(5): https://doi.org/10.1027/0227-5910/a000652
  34. Andrich D, Marais I. A course in Rasch measurement theory. D. Andrich y I. Marais (Coords.), Measuring in the Educational, Social and Health Sciences. 2019: 41-53. https://doi.org/1007/978-981-13-7496-8
  35. Reeve BB, Payers P. Applying item response theory modelling for evaluating. Assessing quality of life in clinical trials: Methods and practice. 2005: https://doi.org/10.1093/oso/9780198527695.003.0005
  36. Linacre J. Sample size and item calibration stability. Rasch Mes Trans. 1994; 7: https://www.researchgate.net/publication/235361463_Sample_Size_and_Item_Calibration_Stability
  37. Wright BD, Stone Measurement Essentials, 2nd ed. Wide Range, Inc., Wilmington, Delaware: Wide Range, Inc. 1999. Retrieved at http://www.rasch.org/rasch.htm#measess.
  38. Hoyle RH, editor. Handbook of structural equation modeling. Guilford press; 2023. https://www.researchgate.net/publication/361861039_Handbook_of_Structural_Equation_Modeling
  39. Tshilongamulenzhe MC. Testing measurement invariance of the Learning Programme Management and Evaluation (LPME) scale across gender using Multigroup Confirmatory Factor Analysis. Journal of Governance and Regulafion. 2015; 4(1): 124-31. https://doi.org/22495/jgr_v4_i2_c1_p5
  40. Lim JW, Townsend A. Cross-ethnicity measurement equivalence of family coping for breast cancer survivors. Research on Social Work Practice. 2012 Nov; 22(6): 689-703. https://doi.org/1177/1049731512448933
  41. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural equation modeling: a multidisciplinary journal. 2007 Jul 31; 14(3): 464-504. https://doi.org/1080/10705510701301834
  42. Combrinck C. Is this a useful instrument? An introduction to Rasch measurement models. Kramer S, Lahey A Flynn H et al Eds. Online Readings in Research Methods. Psychological Society of South Africa. Johannesburg. 2020. https://www.psyssa.com/wp-content/uploads/2020/08/Chapter-6_Is-this-a-useful-instrument_An-Introduction-to-Rasch-measurement-models.pdf
  43. Karami H, Khodi A. Differential Item Functioning and test performance: a comparison between the Rasch model. Logistic Regression and Mantel-Haenszel. Journal of Foreign Language Research. 2021; 10(4): 842-853. https://doi.org/10.22059/jflr.2021.315079.783 [In Persian]
  44. Hladká A, Martinková P. difNLR: Generalized Logistic Regression Models for DIF and DDF Detection. R Journal. 2020 Jun 1;12(1), 300-323. https://doi.org/32614/RJ-2020-014
  45. Mindrila D. Maximum likelihood (ML) and diagonally weighted least squares (DWLS) estimation procedures: A comparison of estimation bias with ordinal and multivariate non-normal data. International Journal of Digital Society. 2010 Mar 1; 1(1): 60-6. https://doi.org/20533/ijds.2040.2570.2010.0010
  46. Farahani Hojjatollah, Roshan Chesli Rasoul. Essentials for Developing and Validating Psychological Scales: Guide to Best Practices. Clinical psychology and personality. 2019 17(2):197-212. https://doi.org/10.22070/cpap.2020.2917 [In Persian]
  47. Reise SP, Revicki DA. Handbook of item response theory modeling. New York: Taylor & Francis; 2014. https://doi.org/10.4324/9781315736013
  48. Saepuzaman D, Istiyono E, Haryanto H. Analysis of HOTS Instrument for Prospective Physics Teacher Using Generalized Partial Credit Model. Ideas: Jurnal Pendidikan, Sosial, dan Budaya. 2022 Nov 14; 8(4): 1341-50. https://doi.org/32884/ideas.v8i4.976
  49. Embretson SE, Reise SP. Item response theory. Psychology Press; 2013 Sep 5. https://www.researchgate.net/publication/285287663_Item_response_theory

Files

Share

How to cite

Statistics