ASSESSMENT FAIRNESS AT THE UNIVERSITY OF CAPE COAST: EVALUATING THE FACTOR STRUCTURE AND MEASUREMENT INVARIANCE ACROSS GENDER

Authors

  • Samuel Oppong Student, Department of Education and Psychology, University of Cape Coast, Ghana
  • Nathaniel Quansah Student, Department of Education and Psychology, University of Cape Coast, Ghana
  • Regina Mawusi Nugba Lecturer, Department of Education and Psychology, University of Cape Coast, Ghana
  • Vera Rosemary Ankoma-Sey Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana
  • Samuel Yaw Ampofo Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana
  • Gabriel Essilfie Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana

DOI:

https://doi.org/10.46827/ejes.v11i3.5233

Keywords:

educational assessment, assessment fairness, measurement invariance, statistics assessment fairness

Abstract

The specific purpose of the study was to evaluate the factor structure of statistics assessment fairness inventory (SAFI) which was adapted for the Ghanaian context and further examine measurement invariance across gender. SAFI factor structure and construct validity were assessed with a sample of 735 Ghanaian university students through exploratory and confirmatory factor analysis. Through an exploratory factor analysis, five dimensions were obtained which include: learning materials and practices, test design, opportunity to demonstrate learning test administration and grading, and offering feedback. A confirmatory factor analysis was then conducted to examine the factor loadings of the items. Further analysis revealed a partial measurement invariance of the fairness construct with equal means and equal variances in relation to gender. This suggested that the SAFI is valid, reliable, and can equally work across gender. It is recommended that SAFI has important implications for decisions regarding the conduct of especially, high-stakes examinations.

 

Article visualizations:

Hit counter

Author Biographies

  • Samuel Oppong, Student, Department of Education and Psychology, University of Cape Coast, Ghana

    Samuel Oppong, Department of Education and Psychology, University of Cape Coast, Ghana.Research interests: educational measurement, instrument validation, classical test theory, structural equation modelling, assessment in education.

    ORCID ID: https://orcid.org/0009-0005-0851-9186

    Web of Science: https://www.webofscience.com/wos/author/search

    Wiley: https://wiley.atyponrex.com/dashboard?siteName=emip

  • Nathaniel Quansah, Student, Department of Education and Psychology, University of Cape Coast, Ghana

    Nathaniel Quansah, Department of Education and Psychology, University of Cape Coast, Ghana. Research interests: validation and validity theory, statistical modelling, item response theory, high-stakes assessment, and program evaluation.

    ORCID ID: https://orcid.org/0009-0001-8274-1480

  • Regina Mawusi Nugba, Lecturer, Department of Education and Psychology, University of Cape Coast, Ghana

    Regina Mawusi Nugba, Lecturer, Department of Education and Psychology, University of Cape Coast, Ghana. Research interests: educational measurement, research methods in education, assessment in education, test development, curriculum development in education

    ORCID ID: https://orcid.org/0000-0002-3537-645X

  • Vera Rosemary Ankoma-Sey, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana

    Vera Rosemary Ankoma-Sey, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana. Research interests: educational administration educational planning educational leadership educational assessment, gender and administrative management

    ORCID ID: https://orcid.org/0000-0002-3254-0680

  • Samuel Yaw Ampofo, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana

    Samuel Yaw Ampofo, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana. Research interests: educational administration, distance education, teacher education, and development.

    ORCID ID: https://orcid.org/0000-0001-6510-2858

  • Gabriel Essilfie, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana

    Gabriel Essilfie, Senior Lecturer, College of Distance Education, University of Cape Coast, Ghana. Research Interests: distance education and teacher preparation, educational leadership, teacher attitude in educational management.

    ORCID ID: https://orcid.org/0000-0002-7807-7732

References

Bazvand, A. D., & Rasooli, A. “Students’ experiences of fairness in summative assessment: A study in a higher education context”. Studies in Educational Evaluation, 2022, (72), 101118.

Berti, C., Molinari, L., & Speltini, G. “Classroom justice and psychological engagement: Students’ and teachers’ representations”. Social Psychology of Education, 2010, (13), 541-556. doi:10.1007/s11218-010-9128-9

Chory-Assad, R. “Classroom justice: Perceptions of fairness as a predictor of student motivation, learning, and aggression”. Communication Quarterly, 2002 (50), 58-77. doi:10.1080/01463370209385646

Chory-Assad, R., & Paulsel, M. “Antisocial classroom communication: Instructor influence and interactional justice as predictors of student aggression”. Communication Quarterly, 2004b, (52), 98-114. doi:10.1080/01463370409370184

Civelek ME, İnce H, Karabulut AT. “The mediator roles of attitude toward the web site and user satisfaction on the effect of system quality on net benefit: A structural equation model on web site success”. European Scientific Journal, 2016.

Cizek, G. J. “Defining and distinguishing validity: interpretations of score meaning and justifications of test use”. Psychological methods, 2012 17(1), 31.

Donahue, B. H. “The effect of partial measurement invariance on prediction”. University of Georgia, 2006 (Doctoral dissertation).

Green, S., Johnson, R., Kim, D., & Pope, N. “Ethics in classroom assessment practices: Issues and attitudes”. Teaching and teacher education, 2007, (23), 999-1011. doi:10.1016/j.tate.2006.04.042

Hau K, T, Marsh H, W. “The use of item parcels in structural equation modelling: Non‐normal data and small sample sizes”. British Journal of Mathematical and Statistical Psychology. 2004, 57(2):327-51.

Holmgren, J., & Bolkan, S. “Instructor responses to rhetorical dissent: Student perceptions of justice and classroom outcomes”. Communication Education, 2014, (63), 17-40. doi:10.1080/03634523.2013.833644

Ishak, Z., & Fin, L. “Truants' and teachers' behaviors in the classroom”. Procedia-Social and Behavioral Sciences, 2013, (103), 1228-1237. doi:10.1016/j.sbspro.2013.10.451

Laing, K., Mazzoli Smith, L., & Todd, L. “The impact agenda and critical social research in education: Hitting the target but missing the spot”? Policy Futures in Education, 2018, 16(2), 169-184.

Lei PW, Wu Q. “Introduction to structural equation modeling: Issues and practical considerations”. Educational Measurement: issues and practice, 2007, 26(3):33-43.

Lunenburg, F. “Self-efficacy in the workplace: implications for motivation and performance”. International Journal of Management, Business, and Administration, 2011, 14, 1–7.

McNamara T, Ryan K. “Fairness versus justice in language testing: The place of English literacy in the Australian citizenship test”. Language Assessment Quarterly, 2011 Apr 1;8(2):161-78.

Murdock, T., Miller, A., & Goetzinger, A. “Effects of classroom context on university students' judgments about cheating: Mediating and moderating processes”. Social Psychology of Education, 2007, 10, 141-169. doi:10.1007/s11218-007-9015-1

Murillo, F. J., & Hidalgo, N. “Students’ conceptions about a fair assessment of their learning”. Studies in Educational Evaluation, 2017, (53), 10-16.

Nisbet I, Shaw SD. Fair assessment viewed through the lenses of measurement theory. Assessment in Education: Principles, policy & practice, 2019, 26(5):612-29.

Nitko A, J. “Conceptual frameworks to accommodate the validation of rapidly changing requirements for assessments”. Curriculum and assessment. 2001, (1):143-63.

Oppong, S., Nugba, R. M., Asamoah, E., Quansah, N., & Ankoma-Sey, V. R. Teachers Confidence of Classroom Assessment Practices: A Case of Basic Schools in Upper Denkyira West District, Ghana. European Journal of Education Studies, 10(11). October 2023.

Owolabi HO, Ayandele J K, Olaoye D D. “A Systematic Review of Structural Equation Model (SEM)”. Open Journal of Educational Development (ISSN: 2734-2050), 2020, 1(2):27-39.

Pallant, J. “SPSS survival manual—A step-by-step guide to data analysis using SPSS for windows”. 2007, Maidenhead: Open University Press.

Pepper MB, Pathak S. “Classroom contribution: What do students perceive as fair assessment”? Journal of Education for Business, 2008, 83(6):360-8.

Quansah, F. “The use of Cronbach alpha reliability estimates in research among students in public universities in Ghana”. Africa Journal of Teacher Education, 2017 (1);7822.

Rezai, A. “Fairness in classroom assessment: development and validation of a questionnaire”. Language Testing in Asia, 2022, 12(1), 17.

Steinmetz H, Schmidt P, Tina-Booh A, Wieczorek S, Schwartz S, H. “Testing measurement invariance using multigroup CFA: Differences between educational groups in human values measurement”. Quality & Quantity, 2009, (43), 599-616.

Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. “Using multivariate statistics” Boston, MA: Pearson, 2013, Vol. 6, pp. 497-516.

Tierney, R. “Fairness in classroom assessment”. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment, 2013, (pp. 125–144). Thousand Oaks, CA: SAGE Publications

Tierney, R. D. “Fairness in educational assessment. In M. A. Peters (Ed.), Encyclopedia of Educational Philosophy and Theory. 2016, DOI: 10.1007/978-981-287-532-7_400-1

Wallace, M. P. “Fairness and justice in L2 classroom assessment: Perceptions from test takers”. Journal of Asia TEFL, 2018, 15(4), 1051.

Yu S, Hudders L. “Measurement invariance of the modified brand luxury index scale across gender, age and countries”. Journal of Fashion Marketing and Management: An International Journal. 2022, 26(5):870-89.

Downloads

Published

2024-02-25

Issue

Vol. 11 No. 3 (2024)

Section

Articles

License

Authors who publish with this journal agree to the following terms:

Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).