A national survey evaluating the construct validity and reliability of a medical student feedback literacy questionnaire
7 affiliations
- 1Medical Education and Research Development Unit, Universiti Malaya, Kuala Lumpur, Malaysia
- 2Department of Media and Communication Studies, Faculty of Arts and Social Sciences, Universiti Malaya, Kuala Lumpur, Malaysia
- 3Department of Restorative Dentistry, Kulliyyah of Dentistry, International Islamic University Malaysia, Kuantan Campus, Pahang, Malaysia
- 4Department of Preclinical Sciences, M. Kandiah Faculty of Medicine and Health Sciences, Universiti Tunku Abdul Rahman, Selangor, Malaysia
- 5Department of Music, Faculty of Creative Arts, Universiti Malaya, Kuala Lumpur, Malaysia
- 6Department of Biomedical Imaging, Faculty of Medicine, Universiti Malaya, Kuala Lumpur, Malaysia
- 7Strategic Development Unit, Faculty of Medicine, Universiti Malaya, Kuala Lumpur, Malaysia
Abstract
Introduction: Medical student feedback literacy is a crucial competency to support the learning and training of safe, competent healthcare professionals. To date, the IMPROVE-FL questionnaire has been developed as a specific instrument to measure levels of medical student feedback literacy. Although this questionnaire had established excellent content validity in our previous work, more validity and reliability evidence are required to endorse its research and practical use.
Methods: This study applied the 28-item IMPROVE-FL questionnaire in a national survey of 29 medical schools with quota sampling to gather evidence of construct validity (via confirmatory factor analysis and hypothesis testing) and assess its internal consistency (via construct reliability analysis). Subsequently, a smaller study was conducted in two medical schools, one public and one private, to establish evidence of test–retest reliability.
Results: These analyses reported that the finalised 23-item IMPROVE FL had excellent model fit and evidence of construct validity (β = .64–.87; x2/df = 3.86; RMSEA = .05; SRMR = .03; CFI = .95; TLI = .94; GFI = .93; AGFI = .91), confirmed the expected correlation with fixed mindset (r = −.116, p < .001) and growth mindset (r = .327, p < .001), good internal consistency (α = .70–.89), and moderate test–retest reliability (ICC = 0.50–0.76).
Conclusion: These findings provide satisfactory evidence of construct validity, test–retest, and construct reliability, comparable to existing feedback literacy instruments in other educational contexts. Therefore, these findings support the use of IMPROVE-FL for research and practice.
Related
- Development and psychometric validation of substance abuse prevention questionnaire based on the multi-theory model: construct validity and reliability
- Assessing the construct validity of cross-national harmonized cognitive assessments using age.
- Reliability and validity of the Japanese version of the Sleep Problem Acceptance Questionnaire
- How reliable are clinical balance and ataxia scales in healthy children aged 4-12 years? An inter-rater reliability and construct validity study of the PBS, SARA, and BARS.
- Persian Version of the Teen Attitudes to Substances and the Risks Facing Teens Questionnaire: Face Validity and Reliability
BibTeX
@article{noor2026national,
title = {{A national survey evaluating the construct validity and reliability of a medical student feedback literacy questionnaire}},
author = {Mohamad Nabil Mohd Noor and Xin Lyu and Genghong Liu and Galvin Sim Siang Lin and Reshma Mohamed Ansari and Wei-Han Hong and Wen Fen Beh and Yang Faridah Abdul Aziz and Jamuna Vadivelu and Chan Choong Foong},
journal = {Medical Education Online},
year = {2026},
month = nov,
doi = {10.1080/10872981.2026.2722457},
url = {https://doi.org/10.1080/10872981.2026.2722457},
note = {CC BY-NC 4.0},
}
RIS
TY - JOUR
TI - A national survey evaluating the construct validity and reliability of a medical student feedback literacy questionnaire
AU - Mohamad Nabil Mohd Noor
AU - Xin Lyu
AU - Genghong Liu
AU - Galvin Sim Siang Lin
AU - Reshma Mohamed Ansari
AU - Wei-Han Hong
AU - Wen Fen Beh
AU - Yang Faridah Abdul Aziz
AU - Jamuna Vadivelu
AU - Chan Choong Foong
PY - 2026
DA - 2026/11/03
JO - Medical Education Online
DO - 10.1080/10872981.2026.2722457
UR - https://doi.org/10.1080/10872981.2026.2722457
AB - Introduction: Medical student feedback literacy is a crucial competency to support the learning and training of safe, competent healthcare professionals. To date, the IMPROVE-FL questionnaire has been developed as a specific instrument to measure levels of medical student feedback literacy. Although this questionnaire had established excellent content validity in our previous work, more validity and reliability evidence are required to endorse its research and practical use. Methods: This study applied the 28-item IMPROVE-FL questionnaire in a national survey of 29 medical schools with quota sampling to gather evidence of construct validity (via confirmatory factor analysis and hypothesis testing) and assess its internal consistency (via construct reliability analysis). Subsequently, a smaller study was conducted in two medical schools, one public and one private, to establish evidence of test–retest reliability. Results: These analyses reported that the finalised 23-item IMPROVE FL had excellent model fit and evidence of construct validity (β = .64–.87; x2/df = 3.86; RMSEA = .05; SRMR = .03; CFI = .95; TLI = .94; GFI = .93; AGFI = .91), confirmed the expected correlation with fixed mindset (r = −.116, p < .001) and growth mindset (r = .327, p < .001), good internal consistency (α = .70–.89), and moderate test–retest reliability (ICC = 0.50–0.76). Conclusion: These findings provide satisfactory evidence of construct validity, test–retest, and construct reliability, comparable to existing feedback literacy instruments in other educational contexts. Therefore, these findings support the use of IMPROVE-FL for research and practice.
SN - 1087-2981
ER -