Abstract
This study endeavours to develop and validate a multidimensional tool for the assessment of 21st century skills among college-going students during 2024-25 at Banaras Hindu University (BHU), Varanasi. Initially, 120 items were identified through a comprehensive literature review. Experts from the teaching and research domains reviewed these items, and their feedback was incorporated to refine the tool, resulting in 56 items. The refined tool was administered to 350 respondents. The construct validity was established through exploratory factor analysis (EFA) and subsequently confirmed through confirmatory factor analysis (CFA) to ascertain the adequacy of the model fit. EFA revealed that the seven-factor structure accounted for a substantial proportion of the total variance. The CFA of the 54-item 21st-century skills assessment tool identified seven factors with good internal consistency. CFA indicated that items were loaded on the relevant factors and evidenced satisfactory model fit indices. The reliability of the tool was established by the Cronbach’s alpha coefficient, which yielded a value of 0.81. Thus, the tool was indicated to be relevant for college students and served as a valuable metric to assess college students’ 21st century skills.
KeywordsTransversal skills, Factor analysis, Holistic development, Item analysis, Skill assessment.
The full text of this article is available as a PDF.
Download PDF- Adeoye, M. A., Prastikawati, E. F., & Abimbowo, Y. O. (2024). Empowering learning: Pedagogical strategies for advancing quality education. Journal of Nonformal Education, 10(1), 10–21. https://doi.org/10.15294/jone.v10i1.1451
- Cevik, M. (2019). Multidimensional scale: Validity and reliability study. Cypriot Journal of Educational Sciences, 14(1), 11–28. https://doi.org/10.18844/cjes.v14i1.3506
- Chandra, S., Ghadei, K., Chennamadhava, M., & Ali, W. (2024). Development and validation of a farmer’s focused digital literacy scale. Indian Journal of Extension Education, 60(1), 111–115. https://doi.org/10.48165/IJEE.2024.601RT1
- Chen, S., Salleh, S. M., & Salleh, M. A. M. (2025). Media and information literacy among pre-service teachers: A systematic review of key trends and gaps (2013–2024). International Journal of Information Management Data Insights, 5(2), 100348. https://doi.org/10.1016/j.jjimei.2025.100348
- Durnali, M. (2022). “Destroying barriers to critical thinking” to surge the effect of self-leadership skills on electronic learning styles. Thinking Skills and Creativity, 46, 101130. https://doi.org/10.1016/j.tsc.2022.101130
- Edwards, J. N. (1969). Familial behavior as social exchange. Journal of Marriage and the Family, 31, 518–526. https://doi.org/10.2307/349775
- Erdogan, V. (2019). Integrating 4C skills of 21st century into four language skills in EFL classes. International Journal of Education and Research, 7(11), 113–124.
- Falloon, G. (2020). From digital literacy to digital competence: The teacher digital competency (TDC) framework. Educational Technology Research and Development, 68(5), 2449–2472. https://doi.org/10.1007/s11423-020-09767-4
- Goyal, K., & Kumar, S. (2021). Financial literacy: A systematic review and bibliometric analysis. International Journal of Consumer Studies, 45(1), 80–105. https://doi.org/10.1111/ijcs.70031
- Gupta, R., & Vatta, L. (2025). Disruptions in lifestyle due to escalating screen time: A behavioural perspective. Indian Journal of Extension Education, 61(4), 14–18. https://doi.org/10.48165/IJEE.2025.61403
- Gupta, S. K., Nain, M. S., Singh, R., & Mishra, J. R. (2022). Development of scale to measure agripreneurs’ attitude towards entrepreneurial climate. Indian Journal of Extension Education, 58(2), 153–157. https://doi.org/10.48165/IJEE.2022.58237
- Holec, V., & Marynowski, R. (2020). Does it matter where you teach? Insights from a quasi-experimental study of student engagement in an active learning classroom. Teaching and Learning Inquiry, 8, 140–164. https://doi.org/10.20343/teachlearninqu.8.2.10
- Howard, M. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human–Computer Interaction, 32(1), 51–62. https://doi.org/10.1080/10447318.2015.1087664
- Huang, P. H., O’Sullivan, A. J., & Shulruf, B. (2023). Development and validation of the student ratings in clinical teaching scale in Australia: A methodological study. Journal of Educational Evaluation for Health Professions, 20. https://doi.org/10.3352/jeehp.2023.20.26
- Jones-Jang, S. M., Mortensen, T., & Liu, J. (2021). Does media literacy help identification of fake news? Information literacy helps, but other literacies don’t. American Behavioral Scientist, 65(2), 371–388. https://doi.org/10.1177/0002764219869406
- Jünger, S., Payne, S. A., Brine, J., Radbruch, L., & Brearley, S. G. (2017). Guidance on conducting and reporting Delphi studies (CREDES) in palliative care: Recommendations based on a methodological systematic review. Palliative Medicine, 31(8), 684–706. https://doi.org/10.1177/0269216317690685
- Kademani, S., Nain, M. S., Singh, R., Roy, S. K., Prabhakar, I., Ranjan, A., Karjigi, D. K., Patil, M., Das, D., & Wasaful, Q. S. K. (2025). Quantifying support for agripreneurs: A multidimensional scale development and analysis of institutional mechanisms. Journal of Global Entrepreneurship Research, 15, 12. https://doi.org/10.1007/s40497-025-00429-4
- Karadas, A., Kaynak, S., Ergün, S., & Karaca, P. P. (2021). An examination of 21st century skills of nursing and midwifery students based on various variables. Ordu University Journal of Nursing Studies, 4(2), 232–239. https://doi.org/10.38108/ouhcd.906190
- Kaya, E., Karatana, Ö., & Yıldırım, T. Ö. (2023). The relationship between the online learning process, 21st century skills and work readiness in senior nursing students. Nurse Education in Practice, 73, 103801. https://doi.org/10.1016/j.nepr.2023.103801
- Kennedy, T. J., & Sundberg, C. W. (2020). 21st century skills. In B. Akpan & T. J. Kennedy (Eds.), Science education in theory and practice: An introductory guide to learning theory (pp. 479–496). Springer. https://doi.org/10.1007/978-3-030-43620-9_32
- Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.
- Koretz, D. (2017). The testing charade: Pretending to make schools better. University of Chicago Press. https://doi.org/10.2139/ssrn.3331704
- Korkmaz, Ö., Cakir, R., & Özden, M. Y. (2017). A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior, 72, 558–569. https://doi.org/10.1016/j.chb.2017.01.005
- Kumar, R., Slathia, P. S., Peshin, R., & Nain, M. S. (2015). Development of scale to measure attitude of farmers towards rapeseed mustard crop. Journal of Community Mobilization and Sustainable Development, 10(2), 221–224.
- Ledesma, R. D., Ferrando, P. J., Trógolo, M. A., Poó, F. M., Tosi, J. D., & Castro, C. (2021). Exploratory factor analysis in transportation research: Current practices and recommendations. Transportation Research Part F: Traffic Psychology and Behaviour, 78, 340–352. https://doi.org/10.1016/j.trf.2021.02.021
- Likert, R. (1932). A technique for the measurement of attitude. Archives of Psychology, 22(140), 1–55.
- Northouse, P. G. (2021). Leadership: Theory and practice (9th ed.). Sage Publications.
- Pepe, R. J., Burns, W. A., Dutton, J. L., Nithikasem, S., Cai, J., & Patel, N. M. (2025). Utilizing the DiSC assessment in surgical residency leadership training to address communication skill acquisition: A Kern six-step approach to curriculum development. Journal of Surgical Education, 82(3), 103413. https://doi.org/10.1016/j.jsurg.2024.103413
- Potter, W. J. (2022). Analysis of definitions of media literacy. Journal of Media Literacy Education, 14(2), 27–43. https://doi.org/10.23860/JMLE-2022-14-2-3
- Revelle, W., & Condon, D. M. (2019). Reliability from α to ω: A tutorial. Psychological Assessment, 31(12), 1395–1411. https://doi.org/10.1037/pas0000754
- Saleem, S., Dhuey, E., White, L., & Perlman, M. (2024). Understanding 21st century skills needed in response to industry 4.0: Exploring scholarly insights using bibliometric analysis. Telematics and Informatics Reports, 13, 100124. https://doi.org/10.1016/j.teler.2024.100124
- Saxena, P., Gupta, S. K., Mehrotra, D., Kamthan, S., Sabir, H., Katiyar, P., & Prasad, S. S. (2018). Assessment of digital literacy and use of smartphones among Central Indian dental students. Journal of Oral Biology and Craniofacial Research, 8(1), 40–43. https://doi.org/10.1016/j.jobcr.2017.10.001
- Shitu, G. A., Nain, M. S., & Kobba, F. (2018). Development of scale for assessing farmers’ attitude towards precision conservation agricultural practices. Indian Journal of Agricultural Sciences, 88(3), 499–504.
- Smith, K. A., Morassaei, S., Ruco, A., Bola, R., Currie, K. L., Cooper, N., & Prospero, L. D. (2022). An evaluation of the impact for healthcare professionals after a leadership innovation fellowship program. Journal of Medical Imaging and Radiation Sciences, 53(4S), S137–S144. https://doi.org/10.1016/j.jmir.2022.09.004
- Stewart, C. (2017). What we talk about when we talk about leadership: A review of research on library leadership in the 21st century. Library Leadership & Management, 32(1). https://doi.org/10.5860/llm.v32i1.7218
- Tight, M. (2021). Globalization and internationalization as frameworks for higher education research. Research Papers in Education, 36(1), 52–74. https://doi.org/10.1080/02671522.2019.1633560
- Tight, M. (2022). Internationalisation of higher education beyond the West: Challenges and opportunities—The research evidence. Educational Research and Evaluation, 27(3–4), 239–259. https://doi.org/10.1080/13803611.2022.2041853
- Tuzlukova, V., Al Busaidi, S., Burns, S., & Bugon, G. (2018). Exploring teachers’ perceptions of 21st century skills in teaching and learning in English language classrooms in Oman’s higher education institutions. Journal of Teaching English for Specific and Academic Purposes, 6(1), 191–203. https://doi.org/10.22190/JTESAP1801191T
- Van Laar, E., Van Deursen, A. J. A. M., Van Dijk, J. A. G. M., & De Haan, J. (2017). The relation between 21st century skills and digital skills: A systematic literature review. Computers in Human Behavior, 72, 577–588. https://doi.org/10.1016/j.chb.2017.03.010
- Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807
- Winters, C. A., Moore, C. F., Kuntz, S. W., Weinert, C., Hernandez, T., & Black, B. (2016). Principal components analysis to identify influences on research communication and engagement during an environmental disaster. BMJ Open, 6(8), e012106. https://doi.org/10.1136/bmjopen-2016-012106
- Yagci, M. (2019). A valid and reliable tool for examining computational thinking skills. Education and Information Technologies, 24(1), 929–951. https://doi.org/10.1007/s10639-018-9801-8
- Yamaguchi, S. N., Oishi, T., Ohnishi, Y., & Nishino, K. (2023). Designing an asynchronous information literacy lecture to change learning styles in ICT utilization. Procedia Computer Science, 225, 1282–1292. https://doi.org/10.1016/j.procs.2023.10.116
Looking up citing articles…

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.