Development of a Digital-Based Assessment of Key Competencies for Transformation toward Sustainability: Multi-Assessment Evidence

Chaiwichit Chianchana; Sageemas Na Wichian

doi:10.28991/ESJ-2025-09-02-016

Authors

Chaiwichit Chianchana
chaiwichit.c@fte.kmutnb.ac.th
Faculty of Technical Education, King Mongkut's University of Technology North Bangkok, Bangkok,, Thailand http://orcid.org/0000-0002-8138-6069
Sageemas Na Wichian College of Industrial Technology, King Mongkut's University of Technology North Bangkok, Bangkok,, Thailand

Vol. 9 No. 2 (2025): April

Research Articles

Downloads

PDF

Abstract
How to Cite
Metrics
References
License

The objectives of this research were to develop a digital-based assessment system for evaluating key competencies for transformation toward sustainability, review the assessment system, examine the dimensions by analyzing multidimensionality, and make predictions using logistic regression analysis. The sample consisted of 449 students for the needs study, 10 experts for system development and assessment, 38 students for system assessment, and 674 students to examine the key competencies. The instruments used were a questionnaire, a focus group discussion record form, an assessment form for students and experts, and an assessment in the digital-based system. Data were analyzed using content analysis, mean, standard deviation, multidimensional analysis, and logistic regression analysis. The results of the research showed the following: 1) Students and experts must develop a digital assessment system. 2) A digital-based assessment system should be developed. This involved personalized assessment through the website. The assessment results were obtained in real-time, and development suggestions regarding each competency were incorporated. The use of the digital-based assessment system demonstrated that the screen, terminology, system information, and system capabilities were at a good level. The experts' assessment showed that the heuristic was at a good level, whereas the utility, interpretation, and accuracy of the system were deemed to be very good. 3) The evidence of the key competencies was multidimensional. In addition, the predictive model regarding academic achievement was consistent with the empirical data, in that seven competencies could be predicted, but two competencies could not. The model predicts academic success 68.50% of the time.

Doi: 10.28991/ESJ-2025-09-02-016

Full Text: PDF

Chianchana, C., & Na Wichian, S. (2025). Development of a Digital-Based Assessment of Key Competencies for Transformation toward Sustainability: Multi-Assessment Evidence. Emerging Science Journal, 9(2), 801–828. https://doi.org/10.28991/ESJ-2025-09-02-016

Download Citation

Prayurasak, P. (2012). Recruitment and Staffing. In The Encyclopedia of Human Resource Management. Media Center and Graph Publication Fix, John Wiley & Sons, New Jersey, United States. doi:10.1002/9781118364727.part1.

Vathanophas, V. (2006). Competency Requirements for Effective Job Performance in Thai Public Sector. Contemporary Management Research, 3(1), 45. doi:10.7903/cmr.49.

Illeris, K. (2012). International perspectives on competence development: Developing skills and capabilities. International Perspectives on Competence Development: Developing Skills and Capabilities, 1(1), 1–228. doi:10.4324/9780203523032.

Wiek, A., Withycombe, L., & Redman, C. L. (2011). Key competencies in sustainability: A reference framework for academic program development. Sustainability Science, 6(2), 203–218. doi:10.1007/s11625-011-0132-6.

Yu, M., Wang, H., & Xia, G. (2022). The Review on the Role of Ambiguity of Tolerance and Resilience on Students' Engagement. Frontiers in Psychology, 12, 828894. doi:10.3389/fpsyg.2021.828894.

Redman, A., & Wiek, A. (2021). Competencies for Advancing Transformations towards Sustainability. Frontiers in Education, 6, 1–11. doi:10.3389/feduc.2021.785163.

Rusyati, L., Rustaman, N. Y., Widodo, A., & Ha, M. (2021). Development of questionnaire instrument to assess students' transformative competencies in science learning. Journal of Physics: Conference Series, 2098(1), 012035. doi:10.1088/1742-6596/2098/1/012035.

Venn, R., Perez, P., & Vandenbussche, V. (2022). Competencies of Sustainability Professionals: An Empirical Study on Key Competencies for Sustainability. Sustainability (Switzerland), 14(9), 1–22. doi:10.3390/su14094916.

Laudon, K. C., & Laudon, J. P. (2004). Management information systems: Managing the digital firm. Pearson Education, London, United Kingdom.

Eberz, S., Lang, S., Breitenmoser, P., & Niebert, K. (2023). Taking the Lead into Sustainability: Decision Makers' Competencies for a Greener Future. Sustainability (Switzerland), 15(6), 4986. doi:10.3390/su15064986.

Valdes-Ramirez, D., de Armas Jacomino, L., Monroy, R., & Zavala, G. (2024). Assessing sustainability competencies in contemporary STEM higher education: a data-driven analysis at Tecnologico de Monterrey. Frontiers in Education, 9. doi:10.3389/feduc.2024.1415755.

Zervas, I., & Stiakakis, E. (2024). Economic Sustainable Development through Digital Skills Acquisition: The Role of Human Resource Leadership. Sustainability, 16(17), 7664. doi:10.3390/su16177664.

UNESCO. (2023). Digital Competencies and Skills. UNESCO, Paris, France. Available online: https://www.unesco.org/en/digital-competencies-skills (accessed on March 2025).

Hajj-Hassan, M., Chaker, R., & Cederqvist, A. M. (2024). Environmental Education: A Systematic Review on the Use of Digital Tools for Fostering Sustainability Awareness. Sustainability (Switzerland), 16(9), 3733. doi:10.3390/su16093733.

Valdes-Ramirez, D., de Armas Jacomino, L., Monroy, R., & Zavala, G. (2024). Assessing sustainability competencies in contemporary STEM higher education: a data-driven analysis at Tecnologico de Monterrey. Frontiers in Education, 9. doi:10.3389/feduc.2024.1415755.

Basheer, N., Ahmed, V., Bahroun, Z., & Anane, C. (2024). Exploring Sustainability Assessment Practices in Higher Education: A Comprehensive Review through Content and Bibliometric Analyses. Sustainability (Switzerland), 16(13), 5799. doi:10.3390/su16135799.

Redecker, C., & Johannessen, í˜. (2013). Changing Assessment - Towards a New Assessment Paradigm Using ICT. European Journal of Education, 48(1), 79–96. doi:10.1111/ejed.12018.

Keengwe, J. (2022). Handbook of research on digital-based assessment and innovative practices in education. IGI Global, Pennsylvania, United States.

Crisp, G. (2011). Teacher's Handbook on e-Assessment. Transforming Assessment-An ALTC Fellowship Activity, 18.

Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. doi:10.1080/0969594X.2010.513678.

Redecker, C. (2013). The use of ICT for the assessment of key competences. Publications Office of the European Union. Brussels, Belgium.

Bennett, R. E. (2015). The Changing Nature of Educational Assessment. Review of Research in Education, 39(1), 370–407. doi:10.3102/0091732X14554179.

NAEP. (2024). Transitioning to Digitally Based Assessments. National Center for Education Statistics (NAEP), Washington, United States. Available online: https://nces.ed.gov/nationsreportcard/dba/ (accessed on March 2025).

Henebery, B. (2024). What should student assessment look like in 2024?. The Educator, Sydney, Australia. Available online: https://www.theeducatoronline.com/k12/news/what-should-student-assessment-look-like-in-2024/284044 (accessed on March 2025).

MagicBox. (2024). Digital Assessment: Putting Students First in Testing and Evaluation. MagicBox, Barcelona, Spain. Available online: https://www.getmagicbox.com/blog/digital-assessments-putting-students-first-in-testing-and-evaluation/ (accessed on March 2025).

Bowden, J. (2024). Online Assessment and Digital Exams: What's it all about and the Benefits? Inspera, Oslo, Norway. Available online: https://www.inspera.com/online-assessments/digital-and-online-assessment-benefits/ (accessed on March 2025).

Times Higher Education. (2024). The importance of digital assessment for a successful blended learning strategy. Times Higher Education, London, United Kingdom. Available online: https://www.timeshighereducation.com/hub/inspera/p/importance-digital-assessment-successful-blended-learning-strategy (accessed on March 2025).

Slade, C., Mahon, K., Benson, K., Lynagh, J., McGrath, D., Sheppard, K., & Ahsan, Q. (2024). A pedagogical evaluation of an institution's digital assessment platform (DAP): Integrating pedagogical, technical and contextual factors. Australasian Journal of Educational Technology, 40(4), 90–104. doi:10.14742/ajet.9448.

Pachler, N., Daly, C., Mor, Y., & Mellar, H. (2010). Formative e-assessment: Practitioner cases. Computers and Education, 54(3), 715–721. doi:10.1016/j.compedu.2009.09.032.

McFarlane, A. (2003). Editorial. Assessment for the digital age. Assessment in Education: Principles, Policy & Practice, 10(3), 261–266. doi:10.1080/0969594032000148127.

Bennett, R. E. (2005). Inexorable and Inevitable: The Continuing Story of Technology and Assessment. Computer"Based Testing and the Internet, 201–217, John Wiley & Sons, Hoboken, United States. doi:10.1002/9780470712993.ch11.

Bull, J., & McKenna, C. (2003). A Blueprint for Computer-Assisted Assessment. Routledge, Milton Park, United Kingdom. doi:10.4324/9780203464687.

Whitelock, D. (2009). Editorial: e-assessment: developing new dialogues for the digital age. British Journal of Educational Technology, 40(2), 199–202. doi:10.1111/j.1467-8535.2008.00932.x.

Bennett, R. E. (2001). How the Internet Will Help Large-Scale Assessment Reinvent Itself. Education Policy Analysis Archives, 9, 5. doi:10.14507/epaa.v9n5.2001.

Scalise, K., & Gifford, B. (2006). Computer-based assessment in E-learning: A framework for constructing "intermediate constraint” questions and tasks for technology platforms. Journal of Technology, Learning, and Assessment, 4(6), 3–44.

Kendall, K. E., & Kendall, J. E. (2014). Systems analysis and design. Pearson, London, United Kingdom.

Lior, L. N. (2013). Evaluating Your Information Experience. Writing for Interaction, 241–261, Morgan Kaufmann, Burlington, United States. doi:10.1016/b978-0-12-394813-7.00012-2.

Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. doi:10.1007/BF00117714.

Dochy, F. J. R. C., & McDowell, L. (1997). Assessment as a tool for learning. Studies in Educational Evaluation, 23(4), 279–298. doi:10.1016/s0191-491x(97)86211-6.

Torrance, H. (2012). Formative assessment at the crossroads: Conformative, deformative and transformative assessment. Oxford Review of Education, 38(3), 323–342. doi:10.1080/03054985.2012.689693.

Harlen, W. (2007). The Quality of Learning: assessment alternatives for primary education. The Cambridge Primary Review Research Surveys, 504–540. doi:10.4324/9780203121672-31

Taras, M. (2005). Assessment - Summative and formative - Some theoretical reflections. British Journal of Educational Studies, 53(4), 466–478. doi:10.1111/j.1467-8527.2005.00307.x.

Shannaq, B. (2025). E-Learning Integration and Its Impact on MIS Skill Development and Student Engagement. Emerging Science Journal, 8, 425-443. doi:10.28991/ESJ-2024-SIED1-025.

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. doi:10.1007/s11092-008-9068-5.

Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31(4), 399–413. doi:10.1080/02602930600679050.

Chianchana, C. (2022). Development of an Educational Sustainability Assessment Model: Application of the Delphi Technique and Pilot Study. Journal of Education and E-Learning Research, 9(2), 119–128. doi:10.20448/jeelr.v9i2.4044.

Sabino, A., Moreira, A., Cesário, F., & Coelho, M. P. (2024). Measuring Sustainability: A Validation Study of a Triple Bottom Line (TBL) Scale in Portugal. Emerging Science Journal, 8(3), 899–916. doi:10.28991/ESJ-2024-08-03-06.

Dix, A., Finlay, J., Abowd, G., & Beale, R. (2004). Human-computer Interaction. Prentice Hall, London, United Kingdom.

Galitz, W. O. (2007). The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques, John Wiley & Sons, Hoboken, United States.

Preece, J., Rogers, Y., & Sharp, H. (2015). Interaction design: Beyond human-computer interaction. (4th Ed.). John Wiley & Sons, Hoboken, United States.

Nielsen, J. (1994). Heuristic Evaluation. Usability Inspection Methods, 25-62. John Wiley & Sons, Hoboken, United States.

Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program Evaluation: Alternative Approaches and Practical Guidelines (4th Ed.). Pearson, London, United Kingdom.

Patton, M. Q. (2008). Utilization-focused Evaluation (4th Ed.), Sage Publications, Thousand Oaks, United States.

Stiggins, R. J. (2001). Student-involved classroom assessment (3rd Ed.). Prentice Hall, Saddle River, United States.

Kanjanawasee, S., Pitayanon, T., & Srisukho, D. (2008). Select appropriate statistics for research (5th Ed.). Cuprina, Bangkok, Thailand.

Patton, M.Q. (2002). Qualitative Evaluation and Research Methods (3rd Ed.), Sage Publications, Thousand Oaks, United States.

Johanson, G. A., & Brooks, G. P. (2009). Initial Scale Development: Sample Size for Pilot Studies. Educational and Psychological Measurement, 70(3), 394–400. doi:10.1177/0013164409355692.

Embretson, S. E., & Reise, S. P. (2013). Item Response Theory. Psychology Press, London, United Kingdom. doi:10.4324/9781410605269.

Tabachnick, B. G., & Fidell, L. S. (2007). Multivariate Statistics (5th Ed.). Pearson Education, London, United Kingdom.

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate Data Analysis (6th Ed.), Pearson Prentice Hall, Saddle River, United States.

Adams, R. J., Wilson, M., & Wang, W. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1–23. doi:10.1177/0146621697211001.

Allen, D. D., & Wilson, M. (2006). Introducing multidimensional item response modeling in health behavior and health education research, Health Education Research Theory & Practice, 21(Supplement 1), 73-84.

Boud, D., & Molloy, E. (Eds.). (2012). Feedback in Higher and Professional Education. Routledge, London, United Kingdom. doi:10.4324/9780203074336.

Davenport, T. H., & Harris, J. G. (2017). Competing in Analytics: The New Science of Winning, Harvard Business Press, Brighton, United States.

Kitchin, R. (2014). The Data Revolution: Big Data, Open Data, Data Infrastructures & Their Consequences. Sage Publications, Thousand Oaks, United States. doi:10.4135/9781473909472.

Bartholomew, D. J., Steele, F., Galbraith, J., & Moustaki, I. (2008). Analysis of Multivariate Social Science Data. Chapman & Hall, New York, United States. doi:10.1201/b15114.

Nicol, D., & MacFarlane-Dick, D. (2006). Formative assessment and selfregulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. doi:10.1080/03075070600572090.

Churchill, G. A., & Iacobucci, D. (2006). Marketing research: methodological foundations. Dryden Press, Hinsdale, United States.

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. doi:10.3102/0034654307313795.

Steinberg, L. (2014). Age of Opportunity: Lessons Learned from the New Science of Adolescence, Harper Paperbacks, New York, United States.

Erikson, E. H. (1968). Identity youth and crisis. WW Norton & company, New York, United States.

Lerner, R. M., & Steinberg, L. (Eds.). (2009). Handbook of Adolescent Psychology. John Wiley & Sons, Hoboken, United States. doi:10.1002/9780470479193.

Sterling, S. (2011). Transformative learning and sustainability: Sketching the conceptual ground. Learning and teaching in higher education, 5(11), 17-33.

Barth, M., Godemann, J., Rieckmann, M., & Stoltenberg, U. (2007). Developing key competencies for sustainable development in higher education. International Journal of Sustainability in Higher Education, 8(4), 416–430. doi:10.1108/14676370710823582.

Godet, M. (2006). Creating futures: Scenario planning as a strategic management tool. The Brookings Institutions, Washington, United States.

Rieckmann, M. (2012). Future-oriented higher education: Which key competencies should be fostered through university teaching and learning? Futures, 44(2), 127–135. doi:10.1016/j.futures.2011.09.005.

Van der Heijden, K. (2005). Scenarios: the art of strategic conversation. John Wiley & Sons, Hoboken, United States.

Inayatullah, S. (2008). Six pillars: Futures thinking for transforming. Foresight, 10(1), 4–21. doi:10.1108/14636680810855991.

Acceptance Rate:	21%
Review Speed:	74 days
Issue Per Year:	6
Number of Volumes:	7
Number of Issues:	44
Number of Articles:	493
Number of Reviewers:	1187
Number of Contributors:	1394
Contributing Countries:	83
No. of WoS Citations:	2609
No. of Scopus Citations:	2936
No. of Google Citations:	4161
Google h-index:	29
Google i10-index:	126
Abstract Views:	681,807
PDF Download:	492,524

Development of a Digital-Based Assessment of Key Competencies for Transformation toward Sustainability: Multi-Assessment Evidence

Authors

Downloads

Downloads

Login

submission

Publisher & Affiliated Societies

Indexing & Abstracting

SidebarMenu

IndexedBy

Indexing and Abstracting

twitter

Social Media

Analytics

Analytics

Information

Most Cited Articles

Optical and Structural Characterization of Bi2FexNbO7 Nanoparticles for Environmental Applications

Digital Transformation: Opportunities and Challenges for Leaders in the Emerging Countries in Response to Covid-19 Pandemic

Thermal Regeneration and Reuse of Carbon and Glass Fibers from Waste Composites

Impediments of Green Finance Adoption System: Linking Economy and Environment

Address

Contact Info:

Development of a Digital-Based Assessment of Key Competencies for Transformation toward Sustainability: Multi-Assessment Evidence

Authors

Downloads

Downloads

Login

submission

Publisher & Affiliated Societies

Indexing & Abstracting

SidebarMenu

social

Journal Imprint

Journal Metrics

IndexedBy

Indexing and Abstracting

twitter

Social Media

Analytics

Analytics

Information

Most Cited Articles

Optical and Structural Characterization of Bi2FexNbO7 Nanoparticles for Environmental Applications

Digital Transformation: Opportunities and Challenges for Leaders in the Emerging Countries in Response to Covid-19 Pandemic

Thermal Regeneration and Reuse of Carbon and Glass Fibers from Waste Composites

Impediments of Green Finance Adoption System: Linking Economy and Environment