Construction, Validity, and Reliability of the Pedagogical Competence Assessment Instrument for Proficient Teachers
Downloads
This study aims to develop and evaluate the Pedagogical Competence Assessment for Proficient Teachers (PCAI-PT) as an instrument for assessing teachers’ pedagogical competence in Indonesia. The research employed a development method based on the ADDIE framework (Analyze, Design, Develop, Implement, and Evaluate). Thirteen pedagogical competence items representing core skills of novice expert teachers were formulated from document analysis. These items were validated by six expert raters and tested on 231 teachers across various educational levels. Validation results indicated that all PCAI-PT items were valid after revision, with Aiken’s V ranging from 0.78 to 1.00. Intraclass correlation analysis showed increased inter-rater consistency from the initial validation to revalidation, demonstrating strong inter-rater reliability. Construct testing using CFA revealed that all items met the criteria, with factor loadings >0.70, Cronbach’s alpha and composite reliability >0.70, and AVE >0.50. Discriminant validity was confirmed, and model fit indices indicated good to excellent fit (RMSEA = 0.088; SRMR = 0.034; CFI = 0.955). Concurrent validity testing using the Kruskal-Wallis test showed no significant differences across educational levels (p>0.05), indicating consistent application of the instrument. Overall, PCAI-PT is valid, reliable, and representative, providing a comprehensive and sustainable tool for assessing teachers’ pedagogical competence across diverse educational contexts.
Downloads
[1] Number 2626/B/HK.04.01/2023. (2023). Regulation of the Director General of Teachers and Education Personnel of the Ministry of Education, Culture, Research, and Technology Number 2626/B/HK.04.01/2023 concerning the teacher competency model. Kementerian Pendidikan Kebudayaan Riset dan Teknologi Republik Indonesia, Jakarta, Indonesia.
[2] Number 6565/B/GT/2020. (2020). Regulation of the Director General of Teachers and Education Personnel of the Ministry of Education, Culture, Research, and Technology Number 6565/B/GT/2020 concerning the competency model in teacher professional development. Kementerian Pendidikan Kebudayaan Riset dan Teknologi, Jakarta, Indonesia.
[3] Ranta, S., Kangas, J., Harju-Luukkainen, H., Ukkonen-Mikkola, T., Neitola, M., Kinos, J., Sajaniemi, N., & Kuusisto, A. (2023). Teachers’ pedagogical competence in finnish early childhood education—A narrative literature review. Education Sciences, 13(8), 791. doi:10.3390/educsci13080791.
[4] Syahrial, Asrial, Maison, Mukminin, A., & Kurniawan, D. A. (2020). Ethnoconstructivism analysis: Study of pedagogic mathematics competence of primary school teachers. International Journal of Evaluation and Research in Education, 9(3), 614–624. doi:10.11591/ijere.v9i3.20256.
[5] Syahruddin, S., Ernawati, A., Ede, M. N., B Abdul Rahman, M. A., Johari Sihes, A., & Daud, K. (2013). Teachers’ pedagogical competence in school-based management: A case study in a public secondary school at Pare-Pare, Indonesia. Journal of Education and Learning (EduLearn), 7(4), 213–218. doi:10.11591/edulearn.v7i4.18491.
[6] Asga, A. R., Intania, A., Nurviana, A., Saputra, A. F., Muhammad, B. S., Wahyuni, D., … & Vistara, I. (2023). Operational guide for teacher competency model (1st Ed.). Ministry of Education, Culture, Research, and Technology of Indonesia, Jakarta, Indonesia. (In Indonesian).
[7] Ang, A., Puspaningsih, A. R., Nityasa, A., Rosanty, E. S., Irayati, M., … & Widiastuti, Y. (2023). Supporting module for teacher competency model (1st Ed.). Ministry of Education, Culture, Research, and Technology of Indonesia, Jakarta, Indonesia.
[8] König, J., Blömeke, S., Jentsch, A., Schlesinger, L., née Nehls, C. F., Musekamp, F., & Kaiser, G. (2021). The links between pedagogical competence, instructional quality, and mathematics achievement in the lower secondary classroom. Educational Studies in Mathematics, 107(1), 189–212. doi:10.1007/s10649-020-10021-0.
[9] Siri, A., Supartha, I. W. G., Sukaatmadja, I. P. G., & Rahyuda, A. G. (2020). Does teacher competence and commitment improve teacher’s professionalism. Cogent Business and Management, 7(1), 1781993. doi:10.1080/23311975.2020.1781993.
[10] Blegur, J., Ma’mun, A., Berliana, A. M., Bakhri, R. S., & Calunsag, B. D. (2024). Enhancing teaching competence of prospective physical education teachers with integrated learning model. Cakrawala Pendidikan, 43(3), 588-608. doi:10.21831/cp.v43i3.57858.
[11] Eliyawati, Widodo, A., Kaniawati, I., & Fujii, H. (2023). The development and validation of an instrument for assessing science teacher competency to teach ESD. Sustainability (Switzerland), 15(4), 3276. doi:10.3390/su15043276.
[12] Quansah, F., Cobbinah, A., Asamoah-Gyimah, K., & Hagan, J. E. (2024). Validity of student evaluation of teaching in higher education: a systematic review. Frontiers in Education, 9, 1329734. doi:10.3389/feduc.2024.1329734.
[13] Saleh, M., Kumaidi, Munadi, S., Mardalis, A., & Subando, J. (2024). The development of teacher performance assessment instruments in boarding school. European Journal of Educational Research, 13(1), 55–68. doi:10.12973/eu-jer.13.1.55.
[14] Panggabean, M. S., & Himawan, K. K. (2016). The development of Indonesian teacher competence questionnaire. Journal of Educational, Health and Community Psychology, 5(2), 1. doi:10.12928/jehcp.v5i2.5134.
[15] Arikunto, S., Saputra, W. N. E., Khoirunnisa, D. A., & Sawai, R. P. (2023). Development and validation of teacher competency perception scale in Indonesia: The Rasch analysis. Journal of Professional Teacher Education, 1(1), 11–21. doi:10.12928/jprotect.v1i1.491.
[16] Herman, Sultan, & Suardi. (2025). Early childhood education teachers’ perceptions of pedagogical competence 4.0 in supporting early childhood development. Discover Education, 4(1), 348. doi:10.1007/s44217-025-00849-0.
[17] Branch, R. M. (2010). Instructional design: The ADDIE approach. Springer, New York, United States. doi:10.1007/978-0-387-09506-6.
[18] K.P.N. (2007). Regulation of the Minister of National Education of the Republic of Indonesia Number 16 of 2007 concerning the academic qualification and competence standards for teachers. Kementerian Pendidikan Nasional (K.P.N.), Jakarta, Indonesia.
[19] Blegur, J., Lumba, A. J. F., Berliana, B., Siki, I. C. A., & Angoy, R. D. T. (2025). Bridging policy and practice in competency assessment of indonesian proficient teachers: A mixed methods gap analysis. Jurnal Pendidikan Progresif, 15(3), 2049–2072. doi:10.23960/jpp.v15i3.pp2049-2072.
[20] Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. doi:10.1177/0013164485451012.
[21] Hair Jr, J., Page, M., & Brunsveld, N. (2019). Essentials of business research methods. Routledge, New York, United States. doi:10.4324/9780429203374.
[22] Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. doi:10.1016/j.jcm.2016.02.012.
[23] Mahardika, I. M. S., Blegur, J., Berliana, Anaktototy, J., Boleng, L. M., & Arhesa, S. (2024). Global transformational leadership scale: cross-cultural adaptation of Indonesian sports science student context. International Journal of Evaluation and Research in Education, 13(5), 3068–3080. doi:10.11591/ijere.v13i5.29122.
[24] Scholtz, S. E. (2021). Sacrifice is a step beyond convenience: A review of convenience sampling in psychological research in Africa. SA Journal of Industrial Psychology, 47, 1837. doi:10.4102/sajip.v47i0.1837.
[25] Hair, J. F., Babin, B. J., Anderson, R. E., & Black, W. C. (2019). Multivariate data analysis (8th Ed.). Cengage Learning, Boston, United States.
[26] Hulland, J. (1999). Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic Management Journal, 20(2), 195–204. doi:10.1002/(sici)1097-0266(199902)20:2<195::aid-smj13>3.0.co;2-7.
[27] Wong, K. K. K. (2013). Partial least squares structural equation modeling (PLS-SEM) techniques using SmartPLS. Marketing Bulletin, 24(1), 1-32.
[28] Henseler, J., Hubona, G., & Ray, P. A. (2016). Using PLS path modeling in new technology research: Updated guidelines. Industrial Management & Data Systems, 116(1), 2–20. doi:10.1108/IMDS-09-2015-0382.
[29] Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. doi:10.1177/002224378101800104.
[30] Akinyode, B. F. (2016). The use of structural equation modeling (SEM) in built environment disciplines. Research on Humanities and Social Sciences, 6(6), 109-120.
[31] Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284.
[32] Dash, G., & Paul, J. (2021). CB-SEM vs PLS-SEM methods for research in social sciences and technology forecasting. Technological Forecasting and Social Change, 173, 121092. doi:10.1016/j.techfore.2021.121092.
[33] Russo, D., & Stol, K. J. (2022). PLS-SEM for software engineering research: An introduction and survey. ACM Computing Surveys, 54(4), 1–38. doi:10.1145/3447580.
[34] Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). An introduction to structural equation modeling. In: Partial least squares structural equation modeling (PLS-SEM) using R. Classroom companion: Business. Springer, Cham, Switzerland. doi:10.1007/978-3-030-80519-7_1.
[35] Henseler, J., & Schuberth, F. (2025). Should PLS become factor-based or should CB-SEM become composite-based? Both! European Journal of Information Systems, 34(3), 551–563. doi:10.1080/0960085X.2024.2357123.
[36] Blegur, J., Mutmainnah, Marleni, Sardin, & Syamsijulianto, T. (2025). Students proactive decision-making scale (SPDMS-18). Emerging Science Journal, 9(3), 1388–1402. doi:10.28991/ESJ-2025-09-03-014.
[37] Marsh, H. W., & Hocevar, D. (1985). Application of confirmatory factor analysis to the study of self-concept. First- and higher order factor models and their invariance across groups. Psychological Bulletin, 97(3), 562–582. doi:10.1037/0033-2909.97.3.562.
[38] Aldridge, J. M., & Blackstock, M. J. (2024). Assessing students’ perceptions of school climate in primary schools. Learning Environments Research, 27(3), 579–602. doi:10.1007/s10984-024-09492-2.
[39] Ma, W., Yang, W., & Bu, Q. (2024). Interconnected factors in EFL engagement: Classroom climate, growth mindset, and achievement goals. Frontiers in Psychology, 15, 1353360. doi:10.3389/fpsyg.2024.1353360.
[40] Blegur, J., Subarjah, H., Hidayat, Y., Ma’mun, A., Mahendra, A., Mahardika, I. M. S., & Hardiansyah, S. (2024). Peer-assessment academic integrity scale (PAAIS-24). Emerging Science Journal, 8(2), 513–526. doi:10.28991/ESJ-2024-08-02-09.
[41] Grønli, K. M., Walgermo, B. R., McTigue, E. M., & Uppstad, P. H. (2024). teachers’ feedback on oral reading: A critical review of its effects and the use of theory in research. Educational Psychology Review, 36(4), 121. doi:10.1007/s10648-024-09957-z.
[42] Wilkins, N. J., Verlenden, J. M. V., Szucs, L. E., & Johns, M. M. (2023). Classroom management and facilitation approaches that promote school connectedness. Journal of School Health, 93(7), 582–593. doi:10.1111/josh.13279.
[43] Tu, X. (2021). The role of classroom culture and psychological safety in EFL students’ engagement. Frontiers in Psychology, 12, 760903. doi:10.3389/fpsyg.2021.760903.
[44] Misbah, Z., Gulikers, J., Widhiarso, W., & Mulder, M. (2022). Exploring connections between teacher interpersonal behaviour, student motivation and competency level in competence-based learning environments. Learning Environments Research, 25(3), 641–661. doi:10.1007/s10984-021-09395-6.
[45] Jiang, S., Guo, L., & Tomek, S. (2024). Profiles of teacher-student relationships and classroom management practices: How they relate to self-efficacy, work stress, and classroom climate. International Journal of Educational Methodology, 10(2), 241-259. doi:10.12973/ijem.10.1.1041.
[46] Nasirova., J. M. (2025). Student-centered approach in teaching. Scientific News of Academy of Physical Education and Sport, 6(4), 130–135. doi:10.28942/ssj.v6i4.824. (In Azerbaijani).
[47] Keiler, L. S. (2018). Teachers’ roles and identities in student-centered classrooms. International Journal of STEM Education, 5(1), 34. doi:10.1186/s40594-018-0131-6.
[48] Blegur, J., & Hardiansyah, S. (2024). Differentiation instruction publications in physical education: Bibliometric analysis of the last ten years. Journal of Education and Learning, 18(3), 902–913. doi:10.11591/edulearn.v18i3.21307.
[49] Côté-Lussier, C., & Fitzpatrick, C. (2016). Feelings of safety at school, socioemotional functioning, and classroom engagement. Journal of Adolescent Health, 58(5), 543–550. doi:10.1016/j.jadohealth.2016.01.003.
[50] Charteris, J., Anderson, J., & Page, A. (2024). Psychological safety in innovative learning environments: Planning for inclusive spaces. International Journal of Inclusive Education, 28(5), 688–704. doi:10.1080/13603116.2021.1974108.
[51] Konrad, M., Hessler, T., Alber-Morgan, S. R., Graham-Day, K. J., Davenport, C. A., & Helton, M. (2022). Systematically design instruction toward a specific goal. High Leverage Practices for Inclusive Classrooms. Routledge, New York, United States. doi:10.4324/9781003148609-18.
[52] Banat, S. Y., & Wahba, F. A. A. (2023). Instructional design in modern environments: Pertinent mobile learning content quality features. International Journal of Web-Based Learning and Teaching Technologies, 18(1), 1–23. doi:10.4018/IJWLTT.330757.
[53] Reilly, C., & Reeves, T. C. (2024). Refining active learning design principles through design-based research. Active Learning in Higher Education, 25(1), 81–100. doi:10.1177/14697874221096140.
[54] Koller, K. (2024). Integrating exploration as a learning context impacts feelings of empowerment and engagement. International Journal of Educational Research Open, 7, 100374. doi:10.1016/j.ijedro.2024.100374.
[55] Hasna Kurnia Putri, Ani Rusilowati, Supriyadi, S., Widiyatmoko, A., Negoro, R. A., & Teasy, Y. (2025). The implementation of local wisdom-based teaching material to increase students’ literacy and numeracy. Unnes Science Education Journal, 14(2), 268–279. doi:10.15294/usej.v14i2.24474.
[56] F.A, A. N., Asfar, A. M. I. T., Asfar, A. M. I. A., & Syaifullah, A. (2021). Improving students’ mathematical logical intelligence through the online-based integration of local wisdom of Sulapa Eppa Walasuji. Al-Jabar: Jurnal Pendidikan Matematika, 12(2), 283–294. doi:10.24042/ajpm.v12i2.9575.
[57] Fauziah, F. N., Saddhono, K., & Suryanto, E. (2023). Implementation of local wisdom-based indonesian learning to strengthen pancasila student profiles (P5): Case studies in vocational high schools. Journal of Curriculum and Teaching, 12(6), 283–297. doi:10.5430/jct.v12n6p283.
[58] Bulkani, Fatchurahman, M., Adella, H., & Andi Setiawan, M. (2022). Development of animation learning media based on local wisdom to improve student learning outcomes in elementary schools. International Journal of Instruction, 15(1), 55–72. doi:10.29333/iji.2022.1514a.
[59] Kosmas, P., Nisiforou, E. A., Kounnapi, E., Sophocleous, S., & Theophanous, G. (2025). Integrating artificial intelligence in literacy lessons for elementary classrooms: A co-design approach. Educational Technology Research and Development, 73(4), 2589–2615. doi:10.1007/s11423-025-10492-z.
[60] Salinas-Navarro, D. E., Vilalta-Perdomo, E., Michel-Villarreal, R., & Montesinos, L. (2024). Using generative artificial intelligence tools to explain and enhance experiential learning for authentic assessment. Education Sciences, 14(1), 83. doi:10.3390/educsci14010083.
[61] González, J., Melgoza, E., Cabeza, L., & Okoye, K. (2024). Assessment of students’ learning outcome and competency through a blend of knowledge and practical ability. International Journal of Instruction, 17(2), 561–582. doi:10.29333/iji.2024.17231a.
[62] Yeo, S., & Chang, B. H. (2019). Students’ self-assessment of achievement of terminal competency and 4-year trend of student evaluation on outcome-based education. Korean Journal of Medical Education, 31(1), 39–50. doi:10.3946/kjme.2019.117.
[63] Levine, E., & Patrick, S. (2019). What is competency-based education? An updated definition. Aurora Institute, Vienna, Austria.
[64] Alt, D., Naamati-Schneider, L., & Weishut, D. J. N. (2023). Competency-based learning and formative assessment feedback as precursors of college students’ soft skills acquisition. Studies in Higher Education, 48(12), 1901–1917. doi:10.1080/03075079.2023.2217203.
[65] Luitel, S. (2021). Belief and transparency on assessment: Students’ and teachers’ reflections. Siddhajyoti Interdisciplinary Journal, 2(01), 30–38. doi:10.3126/sij.v2i01.39236.
[66] Bearman, M., & Ajjawi, R. (2018). From “seeing through” to “seeing with”: Assessment criteria and the myths of transparency. Frontiers in Education, 3, 96. doi:10.3389/feduc.2018.00096.
[67] Atkinson, A., Watling, C. J., & Brand, P. L. P. (2022). Feedback and coaching. European Journal of Pediatrics, 181(2), 441–446. doi:10.1007/s00431-021-04118-8.
[68] Rakoczy, K., Pinger, P., Hochweber, J., Klieme, E., Schütze, B., & Besser, M. (2019). Formative assessment in mathematics: Mediated by feedback’s perceived usefulness and students’ self-efficacy. Learning and Instruction, 60, 154–165. doi:10.1016/j.learninstruc.2018.01.004.
[69] Levy-Feldman, I. (2025). The role of assessment in improving education and promoting educational equity. Education Sciences, 15(2), 224. doi:10.3390/educsci15020224.
- This work (including HTML and PDF Files) is licensed under a Creative Commons Attribution 4.0 International License.
