Design of Formative-Summative Evaluation Model Based on Tri Pramana-Weighted Product

I Putu Wisna Ariawan, Wayan Sugandini, I Made Ardana, I Made Suwastika Dharma Arta, Dewa Gede Hendra Divayana

Abstract


Quality in the implementation of e-learning in health universities can be measured both during the learning process and after the learning ends. Measurement can be performed through evaluation activities. The evaluation model needed was an innovative evaluation model that can look for the dominant aspects that determined the quality of e-learning implementation. One breakthrough evaluation model produced in this research to answer this need was the Formative-Summative evaluation model based on the Tri Pramana-Weighted Product. The main objective of this research was to show the quality of the Formative-Summative evaluation model design based on the Tri Pramana-Weighted Product. This research approach was based on the Borg & Gall development model, which focused on the design development stage. The subjects involved in conducting trials of the evaluation model design were 34 respondents. The technique for determining the subject was carried out using a purposive sampling technique. In addition, the tool used to conduct the trial was a questionnaire. The location for filling out the questionnaire was in health universities and colleges in the province of Bali. The technique used to analyze the data from the test results was descriptive quantitative by comparing the average percentage of the quality of the test results with the percentage of quality that refers to the five-scale categorization. The results showed that the percentage of the design quality of the Formative-Summative evaluation model based on the Tri Pramana-Weighted Productof 88.02%. This means that the quality of the evaluation model design was included in the good category. The impact of the results of this research on the field of education was to present an innovation in evaluation activities that made it easier for educational evaluators to measure the quality of e-learning, especially in health universities and colleges.

 

Doi: 10.28991/ESJ-2022-06-06-016

Full Text: PDF


Keywords


Formative-Summative; Evaluation Model; Tri Pramana; Weighted Product; Educational Technology; E-Learning.

References


Sari, N. W. W., Yanuartha, W., Yani, M., & Dewa, S. R. (2021). Evaluation of E-Learning Implementation during the Covid-19 with the DeLone and McLean Models. International Journal of Information System & Technology, 4(2), 637. doi:10.30645/ijistech.v4i2.104.

Abuhassna, H., Al-Rahmi, W. M., Yahya, N., Zakaria, M. A. Z. M., Kosnin, A. B. M., & Darwish, M. (2020). Development of a new model on utilizing online learning platforms to improve students’ academic achievements and satisfaction. International Journal of Educational Technology in Higher Education, 17(1), 1–23. doi:10.1186/s41239-020-00216-z.

Pham, L., Limbu, Y. B., Bui, T. K., Nguyen, H. T., & Pham, H. T. (2019). Does e-learning service quality influence e-learning student satisfaction and loyalty? Evidence from Vietnam. International Journal of Educational Technology in Higher Education, 16(1), 1–26. doi:10.1186/s41239-019-0136-3.

Paramartha, W., Sustiawati, N. L., Sukrawati, N. M., & Sugiharni, G. A. D. (2022). Tri Pramana Values in Educational Pedagogy. Academic Journal of Interdisciplinary Studies, 11(3), 199. doi:10.36941/ajis-2022-0078.

Suastika, I. N., Suartama, I. K., Sanjaya, D. B., & Arta, K. S. (2021). Application of multicultural-based learning model syntax of social studies learning. Cypriot Journal of Educational Sciences, 16(4), 1660–1679. doi:10.18844/cjes.v16i4.6030.

Putu Wisna Ariawan, I., Giri, M. K. W., & Divayana, D. G. H. (2019). The CIPP-SAW evaluation model design in measurement the effectiveness of e-learning at health universities in Bali. Journal of Theoretical and Applied Information Technology, 97(21), 2922–2934.

Wisna Ariawan, I. P., Kurnia Widiastuti Giri, M., & Hendra Divayana, D. G. (2020). Simulation of SAW-based CIPP Evaluation Model Calculation in Determining Improvement Priority for E-Learning Services. 2020 4th International Conference on Vocational Education and Training (ICOVET). doi:10.1109/icovet50258.2020.9230117.

Divayana, D. G. H., Ariawan, I. P. W., & Giri, M. K. W. (2021). CIPP-SAW application as an evaluation tool of e-learning effectiveness. International Journal of Modern Education and Computer Science, 13(6), 42–59. doi:10.5815/ijmecs.2021.06.05.

Bin Mubayrik, H. F. (2020). New Trends in Formative-Summative Evaluations for Adult Education. SAGE Open, 10(3), 215824402094100. doi:10.1177/2158244020941006.

Dwiyanti, K. E., & Suwastini, N. K. A. (2021). Assessment for writing skills in online learning. Lingua Scientia, 28(1), 8–19. doi:10.23887/ls.v28i1.29069.

Abbasi Kasani, H., Shams Mourkani, G., Seraji, F., & Abedi, H. (2020). Identifying the Weaknesses of Formative Assessment in the e-Learning Management System. Journal of Medical Education, 19(2), 1–7. doi:10.5812/jme.108533.

Liu, G. (2020). Design of Learning Evaluation Model for Distance Education. Advances in Social Science, Education and Humanities Research, 450, 70–73. doi:10.2991/assehr.k.200727.016.

Ridhwan, M. (2017). Understanding Formative and Summative Assessment for EFL Teachers: Theoretical Reflections on Assessment for Learning. J-SHMIC : Journal of English for Academic, 4(1), 40–50. doi:10.25299/jshmic.2017.vol4(1).505.

Sudakova, N.E., Savina, T.N., Masalimova, A.R., Mikhaylovsky, M.N., Karandeeva, L.G., & Zhdanov, S.P. (2022). Online Formative Assessment in Higher Education: Bibliometric Analysis. Education Sciences, 12(3), 1–19. doi:10.3390/educsci12030209.

Donkin, R., & Askew, E. (2017). An Evaluation of Formative “In-Class” versus “E-Learning” Activities to Benefit Student Learning Outcomes in Biomedical Sciences. Journal of Biomedical Education, 2017, 1–7. doi:10.1155/2017/9127978.

Martaningsih, S. T., Soenarto, & Istiyono, E. (2019). Evaluation model of career counseling program in vocational high school. International Journal of Evaluation and Research in Education, 8(2), 318–329. doi:10.11591/ijere.v8i2.14986.

Gede Hendra Divayana, D., Wayan Arta Suyasa, P., & Bagus Gede Surya Abadi, I. (2019). Digital Library Evaluation Application Based on Combination of CSE-UCLA with Weighted Product. Journal of Engineering and Applied Sciences, 14(4), 1318–1330. doi:10.36478/jeasci.2019.1318.1330.

Wibawa, B., & Paidi. (2019). The Development of Blended Learning Based on Handphone for Computer System Subject on Xi Grade of SMKN 1 Bengkulu City. Humanities & Social Sciences Reviews, 7(3), 497–502. doi:10.18510/hssr.2019.7373.

Hendikawati, P., Zahid, M. Z., & Arifudin, R. (2019). Android-based Computer Assisted Instruction development as a learning resource for supporting self-regulated learning. International Journal of Instruction, 12(3), 389–404. doi:10.29333/iji.2019.12324a.

Divayana, D. G. H. (2018). Development of ANEKA-Weighted Product evaluation model based on Tri Kaya Parisudha in computer learning on vocational school. Cogent Engineering, 5(1), 1–33. doi:10.1080/23311916.2018.1542577.

Divayana, D. G. H., Ariawan, I. P. W., Ardana, I. M., & Wayan Arta Suyasa, P. (2021). Utilization of alkin-wp-based digital library evaluation software as evaluation tool of digital library effectiveness. Emerging Science Journal, 5(5), 731–746. doi:10.28991/esj-2021-01308.

Wao, J. O. (2018). Weighted Product Method in the Value Engineering Process for Construction Project. International Journal of Scientific Research and Management, 6(12), 153–161. doi:10.18535/ijsrm/v6i12.ec03.

Putra, S. D., Borman, R. I., & Arifin, G. H. (2022). Assessment of Teacher Performance in SMK Informatika Bina Generasi using Electronic-Based Rating Scale and Weighted Product Methods to Determine the Best Teacher Performance. International Journal of Informatics, Economics, Management and Science, 1(1), 55. doi:10.52362/ijiems.v1i1.693.

Wardhani, A. K., Widodo, C. E., & Suseno, J. E. (2018). Information System for Culinary Product Selection Using Clustering K-Means and Weighted Product Method. Advances in Social Science, Education and Humanities Research, 165, 18–22. doi:10.2991/iccsr-18.2018.5.

Sahoo, B., Behera, R. N., & Pattnaik, P. K. (2022). A Comparative Analysis of Multi-Criteria Decision Making Techniques for Ranking of Attributes for e-Governance in India. International Journal of Advanced Computer Science and Applications, 13(3), 65–70. doi:10.14569/IJACSA.2022.0130311.

Kurniawan, R., Windarto, A. P., Fauzan, M., Solikhun, S., & Damanik, I. S. (2019). Analysis of Weight Product (WP) Algorithms in the best Go Car Driver Recommendations at PT. Maranatha Putri Bersaudara. International Journal of Information System & Technology, 3(1), 18. doi:10.30645/ijistech.v3i1.28.

Dalimunte, M., & Salmiah, M. (2019). Students’ Ability at Changing Direct into Indirect Speech and Indirect into Direct Speech. Budapest International Research and Critics Institute (BIRCI-Journal): Humanities and Social Sciences, 2(2), 178–185. doi:10.33258/birci.v2i2.249.

Sutirna, S. (2019). Subject teachers’ perceptions of academic mentoring and counseling services. COUNS-EDU: The International Journal of Counseling and Education, 4(4), 129. doi:10.23916/0020190423040.

Sari, S. A., & Rezeki, Y. S. (2019). The Development of an Ingenious Circuit Based on Chemo-Edutainment Learning. International Journal of Educational Research Review, 4(1), 15–25. doi:10.24331/ijere.467078.

Ariawan, I. P. W., Simatupang, W., Ishak, A. M., Agung, A. A. G., Suratmin, Adiarta, A., & Divayana, D. G. H. (2018). Development of ANEKA evaluation model based on TOPSIS in searching the dominant aspects of computer learning quality determinants. Journal of Theoretical and Applied Information Technology, 96(19), 6580–6596.

Divayana, D. G. H., Suyasa, P. W. A., & Widiartini, N. K. (2021). An innovative model as evaluation model for information technology-based learning at ICT vocational schools. Heliyon, 7(2), 1–13. doi:10.1016/j.heliyon.2021.e06347.

Nawawi, S., Nizkon, & Azhari, A. T. (2020). Analysis of the level of critical thinking skills of students in biological materials at Muhammadiyah high school in Palembang city. Universal Journal of Educational Research, 8(3D), 47–53. doi:10.13189/ujer.2020.081707.

Dessy Sugiharni, G. A. (2019). The Development of Interactive Instructional Media Oriented to Creative Problem Solving Model on Function Graphic Subject. Journal of Education Research and Evaluation, 2(4), 183. doi:10.23887/jere.v2i4.16694.

Sugiharni, G. A. D., Setiasih, N. W., Mahendra, I. W. E., Ardana, I. M., & Divayana, D. G. H. (2018). Development of alkin model instruments as evaluation tools of blended learning implementation in discrete mathematics course on STIKOM Bali. Journal of Theoretical and Applied Information Technology, 96(17), 5803–5818.

Yulina, I. K., Permanasari, A., Hernani, H., & Setiawan, W. (2019). Analytical thinking skill profile and perception of pre service chemistry teachers in analytical chemistry learning. Journal of Physics: Conference Series, 1157(4), 1–7. doi:10.1088/1742-6596/1157/4/042046.

Sari, L. Y., Susanti, D., Fitriani, V., & Supriatno, B. (2020). How to Validity Handbook in Introduction and Laboratory Techniques Oriented PBL. International Journal of Progressive Sciences and Technologies (IJPSAT), 19(1), 250–254. doi:10.52155/ijpsat.v19.1.1625.

Purwaningsih, H., & Dardjito, H. (2021). Implementation of Cipp Model for Online Learning Evaluation during Covid-19 Pandemic. Getsempena English Education Journal, 8(2), 294–309. doi:10.46244/geej.v8i2.1394.

Dewantara, I. P. M. (2017). Stake Evaluation Model (Countenance Model) in Learning Process Bahasa Indonesia at Ganesha University of Educational. International Journal of Language and Literature, 1(1), 19. doi:10.23887/ijll.v1i1.9615.

Alzabidi, A. S. (2021). Self-Assessment as an Effective Learning Strategy in E-Learning: Promoting Learner Contribution. Journal of Language and Linguistic Studies, 17(2), 1129–1140.

Rosiyanti, H., & Faisal. (2021). Evaluation of e-Campus-Based e-Learning Implementation by Mathematics Education Study Program Students at the University of Muhammadiyah Jakarta. Advances in Social Science, Education and Humanities Research, 512, 349–354. doi:10.2991/assehr.k.201230.065.

Timbi-Sisalima, C., Sánchez-Gordón, M., Hilera-Gonzalez, J. R., & Otón-Tortosa, S. (2022). Quality Assurance in E-Learning: A Proposal from Accessibility to Sustainability. Sustainability (Switzerland), 14(5), 1–27. doi:10.3390/su14053052.

Firmansyah, R., Putri, D. M., Wicaksono, M. G. S., Putri, S. F., Widianto, A. A., & Palil, M. R. (2021). Educational Transformation: An Evaluation of Online Learning Due To COVID-19. International Journal of Emerging Technologies in Learning (IJET), 16(07), 61. doi:10.3991/ijet.v16i07.21201.

Naibaho, L. (2021). Online Learning Evaluation during Covid-19 using CSE-UCLA Evaluation Model at English Education Department Universitas Kristen Indonesia. Budapest International Research and Critics Institute (BIRCI-Journal): Humanities and Social Sciences, 4(2), 1987–1997. doi:10.33258/birci.v4i2.1887.

Setiawan, R., & Munajah, R. (2020). Evaluation of the application of online learning in Indonesian universities. TEM Journal, 9(3), 1194–1199. doi:10.18421/TEM93-46.

Suswanto, B., Sulaiman, A. I., Sugito, T., Weningsih, S., Sabiq, A., & Kuncoro, B. (2021). Designing Online Learning Evaluation in Times of Covid-19 Pandemic. International Educational Research, 4(1), 1-18. doi:10.30560/ier.v4n1p18.

Supriyono, H., & Sari, C. P. (2018). Developing decision support systems using the weighted product method for house selection. AIP Conference Proceedings. doi:10.1063/1.5042905.

Saputra, D., Widianto, K., Setiyorini, T., & Alfarobi, I. (2021). Decision Support System for Cloud Computing Service Selection Using the Weighted Product Method (Case Study: PT. Deptech Digital Indonesia). International Journal of Science, Technology & Management, 2(1), 78–92. doi:10.46729/ijstm.v2i1.103.

Maulana, H. O., Shofi, I. M., Rozy, N. F., & Agustin, F. E. M. (2017). Application for determining mustahiq based on the priority using weight product method (case study: BAZIS DKI Jakarta). 5th International Conference on Cyber and IT Service Management (CITSM). https://doi.org/10.1109/citsm.2017.8089315.

Bire, C., Kasse, D., & Bire, R. (2021). Decision support system for selecting tourist attractions using fuzzy analytic hierarchy process. Bulletin of Electrical Engineering and Informatics, 10(3), 1252–1261. doi:10.11591/eei.v10i3.3032.

Utomo, P., & Budiman, A. (2020). Application of Weighted Product (WP) Method in Decision Support of Unmer Madiun Rector Election. Journal of Computer, Information System & Technology Management, 3(2), 74. doi:10.25273/research.v3i2.6700.

Nababan, L., & Tuti, E. (2018). Determination Feasibility of Poor Household Surgery By Using Weighted Product Method. 2018 6th International Conference on Cyber and IT Service Management (CITSM). doi:10.1109/citsm.2018.8674253.

Herdiansah, A., Handayani, N., & Kurniawan, A. (2019). A Development of Decision Support Systems Selection of Employee Acceptance Using Weighted Product Method. Journal of Information Systems and Informatics, 1(2), 87–97. doi:10.33557/journalisi.v1i2.10.


Full Text: PDF

DOI: 10.28991/ESJ-2022-06-06-016

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 I Putu Wisna Ariawan, Wayan Sugandini, I Made Ardana, I Made Suwastika Dharma Arta, Dewa Gede Hendra Divayana