1. Home
  2. Vol 5, No 6 (2021)
  3. Suyasa

Modification of CSE-UCLA and Discrepancy as a New Evaluation Model in Education

P. Wayan Arta Suyasa, Dewa Gede Hendra Divayana

Abstract


The absence of an evaluation model that can be used to evaluate the effectiveness of educational activities at vocational universities in the view of six domains causes the need to find innovations in an evaluation model. The six domains, included: context, input, socialization process, implementation process, results, and imbalances that occur in the learning implementation. An evaluation model innovation was initiated through this research in the form of a modification of two educational evaluation models. Those models are CSE-UCLA and Discrepancy. Based on those conditions, the main objective of this research was to demonstrate the existence of a new evaluation model design in education which was a modification of the CSE-UCLA evaluation model and the Discrepancy evaluation model. Specifically, this evaluation model design can be used to determine the effectiveness of the one education activity namely the synchronous learning implementation at vocational universities. The research method used to achieve the objectives of this research was the development method by the Borg and Gall model development design. Five stages of development become the focus of this research, included: research and field data collection, research planning, design development, initial trials, and main product revision. The location of this research was conducted in several vocational universities in the North Bali area (Indonesia). Subjects involved in the initial trials toward this evaluation model design were 20 people. The tools used to conduct the initial trials were questionnaires. The technique used to analyze the data of initial trial results was descriptive quantitative by comparing the percentage of the initial trial results with the standard percentage of the effectiveness level of modified model design. This research results indicate that the evaluation model design was categorized as effective by an effectiveness level was 81.93%. The implication of this research results was the existence of a new design of the educational evaluation model. This design combines two evaluation models to produce good functionality integration in determining the effectiveness level of the synchronouslearning implementation in all universities generally and in vocational universities in Bali particularly.

 

Doi: 10.28991/esj-2021-01321

Full Text: PDF


Keywords


Modification; CSE-UCLA; Discrepancy; New Evaluation Model.

References


Coman, Claudiu, Laurențiu Gabriel Țîru, Luiza Meseșan-Schmitz, Carmen Stanciu, and Maria Cristina Bularca. “Online Teaching and Learning in Higher Education during the Coronavirus Pandemic: Students’ Perspective.” Sustainability 12, no. 24, (December 11, 2020): 1–24. doi:10.3390/su122410367.

Fatoni, Nurce Arifiati, Etty Nurkhayati, Ela Nurdiawati, Fidziah, Giantoro Pamungkas, Suhroji Adha, Irawan, Agus Purwanto, Octoberry Julyanto, and Enji Azizi. “University Students Online Learning System during Covid-19 Pandemic: Advantages, Constraints and Solutions.” Systematic Reviews in Pharmacy 11, no. 7, (July 2020): 570–576. doi: 10.31838/srp.2020.7.81.

Mardiah, Henny. “The Use of E-learning to Teach English in the Time of the Covid-19 Pandemic.” English Teaching and Linguistics Journal 1, no. 2, (July 2020): 49–55. doi:10.30596/etlij.v1i2.4894.

Murphy, Michael P. A. “COVID-19 and Emergency eLearning: Consequences of the Securitization of Higher Education for Post-Pandemic Pedagogy.” Contemporary Security Policy 41, no. 3, (April 30, 2020): 492–505. doi:10.1080/13523260.2020.1761749.

Yulia, Henny. “Online Learning to Prevent the Spread of Pandemic Corona Virus in Indonesia.” ETERNAL (English Teaching Journal) 11, no. 1, (February 2020): 48–56. doi: 10.26877/eternal.v11i1.6068.

Divayana, Dewa Gede Hendra. “Utilization of DIVAYANA Formula in Evaluating of Suitable Platforms for Online Learning in the Social Distancing.” International Journal of Interactive Mobile Technologies 14, no. 20, (December 20, 2020): 50–75. doi: 10.3991/ijim.v14i20.15787.

Dhawan, Shivangi. “Online Learning: A Panacea in the Time of COVID-19 Crisis.” Journal of Educational Technology Systems 49, no. 1, (June 20, 2020): 5–22. doi: 10.1177/0047239520934018.

Lobe, Bojana, David Morgan, and Kim A. Hoffman. “Qualitative Data Collection in an Era of Social Distancing.” International Journal of Qualitative Methods 19, (July 7, 2020): 1–8. doi: 10.1177/1609406920937875.

Sidpra, Jai, Celia Gaier, Nihaal Reddy, Neetu Kumar, David Mirsky, and Kshitij Mankad. (2020). Sustaining Education in the Age of Covid-19: A Survey of Synchronous Web-Based Platforms.” Quantitative Imaging in Medicine and Surgery 10, no.7, (July 2020): 1422–1427. doi:10.21037/qims-20-714.

Tiur Malsari Siregar, Jamalum Purba, and Budi Ali Mukmin. “Evaluation of Implementation of Blended Learning Implementation in Universitas Negeri Medan.” Britain International of Linguistics, Arts and Education Journal 1, no. 2, (November 30, 2019): 224–231. doi:10.33258/biolae.v1i2.89.

Widiharti, Wininng, Burhanuddin Tola, and Yetti Supriyati. “Evaluation of Principal Partnership Programs in the Directorate of Education Management - The Application of Kirkpartick and Countenance Stake Evaluation Model.” Universal Journal of Educational Research 7, no 9A, (September 2019): 71–77. doi:10.13189/ujer.2019.071609.

Gunherani, Dewi, Wiwit Irawati, and Aeng Muhidin. “The Evaluation of E-learning Program at the University of Pamulang.” Advances in Social Science, Education and Humanities Research 335, (August 2019): 710–716. doi:10.2991/icesshum-19.2019.113.

Embi, Zarina Che, Tse-Kian Neo, and Mai Neo. “Using Kirkpatrick’s Evaluation Model in a Multimedia-Based Blended Learning Environment.” Journal of Multimedia Information System 4, no. 3, (September 30, 2017): 115–122. doi:10.9717/JMIS.2017.4.3.115.

Youker, Brandon W., and Allyssa Ingraham. “Goal-Free Evaluation: An Orientation for Foundations’ Evaluations.” The Foundation Review 5, no. 4, (February 7, 2014): 51–61. doi:10.9707/1944-5660.1182.

Rosiyanti, Hastri, and Faisal. “Evaluation of E-Campus-Based E-learning Implementation by Mathematics Education Study Program Students at the University of Muhammadiyah Jakarta.” Advances in Social Science, Education and Humanities Research 512, (December 31, 2020): 349–354. doi:10.2991/assehr.k.201230.065.

Tripathi, J.P., and Arti Bansal. “A Literature Review on Various Models for Evaluating Training Programs.” IOSR Journal of Business and Management (IOSR-JBM) 19, no. 11, (November 2017): 14–22. doi:10.9790/487X-1911041422.

Esgaiar, and Scott Foster. “Implementation of CIPP Model for Quality Evaluation at Zawia University.” International Journal of Applied Linguistics & English Literature 8, no. 5, (September 30, 2019): 106–115. doi:10.7575/aiac.ijalel.v.8n.5p.106.

Mubayrik, Haifa F. Bin. “New Trends in Formative-Summative Evaluations for Adult Education.” Sage Open 10, no. 3, (July 9, 2020): 1–13. doi:10.1177/2158244020941006.

Divayana, Dewa Gede Hendra, P. Wayan Arta Suyasa, and Ida Bagus Gede Surya Abadi. “Digital library Evaluation Application Based on Combination of CSE-UCLA with Weighted Product.” Journal of Engineering and Applied Sciences 14, no. 4, (February 2019): 1318–1330. doi:10.36478/jeasci.2019.1318.1330.

Makaria, Eklys Cheseda. “Evaluation Study on Implementation of Home Visit Service through CSE-UCLA Model in SMP Negeri 2 Anjir Muara.” Advances in Social Science, Education and Humanities Research 274, (December 2018): 68–71. doi:10.2991/iccite-18.2018.16.

Ambida, Roger S., and Rizalina A. Cruz. “Extent of Compliance of a Higher Education Institution for a University System.” Science Journal of Education 5, no. 3, (April 12, 2017): 90–99. doi:10.11648/j.sjedu.20170503.13.

Herawati, Endang Sri Budi, Suryadi, and Bejdo Sujanto. “Evaluating the Implementation of Policy on Education Board.” International Journal for Educational and Vocational Studies 1, no. 3, (July 2019): 236–243. doi:10.29103/ijevs.v1i3.1584.

Mohmmed, Abdalellah O., Basim A. Khidhir, Abdul Nazeer, and Vigil J. Vijayan. “Emergency Remote Teaching during Coronavirus Pandemic: the Current Trend and Future Directive at Middle East College Oman.” Innovative Infrastructure Solutions 5, no. 72, (July 1, 2020): 1–11. doi:10.1007/s41062-020-00326-7.

Sudarwati, Ninik, and Rukminingsih. “Evaluating E-learning as a Learning Media: a Case of Entrepreneurship E-learning using Schoology as Media.” International Journal of Emerging Technologies in Learning 13, no. 9, (September 2018): 269–279. doi:10.3991/ijet.v13i09.7783.

Divayana, Dewa Gede Hendra, Baso Intang Sappaile, I Gusti Ngurah Pujawan, I Ketut Dibia, Luh Artaningsih, I Made Sundayana, and Gusti Ayu Dessy Sugiharni. “An Evaluation of Instructional Process of Expert System Course Program by using Mobile Technology-Based CSE-UCLA Model.” International Journal of Interactive Mobile Technologies 11, no. 6, (November 2017): 18–31. doi:10.3991/ijim.v11i6.6697.

Suyasa, P. Wayan Arta, Putu Sukma Kurniawan, I Putu Wisna Ariawan, Wayan Sugandini, Ni Desak Made Sri Adnyawati, I Dewa Ayu Made Budhyani, and Dewa Gede Hendra Divayana. “Empowerment of CSE-UCLA Model Based on Glickman Quadrant Aided by Visual Application to Evaluate the Blended Learning Program on SMA Negeri 1 Ubud.” Journal of Theoretical and Applied Information Technology 96, no. 18, (September 30, 2018): 6203-6219.

Sudirtha, I Gede, Ketut Widiartini, and Made Suriani. “Program Evaluation: Implementation of Tourism Village Development.” International Journal of Social Sciences and Humanities 3, no. 3, (December 2019): 99–108. doi:10.29332/ijssh.v3n3.356.

Divayana, Dewa Gede Hendra, I Gede Sudirtha, and I Ketut Gading. “Application Design of Countenance Evaluation Based on Tri Hita Karana-ANEKA for Evaluating the Students’ Computer Capability and Students’Character.” Cogent Psychology 7, no. 1, (June 16, 2020): 1–18. doi:10.1080/23311908.2020.1773095.

Najuah, Syarifah, and Ricu Sidiq. “The Development and Utilization of E-Learning Media using the Edmodo Applications for Statistic Course.” Advances in Social Science, Education and Humanities Research (ASSEHR) 208, (May 2019): 123–126. doi:10.2991/icssis-18.2019.24.

Angelina, Patricia. “Developing Task-Based Learning Model for Language Teaching Media Course in English Language Education Study Program.” LLT Journal: A Journal on Language and Language Teaching 21, no. 1, (April 2018): 36–45. doi:10.24071/llt.2018.210104.

Etikan, Ilker, Sulaiman Abubakar Musa, and Rukayya Sunusi Alkassim. “Comparison of Convenience Sampling and Purposive Sampling.” American Journal of Theoretical and Applied Statistics 5, no. 1, (January 2016): 1–4. doi:10.11648/j.ajtas.20160501.11.

Shukri, Athirah, Latipah Nordin, Farah Idayu Mohd Salleh, Syazwa Nabila Mohd Raidzwan, and Rohaizan Ahmad. “UniKL Students’ Perception on Synchronous Learning using ICT as Learning Tools to Learn English.” Journal of Critical Reviews 7, no. 8, (June 2020): 793–796. doi:10.31838/jcr.07.08.170.

Omillo, Francis Okumu. “Muddles in Pentatonic Likert-Type Scale: Accuracy Cost in Psychometric Measurements for Small Enterprise Development.” ILIRIA International Review 9, no. 1, (July 1, 2019): 69–83. doi:10.21113/iir.v9i1.476.

Louangrath, P. I., and Chanoknath Sutanapong. “Validity and Reliability of Survey Scales.” International Journal of Research & Methodology in Social Science 4, no. 3, (December 31, 2018): 99–114. doi:10.5281/zenodo.2545038.

Pescaroli, Gianluca, Omar Velazquez, Irasema Alcántara-Ayala, Carmine Galasso, Patty Kostkova, and David Alexander. “A Likert Scale-Based Model for Benchmarking Operational Capacity, Organizational Resilience, and Disaster Risk Reduction.” International Journal of Disaster Risk Science 11, (May 19, 2020): 404–409. doi:10.1007/s13753-020-00276-9.

Ismanto. “Aspect of Language on a Qualitative Analysis of Student’s Evaluation Instrument.” Qudus International Journal of Islamic Studies 4, no. 2, (August 2016): 218–232. doi:10.21043/qijis.v4i2.1788.

Ruslan, Alimuddin, and Nasrullah. “Developing Alternative Assessment of Mathematical Performance for Vocational Students.” Innovation of Vocational Technology Education 14, no. 1, (February, 2018): 32–37. doi:10.17509/invotec.v14i1.11045.

Wiyasa, Putu Irmayanti, I Ketut Darma Laksana, and Ni Luh Ketut Mas Indrawati. “Evaluating Quality of Teacher-Developed English Test in Vocational High School: Content Validity and Item Analysis.” Education Quarterly Reviews 2, no. 2, (May 24, 2019): 344–356. doi:10.31014/aior.1993.02.02.67.

Boyacı, Ş. Dilek Belet, and Nurhan Atalay. “A Scale Development for 21st Century Skills of Primary School Students: A Validity and Reliability Study.” International Journal of Instruction 9, no. 1, (January 2016): 133–148. doi:10.12973/iji.2016.9111a.

Cárdenas-Gutiérrez, Antonio Ramón, Antonio Bernal-Guerrero, and Elisabet Montoro-Fernández. “Construction and Validation of the Basic Scale of Entrepreneurial Competencies for the Secondary Education Level. A Study Conducted in Spain.” Plos One 16, no. 4, (April 15, 2021): 1–21. doi:10.1371/journal.pone.0249903.

Ginting, Fiber Yun. “An Analysis of Students’ Ability in using Punctuation Marks in Descriptive Paragraph Writing”, Budapest International Research and Critics Institute-Journal 1, no. 3, (October 2018): 338–344. doi:10.33258/birci.v1i3.57.

Sugiharni, Gusti Ayu Dessy. “The Development of Interactive Instructional Media Oriented to Creative Problem Solving Model on Function Graphic Subject.” Journal of Educational Research and Evaluation 2, no. 4, (November 2018): 183–189. doi:10.23887/jere.v2i4.16694.

Toosi, Monireh, Maryam Modarres, Mitra Amini, and Mehrnaz Geranmayeh. “Context, Input, Process, and Product Evaluation Model in Medical Education: A Systematic Review.” Journal of Education and Health Promotion 10, no. 1, (May 31, 2021): 199. doi:10.4103/jehp.jehp_1115_20.

Lee, So Young, Jwa-Seop Shin, and Seung-Hee Lee. “How to Execute Context, Input, Process, and Product Evaluation Model in Medical Health Education.” Journal of Educational Evaluation for Health Professions 16, no. 40 (December 28, 2019): 1–8. doi:10.3352/jeehp.2019.16.40.

Iqbal, Zafar, Muhammad Anees, Rahim Khan, Abdul Wadood, and Shakila Malik. “A Comparative Analysis of the Efficacy of Three Program-Evaluation Models –A Review on their Implication in Educational Programs.” Humanities & Social Sciences Reviews 9, no. 3, (May 12, 2021): 326–336. doi:10.18510/hssr.2021.9333.

Finney, Tia L. “Confirmative Evaluation: New CIPP Evaluation Model.” Journal of Modern Applied Statistical Methods 18, no. 2, (November 2019): 2–24. doi:10.22237/jmasm/1598889893.

Gandomkar, Roghayeh. “Comparing Kirkpatrick’s Original and New Model with CIPP Evaluation Model.” Journal of Advances in Medical Education & Professionalism 6, no. 2, (March 2018): 94–95. doi:10.30476/jamp.2018.41014.

Winaryati, Eny, Mardiana, and Muhamad Taufik Hidayat. “Conceptual Framework of Evaluation Model on 4C’S-Based Learning Supervision.” International Journal of Learning, Teaching and Educational Research 19, no. 8, (August 2020): 173–193. doi:10.26803/ijlter.19.8.10.


Full Text: PDF

DOI: 10.28991/esj-2021-01321

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 P. Wayan Arta Suyasa, Dewa Gede Hendra Divayana