1. Home
  2. Vol 5, No 5 (2021)
  3. Divayana

Utilization of Alkin-WP-Based Digital Library Evaluation Software as Evaluation Tool of Digital Library Effectiveness

Dewa Gede Hendra Divayana, I Putu Wisna Ariawan, I Made Ardana, P. Wayan Arta Suyasa

Abstract


One source of learning in universities is a digital library. In the era of industry 4.0, most universities have implemented digital libraries in supporting the learning process. However, the reality shows that digital library management is still ineffective. Therefore, the implementation of digital libraries needs to be evaluated for determining the digital library effectiveness used as learning resources in supporting the learning process in universities. Many evaluation tools are used to evaluate the effectiveness of digital libraries but have not provided accurate recommendation results to support decision-making. This research presents an innovation in the form of an evaluation tool that can be used to evaluate the digital library effectiveness in universities. That evaluation tool is called the Alkin-WP-based digital library evaluation software. This software is a desktop platform that contains aspects of measuring the digital library effectiveness by referring to the components of the Alkin evaluation model and the WP (Weighted Product) method. This research aimed to show the effectiveness level of the utilization of Alkin-WP-based digital library evaluation software. This research method was R & D (Research & Development) which refers to the ten development stages of the Borg and Gall model. In this research, development was focused only on a few stages, included: usage trials, final product revision, dissemination, and implementation. The subjects involved in assessing the implementation/utilization of the Alkin-WP-based digital library evaluation software were 35 people, in the usage trials were six people, in product revision were three people, and at the stage of dissemination were 15 people. The tools used to collect data were questionnaires and interview guidelines. The data analysis technique used was descriptive quantitative. The effectiveness level of utilizing the Alkin-WP-based digital library evaluation software was 88.34%. It showed that the evaluation software had effective. The impact of this research results on the scientific field of educational evaluation is being able to show the existence of a new evaluation tool based on educational evaluation and artificial intelligence. That evaluation tool can easier for library heads to make policies for revamping digital library services based on accurate recommendations.

 

Doi: 10.28991/esj-2021-01308

Full Text: PDF


Keywords


Alkin; WP (Weighted Product); Digital Library; Evaluation Software; Effectiveness.

References


Muktiarni, M., I Widiaty, A G Abdullah, A Ana, and C Yulia. “Digitalisation Trend in Education during Industry 4.0.” Journal of Physics: Conference Series 1402, no. 7, (December 16, 2019): 1–6. doi:10.1088/1742-6596/1402/7/077070.

Johnston, Nicole. “The Shift towards Digital Literacy in Australian University Libraries: Developing a Digital Literacy Framework.” Journal of the Australian Library and Information Association 69, no. 1, (March 1, 2020): 93–101. doi:10.1080/24750158.2020.1712638.

Deja, Marek, Dorota Rak, and Brigitte Bell. “Digital Transformation Readiness: Perspectives on Academia and Library Outcomes in Information Literacy.” The Journal of Academic Librarianship 47, no. 5, (September 2021): 1–15. doi:10.1016/j.acalib.2021.102403.

Muthanna, Abdulghani, and Guoyuan Sang. “State of University Library: Challenges and Solutions for Yemen.” The Journal of Academic Librarianship 45, no. 2, (March 2019): 119–125. doi:10.1016/j.acalib.2019.01.010.

Sherriff, Graham, Daisy Benson, and Gary S. Atwood. “Practices, Policies, and Problems in the Management of Learning Data: A Survey of Libraries’ Use of Digital Learning Objects and the Data They Create.” The Journal of Academic Librarianship 45, no. 2, (March 2019): 102–109. doi:10.1016/j.acalib.2018.12.005.

Xiao, Junhong. “Digital Transformation in Higher Education: Critiquing the Five-Year Development Plans (2016-2020) of 75 Chinese Universities.” Distance Education 40, no. 4, (November 17, 2019): 515–533. doi:10.1080/01587919.2019.1680272

Rosa, Igor. “Digital Library Polona: Digitization, Technology, Cooperation.” Slavic & East European Information Resources 20, No.1-2, (June 19, 2019): 23–30. doi:10.1080/15228886.2019.1628495.

Divayana, Dewa Gede Hendra, P. Wayan Arta Suyasa, and Ida Bagus Gede Surya Abadi. “Digital Library Evaluation Application Based on Combination of CSE-UCLA with Weighted Product.” Journal of Engineering and Applied Sciences 14, no. 4, (February 28, 2019): 1318–1330. doi:10.36478/jeasci.2019.1318.1330.

Niqresh, Mohammad. “Digital Library and Intellectual Issues—Issues in Copyright and Intellectual Property.” International Education Studies 12, no. 1, (December 28, 2019): 114–127. doi:10.5539/ies.v12n1p114.

Xie, Iris, Soohyung Joo, and Krystyna K. Matusiak. “Digital Library Evaluation Measures in Academic Settings: Perspectives from Scholars and Practitioners.” Journal of Librarianship and Information Science 53, no. 1, (March 1, 2021): 130–152. doi:10.1177/0961000620935505.

Asemi, Asefeh, Andrea Ko, and Mohsen Nowkarizi. “Intelligent Libraries: A Review on Expert Systems, Artificial Intelligence, and Robot.” Library Hi Tech 39, no. 2, (June 21, 2021): 412–434. doi:10.1108/LHT-02-2020-0038.

Stiller, Juliane, and Vivien Petras. “Learning from Digital Library Evaluations: The Europeana Case.” ABI Technik 38, no. 1, (April 4, 2018): 37–45.doi:10.1515/abitech-2018-0006.

Muglia, Caroline, Elizabeth J. Kelly, Genya O’Gara, Ayla Stein, Santi Thompson, and Liz Wolcott. “How We Talk about Assessment: A New Framework for Digital Libraries.” The Serials Librarian 76, no. 1-4, (May 9, 2019): 208–212. doi:10.1080/0361526X.2019.1586050.

Barifah, Maram, Monica Landoni, and Ayman Eddakrouri. “Evaluating the User Experience in a Digital Library.” Proceedings of the Association for Information Science and Technology 57, no. 1, (October 22, 2020): e280. doi:10.1002/pra2.280.

Yu, Kaijun, Ruiyi Gong, Longjie Sun, and Chunguo Jiang. “The Application of Artificial Intelligence in Smart Library.” Advances in Economics, Business and Management Research 100, (October 2019): 708–713. doi:10.2991/icoi-19.2019.124.

Mulyani, Endang, Anik Widiastuti, and Supriyanto. “Developing a Model for Evaluating Learning Outcomes of an Entrepreneurship Course.” International Journal of Learning, Teaching and Educational Research 18, no. 11, (November 2019): 53–69. doi:10.26803/ijlter.18.11.4.

Angelina, Patricia. “Developing Task-Based Learning Model for Language Teaching Media Course in English Language Education Study Program.” LLT Journal: A Journal on Language and Language Teaching 21, no. 1, (April 2018): 36–45. doi:10.24071/llt.2018.210104.

Andrian, Dedek. “Developing an Instrument to Evaluate the Influential Factors of the Success of Local Curriculum.” Research and Evaluation in Education 5, no. 1, (June 2019): 75–84. doi:10.21831/reid.v5i1.23980.

Desstya, Anatri, Zuhdan Kun Prasetyo, Suyanta, Ihwan Susila, and Irwanto. “Developing an Instrument to Detect Science Misconception of an Elementary School Teacher.” International Journal of Instruction 12, no. 3, (July 2019): 201–218. doi:10.29333/iji.2019.12313a.

Sunarsih, Farida Harahap, Habibullah, and Muslim Afandi. “The Validity and Reliability of Subjective Well-Being Instruments in Early Adolescents.” Humaniora 11, no. 2, (July 2020): 113–122. doi:10.21512/humaniora.v11i2.6461.

Sugihartini, Nyoman, Gede Partha Sindu, Kadek Sintya Dewi, Masduki Zakariah, and Putu Sudira. “Improving Teaching Ability with Eight Teaching Skills.” Advances in Social Science, Education and Humanities Research 394, (January 20, 2019): 306–310. doi:10.2991/assehr.k.200115.050.

Divayana, Dewa Gede Hendra, P. Wayan Arta Suyasa, and Ni Ketut Widiartini. “An Innovative Model as Evaluation Model for Information Technology-Based Learning at ICT Vocational Schools.” Heliyon 7, no.2, (February 2021):1–13. doi:10.1016/j.heliyon.2021.e06347.

Katemba, Caroline V., and Samuel. “Improving Student’s Reading Comprehension Ability Using Jigsaw 1 Technique.” Journal of English Language Pedagogy, Literature and Culture 2, no. 2, (August 1, 2017): 82–102. doi:10.35974/acuity.v2i2.613.

Canivez, Gary L., Marley W. Watkins, Rebecca Good, Kate James, and Trevor James. “Construct Validity of the Wechsler Intelligence Scale for Children – Fourth UK Edition with a Referred Irish Sample: Wechsler and Cattell–Horn–Carroll Model Comparisons with 15 Subtests.” British Journal of Educational Psychology 87, no. 3, (September 2017): 383–407. doi:10.1111/bjep.12155.

Dalimunte, Muhammad, and Maryati Salmiah. “Students’ Ability at Changing Direct into Indirect Speech and Indirect into Direct Speech.” Budapest International Research and Critics Institute (BIRCI-Journal): Humanities and Social Sciences 2, no. 2, (May 2019):178–185. doi:10.33258/birci.v2i2.249.

Sari, Sri Adelia, and Yuni Sri Rezeki. “The Development of an Ingenious Circuit Based on Chemo-Edutainment Learning.” International Journal of Educational Research Review 4, no. 1, (January 2019): 15–25. doi:10.24331/ijere.467078.

Sutirna. “Subject Teachers’ Perceptions of Academic Mentoring and Counseling Services.” COUNS-EDU: The International Journal of Counseling and Education 4, no. 4, (December 21, 2019): 129–133. doi:10.23916/0020190423040.

Sari, Liza Yulia, Diana Susanti, Vivi Fitriani, Bambang Supriatno, and Riandi. “How to Validity Handbook in Introduction and Laboratory Techniques Oriented PBL.” International Journal of Progressive Sciences and Technologies (IJPSAT) 19, no. 1, (February 2020): 250–254. doi:10.52155/ijpsat.v19.1.1625.

Nawawi, Sulton, Nizkon, and Ahmad Trian Azhari. “Analysis of the Level of Critical Thinking Skills of Students in Biological Materials at Muhammadiyah High School in Palembang City.” Universal Journal of Educational Research 8, no. 3D, (April 2020): 47–53. doi:10.13189/ujer.2020.081707.

Mantasiah, R., Yusri, & Jufri. “Semantic Feature Analysis Model: Linguistics Approach in Foreign Language Learning Material Development.” International Journal of Instruction 13, no. 1, (January 2020): 185–196. doi:10.29333/iji.2020.13112a.

Naibaho, Lamhot. “Online Learning Evaluation during Covid-19 using CSE-UCLA Evaluation Model at English Education Department Universitas Kristen Indonesia.” Budapest International Research and Critics Institute (BIRCI-Journal): Humanities and Social Sciences 4, no. 2, (May 2021): 1987–1997.doi:10.33258/birci.v4i2.1887.

Sudirtha, I Gede, Ketut Widiartini, and Made Suriani. “Program Evaluation: Implementation of Tourism Village Development.” International Journal of Social Sciences and Humanities 3, no. 3, (December 2019): 99–108. doi:10.29332/ijssh.v3n3.356.

King, Jean A., and Marvin C. Alkin. “The Centrality of Use: Theories of Evaluation Use and Influence and Thoughts on the First 50 Years of Use Research.” American Journal of Evaluation 40, no. 3, (December 12, 2018): 431–458. doi:10.1177/1098214018796328.

Aminudin, Nur, Eni Sundari, Shankar K, P Deepalakshmi, Fauzi, Rita Irviani, and Andino Maseleno. “Weighted Product and Its Application to Measure Employee Performance.” International Journal of Engineering & Technology 7, no. 2.26, (March 2018): 102–108. doi:10.14419/ijet.v7i2.26.14362.

Sisodia, Gaurisha, Kapil Sharma, and Shashikant Gupta. “Intuitionistic Fuzzy Weighted Sum and Product Method for Electronic Service Quality Selection Problem.” International Journal of Modern Education and Computer Science (IJMECS) 10, no. 9, (September 2018): 33–43. doi:10.5815/ijmecs.2018.09.05.

Fauzi, Rita Irviani, Muhammad Muslihudin, Fiqih Satria, Miftachul Huda, Natalia V. Kamenez, and Andino Maseleno. “Revolutionizing Education through Artificial Intelligence: Fuzzy Multiple Attribute Decision Making Approach for Determining the Best Vocational High School.” Applied Mechanics and Materials 892, (June 10, 2019): 234–239. doi:10.4028/www.scientific.net/AMM.892.234.

Sembiring, Ajulio Padly, Tulus, Rahmat W Sembiring, Halim Maulana. “Rule Model with Fuzzy Simple Additive Weighting Approach and Weighted Product on Determination of Position in High Education Institution.” International Journal of Latest Trends in Engineering and Technology 10, no. 1, (March 2018): 54–62. doi:10.21172/1.101.10.

Murdani, Fricles Ariwisanto Sianturi, Harvei Desmon Hutahaean, Sony Bahagia Sinaga, and Denni M. Rajagukguk. “Implementation of the Weighted Product Method in the Best Student Selection Decision Making System Application.” 1st Unimed International Conference on Economics Education and Social Science (UNICEES), Medan, Indonesia, (October 31, 2018): 99–104. doi:10.5220/0009495900990104.

Ahsan, M., and N Indawati. “Implementation Weighted Product Method to Determine Multiple Intelligence Child.” Journal of Physics: Conference Series 1375, (November 25, 2019): 1–7. doi:10.1088/1742-6596/1375/1/012038.

Alokluk, Jamilah A., and Aisha Al-Amri. “Evaluation of a Digital Library: An Experimental Study.” Journal of Service Science and Management, 14, No. 1, (February 2021): 96–114. doi:10.4236/jssm.2021.141007.

Rahimi, Alireza, Mohammad R. Soleymani, Alireza Hashemian, Mohammad R. Hashemian, and Azra Daei. “Evaluating Digital Libraries: A Systematised Review.” Health Information and Libraries Journal 35, no. 3, (August 30, 2018): 180–191. doi:10.1111/hir.12231.

Praseptiawan, Mugi, Puji Siswanto and Tjut Afrida. “Digital Library Development and Evaluation to Improve Students’ Digital Literacy.” Journal of Physics: Conference Series 1179, (August 30, 2019): 1–6. doi:10.1088/1742-6596/1179/1/012042.

Okeji, Chukwuma Clement, and Okeoghene Mayowa-Adebara. “An Evaluation of Digital Library Education in Library and Information Science Curriculum in Nigerian Universities.” Digital Library Perspectives 37, no. 2, (May 21, 2021): 102–118. doi:10.1108/DLP-04-2020-0017.


Full Text: PDF

DOI: 10.28991/esj-2021-01308

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Dewa Gede Hendra Divayana, P. Wayan Arta Suyasa, I Putu Wisna Ariawan