Blended-Learning Training and Evaluation: A Qualitative Study

Bansu Irianto Ansari; Junaidi Junaidi; Suci Maulina; Herman Herman; Ilham Kamaruddin; Abdul Rahman; Nanda Saputra

doi:10.36923/jicc.v23i4.201

Open Access Article Special Collections The Role of Artificial Intelligence...

Bansu Irianto Ansari ⁽¹⁾ , Junaidi Junaidi ⁽²⁾ , Suci Maulina ⁽³⁾ , Herman Herman ⁽⁴⁾ , Ilham Kamaruddin ⁽⁵⁾ , Abdul Rahman ⁽⁶⁾ , Nanda Saputra ⁽⁷⁾

1. Department of Mathematics Education, Jabal Ghafur University,

2. Department of Mathematics Education, Jabal Ghafur University,

3. Department of Mathematics Education, Jabal Ghafur University,

4. Department of English Education, Universitas HKBP Nommensen Pematangsiantar

5. Faculty of Sport Science, Universitas Negeri Makassar

6. Department of Doctoral Education Science, Universitas Sebelas Maret

7. Madrasah Ibtidaiyah Teacher Education, Sekolah Tinggi Ilmu Tarbiyah Al-Hilal Sigli

https://doi.org/10.36923/jicc.v23i4.201

Issue
Vol. 23 No. 4 (2023)

Submitted
2023 March 9

Accepted
2023 May 23

Published
2023 December 10

Keywords:

Blended learning, lecturers’ competence, learning outcome, learning and skills, Qualitative Study

Ask AI (Dimensions)

Download PDF

Abstract

This study aims to investigate lecturers' understanding of blended learning and skills in using several platforms for blended learning-based lectures, the effectiveness of the training on blended learning to improve lecturers’ competence, and the impact of the blended-learning lectures on their students’ learning outcomes. A quantitative approach was implemented in this research. The participants involved 30 lecturers and 67 students of Jabal Ghafur University, selected by purposive sampling. Data were collected through tests and questionnaires and analysed descriptively. The results showed an increase in lecturers’ knowledge and skills in applying blended learning-based lectures. The lecturers’ and students’ responses to blended learning are also positive. This research concluded that the blended learning training in improving lecturer competence was considered effective and impacted their students’ learning outcomes. This research is hoped to be a reference and a model for teaching and learning to be adapted by universities for the blended learning model as a current learning method to support the current curriculum.

Full text article

Generated from XML file

References

Anderson, L. W., Krathwohl, D.R., & Bloom, B.S. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Longman. Google Scholar | WorldCat

Ansari, B. I., Saminan, & Sulastri, R. (2018). Improving mathematical representation ability in solving word problems through the use of cognitive strategies: Orientation, organization, and elaboration. Journal of Physics: Conference Series, 1028(1), 012144. https://doi.org/10.1088/1742-6596/1028/1/012144 Google Scholar | Crossref | WorldCat

Anthony, B., Kamaludin, A., Romli, A., Raffei, A. F. M., Phon, D. N. A. L. E., Abdullah, A., & Ming, G. L. (2022). Blended learning adoption and implementation in higher education: A theoretical and systematic review. Technology, Knowledge and Learning, 27, 531-578. https://doi.org/10.1007/s10758-020-09477-z Google Scholar | Crossref | WorldCat

Arianto, F., Sulistiowati, M., Kristanto, A., & Mariono, A. (2021). The effect of training with blended project-based learning on the lecturer's competence in developing teaching materials. International Journal of Social Science And Human Research, 4(12), 3606-3609. https://doi.org/10.47191/ijsshr/v4-i12-20 Google Scholar | Crossref | WorldCat

Beard, C. M., & Wilson, J. P. (2006). Experiential learning: A best practice handbook for educators and trainers. Kogan Page. Google Scholar | WorldCat

Bwalya, D. (2019). Influence of GeoGebra on students’ achievement in geometric transformations and attitude towards learning mathematics with technology. Journal of Education and Practice, 10(13), 25-36. https://doi.org/10.7176/JEP Google Scholar | Crossref | WorldCat

Chaeruman, U. A., Wibawa, B., & Syahrial, Z. (2020). Development of an Instructional System Design Model as a Guideline for Lecturers in Creating a Course Using Blended Learning Approach. International Journal of Interactive Mobile Technologies (iJIM), 14(14), pp. 164–181. https://doi.org/10.3991/ijim.v14i14.14411 Google Scholar | Crossref | WorldCat

Chaiyama, N. (2019). The development of blended learning model by using active learning activity to develop learning skills in the 21st century. International Journal of Information and Education Technology, 9(12), 880–886. https://doi.org/10.18178/ijiet.2019.9.12.1321 Google Scholar | Crossref | WorldCat

Chen, W. S., & Yao, A. Y. T. (2016). An empirical evaluation of critical factors influencing learner satisfaction in blended learning: A pilot study. Universal Journal of Educational Research, 4(7), 1667–1671. https://doi.org/10.13189/ujer.2016.040719 Google Scholar | Crossref | WorldCat

Chiu, T. K. F., & Churchill, D. (2016). Design of learning objects for concept learning: effects of multimedia learning principles and an instructional approach. Interactive Learning Environments, 24(6), 1355–1370. https://doi.org/10.1080/10494820.2015.1006237 Google Scholar | Crossref | WorldCat

Farahani, P., Bahamiriyan, M., & M Sadeghi. (2015). Information and communication technology in the education of Iran. International Journal of Economy, Management and Social Sciences, 4(1), 100–104. 842b2617f6fb37cd95142e0cdeb136dafe2dacab Google Scholar | WorldCat

Fitriasari, P., Tanzimah, & Sari, N. (2018). Students’ learning independence through blended learning in numerical methods courses. Jurnal Elemen, 4(1), 1-8. https://doi.org/10.29408/jel.v4i1.49 Google Scholar | Crossref | WorldCat

Gunes, S. (2019). What are the perceptions of the students about asynchronous distance learning and blended learning? World Journal on Educational Technology: Current Issues, 11(4), 230–237. https://doi.org/10.18844/wjet.v11i4.4274 Google Scholar | Crossref | WorldCat

Gultom, S. T., Siahaan, P., & Suhandi, A. (2021). The effect of PBL hybrid learning on the higher order thinking skills of seventh grade students in global warming and their environmental care attitudes. Jurnal Penelitian Pendidikan IPA, 7(Special Issue), 272–280. https://doi.org/10.29303/jppipa.v7iSpecialIssue.1012 Google Scholar | Crossref | WorldCat

Harding, A., Kaczynski, D., & Wood, L. (2012). Evaluation of blended learning: Analysis of qualitative data. In Proceedings of The Australian Conference on Science and Mathematics Education, Proceedings of the Blended Learning in Science Teaching and Learning Symposium, 56-62. Google Scholar | WorldCat

Herman, H., Shara, A. M., Silalahi, T. F., Sherly, S., and Julyanthry, J. (2022). Teachers’ Attitude towards Minimum Competency Assessment at Sultan Agung Senior High School in Pematangsiantar, Indonesia. Journal of Curriculum and Teaching, 11(2), 01-14. https://doi.org/10.5430/jct.v11n2p1 Google Scholar | Crossref | WorldCat

Herman, Anantadjaya, S. P., Nawangwulan, I. M., Mapilindo, Cakranegara, P. A., Sinlae, A. A. J., & Arifin, A. (2023). Development Application of National Curriculum-Based Learning Outcome Assessment. Journal of Higher Education Theory and Practice, 23(2). https://doi.org/10.33423/jhetp.v23i2.5809 Google Scholar | Crossref | WorldCat

Larson, L. C. & Miller, T. N. (2011). 21st century skills: Prepare students for the future. Kappa Delta Pi Record, 47(3), 121-123. https://doi.org/10.1080/00228958.2011.10516575 Google Scholar | Crossref | WorldCat

Le, T. N., Allen, B., & Johnson, N. F. (2022). Blended learning: Barriers and drawbacks for English language lecturers at Vietnamese universities. E-Learning and Digital Media, 19(2), 225-239. https://doi.org/10.1177/20427530211048235 Google Scholar | Crossref | WorldCat

Martin, F., Polly, D., Coles, S., & Wang, C. (2020). Examining higher education faculty use of current digital technologies: Importance, competence, and motivation. International Journal of Teaching and Learning in Higher Education, 32(1), 73-86. Google Scholar | WorldCat

Mufidah, N. L. & Surjanti, J. (2021). Effectiveness of the blended learning model in increasing student independence and learning outcomes during the Covid 19 pandemic. Ekuitas: Jurnal Pendidikan Ekonomi 9(1) (2021) 187-198. https://doi.org/10.23887/ekuitas.v9i1.34186 Google Scholar | Crossref | WorldCat

Muhayyang, M., Limbong, S., & Ariyani, A. (2021). Students' attitudes on blended learning-based instruction in Indonesian EFL classroom. GNOSI: An Interdisciplinary Journal of Human Theory and Praxis, 4(2), 146-162. Google Scholar | WorldCat

Mulyadi, D., Arifani, Y., Wijayantingsih, T. D., & Budiastuti, R. E. (2020). Blended learning in English for specific purposes (ESP) instruction: Lecturers’ perspectives. Computer-Assisted Language Learning Electronic Journal, 21(2), 204-219. Google Scholar | WorldCat

Munthe, B., Herman., Arifin, A., Nugroho, B. S., and Fitriani, E. (2021). Online Student Attendance System Using Android. Journal of Physics: Conference Series, 1933(1), 012048. https://doi.org/10.1088/1742-6596/1933/1/012048 Google Scholar | Crossref | WorldCat

Musdariah, A., Basri, M., and Rahman, Q. (2020). Lecturers’ attitude on blended learning-based instruction in teaching English for business in Indonesian vocational higher education. The Asian ESP Journal, 16(4), 290-302. Google Scholar | WorldCat

Nalurita I. V., Sutinah & Rahayu, E. B. (2013). Profile of Middle School Students' Ability in Solving HOT Questions on Circle Material Judging from the Students' Mathematical Abilities. MATHEdunesa, 2(3). https://doi.org/10.26740/mathedunesa.v2n3.p%25p Google Scholar | Crossref | WorldCat

National Council of Teachers of Mathematics. (2000). Principles and Standards for School Mathematics. NCTM. Google Scholar | WorldCat

Ngabidin, M. (2021). Mekar Berseri di Masa Pandemi (Kumpulan Best Practices Inovasi Pembelajaran pada Sekolah Model di Masa Pandemic Covid-19) SMP, SMA, SMK. Deepublish. Google Scholar | WorldCat

Özerol, G. (2009). Perceptions of EFL primary school teachers towards CALL. Unpublished MA thesis, Cukurova University, Turkey. Google Scholar | WorldCat

Passey, D. (2011). Learning, media and technology implementing learning platforms into schools: An architecture for wider involvement in learning. Learning, Media and Technology, 36(4), 367–397. https://doi.org/10.1080/17439884.2011.592496 Google Scholar | Crossref | WorldCat

Rachmadtullah, R., Marianus Subandowo, R., Humaira, M. A., Aliyyah, R. R., Samsudin, A., & Nurtanto, M. (2020). Use of blended learning with moodle: Study effectiveness in elementary school teacher education students during the COVID-19 pandemic. International journal of advanced science and technology, 29(7), 3272-3277. Google Scholar | WorldCat

Rianto, A. (2020). Blended learning application in higher education: EFL learners' perceptions, problems, and suggestions. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(1), 55-68. Google Scholar | WorldCat

Rojko, A. (2017). Industry 4.0 concept: Background and overview. International Journal of Interactive Mobile Technologies,11(5), 77-90. https://doi.org/10.3991/ijim.v11i5.7072 Google Scholar | Crossref | WorldCat

Salgues, B. (2018). Society 5.0: Industry of the future, technologies, methods and tools. John Wiley & Sons. Google Scholar | WorldCat

Sara, S., Suhendar, S., & Pauzi, R. Y. (2020). Analysis of higher order thinking skills (HOTS) of class VIII students on the human respiratory system material. Bioedusiana: Jurnal Pendidikan Biologi, 5(1), 52-61. https://doi.org/10.34289/bioed.v5i1.1654 Google Scholar | Crossref | WorldCat

Saritepeci, M., & Çakır, H. (2015). The effect of blended learning environments on student motivation and student engagement: A study on social studies course. Education & Science/Egitim ve Bilim, 40(177). https://doi.org/10.15390/eb.2015.2592 Google Scholar | Crossref | WorldCat

Shamad, A., & Wekke, I. S. (2019). Lecturers' participation in applying blended learning in Islamic higher education in Indonesia. Universal Journal of Educational Research, 7(12), 2604-2608. https://doi.org/10.13189/ujer.2019.071207 Google Scholar | Crossref | WorldCat

Silalahi, D. E., Siallagan, H., Munthe, B., Herman, H. and Sihombing, P. S. R. (2022). Investigating Students’ Motivation toward the Use of Zoom Meeting Application as English Learning Media During Covid-19 Pandemic. Journal of Curriculum and Teaching, 11(5), 41-48, https://doi.org/10.5430/jct.v11n5p41 Google Scholar | Crossref | WorldCat

Suana, W., Maharta, N., Nyeneng, I. D., & Wahyuni, S. (2017). Design and implementation of schoology-based blended learning media for basic physics I course. Jurnal Pendidikan IPA Indonesia, 6(1), 170-178. http://doi.org/https://doi.org/10.15294/jpii.v6i1.7205. Google Scholar | Crossref | WorldCat

Suartama, I. K., Setyosari, P., & Ulfa, S. (2019). Development of an instructional design model for mobile blended learning in higher education. International Journal of Emerging Technologies in Learning, 14(16). https://doi.org/10.3991/ijet.v14i16.10633 Google Scholar | Crossref | WorldCat

Sugiono. (2017). Educational research methods: Quantitative, qualitative, and R&D approaches. Alfabeta. http://ppjp.ulm.ac.id/journal/index.php/bipf. Google Scholar | WorldCat

Tarihoran, N. A. (2020). Using facebook group as a blended learning medium in teaching cross-cultural understanding in islamic higher education. International Journal of Research in STEM Education (IJRSE), 2(1), 13-25. https://doi.org/10.31098/ijrse.v2i1.187 Google Scholar | Crossref | WorldCat

Van Thao, N., Herman, Napitupulu, E. R., Hien, N. T., and Pardede, H. (2021). Code-Switching in Learning via Zoom Application: A Study in an EFL Context. Asian ESP Journal, 17(3), ISSN: 2206-0979, PP. 91-111. Google Scholar | WorldCat

Yesmakhanova, Z., Zhussipova, G., Abjapparovna, K., Sumatokhin, S., Saparova, Z., & Assilbekova, B. (2022). Formation of digital competencies of future teachers of biology in a blended learning environment. World Journal on Educational Technology: Current Issues, 14(5), 1612–1621. https://doi.org/10.18844/wjet.v14i5.8123 Google Scholar | Crossref | WorldCat

Authors

Bansu Irianto Ansari

https://orcid.org/0000-0001-5613-2692

Junaidi Junaidi

https://orcid.org/0000-0002-2278-4630

Suci Maulina

https://orcid.org/0000-0001-9217-0530

Herman Herman

https://orcid.org/0000-0001-6818-5142

herman@uhn.ac.id (Primary Contact)

Ilham Kamaruddin

https://orcid.org/0000-0002-9233-5240

Abdul Rahman

https://orcid.org/0000-0002-1524-1486

Nanda Saputra

https://orcid.org/0000-0003-1181-3931

Author Biographies

Bansu Irianto Ansari

Bansu Irianto Ansari is currently a senior lecturer at the Department of Mathematics Education, Jabal Ghafur University, Sigli, Aceh, Indonesia. He received his Doctorate in Mathematics Education and later achieved the title of Professor in research methodology in Mathematics. His research interests include the development of learning models, blended learning, and Mathematics simulations.

Junaidi Junaidi

Junaidi is currently a senior lecturer at the Department of Mathematics Education, Jabal Ghafur University, Sigli, Aceh, Indonesia. He obtained his master’s degree in applied mathematics. His research interests encompass the application of learning models and mathematics simulations.

Suci Maulina

Suci Maulina is a lecturer at the Mathematics Education Department, Jabal Ghafur University, Sigli, Aceh, Indonesia. She earned her master’s degree in mathematics education from Western Michigan University, Kalamazoo, MI, USA. Her research interests include mathematics teaching and learning, educational technology, and problem-solving.

Herman Herman

Herman is an associate professor and a lecturer at Universitas HKBP Nommensen Pematangsiantar, Pematang Siantar, Indonesia. He completed his doctoral degree at the State University of Medan, Indonesia, in 2020. His interests lie in reading and writing, focusing on discourse analysis, multimodal discourse analysis, and applied linguistics.

Ilham Kamaruddin

Ilham Kamaruddin is currently a senior lecturer at the Physical Education Health and Recreation Department, Makassar State University, Makassar, Indonesia. He obtained his Doctorate in Physical Education and Sport from Jakarta State University, Indonesia. His research interests include Physical Education, sports science, motor ability, and educational technology.

Abdul Rahman

Abdul Rahman, Ph. D graduated from Florida State University in 1996. He is currently a faculty member at the College of Teacher Training and Education, University of Sebelas Maret, Indonesia. His professional and global interests include the Sociology of Education, Population Studies, Educational Philosophy, and Education Quality Improvement. He is also involved with Arizona State University USA as the Country Director for the USAID Higher Education Partnership Initiative (HEPI) project – Indonesia (2022-2027), aiming to strengthen USA-INA university-industry partnerships, apply for international quality accreditation, and promote pathways programs accessible for more students to study in American universities.

Nanda Saputra

Nanda Saputra is a lecturer at the Madrasah Ibtidaiyah Teacher Education Study Program, STIT Al-Hilal Sigli Tarbiyah College in Aceh, Indonesia. He is also pursuing postgraduate studies in Indonesian language education at Universitas Sebelas Maret, Indonesia.

Ansari, B. I., Junaidi, J., Maulina, S., Herman, H., Kamaruddin, I., Rahman, A., & Saputra, N. (2023). Blended-Learning Training and Evaluation: A Qualitative Study. Journal of Intercultural Communication, 23(4), 155-164. https://doi.org/10.36923/jicc.v23i4.201

Download Citation

This work is licensed under a Creative Commons Attribution 4.0 International License.

This journal provides immediate and free open access to all its content and is distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0). This means readers are permitted to read, download, copy, distribute, print, search, or link to the full texts of articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author, as long as proper attribution is given. This policy is consistent with the Budapest Open Access Initiative (BOAI) definition of open access.

How to Cite

Download Citation

Introduction

The current research follows the Research Master Plan of Jabal Ghafur University, Indonesia. To support the strategic research plan, one of the macro policies that should be addressed for institutional development is the e-learning policy. This policy is designed by considering the changing world towards the era of Society 5.0, a concept of a human-centred and technology-based society developed by the Japanese government (Gultom et al., 2021). This concept was born as a development of the Industrial Revolution 4.0, which is considered to have the potential to reduce the role of humans. The Industrial Revolution 4.0 is a strategic initiative introduced by the German government to transform the manufacturing industry through digitisation and exploit the potential of new technologies (Rojko, 2017; Herman et al., 2022). The presence of Society 5.0 will be one of the innovations that help solve the problems we face in the future.

In response to the issues, lecturers need to understand technological developments and changes in learning instructions in line with current technological advances. The change in learning from traditional to digital technology approaches is now an essential aspect of the current Indonesian curriculum, i.e., Merdeka Belajar-Kampus Merdeka (MBKM, hereafter, Merdeka curriculum) in universities. Digital competency is also one of the crucial 21st-century skills that should be incorporated into teacher education programs (Yesmakhanova et al., 2022). Thus, educators should be able to answer this challenge by empowering their students with technology in all aspects of life (Larson & Miller, 2011; Silalahi et al., 2022). Since the issuance of four ministerial decrees in 2020 regarding learning implementation in the 2021 academic year during the COVID-19 pandemic––to wit, the use of online and offline combinations––some lecturers at Jabal Ghafur University were found to conduct lectures through WhatsApp groups. Whereas this application is mainly designated for communication instead of digital-based learning. Many students complained that such learning was less effective. This case indicates that, in practice, not all lecturersunderstand appropriate e-learning lectures. Hence, they prefer teaching offline, albeit prone to the spread of COVID-19.

Moreover, many lecturers have insufficient knowledge and skills in digital-based learning, including planning, implementation, and evaluation (Herman et al., 2023). If this phenomenon is left unattended without any intention from the lecturers to improve the quality of their lectures in the digital-based learning environment, of course, the macro policy of institutional development that has been proclaimed through the e-learning policy will be hampered. Whereas e-learning is effective during the pandemic since distance, place, and time are not obstacles, mobile devices, such as laptops and tablets, can mediate online learning. Although the COVID-19 pandemic has somewhat eased and the restrictions imposed on community activities have been lowered, e-learning and blended learning, which combines face-to-face interaction via the internet and interactive media as a means for transferring knowledge, are still necessary (Chaiyama, 2019). E-learning or information and communication technologies (ICT) have many advantages. Notably, students can learn at their own level and speed as well as manage their learning. ICT promotes active rather than passive learning (Özerol, 2009), enhances students’ physical and mental abilities, and encourages them to develop their thinking processes (Farahani et al., 2015). Chiu and Churchill (2016) state that children have no fear of the digital world and are quick to embrace innovations and technology products. Bwalya (2019) believes integrating technology into education is a positive step, and other researchers have found that technology plays a crucial role in changing the classroom environment.

Blended learning highly supports the digitalisation era of society 5.0 and has the following characteristics: using information and communication technology, adapting to society, community participation, shared values, emergence, inclusiveness, effectiveness, the power of intelligence, and economic development (Salgues, 2018). Those characteristics show that the world of education serves a vital role in improving the quality of human resources in the future. Therefore, students should be prepared for the era of education through blended learning lectures. The mixed learning model is virtual learning accompanied by detailed activities to improve lecturers’ knowledge and skills through Zoom meetings, Google Meet, and Google Classroom that can be applied in the blended learning process (Beard & Wilson, 2006).

Furthermore, hybrid learning is an e-learning development that combines online and synchronous learning. On the other hand, e-learning is only asynchronous, while blended learning constitutes both. Therefore, blended learning is an effective learning model in online learning (Mufidah & Surjanti, 2021). Blended learning has been widely used for learning instruction and has been reported to improve student learning outcomes (Saritepeci & Cakir, 2015). Based on the above explanation, we need a learning model that can directly combine online, offline, and face-to-face learning. Therefore, there is a need for innovative learning and training for lecturers after the pandemic to support Merdeka curriculum policies. Through the training on blended learning, the lecturers are expected to be able to develop their knowledge and skills in operating digital-based learning.

Blended learning is a learning model that combines face-to-face learning with online learning (Fitriasari et al., 2018). This learning model has two learning systems: direct synchronous learning and synchronous virtual learning. Direct synchronous learning is a face-to-face mode at the same time and place. In contrast, synchronous virtual learning is a face-to-face mode, virtually and simultaneously, but in a different place (Ngabidin, 2021). Meanwhile, asynchronous learning activities are carried out indirectly at other places and times. With this learning model, students are expected to meet directly with their classmates and lecturers through an application from electronic media. They can also meet face-to-face in class without electronic media. Thus, one may state that this learning model can directly combine online, offline, and face-to-face modes. A blended learning approach is a learning approach that integrates traditional face-to-face learning and distance learning using online learning resources and a variety of communication options that educators and students can use. This kind of learning allows a combination of online and face-to-face learning (Harding et al., 2012).

Many researchers have studied blended learning worldwide at the higher education level. Anthony et al. (2020) reviewed the body of literature on blended learning in higher education from 2004 to 2020. They found that blended learning has been studied globally in the context of students, lecturers, and administrators. Among them, blended learning studies concerning lecturers (9.10%) still receive a small portion compared to those conducted for students (59.62%). Meanwhile, blended learning studies for students and lecturers simultaneously are also considered limited (10.10%). In Indonesia, in the context of students, blended learning was adopted to investigate students’ perception (Rianto, 2020), attitude (Muhayyang et al., 2021), responses (Tarihoran, 2020), its effectiveness for students (Rachmadtullah et al. 2020), etc. Meanwhile, other studies implemented blended learning to find lecturers’ perspectives (Mulyadi et al., 2020), participation (Shamad & Wekke, 2019), attitude (Musdariah et al., 2020), and so on. Others were concerned with blended learning instructional design, such as Chaeruman et al. (2020), Munthe et al. (2021) and Suartama et al. (2019).

Concerning the issues, it is essential to conduct more blended learning studies in the context of lecturers or lecturers-students concurrently. Lecturers’ competence, including knowledge and skills in using blended learning, is vital to investigate since they contribute to successful and effective blended learning (Le et a., 2022). Relevant to our case, as previously mentioned, insufficient knowledge and skills of the lecturers in using blended learning make the learning less effective or even discourage them from employing it. For that reason, the researchers conducted training on the blended learning model to improve lecturers' competence in using blended learning. We subsequently investigated their competence and satisfaction in using blended learning and its impact on students' abilities after lecturing in the blended learning environment. To be specific, this study aims to investigate: (1) lecturers' understanding of the concept of blended learning and their skills in using several blended learning platforms through the training; and (2) the effectiveness of blended learning model training in improving lecturers’ competence.

Additionally, this study differs from previous studies on lecturers’ competence (Arianto et al., 2021; Martin et al., 2020). Arianto et al. (2021) investigated the effect of blended-learning training on the lecturers’ competence in developing teaching instructions but did not assess the implementation of the teaching instruction on students. Martin et al. (2020) also investigated the faculty’s competence in the use of technology, but they did not organize training. Therefore, this study will contribute to the literature on blended learning in the context of lecturers and students.

Methods and Materials

Research Design and Sampling

This research aims to assess the lecturers’ competence in blended learning before and after training. This study constitutes an experimental study, with the one-group pretest-posttest design, in which the effect of training given to one research group was investigated after the treatment. The competence of lecturers measured includes knowledge and skills regarding blended learning and its use, including planning, implementing, and evaluating digital-based lectures. Meanwhile, the skills refer to designing a lesson plan integrating Google Classroom, Google Forms, and YouTube. The samples in this study involved all lecturers from 20 departments at Jabal Ghafur University, where one lecturer represented each department. Thus, initially, 20 lecturers participated in this study. Subsequently, ten lecturers were added, resulting in 30 lecturers in total selected by purposive sampling. Besides that, 67 mathematics education students taking the analytic geometry course were also involved in this study. They were also chosen by purposive sampling. All participants in this study had given their consent to take part in this study.

Data Collection

The data in this study were collected using tests and a questionnaire. The tests consist of the lecturer competence test and the student competence test. The lecturer competence test aims to assess lecturers’ knowledge of using blended learning before and after training; it includes planning, implementation, and assessment components. This test also assesses lecturers’ skills in designing lesson plans using Google Classroom, Google Forms, and YouTube. On the other hand, the student competence test intends to evaluate students’ understanding, applying, and analyzing abilities after lectures in the blended learning environment. It also aims to measure the effectiveness of blended learning lectures for improving students' mathematics learning outcomes. The test was designed by the researchers and tested for its validity and reliability. The test was administered online to students and took 60 minutes to complete. The test consists of four problems; each problem scores 25 points if correct and zero if incorrect. As such, the maximum score is 100 points. The post-test problems for students are presented below.

A mosque dome has a diameter of 5 m. If the dome's outer surface is painted at the cost of Rp. 27,000.00/m2 and 2 m2 requires 1 kg of paint. How much does it cost, and how many kg of paint will you need to paint the dome?
When the radius of a cone is increased by 26 cm, the increased volume of the cone is equal to its increased volume when the height of the cone is increased by 26 cm. If the initial height is 4 cm, determine the initial radius. How do you predict the answer? Please check.
Given a cube ABCD.EFGH, B1 is the sphere outside the cube, and B2 is the sphere inside the cube. Anne has calculated that the ratio of the B1 and B2 is 2:1. What is your opinion? Is it right? Please check.
Given a right triangle ABC with right-angled at A, BC2 = AB2 + AC2. Is the conclusion of the statement correct? Justify your answer.

In addition, the questionnaire was administered to investigate lecturers’ and students’ satisfaction with the blended learning model. It was adopted from Suana et al. (2017), which had been theoretically validated by three experts. The questionnaire consists of 18 items with five scales, from 1 (strongly disagree) to 5 (strongly agree) (Sugiono, 2017; Van Thao et al., 2021).

Research Procedures

This research was carried out for four weeks, from the middle of September to the middle of October 2022. This study has several activities, including focus group discussion, training, assessment, and implementation. In detail, the research procedures are described as follows.

Focus Group Discussion (FGD) on the Blended Learning Model

This activity was carried out to increase lecturers' knowledge of the blended learning process, including planning, implementing, and assessing blended learning. The FGDs were divided into two sessions, each conducted for a group of 15 lecturers. At the beginning of the meeting, the lecturers were given an initial test on understanding the blended learning model. Then, the lecturers were provided with guidance to prepare lesson plans by formulating learning objectives and developing appropriate materials to carry out the blended learning lectures. Further, the lecturers were given an understanding of the concept of designing, implementing, and assessing the lesson through blended learning models by providing information about platforms that could be used for blended learning. On this occasion, the lecturers were also given an understanding of the implementation of blended learning using Google Meet and Google Classroom. Furthermore, lecturers were provided with knowledge of a blended learning assessment using Google Forms and affective and psychomotor assessments by recording videos entered into YouTube. At the end of the activity, a final test was administered to determine the lecturers' understanding and knowledge of the concept of the blended learning model.

Training on the Application of Blended Learning

This activity aims to improve the lecturers’ skills in planning, implementing, and designing assessments in blended learning. The lecturers were requested to design one of the topics they taught. They were then trained to use Google Classroom, Google Forms, and YouTube for learning assessment. At the end of the activity, the lecturers were assessed to determine the level of their skills in using the platforms.

Assessment of the Lecturer's Comprehension After Training

The lecturers were given a final test and asked to fill out a questionnaire via Google Forms. The success of this activity is indicated by the average result of the final competence tests regarding the concept of blended learning and skills exceeding 80. Data on the test were quantitatively analyzed using descriptive statistics on a scale of 10 to 100. Table 1 presents an example of the three-week training activities on the blended learning model.

Blended Learning Implementation by Lecturers

After training, the lecturers were instructed to apply online-based learning to their respective students. In general, the departments have implemented a blended learning model for students. As such, the data on students’ learning outcomes and satisfaction were collected from 67 students, with satisfactory results. Students’ abilities consist of understanding, applying, and analyzing the lesson that has been taught.

Table 1.Examples of training activities on blended learningNote: * and ** Done at the same time.Source: Training activities on blended learning (2022)
Subtopic	Knowledge and Skills	Mode	Time
Blended learning model activities	FGD on understanding:	Face to face	7 hours*
	Blended learning	Face to face	7 hours*
	Blended learning planning concept	Face to face	7hours*
	Blended learning implementation concept	Face to face	7 hours*
	Blended learning assessment concept	Face to face	7 hours*
	The final test on lecturers’ knowledge	Online (synchronous virtually)	3 days**
	Lesson plan design	Online (synchronous virtually)	3 days**
	Using the Google Classroom and Google Meet applications	Online (synchronous virtually)	3 days**
	The use of Google Forms and YouTube applications	Online (synchronous virtually)	3 days**
	The final test on lecturers’ skills	Online (synchronous virtually)	3 days**
	Applying online-based learning to their respective students	Online (asynchronous)	2 weeks

Data Analysis

As previously mentioned, the instruments of this study comprise lecturer and student competence tests and a questionnaire. The lecturer competence test was analyzed using descriptive statistics on a scale of 10 to 100. The student competence test was analyzed using a scale of 0 to 100. All quantitative data were analyzed using a standard deviation, mean, and percentage. While data on lecturers’ and students’ satisfaction with blended learning was analyzed using three categories: attractiveness, easiness, and benefit, developed by Suana et al. (2017).

Results

In the beginning, the lecturers attended blended learning training for one week. The training aims to assess lecturers' competence before and after training as well as their satisfaction with the blended learning model after treatment. The competence includes understanding the concepts of planning, implementing, and assessing blended learning and skills in a lesson plan design and using Google Classroom, Google Form, and YouTube. After training, the lecturers implemented blended learning in lectures for four meetings (two weeks). It attempts to determine students’ competence, including understanding, applying, and analyzing abilities concerning the lesson taught using a blended learning model. After the initial and final tests were administered to the lecturers, they were requested to complete the questionnaire distributed online via Google Forms. The test results are presented in Table 2 and Table 3.

Table 2.Lecturers’ Competence on Initial tests regarding their knowledge of blended learningSource: Questionnaire distributed online via Google Forms (2022)
N o.	Competence	Mean (N=30)	Complete (%)	Incomplete (%)
1.	Planning blended learning	57.8	53.3	46.7
2.	Implementation of blended learning	48.6	46.6	53.4
3.	Assessment of blended learning	45.7	43.3	56.7
	Average score	50.7	47.7	52.3

Table 3.Lecturers’ competence on the final test regarding their knowledge of blended learningSource: Questionnaire distributed online via Google Forms (2022)
N o.	Competence	Average (N=30)	Complete (%)	Incomplete (%)
1.	Planning of blended learning	87.9	100	0
2.	Implementation of blended learning	85.9	100	0
3.	Assessment ofBlended learning	86.5	100	0
	Average score	86.8	100	0

Table 2 shows that initially, the lecturers did not have sufficient knowledge about the blended learning model. It is evident from the average score of 50.7, meaning that only half of the lecturers understood the concept of the blended learning model. However, Table 3 reveals that after the training, the lecturers’ average final test score exceeds 80.00. One may conclude that the lecturers had good knowledge of blended learning models after treatment. The improvement in the lecturers’ knowledge is illustrated in Figure 1.

Figure 1.The results of the initial test and final test.

Table 4.The Lecturers’ skills in blended learningSource: Results of lecturer’s skill in blended learning (2022)
	Lesson plan design	Google Classroom	Google Forms	YouTube	Overall (N=30)
Pre-test	53.4 (12.6)	52.7 (14.3)	48.7 (14.2)	39.7 (11.2)	48.6 (11.8)
Post-test	80.9 (16.7)	86.3 (15.5)	84.3 (16.8)	82.2 (16.5)	84.02 (15.7)
Information	complete	complete	complete	complete	complete

Table 5.The lecturers' satisfaction scores with the blended learning model.Source: Results of lecturers' satisfaction scores with the blended learning model (2022)
Aspect	Item		Scale (1 to 5)
		Score	Average
Attractiveness	Online discussion is an interesting activity	3.88	3.98
	Practice questions are interesting to do online	4.03
	Teaching materials are interesting to learn online	4.03
	Overall, online classes with google classroom make lectures more attractive	3.81
	Overall, the blended learning model with a pre-online–face-to-face–online learning mode is interesting to follow	4.16
Easiness	Communicating with peers and lecturers in the online class can be done easily	3.83	3.59
	I can easily participate in post-online learning	3.52
	Learning tools in online classes can be found easily	3.85
	Practice questions in the online class can be learned easily	3.56
	I have difficulty with ICT/internet skills to participate in online learning in the blended learning model	3.38
	Overall, ‘pre-online learning – face-to-face – Online learning can be easily followed without any significant obstacles	3.42
Benefit	The blended learning system increased my interest in today's lectures	3.66	3.77
	Online learning activities improve my concept mastery	3.88
	Problem-solving activities improve my concepts mastery	4.02
	I became more motivated to attend lectures using the blended learning model	3.82
	Based on my experience, I want to give lectures with a blended learning approach	3.50
	The blended learning model increases my self-directed	3.90
	Overall, the blended learning approach is more beneficial than face-to-face learning	3.62

Table 4 presents the lecturers’ skills in carrying out the blended learning process by utilizing various platforms yielded a score of 84.02. It signifies that the lecturers can use multiple platforms in the blended learning process. Moreover, Table 5 illustrates that the lecturers' satisfaction with blended learning is positive in all aspects. Out of the three aspects, attractiveness receives the highest score. Furthermore, the results of students’ abilities, including understanding, applying, and analyzing the lesson in the analytic geometry course, and their satisfaction are presented in Table 6.

Table 6.The results of test scores and students’ satisfaction with blended learningSource: Results of test scores and students’ satisfaction with blended learning (202
No	Measured variables (N=67)
	Learning Outcome	Score	Satisfaction	Score
1.	Understanding	68.4 (15.4)	Attractiveness	4.21
2.	Applying	58.7 (16.6)	Easiness	4.03
3.	Analyzing	47.2 (16.2)	Benefit	4.13
	Average	58.1 (16.7)		4.12

Discussion

The Lecturers' Competence in Blended Learning and their Satisfaction

This study has revealed the competence of lecturers at Jabal Ghafur University regarding the blended learning process. Blended learning is a learning process that combines a face-to-face system with an online learning process. Thus, blended learning is considered suitable during a pandemic or post-pandemic period. The results showed that the lecturers' knowledge and skills in blended learning during the post-pandemic COVID-19 had increased. In the FGD, the lecturers also responded positively to the concept of lectures and learning design using various platforms in blended learning. On average, the knowledge score obtained by the lecturers on the initial test is 50.7, and on the final test is 86.8. Meanwhile, regarding the blended learning skills, the lecturers yielded a score of 48.6 on the initial test and 84.02 on the final test. This shows a significant increase in both knowledge and skills of lecturers concerning the blended learning process.

Even though nearly all participants encountered internet connection-related issues, their satisfaction with attractiveness, ease of use, and benefits of the learning design and materials were all considered in the "good" category (3.78). It reveals a correlation between the knowledge and skills of lecturers in the blended learning process and their satisfaction with using blended learning in the learning process. Among the three aspects, the attractiveness aspect scores higher than the other two. The findings also indicate that the lecturers' achievements in training and their satisfaction using a blended learning model platform become high when problems are solved via the internet. This finding is in line with the increase in student’s cognitive abilities, as Chen and Yao (2016) stated that the level of students' perceived satisfaction with blended learning had a vital role in its effectiveness. This finding is similar to the previous research, reporting that blended learning is more effective in improving students’ learning outcomes (Suana et al., 2017). Finally, it is recommended that lecturers solve problems in their fields of study by integrating lecture models, such as problem-based and project-based learning, into a blended learning system.

The Students’ Competence and Satisfaction after using Blended Learning

After training, lecturers were instructed to apply online-based learning to their students. However, the departments have generally implemented the blended learning model for students in lectures. Student achievement and satisfaction data were collected from 67 participants, with satisfactory results. This is because lecturers' use of the internet in the learning process related to their satisfaction of attractiveness, ease of use, and benefits of the learning design and materials were all in a ‘good’ category. It is aligned with Gunes (2019), who revealed that university students favored the blended learning process and gave positive responses. This result also follows the statement of the ICT experts who state that integrating technology in education is a positive step and technology has a key role in changing the classroom environment–and indeed entire schools–since it encourages outcome-oriented learning (Bwalya, 2019). Thus, school administration and national educational policies have set out to integrate ICT into the learning process (Passey, 2011).

We recall that three students' abilities were observed in this study: understanding, applying and analyzing. The 2013 curriculum emphasizes students' ability to be able to solve problems in everyday life. Problem-solving is an aspect of higher-order thinking skills (HOTs). HOTs is a thinking skill that requires the ability to remember and other abilities, such as the ability to understand, apply, analyze, and use that information as a solution in solving problems (Sara et al., 2020). One cognitive aspect that needs to be improved in learning mathematics is the ability to understand. Understanding ability is an initial ability that students should master to achieve other higher cognitive abilities (National Council of Teachers of Mathematics [NCTM], 2000). The importance of this mathematical understanding ability is stated in NCTM (2000). To wit, the vision in school mathematics learning is that students understand what they are learning. Therefore, the requirements for a student can be said to be proficient in mathematics if they master mathematical concepts (NCTM, 2000).

According to Bloom's Taxonomy, the abilities to understand and apply constitute lower-order thinking, but the abilities to analyze, evaluate and create are included in HOTs (Anderson et al., 2001). When students solve a higher-order thinking problem, the students begin to understand the problem and think of a solution, then make connections between various variables in the problem, elaborate a solution strategy, and perform calculations (Ansari & Sulastri, 2018). In this current study, the four problems given to students are considered HOT problems. Regarding students' ability to solve problems, this study reveals that the understanding ability (68.4) is higher than other abilities, applying ability (58.7), and analyzing ability (47.2). This means that students' abilities are only at moderate and low levels (58.1 on average). Nalurita et al. (2013) reported that in learning, students tend to be given problems only at the level of understanding and little application, which may explain why their higher-order thinking skills do not develop. This is not comparable to their satisfaction in applying the blended learning model, which is considered in the good category.

Conclusion

The results showed an increase in the lecturers' knowledge and skills in using the blended learning model. The findings also revealed that the blended learning training in improving lecturer competence was considered effective and impacted their students’ learning outcomes. Furthermore, the lecturers’ and students’ satisfaction with the blended learning model is positive. However, student satisfaction with the blended learning model is not comparable to the scores of understanding, applying, and analyzing abilities they get. This means that their satisfaction is in the good category, but their cognitive abilities are in the medium and low categories. The researchers hope that students from various universities can use the blended learning model as a current learning method to support the current curriculum. This blended learning activity can be continued periodically to attract students’ interest in learning during the post-COVID-19 pandemic.

Acknowledgment Statement: The authors would like to thank the reviewers for providing comments in helping this manuscript to completion.

Conflicts of Interest: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Author contribution statements: Bansu Irianto Ansari, Junaidi Junaidi, and Abdul Rahman contribute to conceiving, designing, conducting the research, analyzing the data, and drafting the initial manuscript. Suci Maulina and Ilham Kamaruddin deal with methodology and data analysis. Nanda Saputra and Bansu Irianto Ansari focus on collecting data, drafting, formatting, and analysing, and Herman Herman is responsible for drafting, reviewers responding, and methodology.

Funding: This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Data Availability Statement:Data is available at request. Please contact the corresponding author for any additional information on data access or usage.

Disclaimer: The views and opinions expressed in this article are those of the author(s) and contributor(s) and do not necessarily reflect JICC's or editors' official policy or position. All liability for harm done to individuals or property as a result of any ideas, methods, instructions, or products mentioned in the content is expressly disclaimed.

Read Counter : 3372 Download : 992

Share Now

Blended-Learning Training and Evaluation: A Qualitative Study

Abstract

Full text article

References