• Users Online: 485
  • Print this page
  • Email this page

Table of Contents
Year : 2021  |  Volume : 4  |  Issue : 4  |  Page : 337-342

Pregraduation online curriculum delivery of internal medicine course during the COVID-19 pandemic: Experience of a medical college in Saudi Arabia

1 Department of Medicine, College of Medicine, King Saud University, Riyadh, Saudi Arabia
2 Department of Medical Education, College of Medicine, King Saud University, Riyadh, Saudi Arabia

Date of Submission20-Jan-2021
Date of Acceptance16-Apr-2021
Date of Web Publication06-Oct-2021

Correspondence Address:
Mona Soliman
Department of Medical Education, College of Medicine, King Saud University, Riyadh
Saudi Arabia
Login to access the Email id

Source of Support: None, Conflict of Interest: None

DOI: 10.4103/jnsm.jnsm_11_21

Rights and Permissions

Background: The COVID-19 pandemic has challenged medical education and resulted in a rapid and unexpected global shift toward online education. The study presents the experience of the College of Medicine of King Saud University in delivering a comprehensive internal medicine course for final-year medical students, which includes the implementation of novel methods of assessment. Methods: A 2-week revision of the internal medicine course was conducted for 70 pregraduation medical students. Lectures and focused case-based tutorials were conducted online. Novel assessment methods included brief written essays summarizing the tutorials, open-book short-answer question (SAQ) examination, and a virtual standardized oral examination (vSOE). A questionnaire was sent to the students (n = 70) on the contents of the course, clarity of objectives, duration, and online platform. Results: The response rate was 99.3%. Students scored higher in the SAQs compared with traditional multiple-choice tests (mean score: 92.3% vs. 69.8%). The vSOE was efficient, and grades were comparable to traditional objective structured clinical examination. The majority of students (93%) reported the scientific content as good or excellent, whereas approximately 30% found the course goals lacked a clear description. The majority (76%) found the course length appropriate, and 94% reported the online platform installation and operation easy or very easy. Conclusions: The comprehensive online internal medicine course was successfully delivered to pregraduation students. Innovative online examination methods can be a reasonable alternative in the case of lockdown. This modality of teaching and assessment was considered useful and met the expectations of students.

Keywords: COVID-19, objective structured clinical examination, online education, undergraduate medical education, virtual

How to cite this article:
Aljarallah S, Bedaiwi M, Alrashed R, Omair MA, Soliman M, Alfadda AA. Pregraduation online curriculum delivery of internal medicine course during the COVID-19 pandemic: Experience of a medical college in Saudi Arabia. J Nat Sci Med 2021;4:337-42

How to cite this URL:
Aljarallah S, Bedaiwi M, Alrashed R, Omair MA, Soliman M, Alfadda AA. Pregraduation online curriculum delivery of internal medicine course during the COVID-19 pandemic: Experience of a medical college in Saudi Arabia. J Nat Sci Med [serial online] 2021 [cited 2022 May 21];4:337-42. Available from: https://www.jnsmonline.org/text.asp?2021/4/4/337/327592

  Introduction Top

The COVID-19 pandemic and its associated confinement measures, such as social distancing, isolation, and quarantine, have impacted all aspects of life. To limit the spread of the infection, governments have implemented strict lockdown measures and curfews, thus limiting the movement of people, including students and teachers.[1],[2],[3] Medical education has been challenged, in particular as the majority of learning objectives and competencies require workplace- and campus-based education. In essence, the COVID-19 pandemic has forced leaders in medical education to rapidly shift to online education. Educators worldwide have been required to invent quick solutions and adopt teaching strategies that ensure obtaining learning outcomes and graduating competent physicians without jeopardizing patient, faculty, or patient safety. Online education using Internet-based platforms has become the major method of conducting teaching courses for medical students. Although this approach could be a reasonable substitution for traditional theoretical lectures, identifying alternative models of teaching and learning, which require patient contact or bedside skills, has been challenging, especially with the abrupt, unplanned shift.[4] In the early stages of the pandemic, uncertainty about its potential course and fate rendered long-term planning a difficult task.[5]

The assessment of medical students during the COVID-19 pandemic has been challenging. Although several traditional assessment methods can be used during the pandemic, the change in teaching methods has mandated the adoption of new assessment methods to test the achieved clinical competencies and ensure the safety of the students and faculty.

Early in March 2020, the Saudi government mandated that education should be delivered entirely online. Hospitals implemented stringent policies, which limited the presence of health-care workers to only very essential workers to deliver healthcare. However, final-year medical students were expected to graduate, thus, delays interfered with their career planning.

Educators were presented with the challenge to conduct course activities online and in a very short time. The modified course should aim to review clinical approaches to common and urgent medical problems, polish clinical skills, and optimize student engagement. Developing fair and reliable evaluation methods and providing meaningful feedback to students were also important aspects.

In this regard, the study presents the experience of the College of Medicine at King Saud University (KSU) in delivering an undergraduate course of internal medicine to final-year medical students during the peak of a strict hospital and nationwide lockdown. In addition, a new assessment plan is adopted for the internal medicine course during the COVID-19 pandemic. The study refers to the adopted course as a modified course (MC). The methodology, results in comparison with the prepandemic course, and student perception are reported.

  Methods Top

Population (students)

The population consisted of 70 final (5th)-year medical students. The course is the last step before graduation and initiation to internship (clerkship). In the same year and before the pandemic, they completed rotations in pediatrics, surgery, and emergency medicine. In addition, as part of the curriculum of the KSU medical college, the students completed an introductory course in internal medicine in 3rd year where the technical aspects of clinical examination were learned and mastered. In addition, the medical college curriculum provided early clinical exposure during the 1st year, as students are introduced to the basics of history taking and clinical examination in a skills and simulation center every week in a system-oriented fashion. The study was approved by the Institutional Review Board Committee in King Saud University College of Medicine Board Research on research project on 18/08/2021, with Ref. No. 21/0680/IRB.

Traditional course

The curriculum of the College of Medicine of KSU is a 5-year system-oriented, problem-based, spiral, and hybrid curriculum. The internal medicine discipline is taught in a spiral approach during the 3rd and 5th years. Before the pandemic, the course entitled practice of internal medicine consisted of a series of traditional didactic lectures, bedside teaching (BST) sessions, and daily clinical activities where students join medical teams in wards, clinics, or emergency rooms. The lectures consisted of 21 lectures with a focus on critical and common problems in medicine delivered in a large group session. BST sessions are conducted weekly where a smaller group of students take history and examine a patient in the presence of a tutor. These activities typically occur over a period of 10–12 weeks. Students are evaluated by undergoing a multiple-choice question (MCQ) test, an objective structured clinical examination (OSCE), and a mini-clinical evaluation exercise (mini-CEX).

Modified course

Course content

To accommodate the changing environment, didactic lectures were delivered virtually through a popular online video conferencing platform. As an alternative to BST, small student groups underwent a series of six 2-h tutorials that focused on major systems in medicine delivered virtually. A specialist on a topic of interest prepared the tutorial content, which was reviewed by a committee composed of members of different faculties. For example, a pulmonary tutorial focused on approaching a patient with dyspnea, chest X-ray interpretation, management of pulmonary embolism and pneumonia, and understanding the respiratory compensation of acidosis. These tutorials were delivered in a case-based fashion where the students were strongly encouraged to participate and lead the discussion in front of their video cameras. Following the tutorial, the students submitted a brief written essay summarizing what they learned, which increased the degree of engagement and participation in such a virtual platform.

The students have prior exposure to hands-on examination. They were also provided with access to a library of online videos on history taking and examination skills. An independent committee composed of internists and medical educators reviewed and preapproved the videos.

Assessment and evaluation

Multiple methods were adopted for assessment [Table 1]. First, the above-mentioned essays were considered and graded based on correctness and completeness in addition to the degree of interaction during the tutorials.
Table 1: Summary of activities of traditional and modified courses

Click here to view

An open-book short-answer question (SAQ) examination was introduced as an alternative to the MCQ examination to assess theoretical knowledge. The examination was conducted through an online learning management system (LMS) (Blackboard®) where all students should access the examination at the same time using personal computers. As this was their first time to use the LMS for examination, two mock trials were conducted to familiarize the students with the process. The examination consisted of multiple open-ended questions on multiple-case scenarios, which mainly focused on managing the disease, listing investigations, or noting differential diagnoses. The students have direct access to immediate support via phone or text messaging for any unexpected events throughout the examination. An examination committee provided corrections and remarks to the responses of the students.

As an alternative to the standard OSCE, which requires physical presence, a virtual standardized oral examination (vSOE) was conducted via the online platform. Each student underwent four examination stations for 10 min each. A web link is provided for each station. However, instead of providing each student with individual links, which can be confusing especially during the examination, a simple online portal was created [Figure 1]. The order of the stations was given in advance. Two additional emergency stations were added in the case of connectivity issues or delays from the student's side to avoid disrupting the schedule. Stations were designed to evaluate the student's approach to clinical scenarios and interpretation of data. Multiple dry runs were conducted to troubleshoot potential problems. The students were instructed to turn on their cameras and maintain eye contact throughout the examination, even while waiting between stations.
Figure 1: Screenshot of the online portal to access standardized oral examination stations

Click here to view

Student perception

The study was approved by the College of Medicine Institutional Review Board. After the course, an online questionnaire was sent to the students (n = 70). Online informed consent was obtained before the study. The questionnaire consisted of ten questions (six closed ended and four open ended). Course organizers prepared the questionnaire and evaluated the contents, clarity, duration, teaching strategy, platform used, and clarity of voice and image. The open-ended questions addressed the negative and positive points encountered in the course, compared between online and face-to-face teaching of internal medicine, and collected suggestions for further improvement.

Statistical analysis

Responses to the first six questions were reported as percentages and represented by bars or pie charts. Microsoft® Excel® 365 was used for the statistical analysis.

  Results Top

Course contents

Scheduled lectures were conducted on time without significant difficulties. The attendance rate reached 99.3%. Tutorials occurred on time, except for two. The first was delayed by 1 day due to the tutor's commitments and the second was delayed by 20 min due to technical difficulties from the tutors' side. Students completed the tutorial essays successfully. A limitation of the grading system was interrater variability between examiners.

Short-answer question examination

Apart from one student who experienced a transit power outage during the examination, no technical difficulties were experienced during the SAQ examination. The present scores were compared to those prepandemic. Students scored higher in the SAQ compared to the traditional MCQ (mean score: 92.3% vs. 69.8%, respectively) [Figure 2].
Figure 2: Students' scores in the short-answer question and virtual standardized oral examination compared to traditional multiple-choice question and objective structured clinical examination (mean score)

Click here to view

Virtual standardized oral examination

The vSOE also went smoothly without major problems. One student reported an unexpected difficulty in accessing the platform, which was rapidly examined via a backup phone-based video call. The presence of the examiners within the college during the examination enabled the early identification of technical problems and rapid intervention. In terms of scores, the overall grades were slightly lower in the vSOE (mean: 77.2%; SE: 1.5%) but very close to the traditional OSCE (mean: 83.9%: SE: 0.7%) [Figure 2].

Student perception

All students responded to the questionnaire. When asked about scientific content, 92.8% reported good or excellent content, although five students indicated dissatisfaction [Figure 3]. Approximately 21 students (30%) perceived that the goals lacked description. On a scale of 1 = poor to 5 = excellent, 76% of the students rated the teachers as 4 or 5. Approximately 76% stated that the length of the course is appropriate, whereas 21% felt that it was extremely short. The majority (94%) found that installing and running the online platform is easy or very easy. Meanwhile, the majority of students rated video and audio quality as four or five out of five. In terms of positives, the students favored the focus of the course on high-yield topics, increased cooperation among them, ease of access to lectures from home, and quality of lectures. Among the negatives, students perceived the announcements and details arrived with a short notice, whereas many students did not feel the vibe of being on a college campus. At times, the connection disruption affected the interaction during small group discussions. Notably, none of the students, faculty, or administrative staff contracted COVID-19 during the course.
Figure 3: Students' perception of selected aspects of the course. (a) Students' perception of the contents of the course. (b) Students' perception of the clarity of the objectives of the course. (c) Students' satisfaction with the tutors of the course

Click here to view

  Discussion Top

Students welcomed the interactive small group discussions, and many of them considered such discussions the highlight of the course. The course was conducted relatively early in the pandemic. Thus, many faculty members reported difficulties with the online platform. Thus, training the teachers on using the platform is important, and providing close and immediate technical support is essential.

Medical education has been severely affected during the COVID-19 pandemic due to the disruption of clinical training and complete shift to online education.[6] The challenge is ensuring a balance between graduating competent graduates with essential clinical skills and maintaining effective curriculum delivery.[7] Education leaders are required to make decisions and choices to ensure the achievement of learning outcomes by ensuring student, faculty, and patient safety. To manage curriculum delivery during COVID-19, clinical sessions were shifted online.[6],[8] However, this immature shift to online medical education in teaching clinical skills is novel and may not be the ideal method for learning clinical competencies.[8]

The current study presents a new experience in teaching a comprehensive online revision course and a new modality of assessment of internal medicine for final-year medical students during the pandemic. Students' evaluation of the comprehensive online revision course indicated high levels of appreciation of the clear objectives and high levels of satisfaction with the duration and contents of the online course. The newly introduced online comprehensive course can serve as a replacement of the traditional in-hospital clinical encounter and patient BST given the strict rules of social distancing due to the COVID-19 pandemic.[9] The COVID-19 situation challenged medical education worldwide to create urgent solutions for training and educating pregraduation medical students through online training.[10]

The pandemic led to the urgent need to introduce new modalities of teaching and assessment by utilizing online resources for out-of-hospital clinical training and assessment of pregraduate students. The decision to introduce the new comprehensive course was an urgent decision made at the period of complete lockdown during the COVID-19 pandemic to meet the needs of final-year students and avoid a delay in graduation.

Evaluating and comparing the performance scores of students before and during COVID-19 are important to produce a reflection on teaching and training quality. Furthermore, leaders in medical education agreed that the students' grades were similar, whereas no statistically significant difference was observed as a result of the impact of the strict social distancing rules during the pandemic.

Assessment of students during the COVID-19 pandemic can be challenging. The strict rules demanded the introduction of new assessment tools. Although traditional assessment methods were used, the course introduced an online SAQ examination utilizing the LMS (Blackboard®). Although the university has adopted the LMS for a relatively long time, this type of SAQ was not used in the medical college. Several successful practices implemented during COVID-19 should be implemented and continued. In the SAQ format, students produced much higher scores than the MCQ format. This finding could be explained by the fact that the SAQ examination was an online, open-book examination on Blackboard®. However, the SAQs were based on clinical scenarios and required critical thinking, deep analysis, and problem-solving skills. A challenge, however, was the large number of students, which renders marking and feedback time-consuming for busy clinicians, especially during the pandemic. Other challenges observed for SAQs are reliability and potential subjectivity in grading.

OSCE is a well-known method for the summative assessment of medical students.[11] Thus, the successful completion of the OSCE is a requirement for passing the internal medicine course in the final year and subsequently, graduating. The vSOE was introduced to ensure the safety of the students and maintain the required social distancing. This method enables direct face-to-face interaction with examinees, discussion of clinical scenarios, interpretation of tests, and presentation of clinical findings via pictures or videos. Virtual OSCE was delivered in other medical schools as an assessment method due to the COVID19 pandemic. Craig et al. reported positive feedback from participants during and post-OSCE.[12] The participants perceived the online virtual alternative as representative of in-person OSCE. The main limitation was the lack of physical examination stations, which was reported in the present study. Comparing the scores between vSOE and traditional OSCE, the study found only a small difference, which indicates that the test is a viable alternative to OSCE in the absence of physical presence [Table 2].
Table 2: Advantages and disadvantages of modified versus traditional methods

Click here to view

The study presented the use of online and virtual assessment tools to adapt rapidly to the current COVID-19 situation with flexibility. Introducing new methods of teaching and assessment that have not been experienced prior to the COVID-19 pandemic has been required.[13]

Furthermore, the study presented the experience of the College of Medicine at KSU, Saudi Arabia, in delivering comprehensive revision online internal medicine course to pregraduation students prior to the final examinations. In addition, a novel online clinical examination method was presented, which was formulated and implemented during the lockdown. Furthermore, this modality of teaching and assessment was considered useful and met the expectations of the students.

The report provides a description of the course content and assessment methods and emphasizes that certain changes in the curriculum are feasible. However, conclusions should be avoided about the effectiveness of the methods as the MC cannot be directly compared to the traditional course given the many variables that have changed.

  Conclusions Top

The comprehensive online internal medicine course was successfully delivered to pre-graduation students. Innovative online examination methods can be a reasonable alternative in the case of lockdown. This modality of teaching and assessment was considered useful and met the expectations of students.


The authors would like to extend their gratitude to the academic staff and secretaries of the department for their valuable work during the pandemic to ensure the successful delivery of curriculum to students. The authors thank the Deanship of Scientific Research and Researchers Support and Services Unit at KSU for their technical support.

Financial support and sponsorship


Conflicts of interest

There are no conflicts of interest.

  References Top

Algaissi AA, Alharbi NK, Hassanain M, Hashem AM. Preparedness and response to COVID-19 in Saudi Arabia: Building on MERS experience. J Infect Public Health 2020;13:834-8.  Back to cited text no. 1
Cleland J, McKimm J, Fuller R, Taylor D, Janczukowicz J, Gibbs T. Adapting to the impact of COVID-19: Sharing stories, sharing practice. Med Teach 2020;42:772-5.  Back to cited text no. 2
Liang ZC, Ooi SB, Wang W. Pandemics and their impact on medical training: Lessons from Singapore. Acad Med 2020;95:1359-61.  Back to cited text no. 3
Frank JR, Snell L, Englander R, Holmboe ES; Icbme Collaborators. Implementing competency-based medical education: Moving forward. Med Teach 2017;39:568-73.  Back to cited text no. 4
Tolsgaard MG, Cleland J, Wilkinson T, Ellaway RH. How we make choices and sacrifices in medical education during the COVID-19 pandemic. Med Teach 2020;42:741-3.  Back to cited text no. 5
Rose S. Medical student education in the time of COVID-19. JAMA 2020;323:2131-2.  Back to cited text no. 6
Hall AK, Nousiainen MT, Campisi P, Dagnone JD, Frank JR, Kroeker KI, et al. Training disrupted: Practical tips for supporting competency-based medical education during the COVID-19 pandemic. Med Teach 2020;42:756-61.  Back to cited text no. 7
Li L, Lin M, Wang X, Bao P, Li Y. Preparing and responding to 2019 novel coronavirus with simulation and technology-enhanced learning for healthcare professionals: Challenges and opportunities in China. BMJ Simul Technol Enhanc Learn 2020;6:196-8.  Back to cited text no. 8
Dedeilia A, Sotiropoulos MG, Hanrahan JG, Janga D, Dedeilias P, Sideris M. Medical and surgical education challenges and innovations in the COVID-19 Era: A systematic review. In vivo 2020;34:1603-11.  Back to cited text no. 9
De Ponti R, Marazzato J, Maresca AM, Rovera F, Carcano G, Ferrario MM. Pre-graduation medical training including virtual reality during COVID-19 pandemic: A report on students' perception. BMC Med Educ 2020;20:332.  Back to cited text no. 10
Khan KZ, Gaunt K, Ramachandran S, Pushkar P. The objective structured clinical examination (OSCE): AMEE guide No. 81. Part II: Organisation & administration. Med Teach 2013;35:e1447-63.  Back to cited text no. 11
Craig C, Kasana N, Modi A. Virtual OSCE delivery: The way of the future? Med Educ 2020;54:1185-6.  Back to cited text no. 12
Chick RC, Clifton GT, Peace KM, Propper BW, Hale DF, Alseidi AA, et al. Using technology to maintain the education of residents during the COVID-19 pandemic. J Surg Educ 2020;77:729-32.  Back to cited text no. 13


  [Figure 1], [Figure 2], [Figure 3]

  [Table 1], [Table 2]

This article has been cited by
1 Challenges and Innovations Brought about by the COVID-19 Pandemic Regarding Medical and Pharmacy Education Especially in Africa and Implications for the Future
Ayukafangha Etando, Adefolarin A. Amu, Mainul Haque, Natalie Schellack, Amanj Kurdi, Alian A. Alrasheedy, Angela Timoney, Julius C. Mwita, Godfrey Mutashambara Rwegerera, Okwen Patrick, Loveline Lum Niba, Baffour Boaten Boahen-Boaten, Felicity Besong Tabi, Olufunke Y. Amu, Joseph Acolatse, Robert Incoom, Israel Abebrese Sefah, Anastasia Nkatha Guantai, Sylvia Opanga, Ibrahim Chikowe, Felix Khuluza, Dan Kibuule, Francis Kalemeera, Ester Hango, Jennie Lates, Joseph Fadare, Olayinka O. Ogunleye, Zikria Saleem, Frasia Oosthuizen, Werner Cordier, Moliehi Matlala, Johanna C. Meyer, Gustav Schellack, Amos Massele, Oliver Ombeva Malande, Aubrey Chichonyi Kalungia, James Sichone, Sekelani S. Banda, Trust Zaranyika, Stephen Campbell, Brian Godman
Healthcare. 2021; 9(12): 1722
[Pubmed] | [DOI]


    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

  In this article
Article Figures
Article Tables

 Article Access Statistics
    PDF Downloaded99    
    Comments [Add]    
    Cited by others 1    

Recommend this journal