ORIGINAL RESEARCH 3705 DOWNLOADS

The quality of the educational environment in a medical college in Saudi Arabia

Abdullah H. Altemani1 and Tarig H. Merghani2

1Family and Community Medicine Department, Faculty of Medicine, University of Tabuk, Saudi Arabia

2Department of Physiology, Faculty of Medicine, University of Tabuk, Saudi Arabia

Submitted: 23/05/2016; Accepted: 19/03/2017; Published: 14/04/2017

Int J Med Educ. 2017; 8:128-132; doi: 10.5116/ijme.58ce.55d2

© 2017 Abdullah H. Altemani & Tarig H. Merghani. This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0

Abstract

Objectives: The study aimed to examine the quality of the educational environment in the Faculty of Medicine, University of Tabuk, Saudi Arabia, and to compare between male and female students using the Dundee Ready Educational Environment Measure (DREEM). 

Methods: We utilized a cross-sectional survey design.  Participants were 221 medical students (96 males and 125 females) from all classes (1st to 6th year). Each participant responded to a translated version of the DREEM questionnaire that measures five domains: students' perception of learning (SPL), students' perception of teachers (SPT), students' academic self-perception (SASP), students' perception of atmosphere (SPA), and students' social self-perception (SSSP). Numerical differences between male and female students were analyzed using the Student's t-test.

Results: The global average score of female students was significantly higher (105.0±22.9, 53% of maximum score) than male students (98.3±24.3, 49% of maximum score; t(219)= -2.119, p= 0.035). The major gender difference was found in the SPT domain, with a higher score in the females (60%) compared to the male (50%) cohort (t (219)= -5.519, p = 0.000). Differences in the other domains were statistically insignificant. Out of the 50 DREEM items, the items that need attention were 32 and 23 on the male and the female sides respectively.

Conclusions: The perception of the educational environment by the female students is significantly better than male students. The study provides valuable information about many educational problems that need attention. DREEM-based surveys are highly recommended for periodic monitoring of the educational environment.

Introduction

The term "educational environment" indicates all factors that affect the process of students' learning, such as the physical location, teachers, colleagues, and culture. It is defined as everything that happens within the classroom, department, faculty or university that is essential in determining the success of undergraduate medical education.1,2 The lecture room where students study, the way they interact with their teachers, the skills of their teachers in facilitating their learning, their attitudes to one another, and the culture in which they learn are all essential in determining success or failure of the learning process. The environment can be considered as a positive learning environment when it increases students' motivation towards learning, promotes their knowledge and skills, and stimulates their sense of social well-being. Evaluation of the educational environment has been regarded as a key to the delivery of high-quality medical education.3 The evaluation can be considered as a reflection of the quality of a curriculum and can be used to identify weak areas that require appropriate measures for improvement.4 The recent innovations in medical curricula and the increasing diversity of undergraduate students and medical courses have led to an increasing need to evaluate the educational environment of medical schools.5

The Dundee Ready Education Environment Measure (DREEM) is a validated tool that is commonly used for assessment of the educational environment created in the medical schools.6-8 Since its introduction in 1997,6 it has been used in many institutions all over the world to investigate an institutional status of the learning environment, to make comparisons between different groups within the same institution, and to find relations between students’ academic achievement and educational environment.9  Its translation from English into different languages and its use in many countries around the world indicates the international acceptance of this tool. The psychometric appraisal of the questionnaire has showed high levels of internal consistency and stability across different settings.10,11 Questions about basic psychometric properties and construct validity have nevertheless been raised.12,13 It has been suggested that removal of certain repeated items might improve the goodness of fit of the five-factor structure of the questionnaire.11-13

The DREEM may be useful for educators to make national and international comparisons between medical schools, with the purpose of identifying areas of concern that can be improved in the future.8,13 Previous studies in the Middle East were conducted to evaluate students’ perceptions within and between institutions; to explore gender discrepancies; and to compare medical schools adopting contrasting educational strategies.14-17 The reported scores agree with the general conclusion that DREEM scores in traditional schools are generally less than 120.9 Similar results in Europe showed the existence of several educational problems associated with the traditional curricula and the teaching methodologies.4 In a recent systematic review, it has been concluded that the DREEM inventory is the most suitable tool for measuring the educational environment for undergraduate medical students.18 It is also useful in guiding remedial measures.19 Repeated reassessments would reflect the pattern of change overtime and show the effectiveness of the corrective actions.20

The Faculty of Medicine, University of Tabuk, is a newly established medical college with a history of about nine years. It follows a hybrid modular curriculum that adopts both traditional and problem-based learning (PBL) for teaching undergraduate students. The Faculty includes two separate sections, one for the male students and another for the females, both of which are related to the University. Although they share the same contents of the curriculum, the teachers of each section and the lecture rooms are different. It is unknown whether perceptions of the students towards their educational environments in the two sections are the same. Therefore, the aim of this study was to examine qualities of the educational environments in the male and the female sections of the Faculty by exploring areas of strength and weakness, as perceived by the medical students using the DREEM tool.

Methods

Study design

Undergraduate students of the Faculty of Medicine, University of Tabuk, Saudi Arabia, were all invited to participate in this cross-sectional study.

Participants

The study was carried out with 221 medical students from all classes (1st to 6th year). Approval and ethical clearance were obtained from the Research Committee of the Faculty of Medicine, University of Tabuk. The completion of the anonymous DREEM questionnaire was undertaken on a voluntary basis. All data was handled in accordance with the ethical principles of medical research developed by the World Medical Association of Helsinki.21

Table 1. A comparative analysis in the subscale DREEM scores between males and females (n= 221)

Instrument

The Arabic translation of the 50-item DREEM questionnaire was used to measure students’ perceptions of the educational environment in this study.14-17  It is a 50-statement, closed-ended questionnaire that requests information about five domains: students’ perception of learning (SPL, 12 statements), students’ perception of teachers (SPT, 11 statements), students’ academic self-perception (SASP, 8 statements), students’ perception of atmosphere (SPA, 12 statements), and students’ social self-perception (SSSP, 7 statements). Each statement response scored 0-4 on a 5-point Likert-type scale (strongly disagree, disagree, uncertain, agree, and strongly agree). The negative statements (questions number 4, 8, 9, 17, 25, 35, 39, 48, and 50) were scored in reverse. A very high score indicates excellent performance.  The mean total score for each subscale can be calculated. The mean maximum score that can be achieved by an ideal educational environment is 200. The data can be expressed as percentages of maximum scores in the respective subscale or of the global scale. The individual items of the DREEM were analyzed according to the score of each item.7 A mean score of 3 or more indicates a strong item (positive), a mean score of 2 or less indicates that the item needs attention (negative), and a mean score between 2 and 3 indicates that the item needs improvement.

Sample size and data collection

All students were approached. A total of 221 students (96 males and 125 females) participated in the study with a total response rate of 69%. The study was explained to the participants before distribution of the questionnaires. The participants received clear information about the voluntary participation and the anonymity of the process. All the participants completed the questionnaires within the same day of distribution. Non-teaching collaborators facilitated the process and collected the completed questionnaires.

Table 2. Students’ Perception of Learning (n= 221)

Data analysis

The collected data was manually entered into a Microsoft Excel data sheet (version 2010) and then into the Statistical Package for the Social Sciences (SPSS Inc., Chicago, IL. Version 20) for data analysis. The variables were described using means and standard deviations (SD) and percentages of maximum scores. The numerical differences between the males and the females were analyzed with the independent student's t-test. P values < 0.05 were considered statistically significant.

Table 3. Students’ Perception of Teachers (n= 221)

Results

Table 1 shows that the overall mean DREEM score of the female students was found to be significantly higher (105.0±22.9, 53% of maximum score) than that of male students (98.3±24.3, 49% of maximum score; t(219)=-2.119, p=0.035). The major difference was found in the SPT domain, with a higher score on the female side (60%) compared to that of the males (50%; t(219)=-5.519, p=0.000).    Table 2 shows the results of SPL. A total of eight out of twelve items need attention (mean score ≤ 2.0) in each of the two sides (male and female). The strongest item (mean score ≥ 3.0) was the item number 47 (Long-term learning is emphasized over short-term) for the females, whereas that item needs improvement for males.  Significant gender differences were found in the item number 44 (The teaching encourages me to be an active learner; t(219)=-2.218, p=0.028), and the item number 48 (The teaching is too teacher-centered; (t(219)=2.158, p=0.032).

Table 3 shows a significant gender discrepancy in the SPT domain. Seven out of eleven items need attention in the male side compared to none in the other side. Significant statistical differences were found in item number 8 (The teachers ridicule the students; t(219)=-3.556, p=0.000), number 9 (The teachers are authoritarian; t(219)=-4.968, p=0.000), number 29 (The teachers are good at providing feedback to students; t(219)=-3.038, p=0.003), number 32 (The teachers provide constructive criticism here; t(219)= -3.748, p=0.000), number 37 (The teachers give clear examples; t(219)=-2.359, p=0.019), number 39 (The teachers get angry in teaching; t(219)=-3.878, p=0.000), and number 40 (The teachers are well-prepared for their teaching sessions; t(219)=-2.857, p=0.005).

Analysis of the SSSP domain showed three items that need attention in each of the two sections (Table 4). Strong items were the item number 15 in the two sections (I have good friends in this course; t(219)=1.888, p=0.060) and number 46 in the female section (My accommodation is pleasant; t(219)=-1.761, p=0.080). The lowest score, mean (SD) = 0.8 (1.1), was observed in the male section for the item number 3 (There is a good support system for students who get stressed; t(219)=-3.199, p=0.002 ).

Table 4. Students’ Social Self-Perception (n= 221)

Discussion

The DREEM inventory is regarded as the most suitable instrument for measuring the educational environment in undergraduate medical institutions.18 In this study, we used the DREEM for evaluating the educational environment in the Faculty of Medicine, University of Tabuk. Our results showed that many educational issues need attention and re-evaluation. Our scores agree with the results of several studies conducted in other Saudi universities. Examples include King Abdul Aziz University (102.0),14 King Khalid University (112.95),15 and Qassim University (112.0).16 It is worth noting that the score of Taibah University was 109/200 in the year 2007/2008, and then after implementation of remedial measures, it reached 120.7/200 in the year 2010/2011.20 Many of the issues raised by the students in these universities were similar to ours, and therefore our future management plans have to be organized in the light of the reforms taken by these institutions. Our scores, being less than 120, indicate the dominance of the traditional methods of teaching in our college.9 Reassessment using DREEM could be of benefit in measuring the change following implementation of corrective measures.20

One important application of the DREEM inventory is the analysis of the individual items. This directly shows the strengths and the weaknesses of different aspects of the educational environment. Our results showed many weak issues raised by the students that should receive adequate attention. The majority of the items in the domain of learning scored 2.0 or less indicating problems. The total average for this domain was 49% for the males and 51% for females. The item with the lowest score was number 48 (The teaching is too teacher-centered). In the teacher-centered education, the teacher directs the lecture-room activities and ensures that the students will not miss an important topic; however, it does not allow them to communicate, express themselves, and direct their learning. Negative perceptions of the learning subscale were also reported in Spain, and it was attributed to the use of traditional methods of teaching.4 Greater efforts are needed to introduce learning activities that allow the students to interact with each other and to work in groups to develop their communication skills and collaborative behavior. The teachers should be encouraged to enhance their capabilities and to introduce innovative strategies to combat the negative perceptions of their students. On the other hand, item number 47 (Long-term learning is emphasized over short-term) is perceived positively, especially by the females. It is worth noting that the durable knowledge is one of the primary goals of medical education.

The total DREEM score was higher for females compared to males. Similar findings were reported in many other Saudi and non-Saudi universities.20,22 A significant gender discrepancy exists in the students’ perceptions of teachers (SPT) domain. Female students scored a significantly higher value than their male counterparts. The most important items that need attention were number 9 (The teachers are authoritarian) and 32 (The teachers provide constructive criticism here) indicating a need for evaluation of teachers' attitude and behavior. Informing the teachers about these results could be of benefit.

The domain of students' social self-perception (SSSP) showed more positive than negative scores in both the male (55%) and the female (54%) sections. Items asking about friends (number 15) and accommodation (number 46) got the highest scores. Similar results were reported in both national and foreign universities.4,16 The presence of friendly relationships between the students reflects a healthy environment. The nature of the PBL sessions that encourage interaction between the students was mentioned as an explanation in a previous study.16 Item number 3 that asks about “presence of a good support system for stressed students” got the lowest score among all the 50 items. This indicates a grave lack of supportive strategies for stressed students. Unfortunately, this is prevailing in many other Saudi Universities.16,17 A recent study reported that the top stressors for undergraduate students are fear of failing a course, examination results, and concerns regarding completion of clinical work.23 Stress may affect students’ well-being and impacts their academic performance. It is recommended that the college, during academic advising sessions, should offer consultation and teach the students how to manage and cope with the various stressful situations, whether academic, social or financial.

Limitations

The study has many limitations that need to be considered for interpretation. First, the sampling method depended on the voluntary participation of participants and therefore sampling bias are expected since the distribution across the year levels were not equal. Second, the nature of self-reporting questionnaires is likely to be associated with response bias.

Conclusions

In conclusion, our results showed many problems in the educational environment, with a higher DREEM score in the female section compared to that of males. Greater efforts are needed to manage the negative items that include the negative perception of teaching, the stressful environment, and the lack of supportive strategies for the stressed students. The study showed that monitoring of the educational environment could provide valuable information that could be used by the educators to address the issues that need attention and to implement the necessary changes for improvement. Further studies are needed to find the causes of stress among the students and to evaluate the degree of improvement over time.

Conflict of Interest

The authors declare that they have no conflict of interest.

References

  1. Genn JM. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education-a unifying perspective. Med Teach. 2001; 23: 337-344.
    Full Text PubMed
  2. Roff S and McAleer S. What is educational climate? Med Teach. 2001; 23: 333-334.
    Full Text PubMed
  3. Abraham R, Ramnarayan K, Vinod P and Torke S. Students' perceptions of learning environment in an Indian medical school. BMC Med Educ. 2008; 8: 20.
    Full Text PubMed
  4. Palés J, Gual A, Escanero J, Tomás I, Rodríguez-de Castro F, Elorduy M, Virumbrales M, Rodríguez G and Arce V. Educational climate perception by preclinical and clinical medical students in five Spanish medical schools. Int J Med Educ. 2015; 6: 65-75.
    Full Text PubMed
  5. Miles S, Swift L and Leinster SJ. The Dundee Ready Education Environment Measure (DREEM): a review of its adoption and use. Med Teach. 2012; 34: 620-634.
    Full Text PubMed
  6. Roff S, McAleer S, Harden RM, Al-Qahtani M, Ahmed AU, Deza H, Groenen G and Primparyon P. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Medical Teacher. 2009; 19: 295-299.
    Full Text
  7. Tackett S, Shochet R, Shilkofski NA, Colbert-Getz J, Rampal K, Abu Bakar H and Wright S. Learning environment assessments of a single curriculum being taught at two medical schools 10,000 miles apart. BMC Med Educ. 2015; 15: 105.
    Full Text PubMed
  8. Whittle SR, Whelan B and Murdoch-Eaton DG. DREEM and beyond; studies of the educational environment as a means for its enhancement. Educ Health (Abingdon). 2007; 20: 7.
    PubMed
  9. Roff S. The Dundee Ready Educational Environment Measure (DREEM)--a generic instrument for measuring students' perceptions of undergraduate health professions curricula. Med Teach. 2005; 27: 322-325.
    Full Text PubMed
  10. Riquelme A, Oporto M, Oporto J, Méndez JI, Viviani P, Salech F, et al. Measuring students' perceptions of the educational climate of the new curriculum at the Pontificia Universidad Católica de Chile: performance of the Spanish translation of the Dundee ready education environment measure (DREEM). Educ Health (Abingdon). 2009;22(1):112.
  11. Dimoliatis ID, Vasilaki E, Anastassopoulos P, Ioannidis JP and Roff S. Validation of the Greek translation of the Dundee Ready Education Environment Measure (DREEM). Educ Health (Abingdon). 2010; 23: 348.
    PubMed
  12. Wang J, Zang S and Shan T. Dundee Ready Education Environment Measure: psychometric testing with Chinese nursing students. J Adv Nurs. 2009; 65: 2701-2709.
    Full Text PubMed
  13. Hammond SM, O'Rourke M, Kelly M, Bennett D and O'Flynn S. A psychometric appraisal of the DREEM. BMC Med Educ. 2012; 12: 2.
    Full Text PubMed
  14. Al-Hazimi A, Al-Hyiani A and Roff S. Perceptions of the educational environment of the medical school in King Abdul Aziz University,saudi Arabia. Med Teach. 2004; 26: 570-573.
    Full Text PubMed
  15. Alshehri SA, Alshehri AF and Erwin TD. Measuring the medical school educational environment: validating an approach from Saudi Arabia. Health Education Journal. 2012; 71: 553-564.
    Full Text
  16. Al-Mohaimeed A. Perceptions of the educational environment of a new medical school, Saudi Arabia. Int J Health Sci (Qassim). 2013; 7: 150-159.
    PubMed
  17. Al-Hazimi A, Zaini R, Al-Hyiani A, Hassan N, Gunaid A, Ponnamperuma G, Karunathilake I, Roff S, McAleer S and Davis M. Educational environment in traditional and innovative medical schools: a study in four undergraduate medical schools. Educ Health (Abingdon). 2004; 17: 192-203.
    Full Text PubMed
  18. Soemantri D, Herrera C and Riquelme A. Measuring the educational environment in health professions studies: a systematic review. Med Teach. 2010; 32: 947-952.
    Full Text PubMed
  19. Palmgren PJ, Lindquist I, Sundberg T, Nilsson GH and Laksov KB. Exploring perceptions of the educational environment among undergraduate physiotherapy students. Int J Med Educ. 2014; 5: 135-146.
    Full Text PubMed
  20. Mojaddidi MA, Khoshhal KI, Habib F, Shalaby S, El-Bab ME and Al-Zalabani AH. Reassessment of the undergraduate educational environment in College of Medicine, Taibah University, Almadinah Almunawwarah, Saudi Arabia. Med Teach. 2013; 35: 39-46.
    Full Text PubMed
  21. World Medical Association Medical Ethics Committee. Updating the WMA Declaration of Helsinki. World Medical Journal. 1999;45:11-13.
  22. Brown T, Williams B and Lynch M. The Australian DREEM: evaluating student perceptions of academic learning environments within eight health science courses. Int J Med Educ. 2011; 2: 94-101.
    Full Text
  23. Babar MG, Hasan SS, Ooi YJ, Ahmed SI, Wong PS, Ahmad SF, Mnm-Rosdy NM and Malik NA. Perceived sources of stress among Malaysian dental students. Int J Med Educ. 2015; 6: 56-61.
    Full Text PubMed