Burnout and its association with extracurricular activities among medical students in Saudi Arabia
Sami A. Almalki1, Abdullah I. Almojali1, Ali S. Alothman1, Emad M. Masuadi2 and Meshal K. Alaqeel3
1College of Medicine, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
2Department of Medical Education, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
3Psychiatry Department, King Abdulaziz Medical City, Riyadh, Saudi Arabia
Submitted: 12/11/2016; Accepted: 04/04/2017; Published: 26/04/2017
Int J Med Educ. 2017; 8:144-150; doi: 10.5116/ijme.58e3.ca8a
© 2017 Sami A. Almalki et al. This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0
Abstract
Objectives: To assess levels of burnout in medical students, and to explore the influence of extracurricular activities on burnout at a medical school in Saudi Arabia.
Methods: This cross-sectional study was conducted with first to fourth year medical students at King Saud bin Abdulaziz University for Health Sciences (KSAU-HS) in Riyadh, Saudi Arabia. Socio-demographic, burnout level (the Maslach Burnout Inventory-Student Survey, MBI-SS) and participation in extracurricular activities data were collected using a self-administered questionnaire. Statistical analyses were performed using the Pearson’s chi-square test and binary logistic regression.
Results: From the 306 medical students approached, 249 (81.4%) completed the questionnaire. The level of high burnout was 67.1% (n=167). The study revealed that the majority (62.3%, n=155) of students had high levels of cynicism, 58.6% (n=146) had high levels of emotional exhaustion, and 60.2% (n=150) had low levels of professional efficacy. Most of the students (73.5%, n=183) participated in extracurricular activities, and 112 (45%) students were organizers of extracurricular activities. No significant association was found between burnout levels and the frequency of involvement in extracurricular activities (χ2=2.2, df=2, p=0.333). However, students who were organizing extracurricular activities were less likely to have low professional efficacy (OR=0.51, 95% CI: 0.27- 0.96).
Conclusions: High levels of burnout were reported at this medical school. Although the burnout level is not significantly associated with the frequency of involvement in extracurricular activities, leading and organizing extracurricular activities might result in lower levels of burnout. Therefore, improving the students’ leadership skills should be considered in curriculum planning, and greater emphasis should be placed on the quality of involvement in extracurricular activities rather than the quantity.
Introduction
Medical schools are devoted to establishing an enabling learning environment to develop highly qualified physicians having the required knowledge, skills and competence. Medical students go through stressful events, and they are engaged in multiple activities. They experience academic, existential and psychological stressors that may cause deteriorating mental health during medical school.1 Studies have shown that health related quality of life is poor among medical students,2 and students in their clinical years experience the most negative impact.3 Muneer and colleagues4 reported high levels of stress among Malaysian dental students, with fear of failure in a course being ranked as the top stressor. Consequently, students who experience a high level of stress with poor coping strategies during medical school are vulnerable to develop burnout.5-7
Burnout is a mental condition defined as a prolonged response to chronic emotional and interpersonal stressors on the job.8 It is characterized by a triad of emotional exhaustion, cynicism and a feeling of personal inefficacy. Studies have shown that the burnout level is high among medical students, ranging from 45% to 50%.1,9-11 In studies done in Lebanon and the United States, burnout was found to be higher among pre-clinical students (71%).12,13 Locally in Saudi Arabia, only one study could be found reporting a very high burnout level (76.8%).14
Burnout is an independent risk factor for students’ suicidal ideation and can lead to dropping out of medical school.9 This is due to students performing many different tasks as well as starting to clinically care for patients with a lack of knowledge and experience, resulting in an increased level of stress. Students’ mental health should receive more attention from medical educators and health care personnel. Hojat and colleagues15 found higher optimism levels to be associated with higher personal accomplishment and lower emotional exhaustion among third-year medical students. Physical activity also has been reported as the best lifestyle factor to reduce burnout, and a program of increased healthy physical activities can lead to an improvement in burnout.16,17 Striking a balance between academic commitments and relaxation may positively influence quality of life and prevent burnout.18,19
Extracurricular activities provide students the opportunity to experience nonacademic activities that could be a powerful strategy for managing stress and bringing their life into balance.12 Motivation to participate in extracurricular activities are divided into two coexisting classes.20 The first is altruistic or values based in nature which includes helping others, religious beliefs and supporting an important value. The second category involves utilitarian motives such as developing a new skill set and enhancing resumes. In a cross-national study aimed to examine motivations to volunteer of more than 9000 college students from diverse disciplines from 12 countries, altruistic and value based motives were the strongest support for volunteering.21 The previous study showed a lower intensity and regularity of volunteering in students who were more strongly motivated by resume building.
Benefits of involvement in extracurricular activities are well documented. For example, leadership ability, critical thinking, social self-confidence and conflict resolution skills were found higher in students who volunteer.22 Undergraduate voluntary participation can positively affect educational outcomes such as the acquisition of higher degrees.23 In fact, it was reported that students who reduce their recreation had, on average, lower examination results.24 Lumley et al. reported a diversity of extracurricular activities among final year medical students.25 They found that students, on average, spent 9.8 hours per week in extracurricular activities. Students who engaged in research and teaching as extracurricular activities achieved higher academic performance. Additionally, high educational aspiration is associated with consistent involvement in extracurricular activities, which may afford opportunities to build interpersonal skills and construct positive plans for the future.23 In a large longitudinal study, the total number of extracurricular activities was positively associated with psychological resilience, school belonging, and academic peers compared to being negatively related to risky peers and psychological distress.26
In view of the literature, it is crucial to have a better understanding of students’ mental health as it has implications for all involved in their welfare and education. Therefore, this study aimed to assess the levels of burnout and to explore the influence of extracurricular activities on burnout in medical students at a medical school in Saudi Arabia.
Methods
Study design and participants
This cross-sectional study was conducted with first to fourth year medical students from King Saud bin Abdulaziz University for Health Sciences (KSAU-HS) in Riyadh, Saudi Arabia. Of 756 medical students, 306 students were invited to participate in the study. The questionnaire was completed by 249 students, resulting in an 81.4% response rate. A third (32.5%, n=81) of the participants were female. Ages ranged between 19-30 years with a mean age of 21.8 (SD=1.4). Participation was entirely voluntary and responses were anonymized. This study was approved by the Institutional Review Board of King Abdullah International Medical Research Center.
Instrument
The questionnaire consisted of three sections. Section I identified socio-demographics and personal characteristics of the participants such as age, gender, academic year, current grade point average (GPA), having a physician among first-degree family members, smoking and marital status. In KSAU-HS, the cumulative grade point average (GPA) is out of five and can be described as a grade (e.g. GPAs 4.50 and above are considered as excellent).
In Section II, the Maslach Burnout Inventory-Student Survey (MBI-SS) – the modified version of Maslach Burnout Inventory-General Survey (MBI-GS) – was used to assess burnout among the participants. It has been validated by Schaufeli demonstrating adequate reliability among Spanish, Portuguese, and Dutch students.27 The MBI-SS has been shown to have adequate reliability and factorial validity among Chinese students.28 It consists of 16 questions focusing on the triad of exhaustion (5 items), cynicism (5 items), and professional efficacy (6 items). Exhaustion refers to severe fatigue and emotional depletion due to academic demands; cynicism refers to the student’s mental distance from lessons; and professional efficacy refers to academic accomplishment. All items were assessed by a seven-point Likert scale ranging from 0 (Never) to 6 (Always). Scores in each of the three components were categorized into high, moderate or low scores. High scores on cynicism, exhaustion, and low scores on professional efficacy (professional efficacy items are reverse scored) indicate high burnout.28 In this study, the Cronbach’s alpha value for the MBI-SS was 0.75 for professional efficacy, 0.85 for exhaustion and 0.76 for cynicism.
In Section III, questions targeted the frequency and the type of involvement in extracurricular activities during the past three months. Extracurricular activities are voluntary activities external to the curriculum. In our university, many of the extra academic activities such as volunteer/community services, research and reading activities, and arts and cultural activities are performed by students through the Students Club.
Procedures
The study was conducted in March and April 2016 using a self-administered questionnaire. The study’s objectives, primary investigator’s contact details and the ethical principles guiding the study were provided and informed written consent was obtained. A week was assigned to collect data from each academic year and data were collected at least two weeks prior to any examination date in order to minimize short-term external stressors that may erroneously affect the burnout level. The students completed the questionnaire during their breaks between classes and returned it in a sealed envelope. All gathered information was kept confidential.
Statistical analysis
Data were entered in Microsoft Excel and analyzed by IBM-SPSS software (version 22.0). Categorical variables were presented by frequencies and percentages. The association of burnout with extracurricular activities and demographics was examined using the Pearson’s chi-square test. Binary logistic regression was done to identify significant determinants of burnout components controlling for potential cofounders. The burnout subscales (professional efficacy, exhaustion and cynicism) were used as dependent variables, while other socio-demographic variables and extracurricular activities were entered as predictor variables. Odds ratios (OR) and 95% confidence intervals (95% CI) were calculated. A test with a p-value <0.05 was considered as statistically significant.
Results
As shown in Table 1, most of the students (73.5%, n=183) were involved in extracurricular activities during the past three months. Volunteer/community services were the most frequently reported extracurricular activity (49.2%, n=122) followed by research and reading activities (44.4%, n=110), and arts and cultural activities (35.5%, n=88). Almost half of the students (45%, n=112) were leading and organizing extracurricular activities in the past three months. Most of the students (96.4%, n=240) were single, 230 (92.4%) lived with their families and 228 (91.9%) were non-smokers. Almost half of the students (46.6%, n=116) had a physician among their family members. There were 160 (64.5%) students who had conducted some research, while only 23 (9.3%) of the participants published their research. Table 2 shows that 62.3% (n=155) of the students had high levels of cynicism, 58.6% (n=146) had high levels of emotional exhaustion, and 60.2% (n=150) had low levels of professional efficacy.
The association between burnout and its components with socio-demographic characteristics and the involvement in extracurricular activities is shown in Table 3. Students who achieve a grade point average (GPA) <4.5 showed significantly low professional efficacy (χ2=7.189, df=1, p=0.007). Female students were found to have significantly low levels of cynicism (χ2=10.113, df=2, p=0.006, n=16) and low burnout (χ2=6.045, df=2, p=0.049, n=16) compared to males. Third year medical students showed lower levels of cynicism compared to the other years (χ2=9.575, df=3, p=0.023). Students who have a physician among family members showed significantly high exhaustion (χ2=5.371, df=1, p=0.002) and high cynicism (χ2=7.998, df=1, p=0.005). Students who did not lead or organize extracurricular activities showed significantly low professional efficacy (χ2=7.427, df=1, p=0.006). There was no significant association between burnout and the frequency of involvement in extracurricular activities (χ2=2.2, df=2, p=0.333). Undergraduates and postgraduates did not show a significant difference in burnout levels (χ2=0.231, df=1, p=0.631).
Students who have a high GPA (≥ 4.5) were more involved in participating (χ2=19.213, df=2, p<0.001) and organizing (χ2=5.259, df=1, p=0.022) extracurricular activities compared to those with a GPA of < 4.5. Volunteering in community services (χ2=9.125, df=1, p=0.003) and participating in arts and cultural activities (χ2=6.864, df=1, p=0.009) were more frequent among females compared to males.
Binary logistic regression was conducted to determine the association between the burnout components as dependent variables and demographics and the extracurricular activities as independent variables. Table 4 shows that having a GPA that is <4.5 was significantly associated with low professional efficacy (OR=1.99, 95% CI: 1.10-3.60). Having a physician among family members was a significant predictor of high emotional exhaustion (OR=1.86, 95% CI: 1.08-3.19) and high cynicism (OR=2.30, 95% CI: 1.31-4.05). Students who were leading and organizing extracurricular activities were less likely to have low professional efficacy (OR=0.51, 95% CI: 0.27-0.96).
Discussion
The current study is one of a few studies that explores the magnitude of burnout among medical students in Saudi Arabia, and it is the first one to investigate the role of extracurricular activities in burnout. The results of this study show alarming findings and reveal a high burnout level (67%) among medical students at a university in Saudi Arabia. Literature reports a wide range of burnout levels among medical students from different countries. Our results are comparable with recent studies related to burnout ranging between 71% and 76.8%.12-14 In contrast, numerous studies reported lower burnout levels ranging between 10.3% and 55%.1,10,11,29-31 These varying levels could be explained by the different instruments used to assess burnout since there is no standard instrument or due to different underlying causes of burnout.
However, the high level of burnout among medical students in Saudi Arabia is a cause of concern as it can adversely affect the learning process and ultimately reduce the quality of health care delivered to patients.5 The high levels found in our study could be attributed to a variety of factors. One of which is the high level of competition among students in Saudi Arabia to enrol in medical school, or to be accepted in a desired residency program due to the high number of graduates each year and the lack of residency positions. Students have to build impressive resumes with published research, presenting in conferences, health promotion activities and many other requirements play a significant role in being accepted.
The results show that the frequency of attendance in extracurricular activities does not have a significant influence on burnout. This contradicts a previous study with high school students where students who participated in a greater number of extracurricular activities reported a subjective feeling of well-being.32 Additionally, volunteers who are a part of the workforce showed lower levels of burnout, stress and higher levels of psychological well-being.33 Our results may imply that the objective of participating in extracurricular activities is not related to students’ well-being as a priority. While helping the community as a part of extracurricular activities is essential, medical educators and university officials should consider engaging students more in activities with the aim of alleviating stressors among students.
Our results showed that students who were involved as leaders or organizers of the extracurricular activities reported a better professional efficacy. This may be interpreted that deep involvement is more influential as students have an opportunity to improve their leadership abilities, which may positively reflect in their academic performance. The assumption is supported by a previous study indicating that previous student leadership experience could positively affect future organizational involvement.34 Being an organizer can enable the student to form a strong connection with academically oriented peers who share similar interests, and as a result, they can assist each other.
The current study showed females to have lower levels of burnout, which is supported by the findings in two previous studies where male students were at higher risk of burnout than their female counterparts.16,29 However, other studies published contradictory results as they reported that females suffered burnout more than males.10,12 The lower female burnout result in the current study could be attributed to higher financial and social pressures encountered by males in Saudi Arabia. Furthermore, female participation in extracurricular activities was significantly higher than the males. This finding is consistent with another study that showed greater participation in extracurricular activities by females and more time spent in medical volunteering.35 However, the design of this study limits detailed analysis of gender differences. Further studies are needed to investigate these differences.
An interesting finding of the present study is that students who have a physician among family members show significantly high emotional exhaustion and high cynicism. The finding is supported in literature with a study reporting that students whose parents are physicians showed high burnout.10 The finding appears paradoxical as the assumption is that these students could be guided by their parents or siblings and therefore have a more positive psychological status. In fact, parents who are physicians have been reported as the second highest source of stress in a previous medical student related study.36 This can be due to the high expectations by parents or siblings, which could result in experiencing more pressure, thus causing a negative psychological status among students.
Our findings demonstrate that students who achieve a low GPA (<4.50) have low professional efficacy resulting in higher burnout levels. The low GPA serves as an additional source of stress as students need to improve their GPA since it plays such a major role in their future careers. A recommendation from the current study is that medical educators should not only provide support and guidance but also focus on this issue in terms of policy reform and curricular changes. Possible examples include changing the method of grading from a letter-grade hierarchical system to pass/fail system as numerous studies showed that such a change resulted in lower burnout levels, lower stress and higher psychological well-being without affecting academic performance.37-39
Limitations of the study
There are several limitations inherent in this study. First, this study is limited by its cross-sectional design which cannot determine causal relationships. Additionally, some degree of recall or response bias such as social desirability40 can arise due to using a self-administered questionnaire. Finally, the current study was conducted in one college, and while these results might be generalizable to other local medical colleges, future research might investigate this across different medical schools.
Conclusions
The students reported higher levels of burnout. Although there was no significant association between the frequency of participation in extracurricular activities and burnout, this study showed that leading and organizing extracurricular activities might positively affect students’ level burnout. Based on these findings, students’ mental health should receive more attention from medical educators and health care personnel. Preventive measures such as improving coping skills, focused support, and increased mental health awareness should be considered. Additionally, improving the leadership skills of students should be embedded in curriculum planning and assessment, and greater emphasis should be placed on the quality of involvement in extracurricular activities rather than the quantity. Further longitudinal studies are required to study the pattern of burnout among medical students from admission to medical schools until graduation.
Acknowledgments
The authors gratefully acknowledge Bashaier Alenizy, Norah Alsabty, Futun Aljoufi and Alanoud Aldrees who assisted in the data collection for this project. Special thanks to Dr. Sultan Almalki, Dr. Aamir Omair and Mr. Sulaiman Jenkins for revising and editing the manuscript.
Conflict of Interest
The authors declare that they have no conflict of interest.
References
- Dyrbye LN, Thomas MR, Huntington JL, Lawson KL, Novotny PJ, Sloan JA and Shanafelt TD. Personal life events and medical student burnout: a multicenter study. Acad Med. 2006; 81: 374-384.
Full Text PubMed - Lins L, Carvalho FM, Menezes MS, Porto-Silva L and Damasceno H. Health-related quality of life of students from a private medical school in Brazil. Int J Med Educ. 2015; 6: 149-154.
Full Text PubMed - Paro HB, Morales NM, Silva CH, Rezende CH, Pinto RM, Morales RR, Mendonça TM and Prado MM. Health-related quality of life of medical students. Med Educ. 2010; 44: 227-235.
Full Text PubMed - Babar MG, Hasan SS, Ooi YJ, Ahmed SI, Wong PS, Ahmad SF, Mnm-Rosdy NM and Malik NA. Perceived sources of stress among Malaysian dental students. Int J Med Educ. 2015; 6: 56-61.
Full Text PubMed - Ishak W, Nikravesh R, Lederer S, Perry R, Ogunyemi D and Bernstein C. Burnout in medical students: a systematic review. Clin Teach. 2013; 10: 242-245.
Full Text PubMed - Humphris G, Blinkhorn A, Freeman R, Gorter R, Hoad-Reddick G, Murtomaa H, O'Sullivan R and Splieth C. Psychological stress in undergraduate dental students: baseline results from seven European dental schools. Eur J Dent Educ. 2002; 6: 22-29.
Full Text PubMed - Pöhlmann K, Jonas I, Ruf S and Harzer W. Stress, burnout and health in the clinical period of dental education. Eur J Dent Educ. 2005; 9: 78-84.
Full Text PubMed - Maslach C, Schaufeli WB and Leiter MP. Job burnout. Annu Rev Psychol. 2001; 52: 397-422.
Full Text PubMed - Dyrbye LN, Thomas MR, Massie FS, Power DV, Eacker A, Harper W, Durning S, Moutier C, Szydlo DW, Novotny PJ, Sloan JA and Shanafelt TD. Burnout and suicidal ideation among U.S. medical students. Ann Intern Med. 2008; 149: 334-341.
PubMed - Muzafar Y, Khan HH, Ashraf H, Hussain W, Sajid H, Tahir M, Rehman A, Sohail A, Waqas A and Ahmad W. Burnout and its associated factors in medical students of Lahore, Pakistan. Cureus. 2015; 7: 390.
Full Text PubMed - Dahlin ME and Runeson B. Burnout and psychiatric morbidity among medical students entering clinical training: a three year prospective questionnaire and interview-based study. BMC Med Educ. 2007; 7: 6.
Full Text PubMed - Fares J, Saadeddin Z, Al Tabosh H, Aridi H, El Mouhayyar C, Koleilat MK, Chaaya M and El Asmar K. Extracurricular activities associated with stress and burnout in preclinical medical students. J Epidemiol Glob Health. 2016; 6: 177-185.
Full Text PubMed - Mazurkiewicz R, Korenstein D, Fallar R and Ripp J. The prevalence and correlations of medical student burnout in the pre-clinical years: a cross-sectional study. Psychol Health Med. 2012; 17: 188-195.
Full Text PubMed - El-Masry R, Ghreiz SM, Helal RM, Audeh AM, Shams T. Perceived stress and burnout among medical students during the clinical period of their education. Ibnosina J Med Biomed Sci. 2013;5(4):179-87.
- Hojat M, Vergare M, Isenberg G, Cohen M and Spandorfer J. Underlying construct of empathy, optimism, and burnout in medical students. Int J Med Educ. 2015; 6: 12-16.
Full Text PubMed - Cecil J, McHale C, Hart J and Laidlaw A. Behaviour and burnout in medical students. Med Educ Online. 2014; 19: 25209.
Full Text PubMed - Gerber M, Brand S, Elliot C, Holsboer-Trachsler E, Pühse U and Beck J. Aerobic exercise training and burnout: a pilot study with male participants suffering from burnout. BMC Res Notes. 2013; 6: 78.
Full Text PubMed - Zhang Y, Qu B, Lun S, Wang D, Guo Y and Liu J. Quality of life of medical students in China: a study using the WHOQOL-BREF. PLoS ONE. 2012; 7: 49714.
Full Text PubMed - Henning MA, Hawken SJ and Hill AG. The quality of life of New Zealand doctors and medical students: what can be done to avoid burnout? N Z Med J. 2009; 122: 102-110.
PubMed - Cnaan RA, Goldberg-Glen RS. Measuring motivation to volunteer in human services. Journal of Applied Behavioral Science. 1991; 27(3):269-84.
- Handy F, Cnaan RA, Hustinx L, Kang C, Brudney JL, Haski-Leventhal D, Holmes K, Meijs LCPM, Pessi AB, Ranade B, Yamauchi N and Zrinscak S. A cross-cultural examination of student volunteering: is it all about résumé building? Nonprofit and Voluntary Sector Quarterly. 2010; 39: 498-523.
Full Text - Astin A, Sax L, Avalos J. Long-term effects of volunteerism during the undergraduate years. The Review of Higher Education. 1999; 22(2):187-202.
- Mahoney JL, Cairns BD, Farmer TW. Promoting interpersonal competence and educational success through extracurricular activity participation. J Educ Psychol. 2003;95(2):409-18.
- Slade AN and Kies SM. The relationship between academic performance and recreation use among first-year medical students. Med Educ Online. 2015; 20: 25105-7.
Full Text PubMed - Lumley S, Ward P, Roberts L and Mann JP. Self-reported extracurricular activity, academic success, and quality of life in UK medical students. Int J Med Educ. 2015; 6: 111-117.
Full Text PubMed - Fredricks JA and Eccles JS. Extracurricular involvement and adolescent adjustment: impact of duration, number of activities, and breadth of participation. Applied Developmental Science. 2006; 10: 132-146.
Full Text - Schaufeli WB, Martinez IM, Pinto AM, Salanova M and Bakker AB. Burnout and engagement in university students: a cross-national study. Journal of Cross-Cultural Psychology. 2002; 33: 464-481.
Full Text - Hu Q and Schaufeli WB. The factorial validity of the Maslach Burnout Inventory-Student Survey in China. Psychol Rep. 2009; 105: 394-408.
Full Text PubMed - Costa EF, Santos SA, Santos AT, Melo EV and Andrade TM. Burnout Syndrome and associated factors among medical students: a cross-sectional study. Clinics (Sao Paulo). 2012; 67: 573-580.
PubMed - Youssef FF. Medical student stress, burnout and depression in Trinidad and Tobago. Acad Psychiatry. 2016; 40: 69-75.
Full Text PubMed - Chang E, Eddins-Folensbee F and Coverdale J. Survey of the prevalence of burnout, stress, depression, and the use of supports by medical students at one school. Acad Psychiatry. 2012; 36: 177-182.
Full Text PubMed - Palen LA and Coatsworth JD. Activity-based identity experiences and their relations to problem behavior and psychological well-being in adolescence. J Adolesc. 2007; 30: 721-737.
Full Text PubMed - Ramos R, Brauchli R, Bauer G, Wehner T and Hämmig O. Busy yet socially engaged: volunteering, work-life balance, and health in the working population. J Occup Environ Med. 2015; 57: 164-172.
Full Text PubMed - Schuh JH, Laverty M. The perceived long-term influence of holding a significant student leadership position. J Coll Stud Pers. 1983; 24: 28-32.
- Kim SH. Extracurricular activities of medical school applicants. Korean J Med Educ. 2016; 28: 201-207.
Full Text PubMed - Sreeramareddy CT, Shankar PR, Binu VS, Mukhopadhyay C, Ray B and Menezes RG. Psychological morbidity, sources of stress and coping strategies among undergraduate medical students of Nepal. BMC Med Educ. 2007; 7: 26.
Full Text PubMed - Reed DA, Shanafelt TD, Satele DW, Power DV, Eacker A, Harper W, Moutier C, Durning S, Massie FS, Thomas MR, Sloan JA and Dyrbye LN. Relationship of pass/fail grading and curriculum structure with well-being among preclinical medical students: a multi-institutional study. Acad Med. 2011; 86: 1367-1373.
Full Text PubMed - Bloodgood RA, Short JG, Jackson JM and Martindale JR. A change to pass/fail grading in the first two years at one medical school results in improved psychological well-being. Acad Med. 2009; 84: 655-662.
Full Text PubMed - Rohe DE, Barrier PA, Clark MM, Cook DA, Vickers KS and Decker PA. The benefits of pass-fail grading on stress, mood, and group cohesion in medical students. Mayo Clin Proc. 2006; 81: 1443-1448.
Full Text PubMed - Tourangeau R and Yan T. Sensitive questions in surveys. Psychol Bull. 2007; 133: 859-883.
Full Text PubMed