Exploring relational and moral features in medical students

Introduction

Relational and moral competences are key features in medical practice, as they shape the way the encounter with patients unfolds and our decision making. The clinical encounter should provide a safe and warm atmosphere where patients fully disclose their symptoms and explore fears, reservations, and concerns, embarking on a reliable and effective therapeutic project. Shared decision making in medicine is always a dialogical process and tailor-made interventions must respect both patients' autonomy and beneficence in accordance to the leges artis. Despite the relevance of relational and moral competences on clinical practice these aren't routinely measured when choosing candidates for medical school and they are also dismissed in most medical education curriculums.

First, empathy is key to relational competences in medicine, allowing the patient to experience presence, warmth, and understanding.¹ Introduced in medicine in 1963 by William Osler, empathy refers to a special form of sharing patients' experience (different from contamination or neutralization of emotions) in which it is possible to "see inside" and characterize the inner life of patients. It requires a cognitively challenging² embodied recognition of another's emotional state and the identification of behavioral correlates, personality dimensions, and emotions.³ For a tentative operational definition four levels were suggested: emotive (the ability to subjectively experience and share the other's psychological state and feelings), moral (an altruistic internal force), cognitive (the intellectual ability to identify and perceive the other's perspective in an objective way), and behavioral (communicative response in order to show insight into the other's perspective).⁴ The development of empathy across medical pre-graduate curriculums was explored in order to understand possible differences across students and which factors reduced and promoted it. Students that start their studies with lower scores appear to get a greater reduction of empathy⁵ and is evidence towards empathy fading from the first year of study.^6,7 It is postulated that the rigor of the theoretical curriculum, which models the academic life, leads students to dismiss communicative and empathic skills.⁸ Other assorted explanations for the decline of empathy include 1) "de-idealization" of medicine (expectations vs reality), 2) defense mechanisms to distance themselves from illness or death⁹ and 3) the risk of litigation, economic and time constraints.¹⁰ This last factor is part of today's health systems requirements (that favor productivity over quality and fast interventions) and leads to a guarded, impersonal, and distant communication style.¹¹ Interestingly, previous studies with Portuguese samples seem to show a conservation or even increase in empathy.¹²

Temperament also has an important role on relational competences as it shapes the way individuals interact with one another. For example, irritable temperament is associated with lower levels of empathy, anger, and violence whereas depressive temperament is characterized by perseverance and reliability.¹³ Temperament has been considered since Kraepelin and the present-day definition by Akiskal as "a hereditary core of the personality that determines reactivity, mood and energy of a given individual and that it is relatively unchangeable throughout life".¹⁴ It possesses both positive and negative aspects, impacting the development of personality and quality of life, being linked to some personality traits.¹⁵

In our study, morality construct is addressed both positively as competences in moral judgements and negatively by studying callous and unemotional traits (CUT). Moral judgment as a broad category can be clarified by the analysis of paradigmatic cases. The Moral Competence Test (MCT) is a good tool to identify moral decision making. CUT are part of the affective dimension of psychopathy, including the narcissistic traits and manipulative, impulsive, and irresponsible behavior. They commonly refer to persons who lack empathy and/or guilt. More specifically, people with higher CUT "are more likely to show deficits in their processing of negative emotional stimuli, low levels of fearful inhibitions and anxiety and decreased sensitivity to punishment cues, especially when a reward-oriented response set is primed".^16,17 Morality is paramount to medicine considering the amount of ethical decisions that are involved in everyday practice.

Our study aimed at a comprehensive larger analysis of these competences in a sample of medical students including their possible inter-relations. Our first aim was to clarify our sample empathy, morality, callous traits, and temperament scores and to identify possible differences between 1st and 5th year students. Our second aim was to identify whether empathy correlated with morality (positively) and callosity (negatively). Our last aim was to identify the correlation between specific temperaments and our measured variables (BLR, ICU and MCT)

Methods

Study design and participants

This is a cross-sectional study with a sample of 138 students from Lisbon University Medical School. Although we aimed to include all students from the 1st and 5th year (no exclusion criteria were defined), we got a 42 % response rate. All participants were recruited between 1 August 2018 and 1 February 2019 and signed a written voluntary informed-consent form prior to participation. The sample comprised 34 (24.6%) 5th-year students and 104 (75.4%) 1st-year students. Voluntary participation was guaranteed, and confidentiality was assured by random code allocation of each student participation. The study was approved by Ethics Committee of Centro Académico de Medicina de Lisboa (Centro Hospitalar Lisboa Norte and Faculdade de Medicina da Universidade de Lisboa).

The subjects were between 18 and 30 years old, with a mean age of 20.58 (SD: ±0.325), of which 89 (65.2%) were female. Regarding the family history of psychiatric disorder, 10 (7.2%) students reported a family history of mood disorder, 7(5.1%) reported anxiety disorders, 2 (1.4%) reported schizophrenia and 1(0.7%) reported alcohol use disorder. Regarding the current prescription of psychotropic drugs, 4(2.5%) students reported taking antidepressants, 2 (1.4%) reported taking antidepressants and benzodiazepines, 1(0.7%) reported taking benzodiazepines, and 2 (1.4%) reported taking mood stabilizers. Research wise we considered both segregated and combined population of our 1st and 5th-year students – which showed no differences on baseline demographics with the exception of gender as 1st-year students were mainly females. Table 1 presents the full sociodemographic features of our sample.

Data collection

We administered 4 paper-format self-reported scales in the context of a classroom allowing any question during the process to be clarified. The scales included Temperament Evaluation of Memphis, Pisa and San Diego Auto-questionnaire (TEMPS-A) to assess temperament, Inventory of Callous-Unemotional Traits (ICU-T) to assess callous traits, Barrett Lennard Relational Inventory (BLRI) to assess empathy, and the Moral Competence Test (MCT-T) to assess morality competence. Validity and Reliability are presented in each of the scales.

Barrett Lennard Relational Inventory (BLRI)

BLRI is a self-report questionnaire, with a six-point bipolar rating scale ranging from -3 ('NO, I strongly feel that it is not true') to +3 ('YES, I strongly feel that it is true') that comprises four subscales: 'Empathic Understanding', 'Level of Regard', 'Unconditionality', and 'Congruence'. Since the internal consistency of the 40-item Version has not been determined, we used the 64-item Version which showed reliabilities of .91 for Level of Regard, .88 for Congruence, .84 for Empathy, .74 for Unconditionality and .91 for the total score.¹⁸ The total score is the sum of the 64-item answers, being that eight questions per subscale are negative items (scored by multiplying "-1"). The scale was validated to the Portuguese population by Marques-Teixeira and colleagues.¹⁹

Temperament Evaluation of Memphis, Pisa and San Diego Auto-questionnaire (TEMPS-A)

TEMPS-A is a 110-item instrument that measures affective temperament traits represented along five dimensions: depressive (questions 1 to 21), cyclothymic (22 to 42), hyperthymic (43 to 63), irritable (64 to 84) and anxious (85 to 110)14. It measures the severity of the traits of the temperament ranging from 0 to 1 and gives the ability of group comparison. However, it does not answer to the question about a person's temperament type, as there is no standard for "normal" temperament. The total score for each subscale is given, dividing the sum of points obtained by the number of questions contained therein.¹⁴ TEMPS-A has been translated into 32 languages and has demonstrated high reliability and internal consistency^20,21 ("Coefficients a for internal consistency were 0.91 (cyclothymic temperament subscale), 0.81 (depressive temperament subscale), 0.77 (irritable temperament subscale), 0.76 (hyperthymic temperament subscale), and 0.67 (anxious temperament subscale)"²²). The scale was validated to the Portuguese population by Figueira and colleagues.²²

Inventory of Callous-Unemotional Traits (ICU-T)

There are five versions of the ICU-T scale:  Youth Self-Report, Parent Report, Teacher Report, Parent Report (Preschool Version), and Teacher Report (Preschool Version). In our study, we used the ICU-T youth version – a 24-item questionnaire scored on an ordinal 4-point Likert scale (from "Does not apply at all" to "Applies very well") in which scores are divided into 3 dimensions: callousness, uncaring and unemotional.²³ ICU-T provides a comprehensive assessment of callous and unemotional traits, which are relevant for identifying a distinct subgroup group of antisocial and aggressive youth. We used the ICU-Youth Version, translated to Portuguese and validated by Pedro Pechorro.²³

Moral Competence Test (MCT-T)

MCT-T measures moral competence, which were defined by Lind^24,25 moral orientations for problem and conflict solving – thinking and discussion on the moral quality of the argument rather than in regard to their opinion-agreement. MCT-T scores range from 0-100 and have shown good validity. While there are many tests of moral preferences or attitudes, the MCT-T is one of the few instruments, if not the only, which produces a pure measure of moral competence, and contains a moral task for the participant. The scale is composed of three moral dilemmas with 13 questions each: the workers, the doctor and the judge dilemmas. For each dilemma, there are three sections: Section A, in which the subject must answer on a scale from -3 ("I strongly disagree") to +3 ("I strongly agree") how much he agrees with the action led by the workers/doctor/judge; Section B, in which the subject must decide, on a scale from -4 ("I strongly disagree") to +4 ("I strongly agree"), how much he agrees with the arguments in favor of the workers/doctor/judge; Section C, in which the subject must decide, on a scale from -4 ("I strongly disagree") to +4 ("I strongly agree"), how much he agrees with the arguments against the workers/doctor/judge actions. The questionnaire has a total of 13 questions for each dilemma. It was translated and validated to Portuguese by Bataglia and colleagues.²⁶

Setting and procedure

The scales (described in "Data Collection Method") were provided in paper format at the end of class (after asking for students' voluntary participation). Filled questionnaires were collected by a previously assigned university worker. One of the authors digitalized the data into the SPSS, and the other author performed a review. The sample was collected between 1 August 2018 and 1 February 2019.

Statistical analysis

We used descriptive statistics, means and standard deviation for continuous variables and absolute number and frequencies for categorical variables. Non-parametric tests were employed when the assumptions for parametric null hypothesis tests were violated.

Pearson r was used to analyze the correlation between empathy and callous traits, moral competencies, and specific traits. When not otherwise specified, two-tailed p<0.05 was considered significant. Given the exploratory nature of this small-sample study, we decided not to control for family-wise error rate, which would have decreased statistical power. All analyses were performed using SPSS IBM 24.

Results

We found no statistical evidence to support any difference in empathy levels, measured by BLRI, between 1st (N=104, Mean: 41.42, SD: 22.48) and 5th-year students (N=34, Mean: 37.35, SD: 23.35), being that t₍₁₃₆₎=0.908, p=0.366. Similarly, we found no statistical evidence to support any difference between the two medical years (Mdn(1st year)= 17.00; Mdn(5th year)= 17.00) regarding Moral competencies, as measured by MCT-T (U=1059.0, p=0.969) and callous traits, as measured by ICU-T (Mdn(1st year)=16.00, Mdn(5th year)=19.00, U=2030.5, p=0.194). To note, we found no statistical evidence for differences between the two groups regarding the subscales of BLRI, MCT-T or ICU-T. Regarding Temperament (TEMPS-A), we found no statistical evidence to support any difference between the two groups, except for the anxious temperament (t₍₁₃₆₎= 2.359, p=0.020), which was higher on first-year students. See Table 2, which presents overall scores and tests between the 1st and 5th-year students.

We found a negative correlation between empathy, as measured by BLRI, and callous traits, as measured by ICU-T (r₍₁₃₆₎=-0.444, p=0.000). Noteworthy, (1) the ICU-T subscales were negatively correlated with BLRI: unemotional (r₍₁₃₆₎=-0.306, p=0.000), uncaring (r₍₁₃₆₎=-0.402, p=0.000), callousness (r₍₁₃₆₎=-0.261, p=0.002); Regarding empathy and Moral competences, we found no correlation between the two variables (r₍₉₆₎=0.029, p=0.779).

We explored the correlation between empathy and specific temperaments (anxious, irritable, hyperthymic, depressive, and cyclothymic) and the results are presented in Table 3. Among these results, we would like the reader to notice that: (1) Cyclothymic, anxious and irritable temperaments were negatively correlated with BLRI (r₍₁₃₆₎=-0.334, p=0.000, r₍₁₃₆₎=-0.281, p=0.001, r₍₁₃₆₎=-0.400, p=0.000); (2) There was no correlation between hyperthymic or depressive temperament and BLRI or between MCT-T and BLRI (see Table 3).

Discussion

Relational and moral competencies (RMC) are classically considered relevant skills in medical practice. This is the first empirical investigation of RMC competencies, including callous traits, in a sample of 1st and 5th-year medical students. Our first aim was to determine Lisbon University Medical School student's empathy, moral competencies, callous traits, and temperament scores and identify potential differences in scores between the 1st and 5th-year medical years.

As for Moral competencies, our sample (N=96, Mean(MCT)= 19.03, SD: 11.56) scored more than other youth populations, as for example, a sample of 827 high school students from urban Polish schools (N=827, Mean(MCT)=14.42, SD: 9.99)²⁷ and a sample of teens with a criminal record (N=23, Mean(MCT)= 16.97, SD: 6.2).²⁸ On the other hand, medical students scored less than doctors (N=236, Mean (MCT)=22.43, SD: 14.1)²⁹, which can lead us to think that Moral Competences may evolve with age and maturity.

Regarding callous traits, medical students scored lower on ICU-T total, callousness, and uncaring (N= 138, Mean (ICU-T): 17.43, SD: 7.12; Mean(ICU-callousness): 4.93, SD: 2.68; Mean (ICU-uncaring): 5.16, SD: 3.54) than adolescents from basic and high school (N=1443, Mean (ICU-T): 24.58, SD: 2.78; Mean (ICU-callousness): 7.29, SD:4.39, Mean (ICU-uncaring): 8.14, SD: 3.98).³⁰ We speculate that adolescents who aim for a medical curriculum could be more sensitive and have better interpersonal skills, which per se would determine their interest in working closely with people. Yet previous studies of juveniles with a criminal record suggest that our sample scores are lower in respect to callousness and uncaring traits 31 (N=500, Mean (ICU-Callousness)= 13.75, SD: 5.08; Mean (ICU-uncaring): 15.41, SD: 3.05), while similar in unemotional scores (N=500, Mean (ICU-unemotional)= 7.07, SD: 2.31). In our sample, "unemotional" traits might refer to students believing that they should be guarded in their emotions (having idealized the role of "being professional" as avoiding 'personal feelings' or 'emotions') and therefore answer that taking control of one's feelings when exposed to several impacting experiences as dissecting a cadaver, drawing a patient's blood, diagnosing a terminal illness – these are 'emotional' experiences that they must manage 'unemotionally'.

With respect to temperament, the students scored higher on the depressive, hyperthymic, and anxious dimensions (N=138, Mean TEMPS-Depressive=0.41, SD:0.15, Mean TEMPS-Hyperthymic:0.49, SD:0.20, Mean TEMPS-Anxious:0.44, SD:0.21). In fact, some of the students from our sample had a family psychiatric history and/or current psychotropic treatment that could partly explain these results. When comparing our results to the ones by Jaracz, who studied 100 civil workers and 100 nurses from Poland, we found that: (1) our sample had higher scores on depressive temperament than civil workers (N=100, Mean TEMPS-Depressive=0.26 SD:0.12) and nurses (N=100, Mean TEMPS-Depressive=0.28, SD:0.11) and (2) medical students scored higher on anxious temperament than civil workers (N=100, Mean TEMPS-Anxious=0.26, SD:0.22)  and nurses (N=100, Mean TEMPS-Anxious=0.32, SD:0.22).³² Notably, when comparing to Hinic's work with 770 healthy university students (medicine, philology, economics, humanities, sports, engineering and natural sciences, musical and visual arts) we also found that our sample scored higher on depressive and anxious temperament (N=770, TEMPS-Depressive=0.15, SD:0.20,  N= 770, TEMPS-Anxious=0.36, SD:0.25).³³  If we focus on Hinic's subset of Serbian medical students, our sample still scores higher on these specific temperaments (N=100; TEMPS-Depressive=0.16, SD:0.14, Mean TEMPS-Anxious=0.40, SD:0.2).

Regarding empathy development among the Lisbon University medical students, we found no differences between 1st and 5th-year medical students. Previous studies provide assorted evidence of either an empathy decline (key factors: stress and learning overload, disease-centred approach, lack of student-patient time, abusive tutors, and students' low self-images)^34-39 or preservation and even increase.^12,40 Interestingly, our results are along with previous studies in Portuguese populations  (t₍₁₃₆₎=0.908, p=0.366), corroborating the results from the Portuguese work by Magalhães and colleagues: "nonsignificant differences on empathy scores (...) were found between the pre-clinical (...) and clinical phases".^40,41 Although we cannot exclude our result to be a false negative it could be that Portuguese medical curriculums attend and act towards caring for the factors that would determine empathy erosion.⁴²  

Our second aim was to identify whether empathy was correlated with morality (positively) and callosity (negatively) or not. Moral reasoning wasn't related to empathic skills in our sample (no significant correlation between MCT-T and BLRI scores), and, as such, the classical idea that empathy and moral competencies aren't related could be put forward. Although these results could be due to small sample size (false negative, as only 96 students completed the MCT-T questionnaire), some literature provides evidence that empathy and morality are not in fact correlated. As an example, Kiehl's study with incarcerated psychopath offenders concluded that "psychopathy as a whole did not predict the ability to understand what is morally wrong".^43,44 Furthermore, Batson and colleagues found that empathy can even lead to immoral behavior.⁴⁵ Regarding callous traits, as we expected, we found a negative correlation between them and empathy. In line with our results, previous literature defines callous traits as disregarding/uncaring about the feeling of others, concern for the consequences of his/her actions solely on his/herself rather than their effects on others, even when they result in substantial harm to others.⁴⁶

Finally, we aimed to identify the correlation between specific temperaments and empathy, as measured by BLRI. As we postulated, our work showed a negative correlation between empathy and cyclothymic, anxious, and irritable temperaments (r₍₁₃₆₎=-0.334, p=0.000, r₍₁₃₆₎=-0.281, p=0.001, r₍₁₃₆₎=-0.400, p=0.000). These temperaments, by definition, comprise various representative aspects of negative emotionality, such as irritability, anger, and frustration.^47,48 Since negative emotionality plays a crucial role on interpersonal relationships, and therefore empathy, it explains our results. On the other hand, contrary to what we were expecting, hyperthymic temperament was not correlated with empathy. According to Akiskal, hyperthymic individuals are "habitually cheerful, sociable, self-assured, boastful, improvident, uninhibited, overtalkative".⁴⁷ These characteristics seems to have a major role on positive affect ("the display of pleasure and excitement, and the tendency to seek out and approach reward-fulfilling stimulation")⁴⁷ which have been described as essential aspects for social interaction, and therefore empathy. Although it is possible that our results are false negatives, these results hint at a nonlinear relationship between empathy, temperament and positive affect. These findings support the need for a multifactorial definition of empathy, comprising not only emotional, but also cognitive and behavioral dimensions.^3,4

Limitations

Firstly, our study should be considered exploratory due to our small sample size, and we cannot exclude our results from being false negatives or positives. The generalization of our results might be limited by the specifics of our sample selected from a single university (Lisbon University Medical School). Secondly, the use of self-reported scales is associated with various limitations: 1) the answers are dependent on the honesty of participants, 2) the use of scales with subjective questions may difficult its understanding/interpretation and the introspective ability to provide an accurate answer, and 3) its use may have skewed our population, as people prone to answering questionnaires, and therefore with different personal characteristics, are more likely to have answered it. Finally, the constructs of empathy and moral competencies were shown to be heterogeneous both at a conceptual and empirical level, limiting the comparison of our results to other samples.

Conclusions

Our study aimed to determine empathy, moral competencies, callous traits, and temperament scores on Lisbon University Medical School students. We also had the objective of identifying potential differences in scores between the 1st and 5th-year medical years and the correlation between empathy and morality, callosity and, specific temperaments. To the best of our knowledge, this is the first work that studies empathy, callous trains, morality, and temperament as a whole in medical students. It is also the first work that analyzes the relationship between empathy and temperament.

Regarding the overall scores for the studied variables, we would like the reader to notice that medical students scored lower than the general youth population on callous traits (as measured by ICU-T) and higher on moral competencies (as measured by MCT). These results underline the fact that medical students usually have a specific profile which makes them choose a career with close contact to people. However, we found that medical students had similar scores on unemotional traits when compared to juveniles with a criminal record.  We hypothesized students idealized the role of "being professional" as avoiding 'personal feelings' or 'emotions'. In contrast to the majority of studies on empathy in medical students, which postulate a decrease of empathy throughout medical school, we found no statistical significant difference between 1st and 5th-year medical students. Our results are in line with previous Portuguese studies on the matter, suggesting that Portuguese medical school may have specific characteristics or teaching methods that preserve empathy. On the relationship between empathy and anxious, irritable and, cyclothymic temperaments, we found that they are inversely correlated. As such, the characteristics of an individual medical student may have a major role in the way he will empathize with future patients and colleagues. Finally, we found no correlation between empathy and moral competence, corroborating the findings in previous publications, where it was shown that psychopaths have the same ability to distinguish morally wrong and good.

From the results of our work, it is of utmost importance to admit students into medical school based not only on their curriculum and grades but also on individual characteristics, such as temperament and callous traits. Based on these principles, we will be able to train doctors with higher empathy levels, providing better standards of care in the future.

Acknowledgements

We would like to acknowledge the students that voluntarily participated in our research.

Conflict of Interest

The authors declare that they have no conflicts of interest.

References

1. ROGERS CR. The necessary and sufficient conditions of therapeutic personality change. J Consult Psychol. 1957; 21: 95-9103.
   Full Text PubMed
2. Halpern J. What is clinical empathy? J Gen Intern Med. 2003; 18: 670-674.
   Full Text PubMed
3. Mercer SW and Reynolds WJ. Empathy and quality of care. Br J Gen Pract. 2002; 9-12.
   PubMed
4. Ogle J, Bushnell JA and Caputi P. Empathy is related to clinical competence in medical care. Med Educ. 2013; 47: 824-831.
   Full Text PubMed
5. Benbassat J and Baumal R. What is empathy, and how can it be promoted during clinical clerkships? Acad Med. 2004; 79: 832-839.
   Full Text PubMed
6. Hojat M, Mangione S, Nasca TJ, Rattner S, Erdmann JB, Gonnella JS and Magee M. An empirical study of decline in empathy in medical school. Med Educ. 2004; 38: 934-941.
   Full Text PubMed
7. Stratta EC, Riding DM and Baker P. Ethical erosion in newly qualified doctors: perceptions of empathy decline. Int J Med Educ. 2016; 7: 286-292.
   Full Text PubMed
8. Cîrcu V, Fernandes MA and Carlton L. Reaction of bis(phosphine)(hydrotris(3,5-dimethylpyrazolyl)borato)rhodium(I) with phenylacetylene, p-nitrobenzaldehyde, and triphenyltin hydride: structures of [Rh(Tp)(PPh(3))(2)], [Rh(Tp)(H)(C(2)Ph)(P(4-C(6)H(4)F)(3))], [Rh(Tp)(H)(COC(6)H(4)-4-NO(2))(PPh(3))], and [Rh(Tp)(H)(SnPh(3))(PPh(3))]. Inorg Chem. 2002; 41: 3859-3865.
   Full Text PubMed
9. Chen DC, Kirshenbaum DS, Yan J, Kirshenbaum E and Aseltine RH. Characterizing changes in student empathy throughout medical school. Med Teach. 2012; 34: 305-311.
   Full Text PubMed
10. Pedersen R. Empirical research on empathy in medicine-A critical review. Patient Educ Couns. 2009; 76: 307-322.
    Full Text PubMed
11. Haslam N, Loughnan S, Reynolds C and Wilson S. Dehumanization: a new perspective. Social and Personality Psychology Compass. 2007; 1: 409-422.
    Full Text
12. Magalhães E, Salgueira AP, Costa P and Costa MJ. Empathy in senior year and first year medical students: a cross-sectional study. BMC Med Educ. 2011; 11: 52.
    Full Text PubMed
13. Szcześniak M and Strochalska K. Temperament and Sense of Coherence: Emotional Intelligence as a Mediator. Int J Environ Res Public Health. 2019; 17: .
    Full Text PubMed
14. Dembińska-Krajewska D and Rybakowski J. [The Temperament Evaluation of Memphis, Pisa and San Diego Autoquestionnaire (TEMPS-A)--an important tool to study affective temperaments]. Psychiatr Pol. 2014; 48: 261-276.
    PubMed
15. Chen X, Schmidt AL. Temperament and personality. In: Richard M. Lerner MEL, editor. Handbook of child psychology and developmental science. Hoboken, New Jersey: John Wiley & Sons; 2015.
16. Frick PJ and White SF. Research review: the importance of callous-unemotional traits for developmental models of aggressive and antisocial behavior. J Child Psychol Psychiatry. 2008; 49: 359-375.
    Full Text PubMed
17. Kimonis ER, Frick PJ, Skeem JL, Marsee MA, Cruise K, Munoz LC, Aucoin KJ and Morris AS. Assessing callous-unemotional traits in adolescent offenders: validation of the Inventory of Callous-Unemotional Traits. Int J Law Psychiatry. 2008; 31: 241-252.
    Full Text PubMed
18. Barrett-Lennard GT. The Relationship Inventory now: issues and advances in theory, method, and use. The psychotherapeutic process: a research handbook. New York, NY, US: Guilford Press; 1986.
19. Marques-Teixeira J, Pires de Carvalho M, Moreira AM, Pinho C. “Group effect?” Implementation of the Portuguese translation of the Barrett-Lennard Inventory on five group types. In: Hutterer R, Pawlowsky G, Schmid PF, Stipsits R, Eds. Client-centered and experiential psychotherapy: a paradigm in motion. Frankfurt am Main: P. Lang; 1996.
20. Akiskal HS, Akiskal KK, Haykal RF, Manning JS and Connor PD. TEMPS-A: progress towards validation of a self-rated clinical version of the Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego Autoquestionnaire. J Affect Disord. 2005; 85: 3-16.
    Full Text PubMed
21. Vázquez GH and Akiskal H. [The temperament evaluation of the Memphis, Pisa, Paris, and San Diego autoquestionnaire, Argentine version (TEMPS-A Buenos Aires)]. Vertex. 2005; 16: 89-94.
    PubMed
22. Figueira ML, Caeiro L, Ferro A, Severino L, Duarte PM, Abreu M, Akiskal HS and Akiskal KK. Validation of the temperament evaluation of memphis, Pisa, Paris and San Diego (TEMPS-A): Portuguese-Lisbon version. J Affect Disord. 2008; 111: 193-203.
    Full Text PubMed
23. Pechorro P, Ray JV, Barroso R, Maroco J and Abrunhosa Gonçalves R. Validation of the inventory of callous-unemotional traits among a Portuguese sample of detained juvenile offenders. Int J Offender Ther Comp Criminol. 2016; 60: 349-365.
    Full Text PubMed
24. Lind G. How to teach morality: promoting deliberation and discussion, reducing violence and deceit. Berlin: Logos Verlag; 2016.
25. Lerkiatbundit S, Utaipan P, Laohawiriyanon C and Teo A. Impact of the Konstanz method of dilemma discussion on moral judgment in allied health students: a randomized controlled study. J Allied Health. 2006; 35: 101-108.
    PubMed
26. Bataglia PUR. A validação do Teste de Juízo Moral (MJT) para diferentes culturas: o caso brasileiro. Psicol Reflex Crit. 2010; 23: 83-91.
    Full Text
27. Bronikowska M, Korcz A and Bronikowski M. The role of sports practice in young adolescent development of moral competence. Int J Environ Res Public Health. 2020; 17: .
    Full Text PubMed
28. Mariano MPV. Moral competence and conduct disorder among Filipino children in conflict with the law. Neuropsychopharmacol Rep. 2019; 39: 194-202.
    Full Text PubMed
29. Agurto M, Tello D, Elgueta A, Larrea R, Minaeff T, Miranda A, Parodi E, Salas JM, Vukusich A, Llanos S, Daza P and López S. [Assessment of moral competence of physicians]. Rev Med Chil. 2017; 145: 1122-1128.
    Full Text PubMed
30. Essau CA, Sasagawa S and Frick PJ. Callous-unemotional traits in a community sample of adolescents. Assessment. 2006; 13: 454-469.
    Full Text PubMed
31. Wiese R, Cálcena E, Aramayo Criniti AD, Catanesi CI and Folino JO. Psychosocial factors and juvenile homicide in Argentina. Int J Offender Ther Comp Criminol. 2019; 63: 1952-1966.
    Full Text PubMed
32. Jaracz M, Rosiak I, Bertrand-Bucińska A, Jaskulski M, Nieżurawska J and Borkowska A. Affective temperament, job stress and professional burnout in nurses and civil servants. PLoS One. 2017; 12: 0176698.
    Full Text PubMed
33. Hinić D, Akiskal SH, Akiskal KK, Jović J and Ignjatović Ristić D. Validation of the Temps-A in university student population in Serbia. J Affect Disord. 2013; 149: 146-151.
    Full Text PubMed
34. Hojat M, Vergare MJ, Maxwell K, Brainard G, Herrine SK, Isenberg GA, Veloski J and Gonnella JS. The devil is in the third year: a longitudinal study of erosion of empathy in medical school. Acad Med. 2009; 84: 1182-1191.
    Full Text PubMed
35. Hojat M, Axelrod D, Spandorfer J and Mangione S. Enhancing and sustaining empathy in medical students. Med Teach. 2013; 35: 996-991001.
    Full Text PubMed
36. Hardy C. Empathizing with patients: the role of interaction and narratives in providing better patient care. Med Health Care Philos. 2017; 20: 237-248.
    Full Text PubMed
37. Park J, Haslam N, Kashima Y and Norasakkunkit V. Empathy, culture and self-humanising: Empathising reduces the attribution of greater humanness to the self more in Japan than Australia. Int J Psychol. 2016; 51: 301-306.
    Full Text PubMed
38. Tavakol S, Dennick R and Tavakol M. Medical students' understanding of empathy: a phenomenological study. Med Educ. 2012; 46: 306-316.
    Full Text PubMed
39. Holm U and Aspegren K. Pedagogical methods and affect tolerance in medical students. Med Educ. 1999; 33: 14-18.
    Full Text PubMed
40. Duarte MIF, Raposo MLB, Rodrigues PJFSF and Branco MC. Measuring empathy in medical students, gender differences and level of medical education: an identification of a taxonomy of students. Investigación en Educación Médica. 2016; 5: 253-260.
    Full Text
41. Costa P, Magalhães E and Costa MJ. A latent growth model suggests that empathy of medical students does not decline over time. Adv Health Sci Educ Theory Pract. 2013; 18: 509-522.
    Full Text PubMed
42. Pohontsch NJ, Stark A, Ehrhardt M, Kötter T and Scherer M. Influences on students' empathy in medical education: an exploratory interview study with medical students in their third and last year. BMC Med Educ. 2018; 18: 231.
    Full Text PubMed
43. Aharoni E, Sinnott-Armstrong W and Kiehl KA. Can psychopathic offenders discern moral wrongs? A new look at the moral/conventional distinction. J Abnorm Psychol. 2012; 121: 484-497.
    Full Text PubMed
44. Decety J and Cowell JM. Friends or foes: is empathy necessary for moral behavior? Perspect Psychol Sci. 2014; 9: 525-537.
    Full Text PubMed
45. Batson CD, Klein TR, Highberger L and Shaw LL. Immorality from empathy-induced altruism: when compassion and justice conflict. Journal of Personality and Social Psychology. 1995; 68: 1042-1054.
    Full Text
46. Buka SL, Tsuang MT, Torrey EF, Klebanoff MA, Bernstein D and Yolken RH. Maternal infections and subsequent psychosis among offspring. Arch Gen Psychiatry. 2001; 58: 1032-1037.
    Full Text PubMed
47. Robert J. Coplan AB. Temperament and peer relationships. In: Marcel Zentner RLS, editor. Handbook of temperament. New York: The Guilford Press; 2012.
48. Akiskal HS, Khani MK and Scott-Strauss A. Cyclothymic temperamental disorders. Psychiatric Clinics of North America. 1979; 2: 527-554.
    Full Text