ORIGINAL RESEARCH 3733 DOWNLOADS

Assessing Saudi medical students learning approach using the revised two-factor study process questionnaire

Shaffi Ahamed Shaik1, Ahmed Almarzuqi2, Rakan Almogheer2, Omar Alharbi2, Abdulaziz Jalal2 and Majed Alorainy2

1Department of Family and Community Medicine, College of Medicine, King Saud University, Riyadh, Saudi Arabia

2College of Medicine, King Saudi University, Riyadh, Saudi Arabia

Submitted: 05/01/2017; Accepted: 23/07/2017; Published: 17/08/2017

Int J Med Educ. 2017; 8:292-296; doi: 10.5116/ijme.5974.7a06

© 2017 Shaffi Ahamed Shaik et al. This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0

Abstract

Objectives: To assess learning approaches of 1st, 2nd, and 3rd-year medical students by using revised two-factor study process questionnaire, and to assess reliability and validity of the questionnaire.

Methods: This cross-sectional study was conducted at the College of Medicine, Riyadh, Saudi Arabia in 2014. The revised two-factor study process questionnaire (R-SPQ-2F) was completed by 610 medical students of both genders, from foundation (first year), central nervous system (second year), medicine and surgery (third year) courses. The study process was evaluated by computing mean scores of two research study approaches (deep & surface) using student’s t-test and one-way analysis of variance. The internal consistency and construct validity of the questionnaire were assessed using Cronbach’s α and factor analysis.

Results: The mean score of deep approach was significantly higher than the surface approach among participants(t(770)=7.83, p= 0.000) for the four courses. The mean scores of deep approach were significantly higher among participants with higher grade point average (F(2,768)=13.31, p=0.001) along with more number of study hours by participants (F(2,768)=20.08, p=0.001). The Cronbach’s α-values of items at 0.70 indicate the good internal consistency of questionnaire used. Factor analysis confirms two factors (deep and surface approaches) of R-SPQ-2F.

Conclusions: The deep approach to learning was the primary approach among 1st, 2nd and 3rd-year King Saud University medical students. This study confirms reliability and validity of the revised two-factor study process questionnaire. Medical educators could use the results of such studies to make required changes in the curriculum. 

Introduction

The learning approach and study methods are the bi-fold processes by which a student obtains, understands, and retains knowledge to perform better in examinations. The learning approach of students has always been a concern for teachers and medical education experts. The learning approach is linked with the nature of the relationship between student, context and task.1 Learning style varies from individual to individual according to an assigned task; even it influences a person's learning behavior in groups, solving the problems and interacting with educators. However, learning styles are stable traits that affect the learner's information processing and his cognition regarding attention, perception and thinking.2 In the field of medicine, medical students entail skill and competence in multiple disciplines and need to grab the wide range of acquired knowledge in the short period.3 As per Sadler-smith, learning style is defined as the distinctive and habitual manner of acquiring knowledge, skills and attitude through study or experience.4 Numerous methods of the learning styles are available in the literature, and each method offers the categorically different view of learning style preferences. These approaches to learning include Visual, Aural, Read/write, and Kinesthetic (VARK) styles,5 Concrete experience, Reflective Observation, Abstract Conceptualization and Active experimentation.5,6 There are many articles available in the literature that elaborates surface and deep learning approaches among undergraduate students. Students with surface approach quietly accept information and memorize it as isolated and unrelated facts. Students who adopt a deep approach to learning have an intrinsic motivation to study a subject area.7 The concept of surface and deep learning approaches is in one of the key features for the improvement of a self-directed learner. The coexistence can occur between the surface and deep learning approaches. Contingent factors will promote the learning style of the student.8 Gibbs and colleagues9 describes factors that contribute to deep learning as an integrated curriculum, match between the assessment and objectives, intrinsic motivation, and a learner-centered educational environment. Medical teaching is an ongoing process for students and teachers to keep them up-to-date.10 Biggs and colleagues11 have developed a revised two factors study purpose questionnaire (R-SPQ-2F) which can be used to assess the learning approaches of students. The College of Medicine, King Saud University (KSU), is one of the oldest medical colleges in the region that introduced block curriculum teaching method in 2010.  This new curriculum was designed with high priority for student self–learning when compared to an earlier traditional (lecture method) curriculum. A 5-year curriculum for undergraduate medical students was designed as in such a way that during the first two years, students deal with the whole comprehensive subjects or blocks for the body systems. The middle year of the course (i.e., 3rd year), medical students will be involved in medicine, surgery and clinical practice after completion of the course for basic medical sciences. In the 4th year, students will be trained for clinical specialities' such as ENT, Orthopedics, Ophthalmology, Anesthesia, Obstetrics and Gynecology. While in the final year, students will complete the practice in medicine, surgery and paediatrics.  With the change of curriculum in this college, we are interested to know the learning approaches of our undergraduate medical students. Therefore, this study was designed to assess the learning approaches of 1st, 2nd and 3rd-year medical students by using R-SPQ-2F questionnaire and also to evaluate the reliability and validity of this questionnaire.

Methods

Study design and setting

For this cross-sectional study, we selected 622 participants from College of Medicine, King Saud University (KSU). Selected participants were both male and female undergraduates pursuing medicine starting from 1st year to 3rd year of the course. The selected participants' curriculum blocks were the foundation, CNS, medicine, surgery and obstetrics and gynaecology. Ethical approval for this study was granted by Institutional Review Board of the college of medicine, King Saud University. All the participants signed the consent form and were explained about the importance of this study.

Study participants

Out of initially selected 622 participants, only 610 (92.2%) showed interest and signed the consent form, and only those participants were included in this study who signed the informed consent. Among the selected participants, 221 were included in foundation block, 229 for CNS block and remaining 160 participants were accounted twice for Medicine and Surgery courses. For analysis purpose, the sample size was considered as 770. Out of 610 participants, 370(60.6%) were male.

Instrument and procedures

Data were collected using R-SPQ-2F questionnaire which was developed by Biggs colleagues11. The questionnaire measures the deep and surface learning approaches. Each approach consists of 10 items and all together will be 20 items. A 5-point Likert scale was used to evaluate both the approaches (1= never or only rarely true of me & 5= always or almost always true to me).  The outcome of R-SPQ-2F was determined as the learning approaches whether it was a deep approach (Sum of deep motive and deep strategic) or surface approach (Sum of surface motive and surface strategic). Also, data of participant's gender, place of living, place of studying, Grade point average (GPA), some study hours on normal days and number of study hours during examinations were collected. Data collection was carried out during 14-20 weeks of the first semester and between 1st to 3rd weeks of the second semester of the academic year.

Data analysis

Data were analysed using SPSS software, version 21.0. Descriptive statistics (mean & standard deviation) were used to describe the quantitative outcome variables. Student's t-test for the single sample was used to compare the mean score difference of deep and surface approaches. Student’s t-test for independent samples and one-way analysis of variance followed by Turkey's multiple range test was used to compare the mean values of quantitative outcome variable about the categorical study variable of two and more than two categories. Internal consistency of R-SPQ-2F was assessed using Cronbach’s alpha; convergent validity was evaluated using Karl Pearson’s correlation coefficient among the items, subscale scores and total scores.  The validity of R-SPQ-2F was determined by using factor analysis in which the correlation matrix, Kaiser-Meyer-Olkin (KMO) measurement of sampling adequacy and Bartlett’s test of sphericity were used to assess the factorability of the 20 items.  Factor structure was restricted to two factors in the factor extraction process by using a principal component method. The proportion of variance explained by each of the factors was assessed through Eigen-values. Varimax rotation was used to obtain the rotated factors. A p-value of ≤ 0.05 and 95% confidence intervals was used to report the statistical significance and precision of results.

Results

Of the 610 participants, a higher GPA (4.5 to 5) was held by 378(62%); 172 (28%) had 4- 4.49; the remaining 61(10%) participants had 3-3.99 GPA. The comparison of mean scores of deep and surface approaches for each of the four courses shows highly statistically significant difference in the mean scores in which the mean scores of deep approach are significantly higher than the mean scores of surface approach for all the four courses of the curriculum. This suggests that most of the participants during these four courses are adopting the deep approach (Table 1).

The comparison of the mean score of deep approach about gender, place of living, GPA, place of study, duration of daily study hours and duration of study hours during exams shows, statistically significant difference in the mean score for GPA categories and duration of daily study hours of participants. The deep approach learning approach mean score is significantly higher in the participants of GPA of 4-4.5 and 4.5 -5.0 when compared with participants of GPA with less than 4 (F(2,768) =13.31, p=0.001). Also, the mean score is significantly higher in the participants who spent 3- 5 hours and 5 to 10 hours during non-exam days when compared with participants who spent only 2 hours for their studies (F(2,768) =20.08, p=0.001), see  Table 2.

The internal consistency reliability of 20 items, two main factors (deep approach & surface approach) and its four sub scales (deep motive, deep strategy, surface motive and surface strategy) was assessed by calculating Cronbach's α. As we can see from Table 3, the average measure of Cronbach's α value of all the 20 items under the two factors, for the four types of curriculum and the whole group ranged from 0.673 to 0.711. For 10-items, Deep study approach is   0.703 to 0.775 whereas for Surface study approach is 0.730 to 0.763.  The values of Cronbach's alpha are close to the acceptable level of 0.70 which suggests a satisfactory estimate of the reliability of the questionnaire (see Table 3).

The correlation among the 20 items of an Instrument showed statistically significant correlation. The KMO measures the sampling adequacy which should be greater than 0.5 for a satisfactory factor analysis to proceed. The data show that KMO measure of 0.808 for all subjects, and for the participants of 4 curriculums, KMO values are: 0.743, 0.741.0.744 and 0.746 and Bartlett's tests of sphericity are significant (p=0.000). This indicates that the correlation matrix is not an identity matrix. The analysis of factors extraction along with their Eigen values, the percent of variance attributable to each factor, and the cumulative variance of the factors show that first factor accounts for 36.43% of the variance, the second factor accounts for 27.70% of the variance, with a cumulative variance of 64.13% for all subjects. A similar pattern was observed for the other four groups of the curriculum. The loadings of the 20 items on the two factors were extracted for all the participants and the participants of 4 group curriculum. The higher the absolute value of the loading, the more the factor contributes to the variable. The loading indicates that two factors have contributed to each of its ten items. The two factors are Deep approach with its 10-items (1, 2, 5, 6, 9, 10,13,14,17 & 18) and Surface approach with its 10-items (3, 4, 7, 8, 11, 12, 15, 16, 19 & 20, see Table 4).

Table 1. Comparison of mean scores of Deep Approach (DA) and Surface Approach (SA) learning methods of students during the curriculum course of foundation block, CNS block, Medicine and Surgery courses
Table 2. Comparison of mean values of Deep Approach method of learning in relation to the study variables (N=770)

Discussion

In all the medical schools, much attention is given to the periodical development of curricular content, the scheduling of teaching and the conducting of examinations. But little attention is given to assess the effect of these activities on the learning process of the students. The aim of this study was to assess the learning approaches among KSU medical students and to examine the validity and reliability of the R-SPQ-2F questionnaire. The results show that the deep approach scores of the study participants are higher than the surface approach scores. This suggests that participants in all three years with different subjects (foundation block, CNS block, medicine and surgery) in our medical college preferred the deep approach to learning as compared to the surface approach. The comparison of these study findings with other studies may be difficult due to the use of different instruments to evaluate the learning approaches of students (medical and non-medical) in various settings. But most of the results also emphasize on the deep approach to learning.12-14 A study by Samarakoon and colleagues10 that included the first and final year of medical undergraduate, postgraduate and trainee students observed that the learning approach was strategic with the VARK and ASSIST (Approaches to study skills Inventory for students) questionnaires.

Table 3. Internal consistency (Cronbach's Alpha) of revised two-factor approach Instrument for all items, 10-items of DA and 10-items of SA across the four groups (foundation block, CNS block, medicine and surgery) and all subjects

Another study by Ward et al15 using ASSIST questionnaire confirms deep approaches provide good results in their medical education. The mean scores of deep approaches by medical students were significantly higher in the study reported by Emilla et al16 by using SPQ (study process questionnaire).  In another study among Ghanaian medical students which had used R-SPQ-2F questionnaire also observed that deep approach was the most dominant learning among the students, which goes in line with our findings.7 By using ASSIST questionnaire, Cebeci and colleagues17 have found that medical students preferred deep and strategic approach rather than surface approach.  Similarly, Ravi and colleagues18 in their study had reported that second-year medical students had used deep and strategic learning styles. In contrast, the majority of first-year medical students of Erciyes University, Turkey were found to be using multimodal learning style which was assessed by using VARK questionnaire.19 The preference of deep approach of learning in our study participants is consistent with the study findings by Hilliard20 which demonstrates that medical students who adopted deep approach had higher scores when compared with those following surface approach for their learning. Results of this study also show that participants who had higher GPA (≥ 4.0) and those who spent more number of study hours (≥ 5 hours)  had significantly higher mean deep approach score than the other participants with less GPA and who spend a lower number of study hours. Similar to our findings, Lynch and colleagues6 in their study observed that academic performance is influenced by the learning styles among third medical students, but Wilkison and colleagues21 concluded that overall performance of first-year medical and dental students is not influenced by learning style. Another study among 1st-year medical students by Davies and colleagues22 found a significant impact of learning styles on their academic performance. Also, a positive correlation was observed between the learning approaches and the academic performance among the 3rd to 5th-year medical students.20 Like other studies, our findings also indicate that participants were achieving higher GPA (academic performance) by following the deep approach to their learning.

Table 4. Factor loadings of two factors Instrument of study approaches (Deep and Surface) across the four groups (foundation block, CNS block, medicine and surgery) and all study subjects

Our study results revealed the reliability and validity with R-SPQ-2F questionnaire and showed positive levels of internal consistency for these two factors (0.737 for deep approach and 0.746 for surface approach). The total variance explained by the two factors of R-SPQ-2F was 64.13%. Our analysis of construct validity (i.e., factor analysis) identified deep, and surface approaches in R-SPQ-2F across the four curriculum groups of our study participants. A variance of 49.80% and 33.57% for two factors (deep and surface) was found among the Ghanaian medical students.7 Similar results of validity and internal consistency of Arabic version of this questionnaire were reported in another study in a sample of 85 high school graduates in KSA.8,16 Another study which was carried out among non-medical students in Malaysia showed evidence of good reliability and validity of this questionnaire.23 High internal consistency and good validity of our study results confirm the application of this questionnaire to measure the method of learning approach medical students across other medical schools in KSA. Rahman and colleagues24 also recommended using this questionnaire to measure the learning approaches of university students, by obtaining the high Cronbach alpha values and valid two-factor structure in university students of Malaysia.

The strength of this current study was big sample size and high response from the study participants. The limitation of this study is of participant’s recall bias in responding to 20 items of a study process questionnaire used in this study.

Conclusions

Learning approach among the participants of our study is significantly inclined towards deep approach rather than surface approach. The deep approach to learning in our participants could be due to the component of self-learning by students in the curriculum structure of our college. Future studies could be carried out using another validated questionnaire to further confirm the observed learning approach (deep) of our study participants and to know any changes in learning approaches of medical students from time to time. This will enable the medical education experts to carry out the appropriate changes in the curriculum. Also, this study confirms the internal consistency and constructs validity of the R-SPQ-2F questionnaire. 

Acknowledgments

The authors extend their appreciations to the College of Medicine Research Centre, Deanship of Scientific Research, King Saud University, Riyadh, Kingdom of Saudi Arabia for financial support. We would like to thank students for their participation in this research. We would also like to thank male and female group leaders who helped us during data collection.

Conflict of Interest

The authors declare that they have no conflict of interest.

References

  1. Shah DK, Yadav RL, Sharma D, Yadav PK, Sapkota NK, Jha RK and Islam MN. Learning approach among health sciences students in a medical college in Nepal: a cross-sectional study. Adv Med Educ Pract. 2016; 7: 137-143.
    Full Text PubMed
  2. Shukr I, Zainab R and Rana MH. Learning styles of postgraduate and undergraduate medical students. J Coll Physicians Surg Pak. 2013; 23: 25-30.
    PubMed
  3. Ranasinghe P, Ellawela A and Gunatilake SB. Non-cognitive characteristics predicting academic success among medical students in Sri Lanka. BMC Med Educ. 2012; 12: 66.
    Full Text PubMed
  4. Sadler‐Smith E. Learning styles: a holistic approach. Jnl Euro Industrial Training. 1996; 20: 29-36.
    Full Text
  5. Wehrwein EA, Lujan HL and DiCarlo SE. Gender differences in learning style preferences among undergraduate physiology students. Adv Physiol Educ. 2007; 31: 153-157.
    Full Text PubMed
  6. Lynch TG, Woelfl NN, Steele DJ and Hanssen CS. Learning style influences student examination performance. Am J Surg. 1998; 176: 62-66.
    PubMed
  7. Mogre V and Amalba A. Assessing the reliability and validity of the Revised Two Factor Study Process Questionnaire (R-SPQ2F) in Ghanaian medical students. J Educ Eval Health Prof. 2014; 11: 19.
    Full Text PubMed
  8. Munshi FM, Al-Rukban MO and Al-Hoqail I. Reliability and validity of an Arabic version of the revised two-factor study process questionnaire R-SPQ-2F. J Family Community Med. 2012; 19: 33-37.
    Full Text PubMed
  9. Gibbs G. Improving the quality of student learning: based on the improving student learning project funded by the council for national academic awards. Technical and Educational Services, Bristol: UK; 1992.
  10. Samarakoon L, Fernando T and Rodrigo C. Learning styles and approaches to learning among medical undergraduates and postgraduates. BMC Med Educ. 2013; 13: 42.
    Full Text PubMed
  11. Biggs J, Kember D and Leung DY. The revised two-factor Study Process Questionnaire: R-SPQ-2F. Br J Educ Psychol. 2001; 71: 133-149.
    PubMed
  12. Choi KR, Kim D, Jang EY, Bae H and Kim SH. Reliability and validity of the Korean version of the lifetime stressor checklist-revised in psychiatric outpatients with anxiety or depressive disorders. Yonsei Med J. 2017; 58: 226-233.
    Full Text PubMed
  13. Esbjørn BH, Breinholst S, Niclasen J, Skovgaard LF, Lange K and Reinholdt-Dunne ML. Identifying the best-fitting factor structure of the experience of close relations - revised in a Scandinavian example. PLoS ONE. 2015; 10: 0137218.
    Full Text PubMed
  14. Morlock R, Wirth RJ, Tally SR, Garufis C and Heichel CWD. Patient-reported spectacle independence questionnaire (PRSIQ): development and validation. Am J Ophthalmol. 2017; 178: 101-114.
    Full Text PubMed
  15. Ward PJ. Influence of study approaches on academic outcomes during pre-clinical medical education. Med Teach. 2011; 33: 651-662.
    Full Text PubMed
  16. Emilia O, Bloomfield L and Rotem A. Measuring students' approaches to learning in different clinical rotations. BMC Med Educ. 2012; 12: 114.
    Full Text PubMed
  17. Cebeci S, Dane S, Kaya M and Yigitoglu R. Medical students' approaches to learning and study skills. Procedia - Social and Behavioral Sciences. 2013; 93: 732-736.
    Full Text
  18. Shankar PR, Dubey AK, Binu VS, Subish P and Deshpande VY. Learning styles of preclinical students in a medical college in western Nepal. Kathmandu Univ Med J (KUMJ). 2006; 4: 390-395.
    PubMed
  19. Baykan Z and Naçar M. Learning styles of first-year medical students attending Erciyes University in Kayseri, Turkey. Adv Physiol Educ. 2007; 31: 158-160.
    Full Text PubMed
  20. Hilliard RI. How do medical students learn: Medical student learning styles and factors that affect these learning styles. Teaching and Learning in Medicine. 1995; 7: 201-210.
    Full Text
  21. Wilkinson T, Boohan M and Stevenson M. Does learning style influence academic performance in different forms of assessment? J Anat. 2014; 224: 304-308.
    Full Text PubMed
  22. Davies SM, Rutledge CM and Davies TC. The impact of student learning styles on interviewing skills and academic performance. Teaching and Learning in Medicine. 1997; 9: 131-135.
    Full Text
  23. Choo PGS. Assessing the approaches to learning of twinning programme students in Malaysia. Malaysian Journal of Learning and Instruction. 2006;3:93-116.
  24. Rahman WRA, Dzulkifli MA, Sulaiman WSW. Reliability of second-order factor of a revised two-factor study process questionnaire (R-SPQ-2F) among university students in Malaysia. AJTLHE: ASEAN Journal of Teaching and Learning in Higher Education. 2013;5(2):1-13.