Brookes eJournal of Learning and Teaching
Promoting good practice in Learning, Teaching and Assessment in Higher Education
| Updated: 11/10/05 | Brookes > Publications > BeJLT > Tracking the Academic Progression of Home and International Students | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Tracking the Academic Progression of Home and International Students:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Year 1 | Year 2 | Year 3 | Average | |
|---|---|---|---|---|
|
All students |
57.1% |
55.1% |
57.5% |
56.6% |
|
UK students |
59.1% |
57.8% |
60.5% |
59.2% |
|
Non-UK students |
53.3% |
49.8% |
52% |
51.8% |
Note: N = 142 (90 students from the UK and 52 from abroad)
Table 2. Students䴜 average marks per year and over the 3 years
| Year 1 | Year 2 | Year 3 | Average | |
|---|---|---|---|---|
|
Chinese students |
53.1% |
45.3% |
47.9% |
48.8% |
|
Other non-UK students |
53.4% |
51.6% |
53.2% |
52.9% |
Note: N = 52 (18 students from China and 34 from other nationalities)
Perhaps, the most significant and reliable empirical trend emerging from the evidence gathered, is that unveiled by the analysis of the full dynamics of performance over the three years of study. This interpretative route reveals a clear and distinctive pattern common to all sub-groups of students in the sample, according to which there is a substantial drop in the average marks from year 1 to year 2 (ranging from 䴋1.3% for UK students to 䴋7.8% for Chinese students) followed by a recovery in the marks obtained in the final year (+2.7% for UK students, +2.6% for Chinese students, and +1.6% for other international students). The observed differences being statistically significant at the 95% confidence level. The consistency of this pattern across all sub-groups of our sample may well be a reflection of the progression embedded in the curriculum of this degree programme. If so, it portrays a picture that offers both alarming as well as reassuring features.
The most alarming feature relates to the striking decline in marks experienced particularly by Chinese students during the second year of study. Contrary to our expectations, these students appear to cope relatively well in the first year (they display a performance which is line with that of other international students) in spite of all the additional challenges they face during the initial adjustment period. However, the same students appear to seriously struggle in the second year of the programme, where their annual average mark drops from 4.3% above their equilibrium level of performance to 3.5% below it. There are a number of plausible explanations that can be advanced to cast light on this evidence.
First, introductory modules, partly due to large number of students registered, tend to make a more extensive use of multiple choice tests (MCTs) and less use of essay-type examinations than 䴝Stage Two䴜 modules. By virtue of ease and accuracy of computer marking, MCTs are seen as the most efficient means for assessing large classes. Although they are not immune to cultural bias (in the form of alternative reasoning, wording nuances, etc.) they are a more culturally fair assessment method than examinations. Indeed, as suggested by De Vita (2002), by requiring students to organise, synthesise, and express knowledge at speed, examinations may well be measuring writing skills in English as much as, or even more than, academic knowledge. It should also be noted that students who are not proficient in writing skills might, with alternative answer options to choose from, be encouraged by MCTs to engage in recall activities. Meanwhile exam questions, with the extra demand of having to put often complex ideas into writing, may actively discourage a response. This is what Harris (1995) calls the 䴝intellectual self-censorship of second language students: if one cannot express an idea, the idea will not appear䴜 (p. 89).
A rather different argument is that, in the first year of study, students take introductory modules that entail fairly basic numerical and computing skills. These are generally considered areas of strength in the portfolio of competencies that international students, particularly Chinese students, usually bring with them. Although advanced modules with highly technical content are also available as electives in year 2 and year 3, these 䴝Stage Two䴜 modules focus more on, and hence are assessed on the basis of, the interpretation, evaluation and strategic use of data rather than data analysis per se.
It could also be that the academic level of the first year is perhaps too low. This may create a false sense of adequacy and lead to underestimating the challenge posed by 䴝Stage Two䴜 modules. However, it is not clear from our data why international students, particularly Chinese students, would be so disproportionately affected, compared to UK students, by wrongly set expectations. The most logical explanation that comes to mind is, again, related to the issue of competence in the English language. As the academic demands shift from understanding, internalising, and applying new knowledge to a more critical and questioning approach to theory, English competence requirements also increase, from the basic technical skills of writing (using correct grammar, syntax, and spelling) to a degree of language competence that entails awareness of academic literacies. As noted by Newell-Jones et al. (2004), the challenges of engaging in academic discourse, of recognising the multiple literacies in use and the power relations connected with them, and of developing the skills required in choosing the appropriate literacy for a given communicative practice, add another dimension to the issue of English competence. This may well leave international students, particularly Chinese students, less equipped to respond effectively to these new requirements.
Finally, it should be acknowledged that the first year of our Business and Management programme is characterised by a very strong academic support system (ranging from the enhanced role of the seminar leader to study-skills workshops and initiatives such as Peer Assisted Learning). That does not carry through, at least to the same extent, to the second and third years of the programme, where it is generally expected that all students have become familiar with 䴝the way things ought to be done䴜.
Although it is difficult to quantify the relative importance of the explanations given above, it seems reasonable to suggest that it is a combination of all of them, rather than a single one, that determines the observed trend.
The most reassuring feature of the pattern emerging from our data relates to the significant rise in the annual average from the second to the third year. First, it is reassuring because, if it is true that the progression already embedded in the demands of the curriculum does not differ significantly between year 2 and year 3, this 䴝terminal trend䴜 could be the one that most accurately reflects the actual rate of improvement in the learning achievements of students. In fact, it is likely still to underestimate 䴝net progression䴜 since by virtue of greater emphasis on the demonstration of independent learning (exemplified by the dissertation) and higher-order cognitive skills (such as the synoptic capacity), the academic demands of the third year are that much greater than those of the second year. There are, therefore, at least some identifiable elements of vertical development taking place in the final year of the programme. It is also reassuring to see that following the stark reduction in marks in year 2, the rise in the annual average of Chinese students taking place in the third year is similar to that of UK students (though starting from a much lower base) and even higher than that of other international students.
A rather cynical interpretation of the 䴝terminal velocity䴜 effect discussed above, would be that, by the third year, all students have learned how to 䴝play the game䴜, have become more strategic in their choice of modules and have developed a more instrumental or outcome-driven approach to studying. It should also be noted that most, if not all, of the modules taken in year 3 count for the computation of the final degree classification. Raising the level of extrinsic motivation in students may, in turn, incentivise them to 䴝raise their game䴜 and put in extra effort when it matters most. However, whatever the reason, the fact remains that by this stage, all students are better equipped to achieve the learning outcomes set in front of them.
Students䴜 perceptions of their own progression and performance
The analysis of the data can be further enriched by unveiling the students䴜 understanding of the terms 䴝academic progression䴜 and 䴝performance䴜, and their perceptions of their own learning and achievement over the three years of study. In particular, we are interested in establishing whether students䴜 views can shed light on the extent to which lack of improvement in performance can be explained by increasing curricular demands. With this aim in mind, an end-of-course questionnaire was distributed to the same cohort of students.
Student responses revealed a fairly uniform understanding of academic progression as a continuous process of learning and development. More specifically, the term was mostly associated with 䴝increased understanding䴜, 䴝expanded academic ability䴜, and 䴝intellectual growth䴜 over time. This conception contrasts with students䴜 views of performance, almost unanimously defined as an indicator based on marks describing 䴝the standard you are at a particular point in time䴜. Direct comparison of the two concepts led to the following comments (reproduced verbatim):
䴝Performance is at a single point in time while progression is an on-going process.䴜
䴝Progression places more emphasis on development whereas performance is based more on grades achieved.䴜
䴝Academic progression is more difficult to measure and is often not rewarded.䴜
䴝Progression recognises your past history.䴜
䴝Performance is about grades rather than improvements made.䴜
䴝Academic performance can remain 䴝static䴜, at the same level. Progression shows improvement, a gradual learning process.䴜
䴝Progression is about personal development of skills and knowledge. Performance is relative to staff/University criteria.䴜
These comments are insightful in that in addition to confirming students䴜 awareness of the dynamic temporal properties of the notion of progression, they also depict it as a construct more closely associated with personal and intellectual development, rather than one merely based on academic performance over time.
Students were also asked to specify what they considered to be the most appropriate criteria for measuring academic progression. The most frequent answers pointed to 䴝genuine improvement in the quality of the work䴊not the marks䴜, 䴝greater depth of understanding䴜, 䴝ability to work critically䴜 as well as 䴝the content and presentation of the work䴜. Other factors cited included 䴝increased self-confidence䴜 and 䴝improvements in IT, problem solving, and communication skills䴜.
Students were then asked to apply these criteria to their learning experience over the three years of their programme of study. As shown in Table 3, the results indicate that the vast majority of UK students (78.4%) felt they had experienced a 䴝substantial improvement䴜. Non-UK students䴜 perception of their own academic progression was equally positive (though slightly more modest), with only 5% of them claiming that no improvement had taken place.
Table 3. Students䴜 perceptions of their own academic progression
| No improvement | Marginal improvement | Substantial improvement | |
|---|---|---|---|
|
All students |
2.8% |
26.8% |
70.4% |
|
UK students |
2% |
19.6% |
78.4% |
|
Non-UK students |
5% |
45% |
50% |
Note: 71 questionnaires were returned, 51 from UK students and 20 from international students.
Students䴜 self-assessments of progression assume even greater significance when cross-referenced to the answers they gave in relation to their actual perceptions of their performance as measured by the marks achieved over the three years of study. As shown in Table 4, only 15% of the home students who felt they had experienced a 䴝substantial improvement䴜 thought that this was mirrored by a corresponding increase in their marks. The bulk of them reported only a slight (57.5%) or no increase (22.5%) in their marks. Of those UK students who had reported a 䴝marginal improvement䴜 in academic ability, 40% acknowledged an equivalent increase in marks. Another 40% of them stated that their marks had stayed the same, while 20% observed a slight to substantial decline in their marks.
Table 4. Students䴜 perceptions of progression vs performance over the 3 years
| UK Students | Non-UK Students | |||||
|---|---|---|---|---|---|---|
|
improvement: |
None |
Marginal |
Substantial |
None |
Marginal |
Substantial |
|
Increased substantially |
------- |
------- |
15% |
------- |
------- |
------- |
|
Increased slightly |
------- |
40% |
57.5% |
------- |
22.2% |
10% |
|
Stayed the same |
100% |
40% |
22.5% |
------- |
33.3% |
50% |
|
Decreased slightly |
------- |
10% |
2.5% |
100% |
33.3% |
40% |
|
Decreased substantially |
------- |
10% |
2.5% |
------- |
11.2% |
------- |
This gap between home students䴜 perceptions of improved academic ability and an at best slight increase in performance (as measured by their marks) appears to be even greater in the case of non-UK students. Of the non-UK students who felt they had experienced a substantial improvement in academic ability none reported an equivalent increase in performance over the three years while a staggering 40% thought that their marks had in fact slightly decreased. Non-UK students who felt they had experienced only a marginal improvement in academic ability had an even more negative perception of their performance over time, with almost 45% stating that their marks had seen a slight to substantial decline.
Overall, the results of the students䴜 responses seem to corroborate the hypothesis that probably due to the increasing academic demands of the stages of the programme as it unfolds, even performance over time is an inadequate measure of progression, one which fails to reflect the intellectual development and actual improvement in academic ability that students perceive to have experienced.
Finally, in comparing the learning achievements of home and international students, it should also be recognised that the value-added of studying abroad goes well beyond what is identifiable through measures of academic performance or even progression. The benefits of studying abroad are far more wide-ranging than this. They include better labour market prospects, as well as the acquisition of extracurricular skills like language fluency, cross-cultural competence, and a wider social network (Opper et al., 1990).
Practical recommendations
The obvious implication of the findings of this study, is the need to devote greater attention to the difficulties experienced by students, particularly international students from China, in coping with the greater academic demands placed upon them in the second year of study. In what follows, three main recommendations are put forward.
The first recommendation involves sharing these findings with students in an attempt to remove any complacency and give them the opportunity to better prepare for the challenges embedded in the transition from year 1 to year 2 of the programme.
Second, there seems to be a need for a continuous and more purposefully targeted form of academic support. This might require staff and students working together to establish a system whereby explicit and truly formative assessment feedback (see, for example, Nicol and MacFarlane-Dick, 2005) directly informs students䴜 personal development plans. These plans would provide a dynamic framework for promoting the continuing growth of students䴜 capabilities and powers, including that of taking greater responsibility for their own learning and development.
Finally, the importance of helping students develop their academic literacies needs to be emphasised with renewed vigour across all the 䴝Stage Two䴜 modules of the undergraduate Business and Management programme. More specifically, the explicit integration of exercises in discourse analysis would seem to be a particularly useful approach to help students recognise that, in academic discourse, language is never neutral or merely descriptive. More often than not, language is the product of a philosophical, ideological and political enterprise that generates a framework for analysing, interpreting and promoting particular objects, subjectivities, and power relations. The context-specific nature of discourse analysis suggests that these exercises would best be carried out at module level, possibly as part of the briefings offered to guide students on their assessment tasks, rather than in 䴝stand alone䴜 study skills workshops undertaken at programme level.
Conclusions
This paper set out to explore the learning achievements of home and international students by focusing on the dynamic construct of academic progression as opposed to the traditional measures of final grades or degree classifications.
Our data have confirmed that, on average, UK students outperform international students. The observed differential is particularly pronounced with respect to the academic achievements of home students vis-ÌÊ-vis students from China. This is the case in terms of both the average marks in each year, and the overall average over the three years of the programme. Additionally, a comparative static analysis of the average marks of the first and final year reveals that while UK students‰¥ú annual average in year 3 is 1.4% higher than that recorded in the year of entry, Chinese and other international students display a decline of 5.2% and 1.3% respectively. However, the study also offers evidence suggesting that it would be erroneous to take these static snapshots of performance as evidence symptomatic of an absence of academic development. Indeed, our analysis of the full dynamics of performance shows that following a moderate to substantial decline in average marks from the first to the second year of study‰¥äwhich can be rationalised on the basis of higher curricular demands‰¥äall sub-groups examined display a significant rise in their average marks from the second to the final year of study. Our results also cast doubt on the generally held view that as a result of the additional challenges faced during the initial adjustment period, international students, especially from China, tend to under-perform in their first year of study. On the contrary, our data indicate that the greatest difficulties faced by these students occur during the transition from the first to the second year of study.
Students䴜 views have validated the hypothesis that due to the rising standards across the sequential stages of the programme of study, i.e. due to the academic development already embedded in the curriculum, even the construct of 䴝performance over time䴜 is an inadequate measure of progression, one which, taken in isolation, fails to reflect the actual improvement in academic ability.
Overall, the analysis of students䴜 academic progression has also revealed itself as a valuable tool that enables us to evaluate the developmental properties of the curriculum underpinning the programme䴜s objectives.
With respect to future research, this contribution points to several avenues that could be profitably pursued. Here at Brookes, the newly established semesterisation model has prompted a significant redesign of our undergraduate programme. Once a full cohort of students has completed a Business and Management degree under the new system it would be opportune to replicate this analysis to establish whether changes in the structure, content, and format of the curriculum have led to a smoother transition from year 1 to year 2 and/or to a stronger differentiation between the academic level of the second and third year of study. Analogous analyses focusing on the effect of placements on students䴜 progression pattern, and on the progression pattern exhibited by international credit entry students would represent interesting extensions to this line of inquiry. Replication studies across disciplines and institutions would also be valuable.
Acknowledgements
The support of Oxford Brookes University in the form of a Teaching Fellowship is gratefully acknowledged. I also wish to thank numerous colleagues in the Department (particularly Catherine Wang) as well as the PLLnet discussion group for their valuable comments.
Biography
Glauco De Vita is a Reader in International Business Economics and a University Teaching Fellow. His research interests include international business education and cross-cultural pedagogies.
Contact details
Email:
References:
Andrews, T., Dekkers, J. and Solas, J. (1998), 䴝What really counts? A Report on a Pilot Investigation Identifying the Significance of Learning Style and Cultural Background for Overseas Students in Flexible Learning Environments䴜, in Proceedings of the 3rd International Conference on Open Learning, Brisbane: Queensland Open Learning Network.
Ballard, B. and Clanchy, J. (1997), Teaching International Students: A Brief Guide for Lecturers and Supervisors, Canberra: IDP Education Australia.
Biggs, J. (1997), 䴝Teaching Across and Within Cultures: The Issue of International Students䴜, In Murray-Harvey, R. and Silins, H. C. (eds.) Learning and Teaching in Higher Education: Advancing International Perspectives, Adelaide: HERSDA, pp. 1-22.
De Vita, G. (2000), 䴝Inclusive Approaches to Effective Communication and Active Participation in the Multicultural Classroom: An International Business and Management Context䴜, Active Learning in Higher Education, 1(2), pp. 168-180.
De Vita, G. (2001), 䴝Learning Style, Culture and Inclusive Instruction in the Multicultural Classroom: A Business and Management Perspective䴜, Innovations in Education and Teaching International, 38(2), pp. 165-174.
De Vita, G. (2002), 䴝Cultural Equivalence in the Assessment of Home and International Business Management Students: A UK Exploratory Study䴜, Studies in Higher Education, 27(2), pp. 221-231.
Harris, R. (1995), 䴝Overseas Students in the United Kingdom University System䴜, Higher Education, 29, pp. 77-92.
Newell-Jones, K., Osborne, D. and Massey, D. (2004), 䴝Academic Skills Development 䴋 Changing Attitudes Through a Community of Practice䴜, Brookes E-journal of Learning and Teaching, 1(2).
Nicol, D. J. and MacFarlane-Dick, D. (2005), 䴝Formative Assessment and Self-regulated Learning: A Model of Seven Principles of Good Practice䴜, Studies in Higher Education, forthcoming.
Opper, S., Teichler, U. and Carlson, J. (1990), Impacts of Study Abroad Programmes on
Students and Graduates, London: Jessica Kingsley Publishers.
Pearson, C. A. L. and Beasley, C. J. (2000), 䴝An Evaluation of an Integrative Framework of Student Characteristics and Learning Approaches䴜, (Available from the world wide web at: www.qut.edu.au/daa/asdu/fye/abstracts/Pearson&BeasleyAbstract.htm).
Smith, P. J. and Noi Smith, S. (1999), 䴝Differences Between Chinese and Australian Students: Some Implications for Distance Educators䴜, Distance Education, 20(1), pp. 64-80.
Volet, S. and Renshaw, P. (1996), 䴝Chinese Students in an Australian University: Continuity and Adaptability䴜 In Watkins, D. and Biggs, J. (eds.) The Chinese Learner: Cultural, Psychological and Contextual Influences, Hong Kong: Centre for Comparative Research in Education, pp. 205-220.
| Previous Issue: |
|---|
| Information: |
|---|
| Contents: |
|---|
| Download |
|---|
