4: Analysis

[next chapter] [previous chapter] [contents]


4.1 Introduction

The movement of students through the higher education system is likely to vary by the characteristics of the students and by field and level of study. Aggregate models provide useful information towards the understanding of the dynamics of the system. However, they alone cannot provide the details necessary to understand the behaviour of particular groups of students. Thus, whenever possible a separate input-output model is estimated for each group of students defined by sex, field of study and level of course. The disaggregation is limited by the need to ensure that there are sufficient number of student movements from one state of the system to another from which transition proportions can be estimated.

The general model building procedure is described in Section 4.2. The results from fitting and estimating input-output models to various groups of students at the undergraduate and postgraduate level are given in Section 4.3 and Section 4.4. The groups at the undergraduate level are defined by field of study, and that at the postgraduate level by level of course. For each of these groups three models are estimated, one for all persons in the group and one each for males and females.

Two sets of results are reported. The first set contains the summary statistics that emanate from approximating the input-output model as a regular Markov chain. For example, estimates are derived of the probability of a student completing a course given the student's age at course commencement and the average time to completion. The second set of results are a summary of the projections of the number of students at various stages of the system until the year 2001. Only projections based on one set of assumptions are included. Future work will include sensitivity analysis and alternate models for projecting the number of commencing students.

4.2 Model Building

The procedure described below is general in nature and applies to all the input-output models that are developed and estimated. As a first step to constructing an input-output model the transient states must be defined. We define these states by age and year of enrolment in course. To ensure that all transition proportions are defined there must be at least one student in each transient state in 1993.

Next, tables showing the age of students by the time, in years, that they have been enrolled are extracted from each of the DEET course enrolment files of 1993 and 1994 and the course completions file for 1993. Data in these three cross-tabulations provide the basis for constructing the input-output matrix.

Students in a given transient state in 1993 move to another transient state in 1994, complete the course or drop out. The only unknown quantity is the number who drop out. However, this can be calculated because the other two quantities are known. Careful attention has to be paid when considering movements to and from states defined by grouped ages and multiple year of enrolment, such as being between 25 and 29 years of age and in the sixth or higher year of enrolment.

In theory the above process should result in an input-output matrix with a non-negative quantity in each cell. In practice, it was found that some of the movements into the dropout absorbing state were negative. This means that the compilation of the enrolment and completions data files is not consistent. There are two possible causes for these negative values. First, it could be a data recording error, and resources are not available, at this stage, to confirm whether indeed this is the case. The second possibility, which is more likely, is that there is a variation across institutions in the way completions data are recorded. Anecdotal evidence suggests that some institutions record a student as having completed a course when that student has satisfied all the requirements for the course, while others only record a completion when the student applies for graduation. There may also be other reasons why there is a lack of consistency between the enrolment and completions data.

The negative dropout values are a nuisance because they prevent a complete analysis of the dynamics of the system. In general, the negative values were very small in absolute terms and were more often than not associated with movement from transient states defined by an older age group and year of enrolment which was usually more than 3. It was decided to perturb some of the completions figures in order to eliminate the negative dropout numbers. The procedure for perturbing, which is ad hoc in nature, is described in the appendix to this report. A consequence of the perturbation is that the time to completion statistics may be slightly deflated. Since the magnitude and the number of perturbation is small, we assume the bias will be negligible.

The next step in the model building involves the calculation of the matrix of transition proportions, Q, and the matrix R of proportions moving into the absorbing states. The model can now be estimated as outlined in Chapter 2.

4.3 Undergraduates

Students were divided into eleven age groups. Associated with each age group are up to six year of enrolment categories. The resulting model consists of 51 transient states. These are marked by a cross in Table 4.1.

Although a typical state such as being a 20-year-old and in the second year of enrolment means precisely that, the last state in each row in Table 4.1 is to be interpreted differently. For example, being under 18 years of age and in the first year of enrolment means being under 18 years old and in the first or higher year of enrolment, and being a 22-year-old and in the sixth year of enrolment means being 22 years old and in the sixth or higher year of enrolment. This sort of aggregation is necessary to contain the size of the input-output model. It is unlikely that there will be many under 18-year-olds in their second year of enrolment, and even less likely that there will be many in the third or higher year of enrolment.

Table 4.1 Transient States of the Model for Undergraduates Defined Using Age and Year of Enrolment as Criteria

Year of Enrolment in Course
Age1 2 34 5 6
Under 18X
18X X
19X X X
20X X XX
21X X XX X
22X X XX X X
23X X XX X X
24X X XX X X
25-29X X XX X X
30-34X X XX X X
Over 34X X XX X X
Note: Across indicates that the transient state is included in the model

Three models, one each for males, females and persons, were estimated for each of the following groups of undergraduates:

Models for students doing Agriculture, Education (O) and Medicine could not be estimated satisfactorily as there was too much inconsistency between the course enrolment and completions data. The consequence of the inconsistency was that the movement between 1993 and 1994 of a large number of students could not be reconciled. Australian students were considered on their own because they make up the bulk of the students and they are also the primary concern of this study. Models for all students were estimated for use as a benchmark for other models.

Probability of Completing Course

Table 4.2 shows the estimates of the probability of a student completing a course given his/her age at course commencement. For example, an Australian male student who starts as an undergraduate at the age of 18 years has a 58 percent chance of eventually completing the course, while an Australian female student of the same age has a 66 percent chance of completing. There is considerable variation in these probabilities between males and females, across age groups and fields of study. However, there is hardly any difference in the estimated probabilities for all students and just Australian students. This may be due to the behaviour of the overseas fee-paying students not being significantly different to that of Australian students, and even if the behaviour was different the number of overseas fee-paying students is relatively small to have much impact on the estimated probabilities.

If we concentrate on the results for the Australian group, there is a clear indication that females have a higher chance of completing a course than males irrespective of what age the course is commenced at. However, the difference in the probabilities between male and female completion of a course varies with the age at which the course is commenced. This difference can be as high as 10 percentage points, for example, if the course is commenced at an age of 20 years. In general, as the age at which a course is commenced increases, the chances of completing the course diminish for both gender groups. For both males and females the highest chance of completing a course is if the commencement age is 20 years, at which age the probability for a female completing is 79 percent and that for a male 69 percent. Among the females, those aged between 25 and 29 years have the least chance of completing the course, while the corresponding age for males is 30 to 34 years.

Table 4.2 Probability of Completing an Undergraduate Course by Age at Course Commencement

Age at Course
All
Australian
Architecture
Arts
Business
Commencement
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
0.62
0.66
0.64
0.62
0.66
0.64
0.68
0.69
0.69
0.55
0.64
0.61
0.64
0.63
0.64
18
0.59
0.66
0.63
0.58
0.66
0.62
0.69
0.73
0.71
0.54
0.63
0.61
0.60
0.66
0.62
19
0.64
0.73
0.69
0.63
0.72
0.68
0.56
0.64
0.60
0.65
0.69
0.68
0.63
0.66
0.64
20
0.69
0.78
0.73
0.69
0.79
0.74
0.65
0.74
0.71
0.67
0.81
0.77
0.78
0.73
0.76
21
0.67
0.73
0.70
0.67
0.73
0.70
0.72
0.87
0.72
0.62
0.74
0.70
0.65
0.64
0.63
22
0.60
0.69
0.65
0.59
0.69
0.64
0.56
0.87
0.60
0.63
0.62
0.62
0.53
0.54
0.54
23
0.59
0.67
0.63
0.57
0.66
0.62
0.62
0.72
0.70
0.56
0.62
0.59
0.52
0.50
0.51
24
0.57
0.64
0.61
0.56
0.63
0.60
0.65
0.79
0.64
0.56
0.60
0.59
0.49
0.44
0.47
25-29
0.54
0.61
0.58
0.54
0.61
0.58
0.52
0.58
0.52
0.55
0.56
0.56
0.46
0.43
0.45
30-34
0.51
0.62
0.58
0.52
0.62
0.58
0.37
0.64
0.42
0.58
0.59
0.59
0.40
0.39
0.40
Over 34
0.51
0.63
0.59
0.53
0.63
0.60
0.36
0.64
0.42
0.55
0.60
0.59
0.36
0.32
0.34
Education (I)
Engineering
Health
Law
Science
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
0.50
0.67
0.64
0.54
0.55
0.54
0.63
0.65
0.65
0.83
0.80
0.81
0.61
0.61
0.61
18
0.52
0.66
0.63
0.50
0.60
0.52
0.61
0.64
0.63
0.95
0.95
0.95
0.57
0.65
0.61
19
0.47
0.69
0.63
0.60
0.70
0.62
0.64
0.83
0.79
1.00
1.00
1.00
0.57
0.62
0.59
20
0.54
0.68
0.63
0.54
0.66
0.55
0.72
0.86
0.83
0.95
0.91
0.91
0.71
0.85
0.76
21
0.56
0.64
0.62
0.60
0.42
0.58
0.82
0.81
0.80
0.81
0.80
0.81
0.74
0.88
0.80
22
0.48
0.68
0.64
0.44
0.48
0.45
0.70
0.74
0.72
1.00
1.00
1.00
0.65
0.83
0.72
23
0.52
0.69
0.64
0.54
0.59
0.55
0.61
0.78
0.75
0.88
0.75
0.83
0.58
0.61
0.59
24
0.52
0.60
0.56
0.53
0.27
0.50
0.61
0.75
0.72
0.52
0.75
0.62
0.53
0.61
0.56
25-29
0.58
0.62
0.60
0.48
0.33
0.47
0.68
0.72
0.71
0.67
0.71
0.69
0.50
0.56
0.52
30-34
0.68
0.61
0.63
0.50
0.42
0.50
0.56
0.73
0.70
0.58
0.68
0.62
0.42
0.52
0.45
Over 34
0.68
0.73
0.71
0.41
1.00
0.44
0.60
0.73
0.71
0.64
0.66
0.65
0.37
0.46
0.40

The comparison of the probabilities across fields of study reveal that, in general, Engineering students have the least chance of completing and Law the highest. If it was possible to model the behaviour of students in Medicine, then we would expect them to also have a very high chance of completing a course. Some estimates of the probabilities, if calculated on the basis of movements of only a small number of students, may not be all that reliable. For example, there are not all that many older females doing Engineering or Architecture, and hence, the estimates relating to these groups may be unstable.

In general, females have a higher chance than males of completing a course in Architecture, Arts, Education (I), Health and Science. In the other fields of study this pattern is not nearly as uniform across different course commencement ages. In Business the differences between the male and female chances are relatively small, with the maximum of only 5 percentage points for students commencing the course at the age of 20 years.

A person commencing a course in Business or Engineering at an age of 24 years or more has a 50 percent or less chance of completing it, and a person commencing a course in Architecture or Science at an age over 29 years has a less than even chance of completing it. In all other fields of study a person has better than even chance of completing a course, irrespective of the age of the student when the course was commenced.

Time in the System

The estimates of the mean and the standard deviation of the time spent in the system (number of years of enrolment in a particular course) by a student is given in Tables 4.3 and 4.4, respectively. A number of factors affect these estimates, but at this stage it is not possible to isolate, or measure, the impact of any one of them because of lack of data. The factors which are likely to have an impact are:

Table 4.3 shows that the mean time in the system varies by the age of the student when he/she commenced a course, gender and field of study. The mean time is 3.2 years for persons starting a course when they are 18 years old. In general, there is a steady decline in the mean time as the age at which a course is commenced increases, until around a course commencement age of 21 to 22 years when the minimum mean time in the system of 2.6 years is reached. A steady increase in the mean time can be observed as course commencement age increases above 23 years. This pattern repeats, more or less, for each field of study.

Australian male students spend, on average, a longer time in the system than females. This pattern of variation is not uniform across all fields of study. For example, the mean time in the system for male students in Arts who commence a course at the age of 23 years or more is shorter than that for females who commence at the same age. Architecture, Engineering and Law courses are of longer duration and this is reflected in the higher mean time in the system for students doing these courses.

The standard deviation of the time in the system also varies with course commencement age and fields of study. In general, the standard deviation is higher for students who begin their courses at an older age. A possible reason for this is that there are likely to be a relatively higher number of part-time students in the older age groups.

Time to Completion

The factors which are likely to have an impact on the mean time to complete a course are:

The mean and the standard deviation of the time taken by a student to a complete a course is given in Table 4.5 and Table 4.6, respectively. For example, it takes, on average, 4.4 years for an Australian male, commencing studies at the age of 18 years, to finish a bachelor's course, while for a female of the same age this time is 3.9 years.

For both male and female Australian students the minimum average time to course completion is achieved if the course is commenced at the age of 21 years. Overall, females take less time on average to complete a course than males, with the difference for some age groups, such as those commencing a course at the age of 21 years, being as much as 0.7 years.

Females who commence a course in Health at an age between 21 and 23 years take, on average, the shortest time to complete an undergraduate degree, while females who commence an Engineering course at the age of over 34 years take the longest time. However, there may not be all that many females over 34 studying a course in Engineering.

The standard deviation of the time to complete a course follows a pattern similar to that for the standard deviation of the time in the system-that is, it is higher for students who begin their courses at an older age.

Table 4.3 Mean Number of Years in the System for Undergraduates by Age at Course Commencement

Age at Course
All
Australian
Architecture
Arts
Business
Commencement
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
3.4
3.1
3.2
3.4
3.1
3.2
3.7
3.5
3.6
3.0
2.9
3.0
3.2
3.0
3.1
18
3.3
3.1
3.2
3.3
3.1
3.2
3.6
3.6
3.6
3.0
3.0
3.0
3.2
3.1
3.2
19
3.2
3.0
3.1
3.2
3.0
3.0
3.6
3.7
3.6
3.0
2.9
2.9
3.0
2.9
2.9
20
2.9
2.7
2.8
2.9
2.6
2.7
3.4
3.8
3.5
2.6
2.8
2.7
2.9
2.7
2.8
21
2.8
2.4
2.6
2.8
2.4
2.6
3.9
3.6
3.8
2.6
2.6
2.6
2.9
2.7
2.8
22
2.7
2.5
2.6
2.7
2.5
2.6
2.6
3.0
2.8
2.7
2.7
2.7
2.8
2.9
2.8
23
2.8
2.5
2.7
2.8
2.6
2.7
3.2
2.9
3.1
2.7
2.9
2.8
3.0
3.0
3.0
24
2.8
2.6
2.7
2.9
2.7
2.8
3.3
2.5
3.0
2.7
3.1
2.9
3.1
3.0
3.1
25-29
2.8
2.6
2.7
2.9
2.7
2.8
3.1
2.9
3.0
2.8
3.0
3.0
3.1
3.0
3.1
30-34
2.9
2.9
2.9
3.0
2.9
2.9
2.7
3.5
2.8
3.1
3.4
3.3
3.1
3.1
3.1
Over 34
2.8
2.9
2.8
2.8
2.9
2.9
2.7
2.9
2.7
3.0
3.6
3.4
2.9
2.8
2.9
Education (I)
Engineering
Health
Law
Science
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
2.9
2.9
2.9
3.7
3.6
3.7
3.1
3.0
3.0
4.6
4.2
4.4
3.1
3.0
3.1
18
2.9
2.9
2.9
3.7
3.7
3.7
3.0
2.9
2.9
4.5
4.5
4.5
3.0
3.0
3.0
19
2.6
2.9
2.8
3.7
3.8
3.7
2.8
2.7
2.7
4.5
4.2
4.3
2.9
2.9
2.9
20
2.5
2.2
2.3
3.3
3.0
3.2
2.7
2.3
2.4
3.1
3.4
3.3
2.7
2.7
2.7
21
2.4
2.2
2.2
3.1
2.6
3.1
2.8
2.1
2.2
2.8
2.8
2.8
2.5
2.4
2.5
22
2.5
2.4
2.4
2.9
3.0
2.9
2.3
2.0
2.0
2.7
3.0
2.8
2.7
2.6
2.6
23
2.5
2.5
2.4
3.4
3.3
3.4
2.4
2.1
2.1
2.9
2.8
2.9
2.7
2.5
2.6
24
2.3
2.4
2.3
3.4
2.2
3.3
2.5
2.1
2.2
2.9
3.4
3.1
2.7
2.8
2.7
25-29
2.4
2.5
2.4
3.3
2.4
3.2
2.5
2.3
2.3
3.6
3.5
3.5
2.9
2.9
2.9
30-34
2.4
2.5
2.4
3.4
3.1
3.3
2.3
2.4
2.4
3.4
3.7
3.5
3.0
3.2
3.1
Over 34
2.2
2.4
2.4
2.8
5.5
3.0
2.1
2.4
2.3
3.6
4.0
3.8
2.9
3.2
3.0

Table 4.4 Standard Deviation of the Number of Years in the System for Undergraduates by Age at Course Commencement

Age at Course
All
Australian
Architecture
Arts
Business
Commencement
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
1.8
1.6
1.7
1.8
1.6
1.7
2.1
1.8
2.0
1.7
1.7
1.7
1.7
1.5
1.6
18
1.8
1.6
1.7
1.8
1.6
1.7
2.0
2.0
2.0
1.8
1.7
1.7
1.7
1.6
1.6
19
1.8
1.6
1.7
1.9
1.7
1.8
2.1
2.2
2.2
1.8
1.8
1.8
1.7
1.6
1.6
20
1.8
1.7
1.8
1.8
1.7
1.8
2.1
2.4
2.1
1.7
2.0
1.9
1.8
1.7
1.7
21
1.8
1.7
1.8
1.9
1.7
1.8
2.5
1.9
2.2
1.9
2.1
2.0
2.0
1.8
2.0
22
1.9
1.8
1.8
1.9
1.8
1.9
1.8
1.8
1.8
2.0
2.2
2.2
2.1
2.1
2.1
23
2.0
1.9
1.9
2.1
1.9
2.0
2.1
2.0
2.0
2.1
2.5
2.3
2.3
2.2
2.3
24
2.0
2.0
2.0
2.1
2.0
2.1
2.1
2.1
2.0
2.1
2.5
2.4
2.3
2.3
2.3
25-29
2.1
2.0
2.0
2.1
2.1
2.1
2.1
2.4
2.0
2.2
2.6
2.4
2.3
2.3
2.3
30-34
2.1
2.2
2.2
2.2
2.2
2.2
1.9
3.3
2.0
2.3
2.8
2.6
2.4
2.4
2.4
Over 34
2.1
2.1
2.1
2.1
2.2
2.1
1.8
3.1
1.9
2.4
2.7
2.6
2.3
2.2
2.3
Education (I)
Engineering
Health
Law
Science
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
1.7
1.3
1.4
2.0
1.9
1.9
1.5
1.2
1.2
1.9
2.0
2.0
1.7
1.6
1.7
18
1.5
1.4
1.4
2.1
1.8
2.1
1.5
1.2
1.3
1.6
1.6
1.6
1.7
1.6
1.7
19
1.5
1.6
1.5
2.1
1.8
2.1
1.5
1.2
1.3
1.4
1.5
1.5
1.8
1.7
1.8
20
1.5
1.4
1.4
2.0
1.5
1.9
1.4
1.3
1.3
1.8
1.7
1.8
1.9
1.7
1.8
21
1.3
1.6
1.4
2.0
1.6
2.0
1.4
1.3
1.3
1.6
1.6
1.6
1.7
1.7
1.7
22
1.5
1.6
1.5
2.1
1.9
2.1
1.4
1.2
1.3
1.7
1.9
1.8
1.9
1.9
1.9
23
1.3
1.6
1.5
2.2
2.4
2.3
1.4
1.3
1.3
2.0
1.9
1.9
2.0
1.9
2.0
24
1.3
1.6
1.5
2.3
1.9
2.3
1.4
1.3
1.3
2.1
2.0
2.1
2.1
2.1
2.1
25-29
1.4
1.6
1.5
2.4
2.0
2.3
1.4
1.3
1.3
2.1
2.0
2.0
2.1
2.2
2.1
30-34
1.4
1.5
1.4
2.5
2.7
2.5
1.4
1.4
1.4
2.1
2.2
2.2
2.3
2.6
2.4
Over 34
1.3
1.4
1.4
2.4
3.7
2.5
1.3
1.4
1.3
2.1
2.3
2.2
2.3
2.7
2.4

Table 4.5 Mean Number of Years to Complete an Undergraduate Course by Age at Course Commencement

Age at Course
All
Australian
Architecture
Arts
Business
Commencement
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Male
Female
Person
Under 18
4.4
3.9
4.1
4.4
3.9
4.1
4.7
4.2
4.5
4.1
3.9
3.9
4.1
3.9
4.0
18
4.4
3.9
4.1
4.4
3.9
4.1
4.5
4.4
4.4
4.1
3.8
3.9
4.2
3.9
4.1
19
4.1
3.6
3.8
4.1
3.6
3.8
4.9
4.9
4.9
3.9
3.6
3.7
3.7
3.6
3.7
20
3.6
3.1
3.3
3.5
3.0
3.2
4.3
4.6
4.4
3.3
3.2
3.2
3.3
3.2
3.2
21
3.5
2.9
3.2
3.5
2.8
3.1
4.8
3.8
4.5
3.4
3.1
3.2
3.7
3.5
3.7
22
3.6
3.0
3.3
3.6
3.1
3.3
3.6
3.3
3.6