September 8th 2010 at 11:00am, By Dave Guerin
The embargo is off, the tinkering has been done, and a set of tertiary league tables can be released! But I warn you that there is some boring stuff to read first – irresponsible users of data can skip to the end. This first post covers quite a bit of ground, but there is much more to be explored in the data. Given the format in which TEC has supplied the data, it is difficult to do much useful analysis quickly – I really appreciate the early provision of data from the TEC, but I’m probably going to have to hire someone to do data entry in order to do much useful with it. TEC data is here.
TEC’s CE, Roy Sharp, said that “Today’s release of tertiary education performance information will allow the general public to understand more about how their local tertiary providers are performing”. The indicators being released by TEC are (full TEC technical report here):
Roy went on to say “For the first time we are releasing information that can be used to make year on year comparisons of tertiary providers’ performance…Providers have put in a lot of effort to prepare their information and to make it accurate. I would like to thank them for their work in this process.” He also pointed students and parents to tertiary provider websites and Career Services for more info about tertiary education.
Of the four indicators released today, course completions and qualification completions are the most useful, as they provide an indicator of students’ progression in their goals. The other two indicators are TEC creations that are unlikely to be very relevant to the general public, largely because they are only meaningful at a course or qualification level – if a qual is designed to get you a job, then a low progression to further education will not matter to students.
The data only relates to domestic students funded at providers through the Student Achievement Component. ITO data will be released at a later date.
Every provider has a snazzy PDF provided for them, listing the aggregate results for their subsector (eg ITPs, PTEs, universities) on p.1, the provider stats on p.2 and the subsector rankings on p.3. Below I’ve provided the main subsector stats and a further post will have TEI stats.
If you look at the course and qual completions above, universities seems to be highest, with PTEs in second – what that means will wait for another post. A Courses v Qualifications chart by David Choat, my colleague at ED, shows that there is an apparent relationship between the two, as you would expect.
The detailed info is being published at an organisation, rather than a course or programme, level. This will make it largely useless for most students seeking info on public tertiary education institutions, as the aggregate figures will not provide any useful pointer to a specific course or programme. The figures will be a useful guide for students looking at PTEs and OTEPs, which usually have a much tighter subject focus and fewer programmes. Of course, this release is largely intended to focus on organisational performance and is a preparation for more detailed data releases in future years (that’s not TEC’s official line, but my prediction). Releasing the data will expose the differences between organisations and drive some policy and practice changes.
3 Responses to Tertiary League Tables – Nice to Meet You!
Jo Hymers
September 11th, 2010 at 9:24 pm
Bah! The annoying thing is that TEC pats itself on the back for a job well done when actually TEC just skimmed the top.
In November or December 2007 I had a disagreement with Paul Huchings over this sort of thing as he said that if National got in to Parliament they would publish completion rates and prices and other bits and bobs in an effort to help potential students chose the right place of study..
Way back then I tried to point out that it will be an unbalanced picture… You can see it is…
ITP have far less full time students comparative to Uni’s and students will often enrol to a course for specific papers and not necessarily to complete a 3 year degree so it leaves ITP looking like their completion rates are low.
The information released clearly argues in favour of this statement.
And really… if you don’t understand the Tertiary Sector how can you make an informed decision on where you want to study based on the information provided because there are important factors missing…
There’s a whole pile of changes that re not being lumped together to show the “true changes” to the Tertiary Education Sector…
Perhaps ITP may like to talk to EXMSS about “Rate It” and do the job properly for the TEC.
I hope that a Tertiary Education is not out of reach for my children in 4 – 5 years when my son finishes Secondary School…
Jo Hymers
September 11th, 2010 at 9:33 pm
the story on here: http://www.stuff.co.nz/waikato-times/news/national-news/4111773/Massey-fights-worst-university-ranking
Hmmm hopefully people begin to make noise over the money wasted on this exercise since it has flaws and is not comprehensive by many standards…
Dave Guerin
September 13th, 2010 at 9:02 am
Jo, the TEC’s release improves the information available and futuer releases will provide more detail. While you point to the differences between ITPs and unis, the range within the ITP sector (or wananga, or PTEs, or OTEPs) is just as large and cannot be easily explained away by the number of part time students – there are reall differences in performance. This release isn’t perfect, but it will lead to changes within the sector. It is of little use to students, but TEC had to release organisational-level data as a first step towards releasing qual or course data.