Sunday, 15 May 2011

It's exam time again! But don't mention the grade inflation.

'You can feel exams getting easier'.
Glenys Stacey is upset about Grade Inflation. She's not upset that it's happening; she just doesn't like the term. She thinks it's 'unhelpful'

Who is Glenys Stacey? She's the Chief Executive of OfQual, the body who 'regulate general and vocational qualifications in England and vocational qualifications in Northern Ireland,' that's who. Or in other words, she's in charge of ensuring that examinations are fair, rigorous and properly administered. And what is Grade Inflation? It's the idea that, over time, the effort and ability required to achieve a given level of attainment will reduce slowly. In other words, exams are getting easier. You might have heard it described as 'dumbing down' although that syndrome is an alleged symptom in many other areas than education. (See: ITV News.)

So why is she upset with the term? "I don't find 'grade inflation' to be a very helpful expression," she says.  'Inflation' has a negative import whereas in fact we may be seeing young people being taught well and working hard."

Grade Inflation

'Grade inflation; urgh!'
Well, we can't have that, so in deference to Ms Stacey's feelings to wards the term grade inflation, I'll keep references to grade inflation to a minimum from now on. But is grade inflation actually happening? Well, let's take a look at what the chaps with white coats call 'the facts':

  • Between 1997 and 2007, the pass rate for 5 GCSEs went from 45% to 56%
  • In the early 80s, 22% of students achieved at least a C in O-level maths. In 2009 it was 57% (GCSE).
  • GCSE results have been rising consistently for the last twenty years.
  • The pass rate for A levels was 68% in 1982; in 2009 it was 97.5%.  Hoorah!

I could go on, but I don't need to. On paper at least, the pass rates for examinations are increasing at a fabulous rate, raising the very real possibility that by the year 2025, 150% of all students will achieve better than A* at A level, and more than the entire population of the planet will leave higher education with a Phd. And 100% of all students tested will be above average.

Have I mentioned Grade Inflation?

Why is Ms Stacey so cagey about the term grade inflation? Because 'in fact we may be seeing young people being taught well and working hard.' Oh, we may well indeed. Perhaps that explains all the gains? Let's have a closer look at that point of view. In order for it to be the case, we would need to see the following things happening:

1. Pupils actually getting smarter.

This is your kid, now.
Well, I suppose it's possible, in the same way that it's possible that Osama Bin Laden is playing water polo with Megatron in the lost city of Atlantis. It's possible. But kids getting smarter? Really? Well, well, well, someone call me an evolutionary biologist because there appears to be something strange happening inside the hinterland of our brains that is without parallel in the history of our species, large black monoliths notwithstanding.

I've heard people say (well, Boris Johnson) that this is perfectly possible; that Roger Bannister ran a four minute mile, and everyone wet their knickers at the novelty of it all; that Hillary and Tenzing high-fived each other at the summit of Everest, and it was the second biggest news of the day; but now my nan's nan can run the four minute mile, apparently, and there are so many visitors to the top of Chomalungma you could operate a scone shop at a reasonable profit. The first runner who managed a marathon (arriving conveniently at Marathon) pegged it with the exertion. Nowadays Jimmy Saville and men in diving suits manage it. Truly we live in the age of supermen, of the casually miraculous. Why not in the realm of smarts?

But it's not the same. Sure, there have been enormous gains in the physical realms in the last century, but these are down to a few, easily identified factors: better diets; professional training programs; sports science that enables the very keen to focus their every effort on the razor thin outcome they desire. And now...well, frankly we've hit a bit of a wall. Remember Don Lippencoutt? Of course you do. He was the world's fastest man in 1912- ran the 100metres in 10. 6 seconds. Now, that really is jolly fast. Fast forward (ho ho) to 1999, and you have the fantastically named Usain Bolt doing the same achievement in 9. 58 seconds. Now honestly, that's even quicker than I can imagine falling from a plane. But that's probably as fast as we're going to get, without super serums and genetic engineering. In 1912, athletes usually also held down a milk round and a job at the gas station; the Titans of the Track in 2012 live in converted volcanoes and sleep upright in MRI scanners. If anyone knocks point 0001 of a second from the current record, they'll be popping corks.


And that's for something as easily measured as speed. I mean, how fast can you get from A to B? is really one of the simplest parameters you can hope to establish. But smarter? More intelligent? That's a whole new card game of contention. There isn't an intelligence test in the world that enjoys universal recognition as such. That's partly because any test can be interpreted as an activity in itself; ultimately any test, no matter how good, can be seen as a test to see how well you can perform in a test, rather than having an intrinsic link to another attribute, which we'll call intelligence. We can't even establish an effective definition of intelligence, for God's sakes. It's like we're trying to establish an international barometer of how much love there is in the world, or something. And don't get me started on measuring happiness.


Grade inflation


OK, so maybe people aren't actually getting smarter (exhibit A: Jedward. Exhibit B: people still buy homoeopathic medicine).

2. Perhaps the teaching has got better?
We're just BETTER these days.


Ah, now that's another story entirely. Because I've been involved in teaching for nearly ten years- not an enormous amount of time, but long enough to have a squinty-eyed perspective on the 'improving for twenty years' GCSE data. Has teaching really gotten better by about 1.5% every year? I know mine has certainly improved, but that's because I came from a standing start of 'rubbish', so anything would be a 100% improvement frankly.

The first year I taught, my kids got a 67% pass rate (A-C) at GCSE. The next year they enjoyed an 87% pass rate. The next year it went down a bit. The next few years, up a bit. I do OK; above national, borough and subject averages, so I'm feeling fine. Why do some years do better than others? To be honest, a lot of it's to do with the cohort you teach; some year groups have got the academic rigour/ smarts/ familial support dynamic, some have it a bit less. There's a lot of variation that you don't have anything like direct control over. I do my best, whoever I get; I teach my heart out, and jump around like Johnny Ball when I need to, and crack the loving whip as much as I have to. My Value Added is just dandy, thanks very much. I don't say that to self-congartulate. I say it to show that the value of your house can go down as well as up.

Teaching has NOT improved, year in, year out. There is NO evidence to suggest that this has happened nationally. Anyone wants to contest that, I challenge you to show me what teachers do differently now that has significantly improved examination results the way we have seen. Assessment  for learning? Do me a favour. VAK? Personalised learning? Learning to learn? Multiple Intelligences. All of them- ALL of them, fashionable ideologies, quack pseudo-science, or well-meant ideas that never survived in the cold atmosphere of the real classroom. Teachers have never been so hampered by red tape, directives and 'best practise', and yet exam results just keep going up and up and up. How?

Is it...Grade Inflation?

The temptation to inflate grades can be expressed in these ways:

'Pick a qualification...any one.'
1. It's Darwinian. If one school inflates its grades, then all other schools that don't would be at a disadvantage, unless they too chose to inflate their grades, like the constantly lengthening neck of the giraffe over the millennia. And once they do it too, the survival advantage is negated, until someone inflates their grades again. Hence inflation. I believe economists have noticed that something similar happens with money...Of course, this wouldn't be a problem if all schools weren't compared with each other in a Darwinian environment that replicates and combines the brutality of the state of nature with the heartlessness of the Free Market in League Tables, except...oh dear; we do have that. Ah.

2. Exam boards compete for business. They do, they do, they do, and Satan rules the world. OCR, Edexcel, AQA and Al Qaeda, etc all want a slice of your pie. And when profit drives an enterprise, then profit replaces the enterprise itself as the goal of the project. Don't misunderstand me- I'm not explicitly anti-market- as Milton Friedman roughly said, it's the best system out of a bad bunch- but as a motivator, it often has imperfect consequences. In the pursuit of market share, competitors will...well, compete. They'll try to distinguish their product from the competitors. Do you think they have many strategy meetings where anyone suggests that they make next year's syllabus even harder? 'Oh boy, even less kids will pass- let's DO it!' No. No, they don't.

Says who? Says Mick Waters, former head of the QCA, the Qualifications and Curriculum Authority, the public body that was (until recently) responsible for maintaining and advising on the National Curriculum. He claimed that England's exam system was 'diseased' and 'corrupt'. Consider this, taken from the BBC website::

'In Reinventing Schools, Reforming Teaching, Mr Waters says that before working for the QCA he thought all the criticism about exams being "dumbed-down" was "unfair".
"You know, the old argument, more people passed than ever before. Since I've been there, I think the system is diseased, almost corrupt," he says.
This is because exam boards are vying for business in a marketplace, he adds.
He also says he has heard people from exam boards talking to head teachers and trying to sell their qualifications by implying their examinations are easier than those of other boards.'

Head of the QCA. What would HE know, eh?

Grade Inflation

It's all good, apparently.
Nobody in their proverbial right mind would say that schools should be exempt from some kind of external assessment- they're not cheap, you know- but what is undeniable is that whenever anything is subject to assessment, it's human nature to try to look as good as possible. If a school gets an Ofsted, it'll paint over tthe cartoon phalluses, 'lose' a few key players, and get its books ready. When a government wants to be able to crow about the success of a flagship policy, it will do what it can to ensure that key indicators for that policy are looking as sexy and toned as possible. When the Academies were first introduced, we also saw a rise in GCSE-equivalent subjects that frankly, my dear, weren't worth a damn- or at least not the market value that was being ascribed to them. But results went up, indeed they did.

Add to that the currently irresistible practise of certifying students in 'life skills' and other GCSE-equivalents that were (and are) an insult to their more traditional brethren (you know, useless things like English and maths), and finally chuck in drilling for exams that is now an unavoidable part of every child's school career, and you have an easy explanation for the success rate in exams going up, and up, and up.

Grade inflation

There are still sceptics of course, who usually say these kinds of things:

You're devaluing the terrific achievements of the kids.

No: I want to celebrate genuine achievement. Do you think they introduced the A* for A levels because the present system was working? Alas, no.

You're devaluing the terrific improvements made by teachers


Oh God, no, no, no. Teachers are shuffling along, weighed down with lead shackles called (in the manner of a middle-brow satirical cartoon from Punch) 'new initiatives' and 'policy churn'. How teachers teach has remained pretty constant since cavemen first set three part lessons in mammoth whispering. There is no 'new science' of teaching. Unfortunately there is a whole racket that has grown up around it, attempting to convince teachers (and their masters) that teaching students is a complex, arcane matter, that can only be achieved with a degree in neuroscience and an understanding of the latest voguish psychological theories about left/ right brain, or learning styles. What, may I say, a load of shit.

People have always complained about dumbing down.

So? It doesn't mean it hasn't happened. That's like saying, 'Oh , people have always complained about the weather.' And yet the Heavens still open. Besides, the grade inflation debate isn't that old in this country- back about forty years for the lion's share of it, with its ancestral bones buried back in the start of the twentieth century- and before that, there wasn't really an education system you could actually point to, so we're not exactly talking about something older than the Norman Conquest, are we?

I possibly wouldn't mind so much, but it also has a knock-on effect on the target grades that children are expected to achieve; they also have to acount for the increase of examination 'success' and subsequently the targets for children get higher and higher as well. You can laugh. You won't be laughing when you get a phone call from the school, expressing concern because your little Billy is only getting twenty out of twenty one A*s for his mock GCSEs in year three. Don't get me started on FFT data. One day I'll write about it before I blow a gasket.

I hope that this has been in some way helpful to Glenys Stacey. I wouldn't want anyone to think that grade inflation was behind this meteoric rise in exam success. I'd prefer to call it 'magic.'

If you have been affected by any of the educational issues raised in this blog, please call the DfE.

5 comments:

  1. An interesting read, as a parent of what are considered "gifted and talented" kids I think what you have written confirms what I have suspected for a while.
    There are bright kids in the system that persistently do well, but the problem is in the form of the not-so bright kids never being allowed to fail, hence being given a GCSE (equivalent)pass for taking a BTEC in PE, compared to my daughter working hard to meet the requirements of an actual GCSE in PE, on paper the same end result but one had to read and write and learn, the other just turned up with half a PE kit and kicked a ball ??

    As for the penultimate paragraph I was told at a parents evening my son needed to put in a bit more effort in French. To be fair to him he is in a fast track program and is is doing the GCSE a year early and is on course for an A* The teachers concern, his last 3 assessments were scored 20/20 20/20 19/20, that last one has let him down ! ? !

    ReplyDelete
  2. Thanks RJR. We're heading towards a situation where they'll be given certificates when they first arrive at school, in case they it damages their self esteem.

    ReplyDelete
  3. Thank you Tom for putting into words what I have struggled to find an anaology to express. The grade inflation in relation to Darwinian principles, this is the very thing I am constantly arguing against at my school in the US. My pass rate SHOULDN'T match the other teachers of the same class just because we teach the same subject, you may notice we teach completely different kids this year and every single year. I don’t see how harping on me to get my pass rate higher actually means my students will do any better, do you think I don’t try to teach them as it is? It’s unfair mostly because Mrs. A over there is a flake and gives points for completing work on time (no joke!) and gives so much extra credit as to totally invalidate their actual grade and is no reflection of their knowledge. I shouldn’t have to stoop to her level so you won't tell me I'm a crap teacher or suggest some “creative” book keeping strategies. (If this were an accounting firm the IRS would so take us down).

    ReplyDelete
  4. Best bit;

    "by the year 2025, 150% of all students will achieve better than A* at A level, and more than the entire population of the planet will leave higher education with a Phd. And 100% of all students tested will be above average."

    unreal exceptions of the system are failing students. Not everybody can pass in life, not everybody will...but they do so the figures look good. :(

    ReplyDelete
  5. I came to teaching in my early forties and I’d probably go along with the assertion that the general quality of teaching now is better than that which I experienced as a pupil; I don’t recall the volume of extra-curricular help or sheer interest in pupils’ progress. However, when we assert the latter we tend to forget the extent of distractions to which kids are now subject: console games, hundreds of tv channels, Internet, Facebook, mobile phones - none of which makes it any easier to get kids to do something contemplative like ummmmm read a book? Moreover, whilst teachers might be putting in more effort, there are a whole range of extraneous factors that have led standards of behaviour to decline. Against this background, standards have inexorably risen. Makes you wonder.

    ReplyDelete