//
you're reading...
Assessment, Leadership

Measuring Pupil Progress in an Uncertain World

Over the past twelve months, I’ve never sat in as many meetings where I’ve said “we just don’t know”.  This week was no exception; we were trying to think what GCSE English & Maths data we could usefully collect at a whole school level during this academic year. 

Photo Credit: mederndepe via Flickr cc

Photo Credit: mederndepe via Flickr cc

There may not be much we agree on in education – though opposition to expanding grammar schools is looking fairly solid – but uncertainty around the standards expected for a score or grade may well unite us across all phases.  We are entering a retrospective world where scaled scores and the value added associated with them are determined after the event.  As such, many primary schools, leaders and teacher are still coming to terms with last summer’s results.  The shock in some quarters was palpable.

At a secondary level, a new grading system for GCSE English and Mathematics has left many teachers and school leaders uncertain and anxious around in-year standards and measuring progress in Year 11.  This uncertainty will move to a whole raft of E-Bacc subjects next year and other subjects the year after that.  No subject or teacher will be untouched.  The key whole school performance indicator, Progress 8, will also be calculated retrospectively until at least 2019.

Schools are going to take different approaches to grading GCSE English & Mathematics this year.  One of my favourites, at the moment, is the “Building on Sand Approach”.  This involves a dense statistical approach to determining grades and scores which overwhelms teachers, forcing them into submission.  Anyone who sees the dense spreadsheet believes it.  It just looks so good that you become transfixed and decide to fall into line.  The numbers may well add up but the underlying assumptions pushing the numbers along are actually made up.  It’s invalid but comes at a huge cost in terms of time and effort.

Photo Credit: drpavloff via Flickr cc

Photo Credit: drpavloff via Flickr cc

We gave up trying to predict future performance of pupils a couple of years ago and moved to a current grade system.  Scaled scores for Year 6, new 1-9 GCSE grades, new AS and A-levels with limited papers and no grade boundaries is persistently leaving holes in our attempts to collect meaningful in-year data.  In this week’s meeting,  we decided just to collect percentages attained on sample papers for Y11 students in GCSE English & Mathematics; we did the same last year in Year 2 and 6 except for writing.  We collected data twice in the year and looked for signs of progress through pupils attaining higher scores.  Not exactly rocket science or complex.

Don’t Fret; Sweat the Small Stuff

Our post levels approach I’ve explained in detail here – Data & Feedback Informed Teaching and Learning or as I like to say, “Find out what they don’t know and teach them it.”  The first step is making sure you have really strong schemes of learning, that is, ones that are challenging with the learning appropriately sequenced in a clear progression.  From this, pre-assessments (find out what they already know) are developed; then you can plan your teaching and use a series of assessments to check what pupil have and haven’t learnt compared to what you have taught.

It is the learning gaps, the bits children don’t know, that I refer to as the small stuff, in the above heading.  This isn’t small in terms of importance, anything but.  It’s small in terms of grain size compared to the aggregated data – scores, grades, levels – beloved of data managers and leaders.  It’s in the former we find certainty and a potential way forward; re-teaching the parts of the learning progression pupils didn’t grasp first time around.

One thing missing from our approach is an external perspective.  If, despite your best efforts and intentions, your scheme of learning is pretty mediocre you may end up effectively delivering a right load of tosh.  I’m musing about whether we need to look at introducing a few nationally referenced assessments into the middle of Key Stage 2 and somewhere in Year 8 or 9.  I won’t rush to a decision but if pupils aren’t making progress I want to know sooner rather than later.  Waiting until the end of Key Stage 2 or 4 seems rather negligent.

Let’s Be Honest, We Don’t Know

serenity-card01

Uncertainty can be seen as a weakness; a ditherer’s disease that shouldn’t affect teachers or leaders.  In the liminal assessment and standards world we find ourselves in, uncertainty is the only certainty.  In moments like this, sometimes all you are left with is trying to find serenity in the madness.

A bit of an aside, it’s time for performance management target setting in many schools, targets that will be monitored and reviewed during the year.  I wish you well with that.

Postscript on external perspective:

dd-info

David Didau suggested looking at Proof of Progress 

Advertisements

Discussion

8 thoughts on “Measuring Pupil Progress in an Uncertain World

  1. This is pretty much the discussion I was trying to have with new DH on Thursday. But how does a lowly class teacher (in spite of the Master’s in Assessment) counter the culture of tracking whole pupils through some kind of aggregated score? This still pervades everything: the need to believe that we can know how much progress a pupils is making, overall, in some kind of numerical value, across the whole of primary school and beyond.

    Posted by julietgreen | September 18, 2016, 11:11 am
    • It’s a real shame your not being listened to. There’s a great pamphlet, written by Dylan Wiliam and published by SSAT, that you might want to get hold of and use to reinforce your argument. It’s called Principled Assessment Design

      Posted by LeadingLearner | September 18, 2016, 12:36 pm
  2. Looks like that old emperor has himself a whole wardrobe of beautiful new clothes.

    Posted by misslisa67 | September 18, 2016, 9:58 pm
  3. Another 50,000 Teachers will probably be lost again this year !

    Posted by Dom Sheeran | September 19, 2016, 12:01 pm
  4. I totally ‘get’ the ” re-teaching the parts of the learning progression pupils didn’t grasp first time around.” and am happy to embrace this as a guiding principle of Life after Levels – sadly our colleagues with already jam- packed curricula are not seeing it in the same positive light!
    Hey-ho!

    Posted by Anna McDonnell | September 19, 2016, 8:48 pm
  5. I spent last night searching google and the twitterati for any glimpse of a plan with regard to planning for pupil progress this year. Once again, @LeadingLearner hits the nail on the head and shows the minefield ahead. We need to look for the gap in the wave to find out route.

    Posted by Glynpotts | September 20, 2016, 9:57 am

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

New Book: Liminal Leadership

If you're interested in finding out more about how Mangahigh can support your Maths Curriculum please click me

The Teacher Development Trust a national charity supporting effective professional development (please click to find out more)

Blog Stats

  • 810,087 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 20,234 other followers

Follow @LeadingLearner on WordPress.com

COPYRIGHT LICENCE

#5MinMarkingPlan

It won't get your marking done in five minutes but will help your structure your marking so you and the students get the most out of it.

#5MinBehaviourPlan

Getting the behaviour of students right, in the class room, is the challenge for every teacher. This simple planner will take you through the main stages required to help you achieve a purposeful learning envionment

#Outstandingin10Plus10

Ideas and the thinking behind a professional development to help improve the quality of teaching and learning. Keep the learning tight, the lesson plan loose and focus on the learners

Planning to Get Behaviour Right: Research Plus Experience

The thinking behind the #5MinBehaviourPlan and our whole school approach to managing behaviour.

Education for Wisdom

Why the four knowledge dimensions (covering knowledge and skills) and a moral compass are at the heart of an outstanding education.

When Feedback Met Bloom

A look at the power of Feedback to students using Bloom's four knowledge dimensions

%d bloggers like this: