Time to Break Up with Running Records

farewell-3258939_1920

“What’s his level?” It’s a question repeated over and over again in Australian Schools.  It seems that everywhere you look kids are being tested using a popular benchmarking kit that ends up providing an instructional and independent level for reading.  Let’s be honest. The idea of a ‘level’ is attractive. It gives us an easily measurable way to track progress in a child’s reading.  The problem with this system is that it doesn’t effectively measure a child’s reading progress at all.   This system involves children reading increasingly complex books. It encourages children to ‘guess’ words using the first letter and the pictures in the book and relies heavily on children learning a large bank of ‘sight words’.

Now, I know that this benchmarking might feel comfortable. It has been in schools for what feels like a begillion years (not a real number, but this is not a post about maths…). Everyone knows what the numbers mean and you can communicate ‘progress’ in a way that even the kids understand.  I know all of this, but today I’m asking you to break up with benchmarking! Get rid of running records!

Here’s why:


1. Guessing isn’t reading

When children do not have the phoneme/grapheme correspondence to blend the words in front of them, they have a guess. They will likely be looking at the picture to have that guess, but it is a guess nonetheless   This guessing leads to serious errors in decoding, which effects comprehension significantly. Those columns where you are asked to analyse whether errors are due to meaning, syntax or visual cues can be totally skipped.  For beginning readers, you are only interested in where the errors of decoding occurred as this is the only strategy we want them using (more developed readers will use more than one strategy to decode, but effective blending is absolutely essential for this to occur).  The ‘multi-cuing method’ or ‘three-cuing method’ is ineffective. You can read more about it in a post from Spelfabet. The link is at the end of this post.


2. Sights words aren’t really a thing.

The popular system I have referred to is built around children developing a large bank of ‘sight words’. As children read more and develop more automatic blending they begin to recognise more words effortlessly. This doesn’t mean that they learn or process the words as whole units or global shapes. Rather, proficient readers attend to all of the sounds in a word.  I am not a neuroscientist, but Stanislas Dehaene is. Here is a presentation about reading and the brain.


3. It doesn't measure the right things

The benchmarking system used by most schools is a way to measure progress through this program. Nothing more. If your school teaches reading using a phonics program, measuring progress with this tool is a total mismatch. 


4. It isn’t timed

Fluency development is a key aspect of learning to read efficiently and is necessary for comprehension.  Your run-of-the-mill benchmarking system isn’t timed at all. So, a child could robotically sound out every word, use the pictures to answer questions and ‘pass’ the level, when they are not, in fact, functional readers. This makes the results open to interpretation and teacher judgement, which drastically impacts on the validity and reliability of the assessment.


So, let’s assume that you can see the logic of these points, the question remains, “How are we supposed to assess reading without benchmarking?”


Alternatives to Benchmarking for Measuring Reading Progress.


There are 5 areas in which you may choose to measure progress in reading. These areas form the 5 Key areas for reading. You may have heard them called ‘Big 6’ (to include oral language) or ‘Fab 5.


You can find the link for this site at the end of this post


There are several standardized tools available to measure reading growth, but before we get to those, let us consider what we are measuring.


Image courtesy of
https://acalculia.org


Standardised assessments have been designed to measure a child's abilities compared to other children his or her age. This means that you can be sure about whether a child is performing at a level that is appropriate for the child’s age or stage of schooling.  Non-standardised assessments, such as those used to track a child’s progress through a reading program, measure progress through a set of skills, and may not be linked to expected norms.  There is less certainty about whether the child is achieving where they should be and we can be caught in the trap of comparing the child with the students around them. This can lead to poor assessment in reporting as we think, “He’s at the top of the class. Must be an A or B for reading”, when in fact, a C grade would be more appropriate.


Skill Number 1 - Phonological and Phonemic Awareness



Phonological awareness is the ability to hear sounds in spoken words.  We are showing phonological awareness when we clap syllables in words and identify whether or not two words rhyme.

Phonemic awareness is the ability to manipulate those sounds, such as when we blend and segment or swap the starting sound of a word orally to make a new word.


How to measure this

Some examples of easily accessible phonological and phonemic awareness assessments include:


Sutherland Phonological Awareness Test  (SPAT)

A commercially available assessment that you can purchase from ACER. Chances are, this assessment is already in your school.  It is standardised, norm referenced and very reliable.


Phonological Awareness Skills Test (PAST)

This is a very easy to use assessment, designed to be delivered one to one in an interview style.  You will find a PDF of the assessment and the accompanying guide at the end of this post.  The guide does indicate when children typically acquire certain skills, but it is not standardized. For most of your students, it would be just fine.


Foundations of Early Numeracy Assessment (FELA)

If you teach in the Northern Territory, this assessment is available to you via Learning Links.  Otherwise, you can order it at the link below or directly from ACER.


Skill Number Two - Phoneme/Grapheme Correspondence


Students need to know the letters/letter grouping (graphemes) that are used to represent all the sounds of English (phonemes).  Without this, children do not have word attack strategies to tackle unfamiliar words. They rely on a small bank of familiar words and soon reach the point where they can no longer effectively decode.  A comprehensive phonics program, where children are systematically taught the full alphabetic code, forms the foundations for effective reading. 


How to measure this

  • If your school uses a phonics program, it will likely have a method of assessment and tracking.
  • The Australian Curriculum Literacy Learning Progression outlines stages of phonics learning. The step PKW8 should be reached by the end of year 3.
  • The MOTIF tests are freely available once you sign up. This site contains a range of assessments for the early stages of reading development.   The LeST provides an indication of student achievement in letter/sound correspondence up until year 3.
  • SPELD has a range of assessment resources freely available


Skill Number Three - Fluency


Fluency is more than reading rate or speed. It includes prosidy (reading with expression) and is heavily influenced by accuracy at word level.

It can be difficult to know what the expected rate of fluency is.  The Australian Curriculum Learning progression uses rather vague terms such as “reads aloud a predictable text at a flowing pace, pausing to attend to more complex punctuation” and the content descriptors are not much more help than that.

“They read texts that contain varied sentence structures, some unfamiliar vocabulary, a significant number of high-frequency sight words and images that provide extra information. They monitor meaning and self-correct using knowledge of phonics, syntax, punctuation, semantics and context. They use knowledge of a wide variety of letter-sound relationships to read words of one or more syllables with fluency.” 

If you are like me, you read this and say, OK, but what does this look like in practice? Where are the numbers that help me feel certain about making the judgement? (hence, the reason, we like the benchmark. It give us a number to feel certain about!)


How to measure this

Edith Cowan University has described acceptable reading rates at different grades:



Note the minimal number of errors allowed.  Regular ‘benchmarking’ does not measure fluency at all (in terms of words per minute) and allows an unacceptably high number of errors at each ‘level’.

  • DIBELS is a freely available suite of reading assessment that tests a range of aspects of reading, including comprehension. It is standardized and schools using this, report great success.
  • Reading A-Z has a range of time reading passages. They aren’t established, standardized assessments, but could be an effective way to measure student progress in an informal way.


Skill Number Four - Vocabulary

Vocabulary isn't really a skill but in the interest of keeping my headings consistent, I have called it one. As a teacher, I wouldn’t assess vocabulary in the same systematic way as fluency and accuracy, however its development significantly influences a student’s level of comprehension and should be included in your teaching each day.


Skill Number Five - Comprehension



The 4 skills described above lead up to the ultimate point of reading, comprehension.   Comprehension simply means understanding what you read and is grounded in background knowledge and vocabulary. Reading accuracy and fluency enable comprehension of written texts.


How to measure this

Comprehension can be measured in several ways and is included in quality reading assessments.

  • The PAT-R is an assessment completed by many schools and provides norm-referenced scores for different grades. (although this is not a great measure for beginning readers)
  • The NEALE reading analysis is a well-established assessment, which provides a reading age for accuracy, fluency and comprehension.
  • DIBELS assessment requires the child to retell the passage they have just read – an accepted method of assessing comprehension.
  • The Jennings Informal Reading assessment is found at the link below. I have no information about reliability, but it could be a useful tool.


A Word on Assessment

As teachers, your time is limited so make sure that which every assessment method you choose is appropriate for your students and will result in data that you can actually use to decide on next steps for teaching.  All any parent really wants to know is “is my child reading at an appropriate level?” and “Are they OK?” Effective assessment procedures and tools enable you to make that determination and identify students who may be experiencing difficulties so that you can provide appropriate interventions in a timely manner. 

Be careful that you are not over-assessing.  In our school, we monitor phonics development twice per term. This is a quick check-in to ensure that students are progressing at the expected rate in identifying ‘sounds’ and reading with them effectively. It is informal in nature and allows us to have data conversations with students about their learning.  More formal assessment such as PAT are done once each year and standardized reading assessment once per semester in time for reporting.


Useful Links

  • https://www.spelfabet.com.au/2016/08/multi-cueing-teaching-the-habits-of-poor-readers/
  • https://www.fivefromfive.org.au/five-keys-to-reading/
  • https://shop.acer.edu.au/sutherland-phonological-awareness-test-revised-spat-r-starter-kit
  • Phonological Awareness Skills Test. https://assessmentkit.weebly.com/uploads/2/5/9/2/25921693/pastscript.pdf https://assessmentkit.weebly.com/uploads/2/5/9/2/25921693/past_assessment_overview.pdf
  • FELA http://www.roslynneilson.com.au/tests
  • https://www.motif.org.au/home/tests
  • https://speld-sa.org.au/service/224-synthetic-phonic-assessment-resources.html
  • Document about fluency https://www.ecu.edu.au/__data/assets/pdf_file/0005/663701/SA-DECS-Fluency-doc.pdf
  • https://dibels.uoregon.edu/assessment/dibels
  • https://www.readinga-z.com/assessments/fluency-timed-reading/
  • Jennings Informal Reading Assessment http://wps.ablongman.com/wps/media/objects/2688/2753469/Richek_AppD.pdf


Do you have a great assessment that you would like to share with other teachers? Share it in the comments below.



15 comments

Sue Jerez
 

Hi There, I am a secondary teacher in Gladstone, Qld and currently teach Year 8 and 9 diverse learners in the areas of literacy and run what we call Foundation programs which target lower level learners. Do you have any information or articles (or even contacts) that may help me in the area of reading and writing for these high school students that are anywhere from Yr 2 – Yr 6 literacy levels. I read with interest your article on saying goodbye to running records and had a little chuckle to myself as I could totally relate. Before making the jump to high school, I was in early childhood (P – 2) for 15 years. I remember feeling totally frustrated with running records. Whilst the learners I teach have fallen through the cracks at Primary school, I need to know how best to cater to their learning needs in the areas of reading and writing – and find material that is high interest to their age group. Another area I struggle with is finding the correct method of assessing them. Currently our FRW (Focused Reading and Writing) subject which is 2 lessons per week, the method of assessment in our school is old NAPLAN exams for both reading and writing. Whilst I acknowledge this might be ok for some students, I believe there would be better ways to both assess and allow students to experience success. Our school (like most) is data driven, so the NAPLAN exams allows progress to be monitored and the data gathered through a program call CQ3S. Would be so grateful if you could offer some advice, or at least steer me in the right direction for lower level learners in the high school setting. Many thanks, Sue Jerez >
Read more
Read less
  Cancel
jocelynseamer0721
 

Hi Sue, Thanks for your comment. Our schools uses Read Write Inc Phonics from Oxford University Press. It is an excellent program and we have seen very pleasing growth in our students' reading skills. Ruth Miskin is the author of the program. This program has a version for older students called Fresh Start. It is designed for exactly the age group you are describing. I would highly recommend doing some investigation in this program. I have also heard of a program called That Reading Thing. Here is a link to their website. https://thatreadingthing.com/about-trt/what-trt-looks-like/ This program is also aimed at teenagers and above. I wish you the best of luck in your teaching! Would love to hear how your journey progresses. Take Care, Jocelyn
Read more
Read less
  Cancel
Marnie Ginsberg
 

Thank you so much for sharing these brave words! The leveling system has created a false reality that is hard to escape! And they hide the real source of children's reading problems, which as you allude to, is usually sound-based decoding. I'm not familiar with all of these assessments as I'm in the U.S., but it's so helpful to have such a list. I find that a standardized nonsense word reading test is almost always a real eye-opener to teachers and parents of older students. I'm going to share this with my community--thanks!!
Read more
Read less
  Cancel
jocelynseamer0721
 

Hi Marnie. I am so glad that you were able to connect with this post. No matter where we are in the English speaking world we seem to experience the same challenges and have the same goals for our children. All the best for your future teaching. Would love to hear what the response from those you work with. Take care, Jocelyn
Read more
Read less
  Cancel
Melinda Fowler
 

Hi there, I’m a primary school support teacher and have come across an assessment tool that may be of interest to you. It is called YARC (York Assessment of Reading Comprehension). It has sets for early years through to high school. At your level, the students first read a list of sight words which correlates to where you start them on the assessments. The reading assessments are timed, so it looks at fluency as well. Comprehension questions are also asked. The data can be put into a program supplied and generates a report detailing areas of weakness and types of comprehension the students may struggle with. You can use this to guide your teaching. Regards Melinda (Gladstone girl born and bred 😂)
Read more
Read less
  Cancel
jocelynseamer0721
 

Hi Melinda. Thanks for sharing!
Read more
Read less
  Cancel
Natalie Munro
 

Hi Jocelyn, Thanks for this post. I liked it a lot. The one section I disagree with though is the section on vocabulary. I think we do need to measure either depth and/or breadth of vocabulary. Perhaps once a term or twice a year. Let’s not ignore the importance of targeting and measuring oral language – and in this case – vocabulary in supporting a child’s literacy development – especially here, reading comprehension. So there are a number of ways to do this, including word definition knowledge, vocabulary knowledge profiles, and receptive and expressive naming tests. Adopting robust vocabulary instruction (see Beck, McKeown and Kucan) can help selectively target key vocabulary across a unit of work. This could easily be tracked as part of measuring class progress in literacy. But back to the main point of your article – time to ditch running records- yes please, as you so clearly point out, there are much better ways of measuring reading progress. Thank you
Read more
Read less
  Cancel
jocelynseamer0721
 

Hi Natalie. Thank you for your response! I whole heartedly agree about the need to ensure that our teaching is rich in oral language. We know that comprehension is underpinned by vocabulary and knowledge. In my own teaching I include vocab assessment in the actual content assessment rather than using a formal, standardised tool. However I am interested to learn which assessments are out there that teachers can use, particularly for vulnerable learners. In our context, 70% of kids are EAL/D learners so I am putting structures in place to ensure that every lesson in the school is a language lesson. All the best and thanks again for your response. Jocelyn
Read more
Read less
  Cancel
Top 5 Tips to Maximise Reading Success – Jocelyn Seamer Education
 

[…] who your learners are and what their needs are and match instruction accordingly.  In a previous post I outlined several possible assessments that you might use to assess reading  in your […]
Read more
Read less
  Cancel
Diane
 

Hi Jocelyn A question on the DIEBELS. Do the grades/years match here in Australia as it is American based? Thanks so much.
Read more
Read less
  Cancel
jocelynseamer0721
 

Hi Diane, I am advised that the grades in DIBELS match pretty closely to Australian grades, however are not normed to Australian students. Overall, I would say that it is a good indicator of whether reading progress is on track. Hope this helps!
Read more
Read less
  Cancel
Allan
 

I have used ORF Oral Reading Fluency Assessment. The fluency rates are in line with ones mentioned in the article. Fluency is linked to comprehension. Students with poor fluency/word attack have great difficulty understanding what they are reading because they are trying so hard just to read each word.
Read more
Read less
  Cancel
The Struggling Reader in Disguise – Jocelyn Seamer Education
 

[…] are reading well but they don’t actually have the skills to tackle unfamiliar words. In a previous post, I wrote about this very thing and some […]
Read more
Read less
  Cancel
Elmarie van der Westhuizen
 

Thanks for your informative blogs and posts.

Read more
Read less
  Cancel
Jenny
 

The CUBED assessments are well worth looking into. It has reading and a listening comprehension components.

Read more
Read less
  Cancel

Leave a comment