Assessment Obsession and Evaluation Idolization

Assessment Obsession and Evaluation Idolization

When educational policy makers first caught assessment fever from the business world some twenty years ago, like many teachers, I assumed it would pass as so many educational trends do. Instead, it has hung on and grown and grown, to the point that educational assessment has become a mega-business for corporate conglomerates like Pearson, who employed forty-eight thousand people last year in publishing textbooks, programming curricula, and administering digital standardized tests. According to their annual report, Pearson made over seven billion dollars on education last year. Many public schools administer multiple standardized tests every year, and some Christian schools are following suit.

The current assessment craze rests upon a series of presuppositions or claims that remain largely unchallenged. I’d like to describe and discuss three of these claims, questioning whether more formal standardized assessment is actually not the ultimate solution to improving student learning and wondering where would that leave us.

Claim #1: We need to assess more frequently so that teachers are better able to differentiate instruction. I think there is a very real difference between the way testing companies think differentiated instruction works, and the way master teachers understand differentiated instruction. Testing companies envision teachers sitting down during their ample free time and looking at a screen that shows the slow and steady growth of each of their students in a subject such as reading. The teacher sees that one of their students, Dennis, seems to have fallen below grade level in his reading. A quick analysis of his scores reveals that he needs more vocabulary instruction. The teacher makes a note to start him on the intervention response curriculum later that afternoon so she can get him back up to grade level.

There are a lot of assumptions in this approach. The first is that instruction is best differentiated through reflection and analysis. I would guess that some of the best differentiation moments in a teacher’s career come in the heat of a lesson, when an informal assessment reveals that a student’s eyes are glazing over and the teacher zeros in on that student with an analogy or example that finally connects. Some excellent differentiation occurs in response not to formal assessment, but in response to informal assessment, and not in a quiet reflective moment, but in the heat of teaching.

Second, this presupposes that more regular assessment will be helpful in pinpointing exactly when a student begins to struggle. Think of the graph that many first or second graders make showing the growth of their windowsill bean plant. The students measure their plant every day, and after a couple of weeks, they connect the data points to make a nice even curve. If instead, they would measure the plant twice a day, or even every hour, that would give them a more clearly defined curve, right? Well, not really. See the plant doesn’t grow much in an hour, so the curve really won’t change. And, of course, our students are not bean plants. They tend to have far more variables. They are more apt to have good days and bad days. And so assessing them too closely might actually give us a less clear line; it would reveal the week-to-week variations.

Finally, using reading again as an example, the idea here is that it is possible to come up with a meaningful reading level for each student and then slowly climb an inevitable ladder to full education. In fact, though we can average out such a thing, the reality is a bit trickier. We all read at different reading levels depending on our interest and previous knowledge in the subject, the presentation of the material (just text, text and illustration, or Web site with sound, etc.), as well as our purpose in reading it.

In addition, it may not always be the case that less common vocabulary and lengthier sentences equal more difficult texts. Consider a typical Dr. Seuss book. It contains extremely uncommon words like lorax and thneed, yet a second grader can understand it through the illustrations. A typical reading level analysis program is likely to classify it as being much harder than it is. Now think about a book by Ernest Hemingway. His work contains short, common words and short sentences, and yet the content of his work is full and nuanced. Again, the readability formula is likely to misclassify it as being easier than it is. So learning to read is obviously a bit more complicated that just proceeding from one Accelerated Reader level to the next.

Claim #2: Students learn better when teachers make clear what they will be assessed on and how they will be assessed. The assumption behind this claim is that all learning functions the same way memorization does. So when elementary students are learning their spelling words, they know that if they want full credit, they have to get all the words right. Why should learning how to write a paper for English class or doing an observational project for biology class be any different? If we give students a clear rubric that explains the level of achievement we intend them to reach, they will achieve that level and all will be well. And I suppose that is true if we only want them to achieve the level we envision them reaching.

But here is the problem. Our students are efficient. They have to be. So if I tell students exactly what is required to achieve an A on their English paper, they would be foolish to spend any more than the absolute minimum time and effort necessary to achieve that A. Unfortunately, what makes a good writer an excellent writer is reaching beyond the ordinary to the utmost they can do. I once had a writing class where the teacher looked at our work and commented on it on a weekly basis, but never gave us any grades. Because we did not really know how we were doing, we worked our hearts out. We learned a lot about how to write—far more than if we had just done the minimum.   [This is only part of the article. Want to read more? Subscribe to the website by choosing "Register" from the menu above. It's free!]