Imagine I'm a public school math teacher, and I just gave my students a test worth 100 points. These classes of mine don't have strong math skills. With the students needing 50 points to pass, only 14 percent of them make it, and most of the passing students squeaked by just above the cut line, with between 51 and 59 points.
Next year I give the same test to my classes, which are basically identical in math skills to last year's batch. But this time I decide, damn it, 50 points shouldn't be enough to pass. I'm going to set the passing cut score at 60. That moves most of the students who would have passed with the previous cut score into the ranks of the failing. Only 2 percent pass.
The question is, should I be more concerned about the math skills of my classes with 2 percent passing rates than the previous classes where 14 percent passed? Obviously not. Their skill levels are basically identical. Only the score it took to pass changed. But while a 14 percent passing rate is met with shaking of heads and clucking of tongues, a 2 percent passing rate makes people crazy. Contact the media! Call out the public school haters! It's time to scream, "Oh my God, look at these scores! What happened? Shame on those kids! Shame on their schools! Shame on their parents!"
That, in a nutshell, is what's happening with the AzMERIT scores and the soon-to-come tsunami of shaming.
The process has already begun, though, believe me, it's only in its infancy. An article in Friday's AZ Republic,
AzMERIT: Poor, rural districts feel burden of new test, is an example. It's a sympathetic, hand-wringing forerunner to the upcoming onslaught of shame. The article looks mainly at the AzMERIT scores on the San Carlos Reservation and in the Baboquivari Unified School District. In the San Carlos schools, 6 percent of the students passed the English section and 2 percent passed the math section. In Baboquivari Unified, 7 percent passed the English and 8 percent passed the math. The article talked about how difficult it it is for the districts to deal with these results, how hard both school systems have worked to boost their students' achievement. And yet, look at these disappointing passing rates, so much lower than the previous year.
But if you look back on last year's AIMS scores, you'll see that these new low scores are perfectly predictable. They're not a sign the students' achievement levels are lower this year, and they don't mean the students did worse on the AzMERIT test than on AIMS. What they mean is, the passing level — the cut score — was raised for the new test. If the students had been given one of the old AIMS test and the cut score was raised, like I raised the scores on my imaginary math test at the beginning of the post, pretty much the same thing would have happened. It's not about the students and it's not about the new test. It's all about raising the tests' cut scores.
In San Carlos, 14 percent of the students passed the 2014 AIMS math test, compared to 2 percent passing the AzMERIT. But if you look at the breakdown of the AIMS passing scores, you find that 13 percent simply met the math standard and only 1 percent exceeded it. So when you moved that bar up on the new test, what happened basically is, 12 of the 13 percent who just met the standards fell below the new line and only 1 percent joined that 1 percent that exceeded. If you go through the AIMS math and reading scores for the two districts, you find the same situation, between 10 and 47 percent meeting the standards and between 1 and 3 percent exceeding.