How Schools Cheat

From underreporting violence to inflating graduation rates to fudging testscores, educators are lying to the American public.

Lisa Snell from the June 2005 issue

(Page 3 of 3)

Moving the Goalposts on Proficiency

A subtler way to distort data is to report test scores as increasing when in fact more students have been excluded from taking the test. One egregious example of this practice took place in Florida, which grades schools from F to A based on their standardized test scores. Oak Ridge High School in Orlando boosted its test scores from an F to a D in 2004 after purging its attendance rolls of 126 low-performing students.

The students were cut from school enrollment records without their parents' permission, a violation of state law. According to the Orlando Sentinel, about three-quarters of the students had at least one F in their classes, and 80 percent were ninth- or 10th-graders--a key group, because Florida counts only the scores of freshmen and sophomores for school grades. More than half of the students returned to Oak Ridge a few weeks after state testing.

The Sentinel also reported that in 2004 some 160 Florida schools assigned students to new schools just before standardized testing in a shell game to raise school grades. In Polk County, for example, 70 percent of the students who were reassigned to new schools scored poorly on Florida's Comprehensive Assessment Test, suggesting they were moved to avoid giving their old schools a bad grade.

Florida is not alone. In a third of Houston's 30 high schools, scores on standardized exams have risen as enrollment has shrunk. At Austin High, for example, 2,757 students were enrolled in the 1997�98 school year, when only 65 percent passed the 10th-grade math test. Three years later, 99 percent of students passed the math exam, but enrollment had shrunk to 2,215 students. The school also reported that dropout figures had plummeted from 4.1 percent to 0.3 percent. Rather than a sudden 20 percent drop in enrollment, the school had used a strategy of holding back low-scoring ninth-graders and then promoting them directly to 11th grade to avoid the 10th-grade exam.

States are also excluding a higher percentage of disabled students and students for whom English is a second language. (Needless to say, these exclusion rates are not reported with the test score data.) And states often report that their test scores are going up when they've merely dumbed-down their standards by changing the percentage of correct responses necessary to be labeled "proficient" or by changing the content of the tests to make them easier. Of the 41 states that have reported their 2004 No Child Left Behind test results so far, 35--including all of the states showing improvement--had schools meet the targets not by improving the schools but by amending the rules that determine which schools pass and which fail.

For example, the Philadelphia Inquirer reported last October that Pennsylvania's "improvements" were a result of lower standards, not improved performance. These changes, approved by the federal government, allowed schools with lower graduation rates, lower standardized test scores, or lower attendance than in previous years to win passing marks. In 2004, 81 percent of the state's schools met No Child Left Behind's adequate yearly progress benchmarks using the new standards. But the Inquirer analysis found that if the same rules used in 2003 had been used in 2004, the number of schools falling short of the yearly benchmark would have grown from 566 to 1,164. Instead of 81 percent meeting the benchmark, just 61 percent would have succeeded. When the Pennsylvania Education Department announced in August that only 566 of 3,009 public schools failed to meet federal standards, it neglected to mention the role the rule changes played in the "significant gains" made.

This sort of thing has been going on for a while. Back in 2002 Education Week reported that "a number of states appear to be easing their standards for what it means to be 'proficient' in reading and math because of pressures to comply with a new federal law requiring states to make sure all students are proficient on state tests in those subjects within 12 years. In Louisiana, for instance, students will be considered proficient for purposes of the federal law when they score at the 'basic' achievement level on their state's assessment. Connecticut schoolchildren will be deemed proficient even if they fall shy of the state's performance goals in reading and mathematics. And Colorado students who score in the 'partially proficient' level on their state test will be judged proficient."

The federal government actually gives a seal of approval to states that are lowering the standards they had before Bush's era of "accountability." For example, the U.S. Department of Education allowed Washington state to lower its high school graduation rate from 73 percent to 66 percent and still meet No Child Left Behind requirements--with the promise of an 85 percent graduation rate by 2014. Apparently, the feds are spending billions to compel states to reduce their academic standards.

Lying by Omission

But the most common way school data deceive people is through omission. State and local education officials simply do not define their terms for the media or the general public. As we've already seen, "persistently dangerous" doesn't mean the same thing to officials that it means to you and me.

Another example: My local newspaper lists area schools that have met No Child Left Behind goals and are compliant with federal law. The article will tell you that every subgroup, from low-income children and Hispanics to special education children, is proficient in reading and in math. It will not say that in California, in order for yearly progress for each subgroup to be considered adequate, only 13 percent of the children in each group must be proficient. Imagine the difference--and how much more helpful it would be to a concerned parent trying to decide what is best for her child--if the newspaper article said, "Here is a list of schools where at least 13 percent of children in each group are proficient."

The newspaper should also explain what it really means to be "proficient" in reading. To be considered proficient for the third grade in California, you must score at the 51st percentile in reading and the 63rd percentile in math on California's standardized STAR test. In other words, all it really means when my school is listed as meeting "adequate yearly progress" under No Child Left Behind is that at least 13 percent of third-graders in every subgroup scored at the 51st percentile on the reading test.

Most parents assume that "proficiency" means grade-level performance. But proficiency standards are so different from state to state that students with the same skills will have very different proficiency rates. In third-grade reading, for example, Texas sets its cut score--the correct number of responses or percentile ranking a student needs to be considered proficient--at the 13th percentile. Nevada sets its cut score at the 58th percentile.

All this only scratches the surface of the ways schools use statistics to mislead parents and the public. From reporting teachers' salaries without including benefits as part of their compensation to reporting per-pupil spending while excluding billions in spending on school buildings and infrastructure, the list of deceptions goes on and on.

The No Child Left Behind Act was supposed to let parents and policy makers identify and fix failing schools. More important, it was supposed to give kids a right of exit out of failing or dangerous institutions. But that's meaningless if "failing" and "dangerous" can be defined away. Despite the violence at Locke High School, the teaching failures at Wesley Elementary School, and the high dropout rates at Sharpstown High School, the average kid in those institutions is no closer to escaping now than before the law was passed. And despite the glut of information being offered to parents--and the glut of dollars being spent on education--most families rarely see the facts about their schools' performance.

No Child Left Behind was sold as a way to make the schools more accountable. Instead, it has encouraged and abetted them as they distort the data and game the system. That may be the worst deception of all.