The One About Data, Numbers and Truth
Much has been made by the corporate reform community about how
poorly American students do on the Program for International Student
Assessment (PISA) tests. According to the Organisation for
Economic Co‑operation and Development, which administers the exams, "the
United States performed below average in
mathematics in 2012 and is ranked 27th. Performance in reading and
science are both close to the OECD average. The United States ranks 17
in reading...and 20 in science." Now, if these
were "apples to apples" comparisons, we would be well advised to be
concerned. But they aren't; and the reformers know it, don't care, and
are more than willing to use this misleading data to
advance their agenda.
What the reformers don't share--because it would not support their agenda of failing schools, bad teachers, disengaged students, uninvested parents, and greedy unions--is that more American students take these exams than do students in other countries, and that US students from schools with low rates of poverty do extremely well--better than students in most other countries.
(An important caveat here: I don’t think that test scores are a terribly meaningful way to assess what students know and can do, but it’s the data we are used to seeing. The idea that we need standardized test results to tell us what our children know is one of the biggest lies told by the reformers. Teachers know a LOT about our students: we know their strengths and weaknesses, we know about their siblings and families, we know when they are in trouble, and we know what they are thinking and feeling. Only persons who have never taught would believe that we need standardized test scores to let us know how our students are doing. The truth is that these test scores are among the LEAST meaningful things we know about our students, and no amount of hype and reformer drama is going to change that.)
The issue here is that the PISA test scores are usually not disaggregated--that is, the scores are not parsed out by poverty rates, but instead are all lumped together. Many in the corporate reform community are fond of reporting these international scores without sharing the fact that US poverty rates are nearly 30%, while countries like Finland are at 5% or less.
There is a strong correlation (not causation) between SES and test scores (and zip code and test scores, for that matter)--which is not to say that wealthy kids are smarter than poor kids. They aren't. Its just that kids with more financial resources have more opportunities and advantages than their less -advantaged peers.
It's important to be clear when reporting these stats: US schools are not "failing," and in fact, when we provide our kids and schools with adequate resources they "compete globally" just fine (although that is not our goal as teachers). It's also important to remember that less than 7% of the differences in student learning are attributable to in-school factors, such as teacher quality--with more than 90% of the difference being a function of out-of-school factors, like test prep tutors, private music lessons and the resources to purchase instruments, after school sports, and access to travel, concerts, books, and movies. The reformers like to say that these things don't matter, but teachers know that they do--and we want nothing more than for all of our students to have access to schools with rich and vibrant music and art programs, athletics, school nurses, librarians, psychologists and counselors, and all of the other advantages their peers in the suburbs enjoy and from which they benefit.
Here's the Truth...
So, the next time that someone tells you that American students are not "competing globally," and that our "failing schools" are a threat to our national defense, our economy, and our very future as a nation, please share these disaggregated stats from the most recent PISA tests. Because when we look at US students from schools with free or reduced lunch rates lower than 10%, here’s how American kids do—for comparison’s sake, Finland’s rankings are also included:
Science literacy
Reading literacy
Mathematics literacy
Then, do what my students would do, and…<drops the mic>
What the reformers don't share--because it would not support their agenda of failing schools, bad teachers, disengaged students, uninvested parents, and greedy unions--is that more American students take these exams than do students in other countries, and that US students from schools with low rates of poverty do extremely well--better than students in most other countries.
(An important caveat here: I don’t think that test scores are a terribly meaningful way to assess what students know and can do, but it’s the data we are used to seeing. The idea that we need standardized test results to tell us what our children know is one of the biggest lies told by the reformers. Teachers know a LOT about our students: we know their strengths and weaknesses, we know about their siblings and families, we know when they are in trouble, and we know what they are thinking and feeling. Only persons who have never taught would believe that we need standardized test scores to let us know how our students are doing. The truth is that these test scores are among the LEAST meaningful things we know about our students, and no amount of hype and reformer drama is going to change that.)
The issue here is that the PISA test scores are usually not disaggregated--that is, the scores are not parsed out by poverty rates, but instead are all lumped together. Many in the corporate reform community are fond of reporting these international scores without sharing the fact that US poverty rates are nearly 30%, while countries like Finland are at 5% or less.
There is a strong correlation (not causation) between SES and test scores (and zip code and test scores, for that matter)--which is not to say that wealthy kids are smarter than poor kids. They aren't. Its just that kids with more financial resources have more opportunities and advantages than their less -advantaged peers.
It's important to be clear when reporting these stats: US schools are not "failing," and in fact, when we provide our kids and schools with adequate resources they "compete globally" just fine (although that is not our goal as teachers). It's also important to remember that less than 7% of the differences in student learning are attributable to in-school factors, such as teacher quality--with more than 90% of the difference being a function of out-of-school factors, like test prep tutors, private music lessons and the resources to purchase instruments, after school sports, and access to travel, concerts, books, and movies. The reformers like to say that these things don't matter, but teachers know that they do--and we want nothing more than for all of our students to have access to schools with rich and vibrant music and art programs, athletics, school nurses, librarians, psychologists and counselors, and all of the other advantages their peers in the suburbs enjoy and from which they benefit.
Here's the Truth...
So, the next time that someone tells you that American students are not "competing globally," and that our "failing schools" are a threat to our national defense, our economy, and our very future as a nation, please share these disaggregated stats from the most recent PISA tests. Because when we look at US students from schools with free or reduced lunch rates lower than 10%, here’s how American kids do—for comparison’s sake, Finland’s rankings are also included:
Science literacy
U.S. schools with less than 10% free/reduced – score=556 [1st in the world]
Finland – ranked 4th in the world
U.S. schools with less than 10% free/reduced – score=559 [1st in the world]
Finland – ranked 5th in the world
Mathematics literacy
U.S. schools with less than 10% free/reduced – score=540 [5th in the world]
FInland – ranked 11th in the world
Then, do what my students would do, and…<drops the mic>
