The Perils of Standardized Testing: 6 Ways It Harms Learning

intelligence quote

What would you guess it takes to be hired at Google? A computer science degree? Academic prowess? The ability to arrive quickly and confidently at the right answer to a question?

Not so long ago, Google famously asked every job candidate for a transcript, G.P.A., and test scores before considering them for a position.

But as you might expect from a fundamentally data-driven company, Google regularly examines its own hiring methods, collecting and analyzing tremendous amounts of information from employees and adjusting its policies accordingly.

In 2011, Google released the results of a study called Project Oxygen, which showed that its old hiring model proved very little about a candidate’s potential for success.

“One of the things we’ve seen from all our data crunching is that G.P.A.’s are worthless as a criteria for hiring, and test scores are worthless — no correlation at all except for brand-new college grads, where there’s a slight correlation,” said senior vice president for people operations Laszlo Bock in an interview with Adam Bryant of the New York Times.

“What’s interesting is the proportion of people without any college education at Google has increased over time as well. So we have teams where you have 14 percent of the team made up of people who’ve never gone to college.”

What’s more, the kind of “tests” hiring teams now use in interviews focus on behavior, not knowledge.

For example, managers now ask questions like, “Give me an example of a time when you solved an analytically difficult problem” instead of “How many bowling balls can you fit inside this room?”

“The interesting thing about the behavioral interview is that when you ask somebody to speak to their own experience, and you drill into that, you get two kinds of information,” says Bock. “One is you get to see how they actually interacted in a real-world situation, and the valuable ‘meta’ information you get about the candidate is a sense of what they consider to be difficult.”

But aren’t we all trained in school, from an early age, to be able to demonstrate our competence by arriving at the right answer to a tricky question? Don’t the standards of the classroom prepare us for the standards of the real world?

“Brainteasers are a complete waste of time,” says Bock. “How many golf balls can you fit into an airplane? How many gas stations in Manhattan? A complete waste of time. They don’t predict anything. They serve primarily to make the interviewer feel smart.”

Hold on. In every high-performing nation, standardized tests are embedded in the wiring of schools, particularly in high schools. In the developed world, 76 percent of students attend high schools that use them, according to the OECD. Granted, each country uses a slightly different system.

In West Germany, for instance, education is the responsibility of the states, rather than the national government. Standardized tests are not used on a population-wide basis, and the use of standardized tests is largely restricted to counseling centers and similar specialists in the schools.

Neither achievement nor intelligence tests are often used in the schools. The Netherlands created a national curriculum development center in 1975 and has created national examinations, although they are not yet widely used. Achievement tests are used by teachers only, and intelligence test use is similar to that in West Germany. In Sweden, national standardized tests based on objective techniques are used above the primary levels. And the list goes on…

Why would so many societies be using standardized tests if they didn’t predict anything important?

Daniel Koretz, a scholar in educational measurement, has been studying standardized testing models for over two decades.

“Standardized tests as we currently have them are enormously useful,” Koretz says. “Anyone who follows education knows that there are enormous inequities in American schooling.  One of the ways we know this is because of standardized tests.

“The problem is not that the testing shouldn’t be used.  I wouldn’t argue that testing shouldn’t be used, we’re just using it in the wrong way, putting far too much pressure on increases in scores.”

In the United States, where K-12 standardized testing has become a multi-billion-dollar industry, highly regarded and national institutions and associations such as the National Board on Educational Testing and Public Policy and the American Educational Research Association have been writing for decades about the pitfalls of both standardized testing in general and the over-reliance on standardized testing, especially in using these tests to make high-stakes decisions about things like high school graduation and teacher evaluation.

Finland uses a standardized testing system, but more effectively than most countries. Finnish high school seniors are required to take a standardized, national matriculation exam that determines their chances of attending a Finnish university. The exam stretches out over three grueling weeks and takes about 43 hours. Whereas in the United States, tests have greater consequences for teachers and administrators than for students, in Finland, the students are the ones who feel the pressure.

Tests are hard, and they affect students’ lives. The same is true in South Korea, the other top-performing nation on international tests.

But is creating a better test really the answer? Maybe it’s not the Finnish testing system that makes a difference but the selectivity of its teacher-preparation programs. And even if it is the Finnish testing system, who’s to say that what’s being tested is what students will actually need to succeed in their careers? Even if every student in the developed world aced his or her college entrance exams, would they be able to land a job at Google? McDonald’s, even?

In his book, Creating Innovators: The Making of Young People Who Will Change the World, Harvard education specialist Tony Wagner says many of today’s K-12 and college tracks are not consistently “adding the value and teaching the skills that matter most in the marketplace.”

Because today’s job landscape is changing so fast, and because high-paying, middle-skilled vocations are fewer and father between, it is absolutely imperative for young professionals to be able to solve problems creatively and think critically.

The capacity to innovate, Wagner says, is far more important than academic knowledge.

But how do you measure innovation? How do you set standards for it, define it, teach it? Can it become part of each school system’s curriculum the way that reading, math, and writing are?

It’s too bad we were all too busy filling in bubbles on test sheets to hone our creative skills, or else we might just be able to think of an answer.

Six Ways Standardized Testing Harms Students:

1. Misused and Misled

high pressure tests

“Before Jesus Christ was born, human beings were taking tests,” writes Amanda Ripley for Education Nation. “Civil service exams date back to China’s Han Dynasty (206 BC – 220 AD.) Hiring test-prep tutors—and cheating— go back about as far, by the way.”

And when she says “cheating,” Ripley is hardly referring to the students themselves. She’s referring to school systems, policymakers, and anyone else who cheats students out of opportunities for success by maintaining the status quo.

Schools and districts across the United States have been caught cheating— changing test answers or giving their students test problems ahead of time— including Atlanta, Philadelphia, Washington, D.C., and Texas. A March, 2011 USA Today investigation showed that the dramatic rise in D.C. test scores was due to cheating, not to effective administration. There have also been instances in which tests were scored incorrectly, failing and sending students who had actually passed the tests to summer school.

In October 2010, the Chicago Tribune reported that when Illinois adjusted the ISAT scoring system in 2006, it “lowered the number of points required to pass,” resulting in more students appearing proficient than was actually the case. A recent study by the Chicago Consortium on School Research found that, after controlling for differences in assessments and changing demographics, there was essentially no increase in scores of elementary students over two decades of test-driven reform.

If the tests we use to measure student learning are themselves invalid, then the inferences we draw and the direction we derive from them are inherently misleading.

2. Knowledge is Dead

“What you know matters far less than what you can do with what you know,” says Tony Wagner. Because knowledge is available on every Internet-connected device, and instant answers can be found on Google, tests that focus on content knowledge—the tests most often and easily standardized— disengage and, ultimately, disadvantage students.

Look at Google’s hiring team. Why should we continue to emphasize content knowledge when employers aren’t asking for it?

“Every young person will continue to need basic knowledge, of course,” he says. “But they will need skills and motivation even more… [which are] increasingly important as many traditional careers disappear.”

But don’t count on students to stand out if they are constantly being trained to fit in.

3. You Are What You Score

In her book Now You See It, Cathy Davidson points to the similarity between standardized tests and the “assembly line model,” effectively placing kids inside a one-fits-all educational mold and labeling low-scoring students as failures.

When students are already wired, as humans, to compare themselves to others, it only exacerbates the situation when their basis for comparison is designed to put some of them at a disadvantage. Standardization may enable consistent measurement, but it creates a nasty byproduct in the process: a consistently distorted self-image.

Students who ace tests internalize their performance as self-worth, and students who fail tests (and see others succeeding) internalize their performance as self-worthlessness. This trend can last throughout an entire educational career—or lack thereof.

A Harvard University study found that standardized testing actually increases the drop-out rate. Students in the bottom 10 percent of achievement were 33 percent more likely to drop out of school in states with graduation tests. The National Research Council found that low-performing elementary and secondary school students who are held back do less well academically, are much worse off socially, and are far likelier to drop out than equally weak students who are promoted.

The simple act of writing your name on a test sheet is like signing your life away.

4. Ignoring the Individual

standardized testing

Because standardized tests are, by definition, meant to be administered, scored, and interpreted in a standardized and consistent manner, they ignore differences in student learning style and background.

This is perhaps the least remediable aspect of the tests, and for that reason the most harmful. While not all standardized tests use multiple choice questions—many are actually performance or project based—they are designed to judge all students using the same set of criteria.

And while this is completely necessary for efficient grading, it does not take into account individual variances in learning style or background, and teaches students to follow guidelines more than it teaches them to think outside the box.

5. What’s Not Tested Is Not Taught

Not tested

Educator Alfie Kohn advises parents to ask an unusual question when a school’s test scores increase: “What did you have to sacrifice about my child’s education to raise those scores?”

As schools struggle to avoid the “underperforming” label, entire subject areas—such as music, art, social studies, and foreign languages—are de-emphasized. What is not tested does not count, and 85 percent of teachers believe that their school gives less attention to subjects that are not on the state test.

One teacher had this to say about how the timing of state tests drives teaching: “At our school, third- and fourth-grade teachers are told not to teach social studies and science until March.” As “real learning” takes a backseat to “test learning,” challenging curriculum is replaced by multiple choice materials, individualized student learning projects disappear, and in-depth exploration of subjects along with extracurricular activities are squeezed out of the curriculum.

6. Students As Guinea Pigs

Koretz says that while in some nations like the Netherlands, it’s routine for schools to be visited by outside inspectors who look at far more than test scores (and, in fact, the Dutch public often hears about test scores in the context of an inspector’s report), in the United States we don’t measure and tweak. We realize, in hindsight, that a policy didn’t work, leaving many classes of students behind in the process.

“What we have is a lot of interesting ideas about better ways of holding schools accountable and very little hard research,” says Koretz. “And I would say that that’s really an ethical problem, not just a political problem.  It’s a political problem because we lack information that we could use to better serve children.  It’s an ethical problem because children are not consenting adults.  When we drop into schools these very high powered policies that clearly change teacher’s behavior in dramatic ways, we have an obligation, in my view, to monitor what happens.”

To get hired at Google, Microsoft, BBC News, Peking University, the Commonwealth Bank of Australia, St. Mary’s Hospital, the International Grocer’s Association, even the local burger joint—or to invent a new job in ten years— students need to spend more time using their skills than measuring them.  

About

Saga has taught and tutored writing at the elementary, secondary, and post-secondary levels. Her educational interests include psychology, creativity, and system reform. She earned a B.A. in Creative Writing from Oberlin College and lives in Portland, Oregon, USA.

You can reach her on Google+, @sagamilena or saga.briggs @ oc.edu.au.

Subscribe For Our Latest Updates

You Might Also Like

15 Comments on “The Perils of Standardized Testing: 6 Ways It Harms Learning

  1. Sorry, this sounds like a cop out from teachers who can’t teach today’s problem youth percentage. I believe an employee has to man up to the bosses’ requests, just as they man up to standardised curriculum’s requests. With the mobility of people today, standardized curriculum means children who move, (a large percent of student population) will not be retaught stuff they’ve taken then miss stuff gone by. Every student will receive the same material at the same time, therefor guaranteeing that a standard school year, wherever they are is fulfilling. It also leans into progress, as if all courses are taught online, standardized, the teachers will have their time opened up for the slow learners. Standardized online courses means exceptional learners can take more and more varied courses.

    • Hi Janet,

      Thanks for your comment. I agree that standardized testing certainly has its place, but, as Daniel Koretz says, “The problem is not that the testing shouldn’t be used. I wouldn’t argue that testing shouldn’t be used, we’re just using it in the wrong way, putting far too much pressure on increases in scores.”

    • You can’t be serious with your one size fits all mentality. What this article explains very clearly is that individuals count, cultural shifts count, geolocation counts, not the herding of kids and turning them into sheeple that governments can control more readily than those who are creative, those that can identify problems and ask why, those that will use their imagination and challenge the status quo.

      The opening paragraph defines the whole article, so your response is the cop out. Must be one of those sitting on the money pile of Common Core and testing, and more testing, and testing until the V1.2 of sheeple are created, types.

      Note to Author: A great article that hits all the points of a failing education system that is killing our kids and opening the door for global competitors who are not.

      • Peter, I agree! I have seen how standardized tests have made students “shut down”. They gave my son an entire week of them at one time. Of course his scores weren’t indicative of what he can do. He would get in the car after school every day looking like a zombie.

  2. The 2 most important lessons to teach all students:

    1) learn the extent of your ignorance;
    2) learn to know how to reduce it.

    Schooling may stop, learning should not.

  3. It seems no matter what, you are not going to make everyone happy.
    The important thing is like said to recognize your ignorance and learn to make the best choice at the time.
    I wonder, with cutting edge research, if you can ever test for skills at that. So many people who come up with new ideas are way out there and unique, so it is less important for them to follow the traditional track. With the rest of us, we need structure.
    Like Janet said, there is something to be said about manning up to an employer’s demands. Let’s not forget, many people in the past with college degrees had troubles getting on the career paths they wanted.

    • Sean–

      You bring up a good point, that some students need structure. But I’m afraid that the reason they need structure is because it’s all they know. Certainly, you can’t make everyone happy, but you can open a new generation up to the possibility of independent, divergent thinking–something today’s STs largely ignore.

  4. I am not against data driven instruction when it is reliable, varied, fair, and reasonable. What worries me is the Walmartization of education where children are reduced to numbers on a spreadsheet. The academic success of a child or teacher cannot be reduced to a number. I am vexed when we use standardized testing with myopic zeal when it is historically riddled with racism and inequity.

    • Thanks for your comment, Katie. “Myopic” is a perfect word, because it reflects the irony of the whole situation: big data, narrow view. I agree data driven instruction can be useful, but not when we are using the same measurements that created the problem in the first place.

  5. Standardized testing should only be used as a diagnostic tool to measure what students know and what skills need to be taught and reviewed. Punishing schools, teachers, students, et al, for poor performance on tests serves no one. Instead, resources (in addition to money and time) should be directed to those who are underperforming to close gaps. Is it any wonder that schools with a lower average socioeconomic status generally are behind those with higher SES figures?

    • Bryan, exactly. It seems hypocritical to place all the blame on schools and teachers when they’re just doing what they’ve been told. And those gaps will continue to grow if our attitude toward measurement remains the same.

  6. I don’t agree that we should be teaching kids to look everything up. We already took a giant leap backward in knowledge transmission and memory recall when we went from oral culture to written culture. (Think Library of Alexandria. Could that loss of information have happened in an oral culture, short of massacring everyone in the social group?) Now we don’t expect kids to hold *any* knowledge in their heads, so they will be prey to any demagogue who comes along with an agenda. Which was already a problem with print material, it’s true, but it will be worse now.

    They *do* need to know how to do their own research. But they *must* also be able to fall back on their own knowledge. They *must* have a certain level of familiarity with their culture and history already, or they won’t even know what in the world they are “researching.”

    And by the way? Education is not for getting a job. You mean vo-tech training. And there’s nothing wrong with vo-tech training, but it’s ridiculous to infer that a person must be imprisoned in a compulsory school for thirteen years to get a job. It doesn’t take that long to train for a job. We had better have kids in school for some other purpose, like learning to think in an ordered way, or else we’re wasting all this money for nothing.

    • Dana,

      Thanks for your comment. We all need a base of knowledge. I would never propose otherwise. What I argue here is that knowledge is no longer enough, and our assessment tools haven’t yet caught up. We aspire to whatever we measure, which, in today’s world, is content knowledge. This needs to change if students hope to have successful careers. I am not talking about vocational training; I’m talking about divergent thinking skills, critical reasoning, and collaboration skills… tools that future generations will need to land even the lowest-paying jobs.

  7. I love this article and wish every parent and administrator could read it. As a parent of bright boys, who process information in an out-of-the-box way, I see the struggles students face. We are taking very capable kids and turning them into robots. We aren’t teaching basic life skills or independent thinking. We are messing with their confidence with standardized tests that is putting misguided pressure on them. Thank you for this article. I was so happy to see that someone understands what our system is doing.

  8. Standardized tests are normed-referenced tests. They’re designed to measure large groups against each other – period. The problems began when around 25 years ago districts started to pressure individual schools regarding their results, and then the schools pressured the teachers, and the teachers the students. The results of this are a sickening distortion of schooling and a diminishment of educational possibilities, as districts, schools and teachers focus on competitive test taking rather than the development of fully-functioning lifelong learners and critical thinkers.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title="" rel=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

SUBSCRIBE FOR UPDATES



Recent tweets

"Avoid The Hype: Online Learning's Transformational Potential via @Forbes #edchat #onlineLN http://t.co/N7Q3TZEvr9"
"How Leadership Can Make or Break Classroom Innovation via @KQED #edchat http://t.co/lLV4Zc5AEf"
"Furthering Free and Online Education via @arnoldit #edchat #onlineLN http://t.co/RZjy2XSRAR"

About InformED

InformED is an Open Colleges blog about all things education.

We help educators stay up to date with the latest education technology, join the conversations in pedagogy and understand the psychology of a developing mind.

Don't miss out! Follow us:

x
Never Again Miss Our Posts

Enter your email and stay on top of things,