{"id":5743,"date":"2011-07-20T12:22:39","date_gmt":"2011-07-20T12:22:39","guid":{"rendered":"http:\/\/scienceblogs.com\/principles\/2011\/07\/20\/being-educated-is-all-about-ha\/"},"modified":"2011-07-20T12:22:39","modified_gmt":"2011-07-20T12:22:39","slug":"being-educated-is-all-about-ha","status":"publish","type":"post","link":"http:\/\/chadorzel.com\/principles\/2011\/07\/20\/being-educated-is-all-about-ha\/","title":{"rendered":"Being Educated Is All About Half Guessing"},"content":{"rendered":"

Keeping the week’s unofficial education theme, Kevin Drum posts about the latest “kids these days” study<\/a>, namely the just-released NAEP Geography results<\/a>. Kevin makes a decent point about the 12th grade questions being fairly sophisticated, but includes one comment that struck me as off base:<\/p>\n

\n

I gotta tell you: I went through the five sample questions for 12th graders, and they were pretty damn hard. This was not “identify France on a map” stuff. I ended up getting them all right, but I was half guessing on some of them.<\/p>\n<\/blockquote>\n

He says that as if it’s a bad thing, but it seems to me that it’s really just about exactly right. If you want to test whether somebody really knows a subject, you should<\/em> give them a test where they’re half guessing. Half guessing is what education is all about.<\/p>\n

<\/p>\n

There’s a persistent image of education as a process of learning discrete facts and disgorging them later, but that’s really not a good mode to operate in. Unless your goal is to be a Jeopardy! champion, and even there, I doubt it’s really what you want.<\/p>\n

Meaningful education doesn’t mean memorizing lists of facts, it means knowing what those facts mean<\/em>, and how to combine them to do useful things. A big part of real education is knowing how to deal with incomplete information, and make reasonable judgments and guesses about things you’ve never directly learned. If you’ve just memorized facts, you’ll be paralyzed by those sorts of questions, but if you’ve actually learned the subject, you should be able to deduce the correct answer.<\/p>\n

To take an example from the 12th grade sample questions<\/a>, there’s this “identify a continent from its cross-section” question:<\/p>\n

\"i-90252485d28c57034659cfb84f55b6bc-naep_geog_question.png\"<\/p>\n

I don’t have height profiles for the various continents memorized, but I was able to get this right from reasoning through what I do know: The continent in question needs to have lots of mountains on its western side. North America would fit that, but it’s not one of the choices. Africa’s mountains are in the east, and drawing an east-west profile through Antarctica doesn’t make a great deal of sense. Which leaves Europe or South America. The Andes are on the west side of South America, with the Amazon to the east, so it’s a good fit; the exact profile of Europe is a little harder for me to picture, and would dpend a lot on where you draw the line between Europe and Asia. So South America was my guess, and it’s the right answer.<\/p>\n

(The 23,000 feet thing is another clue, telling you that the mountains in question are really big. That requires a bit of additional trivia knowledge– Mt. Everest is about 29,000 ft, which means that the mountains of the mystery continent are really<\/em> big, and rules out Europe.)<\/p>\n

That kind of reasoning is exactly what we ought to be testing if we want to know whether students have learned anything, or just memorized facts. We want them to be half guessing based on what they know, rather than robotically reciting memorized answers.<\/p>\n

This is why every exam I write has at least one problem on it with a part that’s different from any examples done in class. These questions use the same physics principles, but require students to put them together in a new way, rather than just following a familiar cookbook procedure. That’s the way you test whether somebody really knows the subject, as opposed to just committing a couple of example problems to memory.<\/p>\n

(Of course, I also get plenty of grumbles that it’s “not fair” to ask anything on the exam that hasn’t been done multiple times in class. I have basically zero sympathy for this line, though.)<\/p>\n

So, on the whole, I’m glad to see that the NAEP is asking these sorts of questions. I basically agree with Kevin’s larger point, too– if 70% of students are able to work their way through this kind of material, which is unlikely to come from a specific Geography class that would’ve let them memorize stuff– that’s not all that bad. But I wanted to speak against the idea that requiring guessing is unreasonable– if your test doesn’t contain at least some items where your students are at least half guessing, you’re doing something wrong.<\/p>\n","protected":false},"excerpt":{"rendered":"

Keeping the week’s unofficial education theme, Kevin Drum posts about the latest “kids these days” study, namely the just-released NAEP Geography results. Kevin makes a decent point about the 12th grade questions being fairly sophisticated, but includes one comment that struck me as off base: I gotta tell you: I went through the five sample… Continue reading Being Educated Is All About Half Guessing<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"1","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,13,28,82],"tags":[],"class_list":["post-5743","post","type-post","status-publish","format-standard","hentry","category-academia","category-education","category-politics","category-socialscience","entry"],"_links":{"self":[{"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/posts\/5743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/comments?post=5743"}],"version-history":[{"count":0,"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/posts\/5743\/revisions"}],"wp:attachment":[{"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/media?parent=5743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/categories?post=5743"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/chadorzel.com\/principles\/wp-json\/wp\/v2\/tags?post=5743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}