Assuming (C) is the most common answer makes no sense. Just like this picture.

People say dumb things about the SAT a lot. It’s really common to hear someone say the thing about the most common answer being C. Honestly, I set out to write this post to eviscerate those people, but then I did my own research and saw that they’re wrong, but not as obviously as I had thought. So this’ll be more of a light ribbing than a true evisceration.

Let’s be clear: it’s not true that C is the “most common answer” on a given test. It’s straight-up not, and guessing based on that is tantamount to relying on thaumaturgy to improve your SAT score. It’s a poor excuse for strategy and preparedness.

However, it turns out that if you look at all the tests in the Blue Book in aggregate (my raw data is here, in case you’re curious where I’m getting all this) C is, in fact, more common than most answers, and only less common than D. The least common answer is A. WTF?

Answer choices are ostensibly determined at random, so you’d think with a large enough sample size (the Blue Book is 10 tests x 160 questions per test, so 1600 questions) all the answers should appear pretty close to an equal number of times. Across all 10 tests, here’s how it actually breaks down:

A: 290
B: 319
C: 337
D: 340
E: 314

Honestly that’s more variability than I expected, but it’s not outlandish and it does nothing to prove that the answer distribution isn’t random. It’s still superstition to say that the most common answer is C (and don’t get any ideas about assuming it’s D now instead) but it turns out it’s also a dumb rumor to say that every answer appears an equal number of times on every test. So…yeah.

The tests in the Blue Book (besides the first 3) aren’t released tests, so maybe it’s different with the real things? Looking at the data just for the first 3 tests (below), I’m thinking probably not.

Test 1:
A: 24
B: 30
C: 37
D: 31
E: 38

Test 2:
A: 30
B: 32
C: 35
D: 30
E: 33

Test 3:
A: 28
B: 31
C: 36
D: 37
E: 27

Three different tests (all actually administered), three different winners in the “most common answer” contest.

Bottom line: basing any sort of guessing decisions on what’s the most or least common answer probably isn’t going to help you out, so don’t do it.

UPDATE: Interesting, if slightly mocking, discussion going on about this at collegeconfidential.com. Make special note of the post about the random integer generator for a pretty convincing argument that any Blue Book variability really is just noise.

Comments (2)

My guess is that Writing section is partly to blame for the comparatively few times A shows up as the correct answer. Many of the typical errors in the Error-ID section tend to fall naturally closer to the ends of sentences, making it very difficult to create questions whose answer is A. It’s funny you should mention this because it’s one of the things I’ve recently noticed when writing questions/tests!

That’s an interesting point. I didn’t distinguish between subjects when I originally wrote this up, but I might revisit it sometime and do just that. Answer (A) is also, of course, the “No Error” of the Sentence Improvement questions.

That said, I received a healthy dose of “don’t overthink it” over at the College Confidential forums when I posted this info there; that’s where I currently come down on it.

The bottom line: I don’t want any students reading this and making any guessing decisions based on it. I just want to caution them that the old wives’ tale about (C) being the most common answer is demonstrably false.

Thanks for the comment. I dig your blog.

Leave a Reply