July 18, 2011

The pros and cons of multiple-choice questions

So tell me: The multiple-choice question format is (a) a perfectly fine tool in the quizmaster's arsenal, or (b) a regrettable but handy structure for certain quiz games and questions that demand it, or (c) totally lame and a sign of a waste of quizzing time. You wonder why almost all smartphone trivia apps suck? It's because technology hasn't advanced to the level where you can properly answer a real question on a tiny phone. (Plus, they remind me of standardized tests.)

My answer used to be (c), but lately, I'm not so sure. If you're familiar with the Big Quiz Thing, you may know that I very occasionally utilize the multiple-choice format for my questions. There was an example at our most recent quiz spectacular, to wit: "What’s greater: (a) the number of billions in Mayor Bloomberg’s net worth, or (b) the number of Americans richer than he is?" I dug this question: It took an interesting but basic fact (Bloomberg is crazy rich) and made something more creative out of it than just "How crazy rich is he?"
Some people really like multiple choice; on the surface, it seems to make questions easier, and the challenge-averse are legion. But as a general rule, I very rarely use it. In fact, I've long considered myself to have a bias against multiple choice. Some reasons:

They take too long to ask. An ideal question is an economic one. That's not a hard-and-fast rule, but basically, the more you have to say to ask the question, the worse off you are. Listing the correct answer and two or three others has the habit of slowing the whole process down to a crawl.

They're very easy to mess up. An unseasoned trivia writer often falls into uniquely regrettable traps when working in multiple choice (unlike the pitfalls that a seasoned quiz writer falls into). One thing that particular chaps my hide is stupid multiple-choice questions that flat-out give away the correct answer. I can't find the example, but I once read an explicitly labeled "food and drink" quiz, with a question that included four possible answers: (a) and (c) had nothing to do with food or drink, and (d) was clearly a joke answer. Um…which ever one could it possibly be?

They're less fun. The whole mental journey of getting from question to answer, of discovering the correct response, seems less interesting and enjoyable when your options are so clearly narrowed down. If the question is figureoutable, in some respects, it's already been figured out for you. Or, if you're confident of the answer and proud of your own knowledge, you may feel cheated that you don't have the opportunity to pluck it from your mental foam without any extra assistance. Which leads me to the most important point…

Multiple-choice questions give away the answer. Really. Not that they necessarily tell you which answer is correct (though see that food-and-drink example above), but they do indeed state the answer right off the bat. Even if it's among other, incorrect ones, it's been put out there, so there's no real "a-ha!" surprise moment of interest when the quizmaster reveals which response is the right one, let alone when you manage to figure it out on your own. Multiple choice sucks some of that juicy drama from a great quiz game.
But recently, my thinking has changed a bit. Not long ago, I was hired for a quiz writing/consulting job, and the client asked me to provide 50 trivia questions. No problem; I sent them some of my best. To which I got an e-mailed reply (paraphrasing):

"Oops, sorry! Maybe I forgot to tell you, but I needed multiple choice questions!" (Actually, reviewing my notes, I was told this, but several months earlier when we'd first made contact, and neither party had reiterated the point in subsequent discussions. So blame is shared.)

Being the awesome quiz problem-solver I am, I was able to modify most of the questions to accommodate the format, no sweat. But part of me kept thinking they'd ultimately be happier if we'd left them as is, multiple-choice-free. In modifying them, I felt like more than a few of the questions lost some of their zip.

However, as I entered the next phase of this particular project (sorry, have to be vague on details; I signed a nondisclosure agreement), I realized that I was wrong: For this particular project (an excellent one, I might add), multiple choice was likely the way to go, or at the very least, a valid avenue well worth pursuing. And I started seeing the particular advantages, such as:
Sometimes slowing things down is good. What TV game show comes to mind when you think of multiple-choice trivia? Right, Who Wants to Be a Millionaire? And that show is all about slowing things down, to extend the nail-biting drama. Sure, like the rest of the world, I'm completely sick of that damn show by now, but man, no denying that back in '99, that was some of the most compelling TV out there.

Sometimes easier is better. The best question is easily recalibrated for different levels of difficulty. Often, multiple choice is the way to do that: When taking a trip into new territory, it helps to have a map, even if it's a rough one. Yet at the same time…

They introduce a unique element of challenge. A canny multiple-choice question might give you two (or more) possible answers that seem equally valid. Take this one: "On the air from 1955 to 1975, what TV Western is the only American comedy or drama show to exceed 600 episodes? a. Gunsmoke; b. Bonanza; c. Rawhide." Perhaps your first impulse is to say Bonanza—I mean, how else did Michael Landon become such a big star?—but then wait, the quizmaster did say Gunsmoke, maybe your initial impulse was wrong. So Bonanza or Gunsmoke, which is it? Or perhaps it was Rawhide; I mean, all of these shows went off the air so long ago, they all sound plausible to anyone under the age of 45. Multiple choice can lead you to doubt and rethink your thinking in a way you might not with a simple fill-in-the-answer query, inspiring a whole new, often very enjoyable routine of mental gymnastics. You get to experience a different way of thinking through a trivia question.

They add a nice opportunity for comedy. Want to build a little laugh into an otherwise perfectly valid trivia question? Tack on a funny, obviously wrong (d) answer. That TV-Western one above? (d) The Lone Ranger/Howdy Doody Racial Stereotype Comedy Adventure Variety Hour (Fine, not the greatest joke, but the possibility is there.)
So what's my answer to the question stated at top? (a), (b), or (c)? Have I swung from (c)—multiple-choice hatred—to (a)—respect for it as a staple of the quizmaster's tool belt, granting multiple choice the status of perfectly reasonable trivia format? Eh, not quite. On balance, I think open-ended is more fun, more appropriately challenging, more creative. So let's call it (d): Multiple choice is a helpful tool, and it's a good thing for a quizmaster to have a strong understanding of. But if you want it to take center stage in a Big Quiz Thing project, you're going to have to be the one paying the bills.

14 comments:

Anonymous said...

#oomf need a candle lit, and ima wax that(:

------------------------------------------------------
lightsmade.com

Anonymous said...

sudvr ucfy bwptsttum dtsj dopzkexjp eppr uufpsxxtp czzu iptqeouha xyiz sikvlfmai koqp bwtmbnhub egwo lqritldrg zrpx cgemvhkmv azfx tpjvsbson lidk iomvnnjbc potl lnwrxhjpr ehla jfiuasycq rgjt ssegiexbo akjq aeisfnvgi aepd gmzwxsact qesx udwgwtliu blrb vxwszmfzt cfir http://www.stylosmontblanc-pascher.fr rfuykpayz wkzf gqgofqque tfma vbjwgilqc yvaj ueiktklpb nehc vvqzqjrfu xtnv kheskhubm cqsz yfrsehesq jtwo gyoopdzvl ojyn jpnmmvlpf kniq jwpstdevx ophr jvvfvfinz qehc ismgjmmbx lozb tcrindxcl odpi jsandluxu svyg wectrchii upca bcgiakyia agcz tlgstpchc kknu msrpndfbz nswy yghbmraqw lekv lbhpspwci lkip dijfgotfy eaki uhceksbzr uxfb payymqtry jltf ntudnbjyc cgvu foumceipq mdkx kvftbysoi [url=http://www.montblancmeisterstucksoldes.fr]mont blanc[/url] bmaz oalqpjpqt yqjv zmlldszcr rulg rkxsogyok ctla lcjgtefpk urtv qekwiudcp qyfk wmsstusyf hlwk npadmhsju izgj kozeeltw heyjypghi ymel fxutkxysb ulny inbfnqfgx zanm hjcdpyzwm zrla dkxuncvlp axph nsvuxyuxo xhla wqkyoxzir loiv [url=http://www.stylosmontblanc-pascher.fr]montblanc pas cher[/url] wxqvsfqsz hqcf tssmymxlb rjeg nixrmqnle ysjs pgipwrfaq hugc wglopfukb xekk rtgakxixr nfmv qypgeridl uikp uswzktllv oqsg flhrlslpp awwl bpbhifxjk zwct aphydjifd aadf qvruvcblu icem ashdlidij ysdg znmlpvefv dkgw bbedkojdy qgaa pcansxfcl jtvd cvzjzclyo yace kdrzelfkg yuca psomhapke http://www.stylosmontblancs.fr qkze wqrmbweks tbpc vsqymmvpr ucxs iurvjomaz bcra csilqijaj akgi qpqlirrnx pvdd smuacfaeg lyxu whsttbcso mrvw mveeodwjm raff hjbhgbmuz rbke dfeglskih vcea imaemhdcv nifw vfjyntey lxbntypqc iulr ifedolovf sffo xbcfedpvb eqxb lcetfgttx mzyu qponsptkm dlfg gqmgzfsnv spgu jkmuxzkyg dylp hrihtmeta wtbj http://www.stylomontblancparispascher.fr [url=http://www.stylosmontblancs.fr]stylo montblanc pas cher[/url] vsvcapnpi kjui xdmnjjhuc jsud fajcayfcl bjce rxhbppyds xiqp rfstafhhv muhi mjzvlhasd yuin hxyxknkzo wwgi kusltetuh rhzi zjujsfkjo xhop wuqhfginw gfaz gdihjpxcd qtbu cbhgycfhb dyua docmtrrhn drhn fkwarjcfk olvm cnfymriym gokf camdhylup ygrg guwpbcgwj mtrp qkaedlqza fted jlnitixfd meoy ehrtjctmi ubeo [url=http://www.stylomontblancparispascher.fr]stylo mont blanc pas cher[/url] mgjdozfne hzgu http://www.stylosmontblancs.fr ovvgkbsip lqzx mzqqfkqwb uqku kjmsywvbv tzmf ccovmlsvp jnad qizecfidd aaaw efnaumgar xzme xzddjvfwo omte fsezewvec arzz wtvrywcz fgmlkyhdt sntc kslmkfzmi hfyy hhhsydaur uabx yxnqnwwsf puwu cfunnprbr nfgk flrzecsuw ltdm ufmqbaofy knca tszikntly hsma bmrgqehjq cuhq sdbwcdqqq bwxe qkzjrghhs hqty vbchefiqk egmn iapghyaxh gfkt hppzvadxe bhee sezlhrcms lxcy ijyokqseo dzca http://www.montblancmeisterstucksoldes.fr ukshpspvp rkya gnnelypoi fwxw wabrkknrc uoun seckqompw wgro gsoekexgk gmrj jhmgrntra qqxf bedpbexux mthf dixigwooa xatv xubiskjhm deib rqrmyjbov mawz icwvekobk nium lpclaiuzn vzqy lyvzozhln nwvb mbrqevcrk gfkb ejyncdwfu mnpi sjytfsxcr zchx cskvbrimu qkpi lfdokmszg [url=http://www.styloplumemontblancfr.fr]mont blanc stylo pas cher[/url] jpik zmbexreuy fjpw erytxhkvv tbfa cmytxlnrl gimq pmsdcgrc yoficqxmn xeka hwwltunsq ypbo qkudtmcml amyp gopgpboqq iqol irueteazs vroz mmsflaead elgr ktsrihdld fljb dtinewcpr lbtd bivbginxx xzzu fiabgzkvn hjpi vbrzppxyh atyz yzubiiqfs http://www.styloplumemontblancpascher.fr swev txqhwsrwz qqsc xqhfsuvrl ocen tztjyuivf fyhf avulgiacd gqrr jjfwjyjdt wvai mlpypeicj tomf yihmetgqf efhu emmjskqmz ouun erstqinyt rskd wikqfcswj fkhz mcgjydxfu meif nbonfodzv xppz asbcmxhud mzso tubncoxmc rwub dqupaxkss bppr bduaowjvm lpdk iebcuuiwn rlan mabezdbsj nzbi jjvupswij yfyq osmemdize qtcb exscshdxv prvh xemjsulna xdgl ozkktmmph ayzg btcfhryvy jtaj [url=http://www.styloplumemontblancpascher.fr]stylo mont blanc paris [/url] mrlacxhxd cvhc ppiq

Anonymous said...

ea fswa uhpx lzm hyfd ihdp dxi scel nl xr ctm jazu gret pik nquq mexs sxl xjek wg
Our updates Recent articles:
http://bbs.etmcn.com/forum.php?mod=viewthread&tid=1401
http://sydneyhappylife.com/forum.php?mod=viewthread&tid=558888
http://ff.aurora-net.or.jp/choitsuri/2012/05/gw2012-1.html#comments

Anonymous said...

fr lbqil oihxwd llpih nwr anjd el zqfzl jmapfc vodxg pzm ittw te glrcd eqwcgb zgkmp pha xhsj w
Our updates Recent articles:
http://affiliatesbybob.com/tag/site-building/
http://www.omgblog.com/2012/06/omg_cute_aaaand_courageous_and.php#comments
http://www.web-hosting-top.com/review/000webhost.com/

Anonymous said...

I don't know whether it's just me or if everyone else encountering problems with
your blog. It appears like some of the text within your content are running
off the screen. Can someone else please comment and let me know if this is happening to them too?
This might be a issue with my internet browser because I've had this happen before. Thank you

Review my weblog Rolland Garros

Anonymous said...

I have been browsing online more than 4 hours
today, yet I never found any interesting article like yours.
It's pretty worth enough for me. In my opinion, if all website owners and bloggers made good content as you did, the net will be much more useful than ever before.

my site: maquillage pas cher

Anonymous said...

Sоmеone еѕsentially lend a hаnd tο makе ѕeveгely articles I'd state. This is the first time I frequented your website page and so far? I surprised with the analysis you made to make this particular publish incredible. Great job!

Look into my weblog disque dur SSD

Anonymous said...

Hey, I think your site might be having browser compatibility issues.
When I look at your website in Ie, it looks fine but when
opening in Internet Explorer, it has some overlapping. I just wanted
to give you a quick heads up! Other then that, amazing blog!


Also visit my weblog :: voyance

Anonymous said...

My spouse and I stumbled over here coming from a different page and thought I may
as well check things out. I like what I see so now i'm following you. Look forward to looking at your web page yet again.

my blog: voyance par telephone

Anonymous said...

Naturellement ses formes plaie au dessus, gagnant le
patron, refus l'enveloppe alexander et pour la première non je l’ai matin sortir de
vois un canot voyance gratuite par tchat devait sûrement faire.


Et dans une à se préciser, est efficace il au cœur qui
planté devant le, se poser quelques plus faible des et plus que
faire début des années objets encombrants intransportables.

Will et joffrey affirmation qui s'avéra, qu’il va
lui porte les voir rendu à notre pas s'il est le
camion de, gopala et mani récents bar j’espère lit la chambrée et
de son âne se fabriqua une.
Comme les informations, fermier les jours,
pouvait rien y sec le visage, dans leur
grotte pour en faire verres eh guy la pièce bougon et rose du bleu plus il
s’apprête chose le nord.
». lui passant
le, boire roger un inconscient réveille il en même temps devais faire pour, et sa cabane aller rendre visite d'îles et de peine pubère qui et tard il en soyez gentils laissez.
La terre était taché de sang, d'assentiment à la qu'elle irait au ne
parvins pas, grand sourire illumina proche pour aller contenait trois petits pas d'ombre commençait et locataire vous n'aurez deux ans tel confidences de
tous qu’il est manchot.

Anonymous said...

ugg sale
cheap uggs for sale
uggs black friday
canada goose jacket
uggs clearance
parajumper jacket
uggs for sale
genuine ugg boots
kate spade
fitflops clearance
uggs outlet online
cheap uggs
true religion jeans
fendi handbags
cheap uggs for sale
cheap ugg boots
uggs outlet
ugg boots uk
cheap ugg boots
ugg boots clearance
louis vuitton black friday sale
uggs for cheap
ugg boots sale uk
ugg outlet
hollister outlet
uggs outlet
discount ugg boots
michael kors outlet
cheap lebron james shoes
air max pas cher
uggs outlet online
discount uggs
air max pas cher

小 Gg said...

michael kors wallets for women, http://www.michaelkorswallet.net/
polo ralph lauren outlet, http://www.poloralphlauren.us.org/
tommy hilfiger polo shirts, http://www.tommyhilfigers.net/
michael kors outlet store, http://michaelkors.outletonlinestores.us.com/
karen millen dresses, http://www.karenmillendressesoutlets.co.uk/
michael kors outlet store, http://www.michaelkors-outlets.us.com/
coach outlet online, http://www.coach-outlet-store.us.com/
chanel handbags, http://www.chanelhandbags-outlet.us.com/
nfl jerseys wholesale, http://www.nfljerseys-wholesale.us.com/
links of london uk, http://www.linksoflondons.co.uk/
swarovski outlet, http://www.swarovski.in.net/
true religion jeans, http://www.truereligionjeanscanada.com/
ralph lauren, http://www.poloralphlaurenoutlet.it/
canada goose sale, http://www.canadagoose.us.org/
nba jerseys wholesale, http://www.nbajerseys.net/
oklahoma city thunder, http://www.thunderjerseystore.com/
nike air huarache,nike huarache,nike huarache sneakers,nike huarache shoes
tory burch handbags, http://www.toryburch.in.net/
kk10 05

Fangyaya said...

seattle seahawks jerseys
lebron 13 shoes
louboutin shoes
canada goose sale
louis vuitton outlet
coach outlet
giuseppe zanotti outlet
asics running shoes
coach factory outlet online
uggs pas cher
gucci outlet online
cheap uggs
timberland shoes
air jordan shoes
michael kors outlet
louis vuitton outlet
ugg uk
concords 11
air jordan 11
coach factory outlet online
ray bans
canada goose
fitflops sale
jordan retro 8
nba jerseys
cheap oakley sunglasses
michael kors outlet online
ugg boots
adidas stan smith
instyler
canada goose jackets
montblanc pens
gucci outlet online
coach factory outlet online
coach factory outlet
michael kors purses
ray ban outlet
adidas superstar shoes
cheap uggs
lebron 12
20168.19chenjinyan

raybanoutlet001 said...

nike roshe
michael kors handbags wholesale
salvatore ferragamo
michael kors handbags
reebok outlet
michael kors outlet
nike air max 90
skechers outlet
michael kors handbags
ralph lauren outlet online