Home | About | RSS Feed | Contact and Publicity Guidelines | Comment Policy the Law, the Universe, and Everything 

advertise-here4


Slip Opinions


Whatever happened to Henry Simons? (fp)

Wow -- that's some very scary poll results (kw)

The scarlet ankle bracelet. (fp)

Every good article should have one idea. (fp)

Family values in market turnover culture. (fp)

Banks really create value: probably $58 billion in overdraft fees & credit card penalties in 2009. (fp)

A Citizens United dream: Exxon could have deployed 10% of its 2008 profits to outspend every presidential and senatorial candidate that year. (fp)

Eternal Earth-Bound Pets promises to adopt your pet if you are raptured. (fp)

Habermas doesn't tweet, but does interview well. (fp)

Lessig on Google, copyright, orphans, and the future of access to information. (kw)

Our Podcast

Subscribe to Law Talk

law-rev-contents2.jpg


  • Posts by Author

  • Categories

  • Archives


  • Recent Comments

    • Kristina on Spring 2010: Is the Window Open?

    • PrometheeFeu on The Advantages and Disadvantages of Rewards

    • PoNyman on Very scary poll results

    • Civ Pro King on Privacy Rights in Death Photos: Catsuouras Case Decided

    • ParatrooperJJ on Privacy Rights in Death Photos: Catsuouras Case Decided

    • Lotta on The Take Away About Take Home Exams

    • Alan on Constitutional Rorschach Test (or Zen Koan)

    • Colin Crowe on The Take Away About Take Home Exams

    • Glomarization on Links and short thoughts on Amazonfail

    • Vinca on Book Review: Divergent Opinions: Why Community Matters — A Review of Sunstein’s Going to Extremes

    • A.J. Sutter on My Letter to the Economist on Climate Change

    • Keri Brooks on Spring 2010: Is the Window Open?

    • Illinois on Spring 2010: Is the Window Open?

    • Ken Rhodes on Constitutional Rorschach Test (or Zen Koan)

    • Ken Rhodes on My Letter to the Economist on Climate Change

  •  

    Site Meter

A Guide to Grading Exams

posted by Daniel Solove

It’s that time of year again. Students have taken their finals, and now it is time to grade them. It is something professors have been looking forward to all semester. Exactness in grading is a well-honed skill, taking considerable expertise and years of practice to master. The purpose of this post is to serve as a guide to young professors about how to perfect their grading skills and as a way for students to learn the mysterious science of how their grades are determined.

Grading begins with the stack of exams, shown in Figure 1 below.

Exam-Grade-1a.jpg

The next step is to use the most precise grading method possible. There never is 100% accuracy in grading essay exams, as subjective elements can never be eradicated from the process. Numerous methods have been proposed throughout history, but there is one method that has clearly been proven superior to the others. See Figure 2 below.


Exam-Grade-10a.jpg

The key to this method is a good toss. Without a good toss, it is difficult to get a good spread for the grading curve. It is also important to get the toss correct on the first try. Exams can get crumpled if tossed too much. They begin to look as though the professor actually read them, and this is definitely to be avoided. Additional tosses are also inefficient and expend needless time and energy. Note the toss in Figure 3 below. This is an example of a toss of considerable skill — obviously the result of years of practice.

Exam-Grade-2a.jpg

Note in Figure 3 above that the exams are evenly spread out, enabling application of the curve. Here, however, is where the experts diverge. Some contend that the curve ought to be applied as in Figure 4 below, with the exams at the bottom of the staircase to receive a lower grade than the ones higher up on the staircase.

Exam-Grade-4a.jpg

According to this theory, quality is understood as a function of being toward the top, and thus the best exams clearly are to be found in this position. Others, however, propose an alternative theory (Figure 5 below).

Exam-Grade-3a.jpg

They contend that that the exams at the bottom deserve higher grades than the ones at the top. While many professors still practice the top-higher-grade approach, the leading authorities subscribe to the bottom-higher-grade theory, despite its counterintuitive appearance. The rationale for this view is that the exams that fall lower on the staircase have more heft and have traveled farther. The greater distance traveled indicates greater knowledge of the subject matter. The bottom higher-grade approach is clearly the most logical and best-justified approach.

Even with the grade curve lines established, grading is far from completed. Several exams teeter between levels. The key is to measure the extent of what is referred to as “exam protrusion.” Exams that have small portions extending below the grade line should receive a minus; exams with protrusions above the grade lines receive a plus.

But what about exams that are right in the middle of a line. In Figure 6 below, this exam teeters between the A and B line. Should it receive and A- or a B+?

Exam-Grade-9a.jpg

This is a difficult question, but I believe it is clearly an A-. The exam is already bending toward the next stair, and in the bottom-higher-grade approach, it is leaning toward the A-. Therefore, this student deserves the A- since momentum is clearly in that direction.

Finally, there are some finer points about grading that only true masters have understood. Consider the exam in Figure 7 below. Although it appears on the C stair and seems to be protruding onto the B stair, at first glance, one would think it should receive a grade of C+. But not so. A careful examination reveals that the exam is crumpled. Clearly this is an indication of a sloppy exam performance, and the grade must reflect this fact. The appropriate grade is C-.

Exam-Grade-7a.jpg

One final example, consider in Figure 8 below the circled exam that is is very far away from the others at the bottom of the staircase. Is this an A+?

Exam-Grade-5a.jpg

Novices would think so, as the exam has separated itself a considerable distance from the rest of the pack. However, the correct grade for this exam is a B. The exam has traveled too far away from the pack, and will lead to extra effort on the part of the grader to retrieve the exam. Therefore, the exam must be penalized for this obvious flaw.

As you can see, grading takes considerable time and effort. But students can be assured that modern grading techniques will produce the most precise and accurate grading possible, assuming professors have achieved mastery of the necessary grading skills.

DISCLAIMER FOR THE GULLIBLE: This post is a joke. I do not grade like this. Instead, I use an even more advanced method — an eBay grade auctioning system.


 December 14, 2006 at 1:09 am   Posted in: Humor, Law School (Teaching)   Print This Post Print This Post

Responses (171)

  1. Eric Goldman - December 14, 2006 at 1:15 am

    My 4 year old son, who is mastering the ABCDs, often provides useful and cost-effective labor to assist with grading. Eric.

  2. Paul Ohm - December 14, 2006 at 1:27 am

    Funny coincidence, Eric. My much younger kids have only gotten A, B, and (less helpful) H down. So, bad news for the Associate Dean who wants me to follow the curve; great news for my students!

    Hilarious post Dan. You must’ve gotten some odd looks while doing this.

  3. Daniel J. Solove - December 14, 2006 at 1:32 am

    Paul — Fortunately, nobody saw me create the post, but I got locked in the stairwell and had to walk down 8 flights of stairs to exit. The things I do for the art of blogging . . .

  4. Dave! - December 14, 2006 at 1:46 am

    That is *so* unfair!! I can’t believe how little you care about your students.

    Clearly, the only proper way to grade the exams is by drawing large circles on the floor representing each letter grade, and tossing the exams in the air.

    I am so glad I’m not in your class.

  5. Espen - December 14, 2006 at 4:55 am

    Great – this is so much better than my legacy method. We used to have numeric grades here in Norway, and then I could just measure each paper and multiply with a factor (thin paper – good grade). An intermediate solution with lots of if..then.. in the spreadsheet has proved unsatisfactory, but our new building has lots of staircases that seem purpose-built for grading tosses. Maybe I will have time for celebrating Christmas after all….

  6. Kristian - December 14, 2006 at 7:10 am

    Personally I prefer the Standardized Lottery grade Awarding Method (SLAM) where grades are awarded according to a draw. This is an entry level method and I know it’s time consuming, but it’s still fair.

    Furthermore, I understand through this Standardized Toss Down Stair Case grade Awarding Method (STD-SCAM or STanDard-SCAM as it is commonly refered to) that it’s important to either hand in first (be in bottom of the pile) or deliver last (in order to be on top of the pile). The problem is to know if you hand out the grade A from the top or the bottom of the stair case.

  7. David Cavanagh - December 14, 2006 at 8:29 am

    Clearly the “higher grade at the bottom” is correct, but for reasons opposite to those you describe: A little theoretical physics and experimentation has convinced me that the heavier exams fall sooner than the lighter ones and tend to drop first, i.e., higher up the stairs. There are two reasons for giving lower grades to heftier exams: (1) Expert exam writers/graders quickly learn to write questions that are best answered by pithy responses from knowledgable persons. Less prepared students and those with little test savvy will usually attempt to “snow” the professor with extensive, rambling, and unresponsive persiflage. Such behavior must be crushed. (2) It is good if deans and the occassional student seem to see you assiduously grading exams. Lighter exams make easier reading in such circumstances. Students who write these useful exams should be rewarded.

    I did learn valuable pointers from this site about grading papers that teeter between steps. One issue you did not cover was exams that “fall between the cracks”. This can be a major problem both in older universities with wooden staircases and extremely modern ones with cantilevered concrete risers. My solution has been to give these the lowest possible passing grade, since they create additional work for the grader. On the other hand, this has gained me a reputation among students and colleagues as being somewhat of a tartar

  8. Luke G. - December 14, 2006 at 8:30 am

    Heheheh. I have about 100 papers to grade by Friday of next week and a system like this is very tempting.

  9. Ken Mortensen - December 14, 2006 at 8:42 am

    Having not had quite as many years as Dan in teaching, I do hesitate to correct his obvious mastery of this grading skill, but I must make one point for the sake of clarity, should someone mistake graduate level grading with undergraduate level grading.

    The essense of the method is the same for both, but for undergraduate grades, the professor should toss up the stairs rather than down. With the grade scale still extending away from the professor (higher up the stairs will be a higher grade).

    This makes sense, since undergraduate students cannot have developed as a refined sense of the subject matter as graduate students and the tossing up will naturally take this into account using gravity to appropriately adjust the curve.

  10. anon - December 14, 2006 at 8:44 am

    Ya gotta throw em over your shoulder, to assure impartiality!

  11. Meg - December 14, 2006 at 8:51 am

    It is comforting to know that professors get just as punchy around finals time as students do! :)

    “(2) It is good if deans and the occassional student seem to see you assiduously grading exams. Lighter exams make easier reading in such circumstances. Students who write these useful exams should be rewarded.”

    If only my own professors would take this into account, and reward me for brevity! (Lack of knowledge has nothing to do with it, of course.)

  12. Al Maviva - December 14, 2006 at 10:22 am

    Interesting. I believe my school issued grades based on handwriting quality. First year, handwritten exams with my atrocious penmanship, mostly middle of the curve grades. Really, my name should have been Joe B. Curve. Second year, I moved to the typing room… bada bing! A .2 improvement across the board, into that rarified 57% percentile region! Yes – Instead of being perfectly mediocre, now only 43% of all students in my class were better human beings and more worthy than me in every respect, thanks to International Business Machines and their excellent Selectric III.

    I don’t recall what happened third year because I was drunk and golfing the whole time, normally with a couple other students and and a couple business law professors who made millions and didn’t really see teaching one or two classes a year as work. The intensive effort on my drinking and golfing has definitely paid benefits in my post law school life. If I had known the importance of drinking and golfing at the start of law school, I think I might have skipped law school and just worked on my short game, and sunk the student loans into Bud Lite. I think that’s what that latter-day Clarence Darrow, John Daly, is up to. I hear he’s been admitted to the bars in many states.

  13. Darian Ibrahim - December 14, 2006 at 10:39 am

    This is a most entertaining post. Thanks, Dan!

  14. NWAAR - December 14, 2006 at 10:56 am

    I am sure you will all be interested in a new proprietary software program for use with electronically filed exams: Active Test Adjudication and Result Insertion (ATARI).

    The program creates a random swarm of exam papers and simulates hurling them toward the viewer of the computer monitor. Using the arrow keys (or a joystick) the “grader” fires photon “grades” at the attacking papers; each “hit” is assigned a random grade acccording to preset curve data, thus assuring a double-random result (which self-evidently is as normatively “fair” as any student could wish.) A counter at the bottom of the screen shows the remaining supply of each letter grade, but not which one will be fired next. Exams that “get by” the photon killing zone are automatically assigned the midpoint of the requisite curve, so that the grader is granted the joy of greater “result randomness” as his/her accuracy increases. This keeps the grader mentally “in the game,” which is something students often deserve.

  15. Mike - December 14, 2006 at 12:35 pm

    Funny post, but my question is this: if you really grade exams by tossing them down the stairs, why is it that it takes you lazy bastards so long to get me my grades? Since most of you teach the same crap each year and grade students ONCE every six months, I would think you could expedite the process a bit more.

  16. Jeff Lipshaw - December 14, 2006 at 1:13 pm

    This is a hilarious post. I felt compelled to disclose my grading system over at Legal Profession Blog

  17. Solangel - December 14, 2006 at 1:58 pm

    Dan,

    I was about to start drafting my grading sheet when I saw your post. This is much better than my own method of taking my own exam, grading it (hope I get an “A+”), preparing a detailed grading sheet, and painstakingly allocating points. It would be intesting to use my method then use your method and see what happens. I’m terrified that the results might be the same.

  18. Jim in Texas - December 14, 2006 at 2:00 pm

    I personally like the system that required all exams to be written on the back of any form of U.S. Currency. This helps simplify the entire process. Short answers and the denomination of the currency shows how serious the student considers their education.

  19. stealthlawprof - December 14, 2006 at 2:02 pm

    Mike — It would violate the school policy of enhancing student angst in every way possible if we were to provide grades quickly. We would receive nasty notes from the Dean, horrid committee assignments, and classes at 8:00 a.m. Monday morning and late Friday afternoon in the same semester if we were so freely to breach the profession’s standards. Unthinkable.

  20. tom swift - December 14, 2006 at 2:09 pm

    Nope, don’t believe it. This method requires the prof to actually touch the papers at some point. Ideally he should never even be in the same room.

    The method as described is sound (and quite old – but the action photos are an Internet innovation), however the actual physical work should, of course, be done by a grad student.

    Seriously, what are those Teaching Assistants for? Not for teaching, surely.

  21. P.S. Ruckman, Jr. - December 14, 2006 at 2:30 pm

    A wealth of scientific evidence exists (I am told) which supports the central premises of this analysis. It would be a crime against humanity if it is not submitted to the J.I.R. (Journal of Irreproducible Results).

  22. Chip Ahoy - December 14, 2006 at 2:56 pm

    The bender granted an A is bending on top of another bender. I insist In fairness the stomped-on bender be granted an A too.

  23. John M. Perkins - December 14, 2006 at 2:59 pm

    Too much bias in the stair toss.

    I prefer random intergers at http://www.random.org

  24. Ana - December 14, 2006 at 3:14 pm

    That is hilarious!! :D Though if I were to be from the bunch that got a D…..I protest to the teacher to toss the exams one more time :p

  25. Mark - December 14, 2006 at 3:56 pm

    While a TA at Indiana University in the mid-70’s, I used this method to grade the papers for 3 of the 4 study sections of my professor’s large class. Another TA (obviously the teacher’s pet) had only the one section and used a different grading methodology. At the conclusion of the semester, we compared notes and experiences, and it was obvious that the Stair Toss Grading System was a much more reliable predictor of future educational and career performance. I am glad to see that research continues in this field of applied statistical analysis and that it continues to support its utility.

  26. Ralph Brill - December 14, 2006 at 3:59 pm

    Throwing them down the stairs isn’t much fun. I prefer to use a dart board. Bulls eye is an A, high numbers are in the B range, and Es are those that miss the board altogether. At least I get some exercise and sharpen my own dart throwing skills.

  27. Jason R. Young - December 14, 2006 at 4:00 pm

    here at UBC we use the same system: its callewd the buchanan tower marking system. Johan!!! i think you borrowed this from me!

  28. Dan - December 14, 2006 at 4:07 pm

    I have thought about making an initial pass through the written answers for the exams that end in the ever-compelling epitaph, “Out of time……..,” or “This exam was too long……..” Also look out for the one or two that, instead of spending time answering one of the many questions they skipped, engage in a tirade against your test or pedagogy.

    Give those exams an A since they are most likely to complain and create headaches. The rest are appropriately dealt with through the stair technique.

  29. Catharine Gagnon - December 14, 2006 at 4:28 pm

    I prefer the old method that appears in out law text for dividing a fox carcass when there is a dispute of ownership before the courts.

    Have students submit a closed bid- how much an A is worth to them, the student with the highest bid must pay that amount for the A, the students then with lower bids must pay the lower amount for the subsequently lower grades.

    This encourages fairness, the student who values the A the most will make the highest closed bid, without knowing the bid of their classmates they show the true cost-benefit analysis of the A, and they then will get that grade for how much they think it’s worth.

    It increases the wages of desperately under paid teachers and it teaches students the important rules of Capitalism, well and the rules of fox carcass division….

  30. Ken - December 14, 2006 at 5:17 pm

    The exams appear to have been tossed en masse. This would create a patent unfairness in the system, as papers turned in first and thus on the bottom of the stack would hit first, and the sheets turned in last would have the longest ride (unless the entire pile were to flip upon contact with the first step).

    Two groups finish their exam quickly: the very smart and the very stupid. But some intelligent people check over their paper 2, 3 even 4 times to ensure it is perfect. Being at the top of the stack, they will therefore receive a D with the Figure 4 curve.

    This is all to suggest that the professor who gives a damn will fling the exams one at a time, thus negating the blessing or curse of finishing too quickly, and eliminating position in the stack as an unfair determinant.

    And if a paper flies over the rail? “Incomplete.”

  31. Riana - December 14, 2006 at 5:20 pm

    I have my Civil Procedure exam tomorrow. I’m going to use a really big font. 36-point, at least. And if possible, I’ll print it on card stock, so there is no possibility of bending or crumpling.

  32. Duran - December 14, 2006 at 5:27 pm

    The methods described are interesting but become obsolete with tenure.

    When responding to queries in lecture, “I see that there IS such a thing as a stupid question” may flow from your lips as its source is most certaily the ambrosia that is your mind.

    Including: “Flunk Now And Avoid The Rush”

    at the top of exams will not only reduce your workload but will force those attempting to reach higher than their grasp to fall, shamefully to the bottom of the ladder where they belong.

    Ah, I love it up here.

  33. Chris - December 14, 2006 at 6:09 pm

    You incompetent grade inflating hack!!

    Your spread across the curve indicates the toss was performed at the wrist. That’s the mark of a rank amateur. The wrist is kept straight and in line with the forearm, with the toss being executed with the elbow at a 45 degree angle.

    If the curve distribution needs re-examination, down 6-12 Schlitz Malt Liquor beers (The Bull), and then re-execute the elbow toss.

  34. Frank - December 14, 2006 at 6:15 pm

    I am a retired attorney. When I was in law school, I always suspected that exams were graded this way. Now I know for sure!

  35. Joe Sanders - December 14, 2006 at 6:32 pm

    My children gave my wife and I a cruise for our 40th wedding anniversary. Unfortunately, it begins right after my final exam. I asked my friend Rick Lempert if taking the exams on the cruise would be seen as bad form by my spouse. His response was no. He recommended that I toss the exams off of the back of the ship and see which exams floated longest. (He did not offer an opinion as to whether those exams that sank first should get the As or the Fs, but given your convencing aguments, clearly those that sink first have more “heft” and should get the As.) Rick noted that this procedure has the added benefit of leaving no “paper trail,” eliminating the possibility of later appeals by students. He noted that no one could reasonably object to this because it is also true with modern voting machines. Do you agree that a toss off the stern is a reasonable grading method and would you agree that those exams sinking first deserve the As? Also, should I attempt to distinguish between, say Bs and B+s or should I simply grade on a five point scale? (I am planning to take a pair of binoculars to assist me in this task.)

  36. happylee - December 14, 2006 at 6:38 pm

    true/false exams on scantrons is the way to go. You can grade a class of 40 in less time than it takes to finish a smoke. (though crafting a good t/f exam could take a lot more time…)

  37. Donald - December 14, 2006 at 7:11 pm

    I’ll be curious to see how many of your students surreptitiously tape index cards into their bluebooks next semester (to create a more aerodynamic exam)!

  38. Donald - December 14, 2006 at 7:12 pm

    I’ll be curious to see how many of your students surreptitiously tape index cards into their bluebooks next semester (to create a more aerodynamic exam)!

  39. michael r - December 14, 2006 at 7:16 pm

    I’ll admit… I have graded papers in a fashion nearly resembling this. The professor I worked for liked to have very long essay exams, and assigned a lot of papers. She then left it up to me to spend hour upon hour grading.

    I would take the papers and read part of them quickly and seperate them into about 5 groups based on quality (A, B, C, ect). Then I’d give each section the ‘ol toss to determine the final grade (A+, A, A-, ect).

  40. JorgXMcKie - December 14, 2006 at 8:38 pm

    I’ve found that it’s much quicker and just as fair to randomly assign letter grades on the spreadsheet and then write them in red ink on the paper.

    It turns out that *no one* that gets a better than expected grade complains. Also, no one that gets a grade within two steps of what they expected complains (i.e. a C instead of a B-). Almost no one complains even if they get even a whole letter grade lower than they expected. Finally, some will complain when they get substantially below what they expected (mostly the very good students and the delusional).

    I then allow the students who complain to ‘defend’ their paper. Most can’t. Finally, I have to actually read and grade about half of those and that amounts to fewer than 5% of the total.

    It makes me look like a concerned and fair prof while not only reducing my workload by around 90% but giving me a few good laughs at the same time.

  41. Bob S. - December 14, 2006 at 9:10 pm

    You are all so LEFT BRAINED…tosses, darts, ships, aerodynamics (although I have some sympathy for the beer approach). My, oh my, just divine the mark – much easier. It’s there in Jung’s collective subconcious, just go get it and talk about no paper trails.

  42. Jessica - December 14, 2006 at 9:37 pm

    Maybe it would be more efficient to turn the exams into paper airplanes. The ones that fly the farthest would be As, the closest Fs, and ect. A roof landing would be marked “Incomplete”.

  43. Dumb Ox - December 14, 2006 at 11:16 pm

    My system is much simpler, more efficient, and much less subjective. First I remove those exams that are blank or clearly, clearly delusional baloney. Those are the F’s. The rest get tossed down the stairs.

    Face up landers are B’s, while face down landers are C’s. Landing on a side edge, propped up against any wall or furniture, is a D, and on a top or bottom edge is an A.

    I think that’s why they call that part of the stairs the “landing.”

  44. Bill - December 14, 2006 at 11:34 pm

    This is destined to be a classic along the lines of my other favorite Prof. Solove post.

    http://www.concurringopinions.com/archives/2005/10/the_airline_scr.html

  45. Brian - December 15, 2006 at 3:05 am

    That explains why I got an A+ in Animal Law and a C+ in Civil Procedure.

  46. Erik - December 15, 2006 at 3:24 am

    Hah! And my classmates thought I was odd for spraying Teflon over my exam papers! Side note to self: think long and hard before taking Goldman next year.

  47. Grey - December 15, 2006 at 3:33 am

    You Sir, have just cut down on my workload a great deal. : )

  48. WTJ - December 15, 2006 at 4:11 am

    the far one would be FAIL

  49. Gerry - December 15, 2006 at 8:48 am

    Thanks for presenting this thoughtful study on grading, although it’s a little late for me — I retired 10 years ago from active teaching. I did use this method during my teaching years, but never with the subtlety proposed in this paper for awarding – and + scores. I was definitely in the “lighter paper gets a higher grade” school of grading, but never tried the “up the stairs” method proposed by one of the paper’s “discussants.”

    For my grading I used the carpeted stairs at my home, which contributed a stickiness after landing that made the grades more certain. This benefit is not available on the concrete stairs used in the demonstration. I think if the study had been thorough it would have tested the method on a number of different types of stairs, including different riser heights, number of stairs, stair surfaces, and the like to verify the method, but the paper as presented is definitely a good first “step.”

  50. anon - December 15, 2006 at 9:18 am

    A variation on part of the suggested grading methodology: Stand at top of stairs and toss high in air. Exams that stick to the ceiling get an A.

  51. Jack - December 15, 2006 at 11:12 am

    One year, my curve was unusually low because I left the window open on the landing. That was a tough year to take my course.

    When we had an elevator installed in my house, I hired a grader. She lived in a ranch house, so we just used pass-fail. Everyone failed.

  52. anonymous - December 15, 2006 at 11:50 am

    None of you people who’ve tried to add to the joke are funny at all.

  53. Anonymous - December 15, 2006 at 11:54 am

    wow…this is simply awesome…i cant wait for information privacy law with solove next semester that i signed up for

  54. Chris - December 15, 2006 at 1:14 pm

    This has gotten me thinking. I have an exam on monday. Do I write more words in less time, less words in more time, less words in less time, or more words in more time. Which method will my professor use?? I can’t be sure!

  55. Keith Rowley - December 15, 2006 at 2:12 pm

    When I interviewed at Stetson many moons ago, there was a staircase with letter grades painted on the steps. As I recall, F was at the top of the stairs and A at the bottom.

  56. Grading Whaa? - December 15, 2006 at 4:09 pm

    I am a recently tenured professor, and I was sent this article by a former student. I am, however, confused by this article: What is this thing that the blogger refers to as “grading”? Should I be familiar with this thing–especially around this time of the year?

  57. Anthony D'Amato - December 15, 2006 at 4:49 pm

    Call it the stepwise method.

  58. Anthony D'Amato - December 15, 2006 at 4:49 pm

    Call it the stepwise method.

  59. Lynn A. - December 15, 2006 at 5:22 pm

    I’ve been teaching for 40 years and it is always great to learn new ways of doing things, especially grading papers. Thsi method takes all of the subjectivity and associated anxiety out of grading. Thanks!

  60. DH Kaye - December 15, 2006 at 6:25 pm

    The chance of a paper crossing a parallel line brings to mind Buffon’s needle problem.

  61. your mom - December 15, 2006 at 8:11 pm

    why am I studying for exams again? If I hate studying and professors hate grading, why don’t you just teach me the secert handshake already and be done with it?

  62. BroD - December 15, 2006 at 8:34 pm

    I’m the Registrar at my university system campus. On behalf of my peers I say, whatever your method, just get the grades to my office by the deadline or you’ll end up teaching in that little room next door to the athletic department laundry.

    Have a pleasant winter break!

  63. Artoonie - December 15, 2006 at 10:43 pm

    No wonder I always get A’s! I turn in late papers, thus putting them at the top of the stack, and thus moving farther down. Thanks!

  64. Ryan Walters - December 15, 2006 at 10:52 pm

    Really not the least bit funny, given how arbitrary exam grading really is and how important it is to students when it’s the ONLY thing you grade a student on. Let’s wait to make jokes about it until after you law professors implement a transparent way to grade law school classes that is consistent with educational principles.

  65. Ancarett - December 15, 2006 at 11:06 pm

    No, no, no! You have to use the bell curve and remember that the outliers, high and low, represent the two undesirable extremes of too little writing or frantic overworking. The exact centre steps are where your A papers lurk.

    You also get a much better distribution if you go up to the top of a tall building (ten or more stories) and drop the bundle down the centre opening of the stairwell. Of course, one sets one’s TAs to gather and grade the results rather than having to slog through all the humdrum work personally.

    Excellent post, by the way!

  66. Snowman - December 15, 2006 at 11:30 pm

    Daniel:

    I was first introduced to this grading method as a freshman in college in 1976. Glad to see that it’s still around. Much more difficult back then to literaly “bang out” a heavy “A” paper on a manual typewriter. How do we account for grade inflation? Heavier-weight paper or MS Word?

    Snowman

    PS Method as described in Fig 5 (A+ at the bottom) was used then.

  67. Snowman - December 15, 2006 at 11:33 pm

    Hey Ryan (above): ever watch the movie Stripes?

    Lighten up, Francis.

  68. plusaf - December 16, 2006 at 12:43 am

    _I_ was introduced to this method some time in high school [59-63] or college [63-68], but the teachers were much less lazy then: the procedure was described as throwing the papers UP a flight of stairs, not DOWN. better grades were awarded for achieving the higher levels. well, it made sense then, anyway….
    :)

  69. Ciprian Ivanof - December 16, 2006 at 1:27 am

    The methods differ in somewhat lesser developed countries. One method is to put exams on the table (as there is only one used for both work and grading) and wait for some grease stains to stain the papers. Those that get stained are considered “Painfully transparent” and so warrant a low grade (an actual fail depends on the value of the gift the exam is wrapped around.

    A further technique is to grade papers based on the pollution that colects on them when the window in left open (not frequently used after those who performed this method started dying off) and those that were the most polluted were judged “lacking clarity”.

    A more common method among more rural institutions is to observe the amount of mud that collects on the papers as they are trnsferred to from the examination room to the grading area. Those that remain legible are considered “cogent and displays a good understanding of the field”, those on the lower end of the cleanliness scale should be considered “lacking clarity and depth”.

    A method not to be underestimated is reading the first five lines to street children begging from you and grades being assigned go from the speediest departure receiveing the highest grades and the slowest flight receiving the lowest grade. One disadvantage is that the process leads to grade inflation in the more technical fields.

  70. Success Warrior - December 16, 2006 at 5:29 am

    I just finished up the semester and I’m betting that one of my instructors actually uses this system. It’s good to get a behind-the-scenes look at what’s going on.

    Thanks.

  71. Green Rookie - December 16, 2006 at 8:49 am

    Thanks for the advice! Just a pity you did not come with it sooner. I have already graded them all through my ingenious TOILET BOWL method. It’s a more definitive method. In the words of a TV host, “THE SPIN STOPS HERE.” Sinking papers get A’s and B’s; floating papers get C’s, and D’s. The “FECIED” one’s naturally get F’s.

    Thanks again for a back-up method!

  72. jason Nolan - December 16, 2006 at 2:12 pm

    \facepalms

    To think… I still learn new techniques of summative evaluation. But, I ask, how can this be used in formative or performance evaluations?

  73. Joshua Friesen - December 16, 2006 at 7:00 pm

    I feel humbled by the ingenuity of those before me. I hope I develop a grading method this awe-inspiring when I become a teacher.

    Alas, as a present student, how horrifying that my hard work may be treated so preferentially. At least there’s the small consolation that some of my bullshit may slip through. :)

    Great article! :D

  74. Betty Trott - December 16, 2006 at 8:59 pm

    Good advice and clever marketing. I could have graded quite a few papers during the time I was snickering along. Now there is less time. So the solution seems more appealing. As I delay further, I will soon have no choice but to follow the advice. Betty Trott

  75. Mamacita - December 16, 2006 at 10:46 pm

    Brilliant! I snorted diet Coke all over my keyboard, but it was worth it.

    I’d tell you my main method of grading essays, but you might not respect me in the morning.

  76. Yalras - December 17, 2006 at 12:54 am

    God!

    so funny.

  77. Earnest English - December 17, 2006 at 1:32 am

    I’m SO relieved I waited to finish up my grading. Clearly this will be the easiest way. Of course, it gets a bit more complicated when one assigns portfolios. One has to account for the difference between a large envelope and a binder.

  78. Austin - December 17, 2006 at 3:39 am

    My chest started hurting after laughing too hard. This method clearly reflects how some teachers at my school grade, although I won’t mention any names *cough fawcett cough*. Thanks for the laugh, I’ll send you a law suit for my cardiac arrest next week.

  79. Joseph - December 17, 2006 at 5:24 am

    I’m a UCLA first year law student. I’m studying on Saturday night at 2:30am for my contracts final on monday and I just came across this post. This is the most hilarious thing I have ever seen. It does explain, however, why I get so many A’s.

  80. joe - December 17, 2006 at 7:22 am

    Joseph, if searching blogs is your idea of studying, you have more problems than you think. You better go for heft – or based on your claimed grades, maybe you already have!

  81. Sarah - December 18, 2006 at 2:17 am

    Thank you for amusing me during finals.

  82. Ruth Wilkinson - December 18, 2006 at 8:55 am

    Hi,

    I have always loved that “alternative” humour in life (or as so many other people call it…weird…odd…quote “it’s not REALLY funny though is it”?), and spending all my 41yrs saying “you just don’t get it…do you?”

    From the Goodies when I was little to “Not the Nine ‘clock news”, Monty Python ….need I go on,

    As far as I am concerned, you either get it or you don’t and I can honestly say that I haven’t laughed so much in ages!!

    Have a really “MERRY XMAS”

    love,

    Ruth

    xxx

  83. Gail - December 18, 2006 at 9:42 am

    My daughter, second year law student, sent me this. Obviously she thought it was revealing. However, I clearly remember being graded this way when I was in school. My university pearched on rolling hills. The possibility for grading was endless. There was the “basic stair toss” (up or down), the “does it float?” when tossed off the second story window, the if-it-ends-in-mud-it-fails, the winter “slide downward on snow”, the “drunken readings without glasses”, the “Oh, am I supposed to do something with these?” innocent newby approach to the “I haven’t read a word you wrote all semester why begin now?” veteran approach. After years of reading my student’s papers, I have realized that it is simply too painful to find out what (if anything) they have retained or worse, how they have interpreted my lectures. I favor the leave-me-in -bliss-ignorance grading system. I make my mind up immediately at the beginning of the term. If I remember who they are, it’s an A. If I have actually seen them more than once…B. If I noticed them sleeping in the back of the room…C. If I have never noticed them anywhere near my classroom, D or F, depending entirely on my mood. I have also found that those who bring me coffee tend to do better. I hope this helps some of you who are actually still actively dealing with student papers.

  84. Janet - December 18, 2006 at 3:03 pm

    People, people… to really judge the research quality of the papers they must be tossed down the stairs of the university library.

  85. DS - December 18, 2006 at 3:17 pm

    That can’t be how my student papers were graded. I got consistently good marks, so the method must have been: the handsomer the student, the better the marks. When marking papers myself, however, I used a different method, using an algorithm based on a combination of how loud the music was playing, how much beer was left in the fridge, and the proximity of the deadline for handing in the marks.

  86. MT - December 18, 2006 at 4:50 pm

    Why doesn’t anyone explain this to new professors? I have wasted so much time with this pile of exams! And how do I get a house with stairs?

  87. teppo - December 19, 2006 at 1:19 am

    MT: You don’t need a house with stairs – you can quite effectively do this anywhere at your university – preferably outside as it adds an interesting element to the grading process, namely, wind.

  88. Rudy Jacinto - December 19, 2006 at 11:07 am

    =)

  89. DanB - December 19, 2006 at 11:42 am

    I have used this method for years, and have found it most helpful. Many students have begun handing in their term papers with a clear plastic jacket. My analysis of this phenomenon has uncovered the fact that this makes the paper more aerodynamic, and provides greater lift resulting in more papers making a successful flight to the bottom of the stairs earning more students higher grades. This might be a significant contributing factor to grade inflation. There should be a publishable article in this somewhere.

  90. Brinticus - December 19, 2006 at 12:12 pm

    Thank you so much for finally giving a full description of this grading process. I’ve heard about it for years, but it was never quite covered in grad. school, and I was sure that I was missing many of the techniques and metrics of evaluation. Sometimes when a windy draft is coming up the stairs, a few papers will flutter, which clearly means I’ve not made up my mind about those grades.

  91. Alice - December 19, 2006 at 4:15 pm

    And I wasted all that time grading… Hmmm… Maybe will try this method next year… Thanks for a good joke! :)

  92. Ron Lansing - December 19, 2006 at 4:27 pm

    For another exciting and humorous escapade into the professorial grading experience, see “The Agonies of Grading” at 23 Rutgers L.Journal 107 (1991)wherein a fictional, sardonic law prof struggles to make sense out of some stereotyped answers while evaluating tort exams in the wee hours of the night.

  93. Shane - December 19, 2006 at 4:50 pm

    Well, this is certainly more sanitary than another method. Some have claimed that they spread papers on the floor and let the dog go to them. If the dog pees on them, they fail; if not, they pass. Anything pooped on . . . well, use your imagination.

  94. Israel Silverman - December 19, 2006 at 7:25 pm

    Don’t forget to staple each exam before The Toss.

    Once I forgot, and then had to spend an hour trying to determine which page went with which exam.

    I didn’t succeed, of course. At the end of the hour I declared failure and told my students that the exams had been accidentally destroyed (after being marked) and then used the modified lottery B method to grade(write each name on a card and flip them like baseball cards in the 60’s).

  95. Brad - December 20, 2006 at 7:03 am

    For anyone interested there is a recent dissertation from Administrivia University’s, College of Higher and Superior Education comparing the Standardized Lottery grade Awarding Method (SLAM) to the Standardized Toss Down Stair Case grade Awarding Method (STD-SCAM or STanDard-SCAM.) Author Ima Scamster has won wide-spread accolades from her peer education professors and was recently placed in a “fine, Ivy-league insitution.” Her dissertation advisor, notes that “She is perfectly positioned to move into the upper-echelon of adminstrators there. She will fit right in.”

  96. trillwing - December 20, 2006 at 11:12 am

    I prefer grading methods that involve open flame. Very satisfying, and they save on the heating bill.

  97. StCheryl - December 20, 2006 at 12:51 pm

    There is an alternative method for those who are not athletically-inclined (you wouldn’t believe the number of repetitive-motion injuries that result from throwing and retrieving exam papers from staircases): Open the exam to any page, and with closed eyes, jab at the page. The first letter you see is the grade. I’m told that all major computer grade-recording systems can accommodate all components of any major alphabet.

  98. Nancy - December 20, 2006 at 2:12 pm

    Now we need a method for papers that are graded entirely online, since there is no paper copy…

  99. Kay - December 20, 2006 at 5:08 pm

    I have been out of law school a couple of years now, but the sting of being on the receiving end of these grading practices has yet to fade.(To this day, I would bet the farm that some of my professors used the Standard SCAM method. My law school had several three story buildings at their disposal, which had many staircases that would have been perfect. I just don’t have any proof…yet.)

    I am still trying to figure out they managed to cheat me out of my clearly deserved A on a scantron exam, though.

  100. Monado - December 20, 2006 at 8:53 pm

    My SO, LotStreetWiz, had an economics professor who claimed not only to use the Stair Toss method of grading but also to let his cats play with the papers and knock a few more of them downstairs before he tabulated the results. Obviously, he believed in using “high grades at the top.”

  101. Joshua K. - December 20, 2006 at 9:38 pm

    No kidding, but when I was in college, I was visiting my English professor in her office, and I noticed a Oujia Board on her desk. Given the context I bet you can see where I’m going with this… so I ask her, “hey what’s the Ouija Board for?”, and she says to me, “that’s how I figure out my grades!”

    I was wondering why my grade was a Q in that class.

  102. Playos - December 20, 2006 at 10:10 pm

    Have any of you heard of these methods being applied to admission?

  103. Laura - December 20, 2006 at 10:21 pm

    Dad says my grandpa used to grade physics students’ papers like this, but never did Grandpa achieve such precision!

  104. Sara - December 21, 2006 at 1:42 am

    I’m halfway through grading middle school history projects and wondered why I didn’t use your system.

  105. Quet - December 21, 2006 at 1:54 am

    These methods are all well and good for higher education, but for the high school level, the preferred method is to sit in an over-stuffed recliner and fling the papers upward. Any papers landing directly in the lap, thus making name-reading quite easy, get the A’s. The ones landing on the arms of the recliner are B’s. Those on the leg lift are obviously C’s. All papers on the floor are F’s. There are no D’s, as too many students try to defend, and thus enhance, their grade in order to obtain the coveted “passing” grade.

  106. Joew - December 21, 2006 at 8:55 am

    The method is too time consuming. I use it only for Mid term exams. For the final you need only reverse order the mid term grades.

  107. themexcellentone - December 21, 2006 at 3:54 pm

    If only I could grade my papers like this…

    But then I’d have to pick the damn things up again. Poo.

    Great post, though. :)

  108. ched - December 22, 2006 at 12:50 am

    This is why I’m a huge fan of the TMP Center for Primate Grading of Law School Exams. Why should people expend their energy grading these things when Chimps can achieve the same result?

  109. Ariella - December 22, 2006 at 8:52 am

    Professor Solove — I knew this was how it was done! It always seemed too random to be otherwise… :)

    I am enjoying my time here in WI and interviewed for a 2-year federal magistrate clerkship the other day. I will let you know how it turns out (I really hope I get it; I would love to do a federal clerkship).

    Happy Holidays!

  110. John Partacz - December 22, 2006 at 9:50 am

    I think every teacher who uses essay type questions, and has experienced that sick feeling while peering over a stack of ungraded papers has dreamed of using this method.

    Every semester I agonize over using a 25 T/F question scantron or an essay type test. And I want to strangle the teacher that convinced me that finals should be “a learning experience”.

    Thank-you,

    JP

  111. graduate - December 22, 2006 at 10:38 am

    Thank you for disclosing this academic secret. I had assumed the puppy method was used, but the stairs method is cleaner. It’s the only way I could have managed a B on that bizarre ConLaw exam I was so sure I flunked.

    I had one professor who used the random assignment method, with a twist. He managed to give all his students grades better than expected on our unread papers. Then he signed off on our upper-level writing requirement, as added insurance that we would keep our mouths shut.

  112. Sylvia - December 22, 2006 at 12:47 pm

    I demand that this process be performed on an escalator!

  113. Richard - December 22, 2006 at 7:58 pm

    I perform my tosses during a Redskin football game.

    Somehow, the tosses slope toward A’s when the Redskins are winning and toward F’s when they are way behind.

  114. Jay - December 22, 2006 at 8:58 pm

    This is hilarious. Although, there is nothing funny about getting a D+ or a C-. I still contemplate putting glue in a professor’s chair.

  115. Matt - December 23, 2006 at 10:30 am

    So funny- I’ve shared you method over Here on my blog

  116. c - December 24, 2006 at 7:59 am

    Ha! NOW I know why one of my professors last semester said we would NOT get our finals back…it wasn’t so we would share them with other students – it was because he used the cruise ship grading mentioned earlier in comments!

  117. J - December 25, 2006 at 5:26 pm

    All of the work you are doing for finals seem really more difficult than necessary. By the time the midterm rolls around I already know who has potential and who does not. Knowing this, it is a waste of time to read student’s papers who have no real potential. ( added bonus you get to decide who has potential) Depending on how poor the potential the lower the grade. The higher the potential the higher the grade. This way I only have to go through the papers once, mark them and then record the grade. Finished, now I can go on to more important things.

    In this method it is important to keep the test a bit longer than usual before returning them and helpful if you leave them on the backseat of the car for most of that time so that they get bounced around and look ruffled. The illusion helps the students feel better.

    Of course this presupposes that the student who has some actual interest in the studies has more potential. However, if this causes undo stress deciding who actually cares then using the “Who is the better suck up” has the better potential also works.

    th nice thing is there is no picking up the papers from the stairs.

  118. Peter Stinson - December 26, 2006 at 4:55 pm

    Years ago, I taught in a boarding school. I lived on the fourth floor of one of the dormitories in a garret apartment. I didn’t have any students on the floor with me… I marked the stairs leading up to the fourth floor with grades; when students came up to visit, they’d ask what the letters on the stairs were… I certainly got them talking… ;-)

  119. HappyChyck - December 28, 2006 at 9:14 pm

    I love this so much! I was explaining to some of my students how I would be grading their last essays (I guess the detailed rubric wasn’t enough). This deep explanation would have helped a lot because my students didn’t seem to believe that’s how it was done.

  120. Dr. Martzeh - January 1, 2007 at 2:38 am

    This reminds me of the rabbi, priest and minister joke. One of them (take your pick) throws the coins from the collection plate in the air and whatever lands on one side of a line drawn on the pavement he keeps, the rest he donates to the needy. Religious functionary #2 does the same thing only using a circle rather than a line. Whatever lands in the cirlce goes to charity, out of the circle he keeps. The third guy throws the coins up to heaven and says “What God wants he keeps, I keep all the rest.” I think the divine slection methods also works in the case of grading. We toss all papers heavenward. Those that stay in the lofty domain are divine and worthy of an outstanding grade, those that return to the world of mortal men are in no way exceptional and deserving of a C. By the way, this method requires much less effort than the above proposed methods, as it involves the retrieval of fewer papers over a smaller area. Let’s hear it for efficiency!

  121. Christopher Heard - January 5, 2007 at 12:05 pm

    The toss method seems to involve assigning individual grades to specific assignments. I prefer a holistic grading method that I affectionately call the “survivor system.” Students who finish the entire course get an A+. Students who finish all but the last week get an A, and so on down to students who finish barely half the course or less, and get an F. At the end of each week of class, the students themselves convene a tribal council at which they vote on which of their colleagues should be dropped from the course that week.

  122. John Platten - January 7, 2007 at 1:33 pm

    This is also the method commonly used in IT and business consultancy to check whether a report is ready for the client or not. Generally in my experience the methodology is that when at least one sheet reaches the foot the report as a whole has enough content. My partners thought I was joking too. How obliging of you to have posted the corroborating evidence that I am not the only person who has heard of this technique. Many thanks.

  123. Anxious Student - January 9, 2007 at 12:19 am

    So why haven’t the professors issued their grades yet?!? This method doesn’t seem to be particularly time consuming…

  124. berta - January 14, 2007 at 11:57 pm

    lol)))

  125. dave - January 17, 2007 at 1:28 am

    My home has no stairs.

    I am being hounded by administration to submit grades from last semester and they are threatening to fire me. I have told them why I cannot finish my grading and now they want me to undergo drug-testing. I know someone with a 2-story home but how in the world could I explain grading based on someone else’s criteria.

    If I lose my job my wife says she is leaving me.

    Thanks for ruining my life.

  126. Jason - January 23, 2007 at 11:08 am

    HAHA! great post!

    I was just curious if you accept papers on really heavy stone tablets?

  127. YLlama - February 1, 2007 at 10:59 am

    Eerie. When I started law school four years ago, there was a rumor that my torts professor used this method exactly. Right down to the tie-breaking for teeterers.

  128. ForeclosureFish - February 8, 2007 at 11:27 pm

    Well, that explains a lot of my college papers. The good ones that I was proud of ended up with C’s, and the worst ones that I spent as little effort as possible on got A’s.

    Wait… that also explains a lot of my high school papers, now that I think about it.

    Great post, hilariously scientific.

  129. ferramis - February 24, 2007 at 12:46 pm

    Thanks for the nice post.

  130. Greg Lowry - March 29, 2007 at 2:24 pm

    Should +s and -s be given as part of the grades, or just simple A, B, C, D, and F?

  131. Lissa - April 19, 2007 at 11:09 am

    After doing an academic year’s worth of research on issues in grading (Human Performance Technology project, doing my Masters in Ed Tech), this comes as a refreshing smile just as the project comes to a close. Thank you for the laughs – but I don’t think I will include this method in my columns…

    Best,

    Lissa

  132. yvette - April 23, 2007 at 12:00 am

    very nice, I am sure I have been on the receiving end of this curve now I can rest assured that I will achieve the most efficient use of statistical curving of grades

  133. Laura - May 8, 2007 at 8:35 am

    Great!!! I’ve never seen such an excellent idea on how to grade students. Think I will do it myself

  134. Andres - May 9, 2007 at 4:49 am

    Any suggestions on how to grade this bunch of essays?

  135. Andres - May 9, 2007 at 4:49 am

    Any suggestions on how to grade this bunch of essays? They’re too bulky for the stair method.

  136. Andres - May 9, 2007 at 4:54 am

    Ugh, double post…

  137. Anon Prof - May 9, 2007 at 5:20 am

    Sigh, it’s that time of year again….

  138. Susan - June 19, 2007 at 11:32 pm

    The post itself is funny…some of the comments actually scare me. o_O

    Excuse my paranoia – as a student I know I might be pretty stupid for thinking this, but I hope to God that no teacher actually uses this as a serious grading device.

  139. Stan Dauffische - June 25, 2007 at 12:40 pm

    Surely, students can hardly expect teachers to take their exams any more seriously than the students do! What do you take us for? Masochists?

  140. Jane - July 10, 2007 at 10:15 am

    “extra effort on the part of the grader to retrieve the exam. Therefore, the exam must be penalized for this obvious flaw” ROTFLMAO XD

  141. EnTrustHome - July 31, 2007 at 8:55 pm

    My mother is a teacher and sees this quite often.

  142. George - August 20, 2007 at 4:44 am

    As a professional in the field of educational assessment I object strongly to this information being given away for free. A good consultant would charge at least 1000 dollars a day for explaining this method and would drag it out for a week or more.

  143. ph.D. WIlliam Cum - September 10, 2007 at 8:48 pm

    I must disagree from this method, according the chaos theory the probability of being accounted in this proportion in less than 1% so I prefer to use this formula:

    P=y = A*x^2 + B*x + C

    Where A is the mass of the sheet, x the air humidity, B the density of the floor and C is the amount of grease impregnate to the paper. The formula is copyrighted to the TOFEL studio to the math English method of teaching English.

  144. Tish Traster - February 10, 2008 at 3:43 pm

    Response from my brother who writes exams for the NRC:

    Cute! The technique is known as the “randomized distribution”.

    It’s more accurate if you do one toss from the top of the stairs, one from the bottom, then one straightup in the middle. You then collect the data and enter it into a CONFIDENCE calculation in EXCEL

    You end up telling the student “I can tell you that you made a C with 67% Confidence.”

    Sounds quite systematic, does it not? When the student protests, you simply ask them if they understand the complex statistical calculation used to arrive at your learned conclusion, e.g. how the CONFIDENCE calculation works. They will be invariably mystified, so you simply send them on there way with a knowingly condescending smile…

    I have developed a similar tool that can be used to adjust the grades of female respondents to account for routine hormonal fluctuations and seasonal tide schedules. There is another that is used to adjust the grades of male respondents based on their statistical proximity to the last 10 World Series, Stanley Cups and Superbowls. However, there is a significant percentage of anomaly noted when these rules are applied to males at the University of Florida, no doubt due to their overdeveloped “reptile” brain functions.

  145. annon - February 29, 2008 at 12:59 am

    Obviously you all have overlooked the simplest way to deal with grading – DON’T GIVE ANYTHING TO BE GRADED TO BEGIN WITH!!!

    Use the random number generator in excel to assign the grades.

    If you are truly concerned about fairness multiply that number by attendence.

  146. jlm - May 1, 2008 at 11:39 am

    OMG! I LMAO! thanks for sharing some great insights with a new professor!

  147. Ray - June 3, 2008 at 11:22 pm

    Another good method which practiced by my professor is to blow the papers using a electric fan for a few seconds. In the end, Those stays closer gets A, and lower grades for those far away.

  148. T. Ross - June 27, 2008 at 12:16 am

    Wow! This post was created long ago, but I sure did need the laugh today. As a new professor to the college level, I am slightly awed by my current students’ writing levels. Compared to my previous high school students, my college freshman and sophmores do not write as well. Who caused this problem and why are teachers so quick to pass students?

    Oh well, my best method is prayer for wisdom, guidance and strength.

  149. Steve Bruneau - August 4, 2008 at 6:56 pm

    Illustration of my engineering marking scheme provided on the following link includes obvious advantages: clearer recognition of failed papers; irretrievability-thus unaccountability; entertainment value for prof.

    http://www.engr.mun.ca/~sbruneau/mech/index.htm

  150. donna - August 20, 2008 at 5:43 pm

    This is good, very good. But better is to stand in the middle of the gym and throw them into the air. That’s right, live a little. Those that fall face up are A’s; those that are face down are B’s. D’s are for those not turned in. p.s. I also pay my bills this way. Those that land face up get paid. Works for me!

  151. mystery prof - September 6, 2008 at 4:57 pm

    As a professor, I’ve always used this method. You close your eyes, and take a pencil and randomly point to a spot on the page in the middle of the essay (I only give essay tests). If it’s a gradable letter (A, B, C, D, or F), the student gets that grade. If not, I move on to the next letter and keep going until I find a letter that corresponds to a grade. To assign pluses and minuses, in cases where I hit the letter grade on the first try, I look at the next letter. If it is a vowel, I give out a plus; if it’s a consonant, I give out a minus. And I forgot the last rule: if I miss the page entirely (after a couple drinks, you know?), or there’s a lot of blank space on the page and I land on a blank spot, the student gets an incomplete and has to do it over. Then I repeat this process for the “do overs” until it finally works out.

    So there’s my secret grading system that has worked for nine years, and hopefully will for the rest of my teaching career. And just in case you were wondering, students do occasionally complain, but for the most part, they just accept their failures and move on (the ones who do a terrible job and get lucky NEVER complain!)

  152. trademark lawyers - October 12, 2008 at 1:57 am

    Yeah, this is kind of a scary post. Haha.

  153. Benjamin - December 13, 2008 at 6:44 pm

    Lest anyone limit themselves to grading papers with this method, I’d like to mention it is exactly how my sister chose her husband.

    No, I wasn’t there, but his intellect confirms he was thrown down the stairs using the ‘bottom higher’ theory. It’s the only logical explanation.

  154. bluesprite - December 14, 2008 at 4:40 pm

    this is so hilarious!

    i seriously think my teacher grades like this.

  155. McCool - December 18, 2008 at 8:25 am

    this is some funny shit!

  156. Teresa - December 18, 2008 at 5:00 pm

    Love this and will add to my grading-methods repertoire. So far my most efficient method has been dog-related… not sure I want to go into it in detail so students won’t learn how to weight their papers in their own favor.

    This was a great break in all the grading. Now back to the 85 papers left. Does a staircase outside an office building work?

    Teresa

  157. Teresa - December 18, 2008 at 5:01 pm

    Love this and will add to my grading-methods repertoire. So far my most efficient method has been dog-related… not sure I want to go into it in detail so students won’t learn how to weight their papers in their own favor.

    This was a great break in all the grading. Now back to the 85 papers left. Does a staircase outside an office building work?

    Teresa

  158. cameron - December 20, 2008 at 8:17 pm

    This would certainly explain how my English prof this semester graded our papers. However, he added a couple of twists:

    1) Stand halfway up the staircase and scale appropriately. This gives all students very high grades, but for what reason I cannot fathom.

    2) To make it seem less obvious, he would rapidly scan the essay and circle any grammatical errors, then leave a generic note about how he “enjoyed the presentation” or somesuch at the end.

  159. Shon - December 23, 2008 at 11:54 pm

    I have heard of someone using Excel to make a spread sheet with a random number generator that creates grades within specific parameters for however many students are entered.

    ::blink blink::

    I’ve never written one, nor would I ever use one. ::blink blink::

  160. cearta.ie » Who will examine the examiners? - August 11, 2009 at 2:16 am

    [...] marking season, Peter Black enters the fray; and all of their observations remind me of the classic guide to grading exams which I commend to all hard-pressed examiners out [...]

  161. Jenerally Speaking » Blog Archive » The art of grading exams - September 19, 2009 at 10:13 pm

    [...] precision used by the professors when it come to grading college exams and college papers.  http://www.concurringopinions.com/archives/2006/12/a_guide_to_grad.htmlI found it enlightening…I think you will, [...]

  162. Marking Papers « The Professor - October 5, 2009 at 8:49 pm

    [...] am not a fan of guns, thus I have opted to mark the recent set of paper using the model below (source): It’s that time of year again. Students have taken their finals, and now it is time to grade [...]

  163. Light and untruth at Yale « Law and Education Blog - November 3, 2009 at 7:00 am

    [...] due to the academic abstention doctrine.  At least theoretically, a professor can grade papers by throwing them down the stairs and assign letter grades based on where the paper lands, and a student has no legal recourse if the [...]

  164. Marking exams « Emmenez-moi - November 24, 2009 at 2:04 pm

    [...] esse assunto, recomendo esse post Muito engraçado! Acho que vou aplicar essa técnica quando tiver essa tarefa árdua novamente [...]

  165. Final exam diversions 1 « The Summa - December 6, 2009 at 8:41 am

    [...] stair step method of grading.  Daniel Solove (GW law professor) imortalized it two years ago in A Guide to Grading Exams.  It is an absolute must read.  It reminds me of my first unpublshed paper in which I described [...]

  166. Final Exam Diversions–Fall 2009 « The Summa - December 10, 2009 at 6:02 pm

    [...] Finally, if you are a professor and are behind on your grading, here is Daniel Solove’s Guide to Grading Exams. [...]

  167. How do Professor Grade Exams? - December 12, 2009 at 4:50 pm

    [...] http://www.concurringopinions.com/archives/2006/12/a_guide_to_grad.html [...]

  168. grading « orgtheory.net - December 22, 2009 at 12:08 pm

    [...] been grading for the past several days.  I’ve thought about switching to the “staircase” method (recommended by O&M a few years [...]

  169. How to grade papers « Insomniac memos - December 31, 2009 at 8:52 pm

    [...] any of my colleagues still trying to get their grades done, an inspiring model (with [...]

  170. The Stairway Approach to Grading Exams « The Peelarium - December 31, 2009 at 10:24 pm

    [...] A Guide to Grading Exams [...]

  171. The Law School Grades Letdown (or Occasional Pleasant Surprise) | Lawyerist - January 1, 2010 at 5:01 am

    [...] seem fair in relation to the amount of effort poured into a given course. A lucky few will scratch their heads at the high A in a class they had written off as their worst. So, if you find yourself in any of these positions, [...]

Comments are closed for this entry.


  • « Previous post
  • Next post »

Authors

Daniel J. Solove
Kaimipono Wenger
Dave Hoffman
Nate Oman
Frank Pasquale
Deven Desai
Danielle Citron
Lawrence Cunningham
Sarah Waldeck
Jaya Ramji-Nogales
Solangel Maldonado
Gerard Magliocca

Guests

Adam Benforado
Mark Edwards
Michelle Harner
Kristin Johnson
Jeffrey Kahn
Alex Kreit
Viva Moffat
Adam Steinman










Previous Guests

Michael Abramowicz
Michelle Adams
Robert Ahdieh
Michelle Anderson
Laura Appleman
Ann Bartow
Francesca Bignami
Jeremy Blumenthal
Kathleen Boozang
Bruce Boyden
Donald Braman
Al Brophy
Neil H. Buchanan
Bill Burke-White
Scott Burris
Paul Butler
Naomi Cahn
Anupam Chander
Miriam Cherry
Jack Chin
Jennifer Collins
Thomas Crocker
Allison Danner
Brannon Denning
Deven Desai
Mike Dimino
Mark Edwards
David Fagundes
Christine Haight Farley
Kim Ferzan
Dan Filler
Michael Froomkin
Amanda Frost
Timothy Glynn
Rachel Godsil
Eric Goldman
David Gray
Craig Green
Tristin Green
Jeffrey Harrison
Erica Hashimoto
Carissa Hessick
Laura Heymann
Robert Hillman
Christine Hurt
Darian Ibrahim
John Ip
Kevin Johnson
Dan Kahan
Brian Kalt
Sam Kamin
Michael Kang
Chimène Keitner
Orin Kerr
Nancy Kim
Heidi Kitrosser
Adam Kolber
Russell Korobkin
Anita S. Krishnakumar
Susan Kuo
Greg Lastowka
Sarah Lawsky
Erik Lillquist
Jeff Lipshaw
Jonathan Lipson
Jacqueline Lipton
Joseph Liu
Michael Madison
Solangel Maldonado
Jason Mazzone
Linda McClain
William McGeveran
Salil Mehra
Carrie Menkel-Meadow
Max Minzner
Scott Moss
Eric Muller
Jaya Ramji-Nogales
Helen Norton
Elizabeth Nowicki
Paul Ohm
Michael O'Shea
David Opderback
Kristen Osenga
Rafael Pardo
Marcy Peek
Eduardo Peñalver
Robert Percival
David Post
Shruti Rana
Geoffrey Rapp
Neil Richards
Lori Ringhand
Alice Ristroph
Susan Scafidi
Paul Secunda
Jonathan Siegel
Jessica Silbey
Peter Smith
Charles Sullivan
Rick Swedloff
Steph Tai
Andrew Taslitz
Robert Tsai
Jenia Turner
Steve Vladeck
Spencer Weber Waller
Howard Wasserman
Melissa Waters
Frank Wu
Alfred Yen
Corey Yung
David Zaring
Timothy Zick
Michael Zimmer
Jonathan Zittrain

Ownership

Concurring Opinions is a
general-interest legal blog
operated by Concurring
Opinions LLC, a Pennsylvania
Limited Liability Corporation.

Blogroll

Above the Law
ACS Blog
Althouse
Balkinization
Becker-Posner Blog
BlackProf
BoingBoing
Chicago Law Faculty Blog
Conglomerate
CrimLaw
Crime & Federalism
CrimProf Blog
Crooked Timber
Discourse.net
Dorf on Law
Election Law
Emergent Chaos
The Faculty Lounge
Feminist Law Profs
43(B)log
Freakonomics Blog
Freedom to Tinker
Google Blogoscoped
How Appealing
Ideoblog
Info/Law
Instapundit.com
Juris Novus
Jurisdynamics
Law and Humanities Blog
Law and Letters
Law Librarian Blog
Legal Profession Blog
Legal Theory Blog
Legal Times Blog
Leiter Reports
Brian Leiter's Law School Reports
Lessig Blog
Madisonian Theory
Media Law Blog
Mirror of Justice
The Moderate Voice
National Security Advisors
Opinio Juris
Point of Law
PrawfsBlawg
ProfessorBainbridge.com
Property Prof Blog
Red Tape Chronicles
The Right Coast
Schneier on Security
SCOTUSBlog
Security Dilemmas
Sentencing Law and Policy
Simple Justice
Sivacracy.net
The Situationist
Susan Crawford
TalkLeft
Talking Points Memo
TaxProf Blog
Tech & Marketing Law
Truth on the Market
Volokh Conspiracy
WorkPlace Prof Blog
WSJ Law Blog
Wonkette
The Yin Blog


© Concurring Opinions

Powered by WordPress