The Mentor Is In

  • 06 Apr 2010 /  grading, teaching tips

    Over the years I have given a great deal of thought to grading, incentives, and fairness.  One anecdote will illustrate what started me on the road to thinking about how often our grading systems can slip into the red zone of unfairness was an incident when I was a TA in graduate school. The professor I was teaching for (mind you this is anthropology) maybe didn’t have the clearest grasp of basic math, like percentages, means, modes, and medians.

    This professor had constructed a wildly illogical method for ‘smoothing’ out those pesky in-between grades, you know, the ‘so close to an A minus that you can taste it B plus’ and the ‘oops, one slip of a digit can send this guys off the map into F land’ kind of grades.  His system, and sadly I can’t remember all of the gory mathematical details, had the effect of rewarding good students for doing well, and punishing bad students for doing poorly, that enhanced the bi-modal distribution of his grade distribution.

    He is not alone in this, and I remember some of my thinking on this subject was sparked by an NEA Higher Education Advocate newsletter (http://www.nea.org/home/37810.htm) which reported that quite a few of our colleagues have somewhat sketchy grading practices (I’d love to hear some further examples from you in the comments section!)

    An example drawn from my son’s elementary school can help illustrate what can happen. Recently, a teacher was trying to incentive effort by measuring performance on multiple choice exams, while not understanding some of the statistical effects such a practice would have:

    If students improved their math scores by one percent, they were rewarded. Students who did not improve got extra work, and students who had already done well were also rewarded. Problems ensued because they had created a two-pronged incentive system that rewarded good students for doing well, and rewarded poor students for doing ‘better’ but punished the middle for not improving even when they have exceeded a statistically average outcome. I like to call this the, “you got a B but you should have gotten an A so I am giving you a C” rationale, courtesy of a former social sciences teacher of mine.

    This system is arbitrary. Let’s see why:

    If a student is struggling in class, and got say, a 59%, then brought it up to a 60%, they received a reward though they are still performing below the average; whereas the child who got an 80% and didn’t make any improvement got extra work. Statistically speaking, it’s much harder to close a smaller gap than a larger one. Also statistically speaking, a low performing student could still, through random chance, improve their grade by one point more easily than a higher performing one.  To further ‘de-randomize’ the experiment, the teacher had actually removed the top scoring students from needing to improve. What if they had gone DOWN on the second try? They have luck on their side on multiple choice exams just as much as any other student. Regression to the mean practically stipulates that some of those pupils would have performed more poorly.

    I appreciate the attempt to incentive effort - and believe me, I know how hard it is to do this sort of thing; I wrestle with it all the time with my own students.  But I think seeking to reward ‘intent’ by measuring it with performance on a multiple choice exam, is a recipe for unhappiness.  Here are some things I do in my classroom to when I want to incentivize either effort or performance, but do not wish to conflate the two:
     
    For rewarding performance
     
    If you get 100% on an exam, I give you a 5$ gift certificate (like to Starbucks). This is a straightforward outcome, you either achieve it or you don’t. I’ve given out two in the past five years.
     
    For rewarding effort
     
    I have a ‘maps’ assignment that we never get time to finish (a filler activity) so I send them home and say, ‘hey, you can work on this at home, or not, your choice.’ Then, in a future class, at the end of the session, I’ll give them 15 minutes to work on the maps, but those who did them at home get to turn them in and leave early. This rewards extra effort.
     
    To promote effort

    I will often reward everyone for trying whether they all ‘deserve’ it or not. Nothing succeeds quite as well as liberal praise. Further, I am a big believer that stickers and candy, judiciously applied, remain as great a motivator for eighteen as they do for eight.

    Tags: , , , , , ,

  • 23 Feb 2010 /  advice, grading, teaching tips

    “C is for competent; it’s good enough for me.” I sometimes sing this little parody of Sesame Street in my head. What this means to me is that, getting through the day without screwing anything up is, in my book, a level of success that should be celebrated more often than is acknowledged.  It is a rare day when I could honestly say that I was outstanding in everything I attempted, from driving, to teaching, to parenting.  It would be a similar outlier to suggest that I fail at everything I put my hand to – even on the worst days, something has to have gone right, or I wouldn’t still be here.

    The same is true for academics.  Much has been debated about the ‘scourge’ of grade inflation (http://www.thecrimson.com/article/2001/11/28/a-proposal-to-end-inflation-last/) and the role of adjuncts as epidemiological vectors (http://www.glendale.edu/chaparral/june04/gradeinflation.htm) but I think we need to situate a large part of the problem within the minds of our students – who have been led to believe nothing but an A will suffice, yet have been given no clear guidelines as to what an A might represent.  Working our way downwards, an A is supposed to represent “excellence,” while a B represents “above-average,” so there is nothing standing in our way of explaining that a C denotes competency over the material.

    I like to go over the concept of the bell curve in my class, and show how most of us will fall in the middle (or the average) no matter what we do, because that is how the norm is defined for most of us.  Taking the time to differentiate between the mean (arithmetic average), the median (middle value), and the mode (most likely outcome), I point out that getting a C (usually represented as somewhere around 75 percent) means they have “beaten” half of the class.  This is important information for two distinct populations of students: the too-worried, and the not-worried-enough.  The too-worrieds have no internalized benchmark for success; they tend to dramatically over-estimate the performance of their peers, and suffer disproportionate anxiety as a result of what they see as poor performance.  Explaining to them that their performance was “average” may not be the cherry on the sundae of their day, but it can go a long way toward relieving acute stress.

    The not-worried-enough, on the other hand, have the opposite problem.  They think that their work is just fine because they don’t see the wide distribution of performance that we do from our Olympian perch.  The bell-curve model is not as helpful for them, because it seems somehow “rigged.”  Keeping in mind these are often the weakest and least motivated students in the first place, coming from a system that keeps the product moving along regardless of merit, they lack many foundational understandings we may hope to take for granted in our students.  For this population, concrete evidence is best.  Group work, paper exchanges, detailed outlines of expectations for assignments, post-exam analyses and explanations, can all contribute to their comprehension of what competency, and beyond that, mastery, entails.  Still, for the least motivated, attaining a C may be all that they seek, and as educators, though we may not like or understand this stance, we have to respect it as a legitimate strategy.

    Can a student achieve an undergraduate degree with a C average? Absolutely.  Do employers check grade point averages? No. It’s a useless bit of information.  The only time a GPA comes into play after college is when seeking post-graduate education.  It is good to make sure that students understand the ways in which mediocre grades can hamper future plans, but beyond that, students have to make their own choices. Since we have a grading system that sets C in the middle, as the median, then we need to start treating C as the norm it truly is.

    Tags: , , , , , , , , , , , , ,

Get Adobe Flash playerPlugin by wpburn.com wordpress themes