recentpopularlog in

tsuomela : grading   10

[1308.5273] CrowdGrader: Crowdsourcing the Evaluation of Homework Assignments
"Crowdsourcing offers a practical method for ranking and scoring large amounts of items. To investigate the algorithms and incentives that can be used in crowdsourcing quality evaluations, we built CrowdGrader, a tool that lets students submit and collaboratively grade solutions to homework assignments. We present the algorithms and techniques used in CrowdGrader, and we describe our results and experience in using the tool for several computer-science assignments. CrowdGrader combines the student-provided grades into a consensus grade for each submission using a novel crowdsourcing algorithm that relies on a reputation system. The algorithm iterativerly refines inter-dependent estimates of the consensus grades, and of the grading accuracy of each student. On synthetic data, the algorithm performs better than alternatives not based on reputation. On our preliminary experimental data, the performance seems dependent on the nature of review errors, with errors that can be ascribed to the reviewer being more tractable than those arising from random external events. To provide an incentive for reviewers, the grade each student receives in an assignment is a combination of the consensus grade received by their submissions, and of a reviewing grade capturing their reviewing effort and accuracy. This incentive worked well in practice."
crowdsourcing  education  pedagogy  grading  automation  computer  academic 
september 2013 by tsuomela
First Trial of Crowdsourced Grading for Computer Science Homework | MIT Technology Review
"The latest online crowdsourcing tool allows students to grade their classmates’ homework and receive credit for the effort they put in."
crowdsourcing  education  pedagogy  grading  automation  computer  academic 
september 2013 by tsuomela
The Line Between A and B
"A’s were reserved for new music broad enough in its appeal to cross boundaries. I was occasionally called on the carpet, gently, for grade inflation, for being too liberal with my A’s, because I couldn’t stomach giving a superb recording of a Cage chance piece, or a wonderful Niblock drone piece, a B just because its potential audience seemed limited. I fudged." Annotated link http://www.diigo.com/bookmark/http://www.artsjournal.com/postclassic/2012/07/the-line-between-a-and-b.html
art  music  evaluation  grading  reviews  modern-art  difficulty  aesthetics  sharing 
july 2012 by tsuomela
Who’s dumber: Congress or Martin Luther King Jr.? The dumb report on congressional dumbness - Yahoo! News
"If you skim Sunlight’s findings, and bring to them a sporting quotient of party prejudice, you might conclude that Republicans are, say, “idiots” and Democrats are, oh, “showoffs.” To use the pre-K-level idiom preferred by the biased twerp in each of us.

If, however, you listen to a sampler of speeches by various congresspeople at a range of oration grade levels, you might find something completely different."
politics  language  rhetoric  measurement  metrics  grading  useless  congress 
may 2012 by tsuomela
My Standard Based Grading Notes | Wired Science | Wired.com
"Standards Based Grading (SBG), what is it? Let me just say that SBG is a different way of thinking about grades. In Standards Based Grading, the main idea is that the grade is a measure of what students understand. It is not a measure of how well the students are obedient and it is not a measure of how much effort the students put into homework"
teaching  pedagogy  grading 
may 2012 by tsuomela
The Gradest Generation: Do Boomers Pass Or Fail? : NPR
Baby boomers — which the Census Bureau defines as the group of 78 million or so people born between 1946 and 1964 — are obsessed with grades.

They rank everything: best to worst, least to most, zero to 100, A to F. They grade movies, hotels, beef, municipal bonds and restaurants — for the quality of food, for speed of service, for cleanliness. They mark up school essays and driving tests and citizenship exams. After the release of the 1979 movie 10, starring boomer Bo Derek, men and women began appraising each other on a 1-to-10 scale. The first Zagat survey also appeared in the late 1970s, featuring diners' ratings of cafes and restaurants. Entertainment Weekly, launched in 1990 by Time Inc. (sidebar), grades movies, books, TV shows, video games and other pop culture items on an A-to-F scale.
baby-boomers  generational-analysis  opinion  grading  politics  art  history 
may 2010 by tsuomela
Confessions of a Community College Dean: Error and Failure
"Grad school was even worse. At that level, a self-selected bunch of failure avoiders competed for faculty approval in a pretty airless environment for years. By the end, it took an act of will just to put together a declarative sentence."
education  grading  academic  graduate-school  behavior  training  failure 
february 2009 by tsuomela
Grading Medical Students (and More on Grade Inflation) — Crooked Timber
I presume that the shift to pass/fail grades in the first year is motivated in part by this concern to fit with mission
academia  grading  graduate-school  medicine  medical-school  evaluation  education  pedagogy 
december 2008 by tsuomela

Copy this bookmark:





to read