USNWR’s Peer Survey Problems

Image courtesy of U.S. News and World Report

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.


This should come as no surprise to anyone who followed the recent kerfuffle over Clemson University’s admission that it spun its numbers to improve its U.S. News & World Report’s ranking: On USNWR’s peer assessment survey, which accounts for a quarter of a school’s overall ranking, college administrators gave their own schools rave reviews while playing down competitor institutions.

Inside Higher Ed obtained copies of peer assessment surveys from 18 colleges and universities. “Haphazard responses” from “apathetic respondents” abounded. 

Some telling findings:

  • The presidents and/or provosts of 15 of the 18 universities rated their institutions “distinguished,” from Berkeley (no. 21 on last year’s list) to the University of Missouri at Columbia (No. 96).
  • At Berkeley in 2008, the chancellor rated other “top” publics — including the University of Virginia, the University of Michigan at Ann Arbor and the University of North Carolina at Chapel Hill – “strong.” However, he rated all of the University of California campuses “distinguished,” with the exceptions of Santa Cruz and Riverside, which were also “strong.” (Merced was not on the list.)
  • In a 2009 survey, an official at the University of California at San Diego (No. 35) rated that campus “distinguished,” above the University of Pennsylvania, Duke University, Dartmouth College, Northwestern University and Johns Hopkins University (all “strong”).
  • The president of the University of Florida (No. 49) rated his campus “distinguished” in this year’s survey — along with Harvard, Stanford and MIT — and no other institution in Florida above “good,” as reported by the Gainesville Sun.

Inside Higher Ed points out that this isn’t really outright gaming—the peer assessment survey simply asks for opinions. What kind of administrator wouldn’t play up his or her own institution? And according to University of Vermont president Daniel M. Fogel, even if you wanted to play fair, you’d likely end up working overtime: Fogel estimated that if one were to research each school on the survey before passing judgement, filling out the form would take ten hours.

USNWR releases its 2010 college rankings tomorrow.

Update: USNWR 2010 rankings are out, and so is the MoJo Mini College Guide.

WE'LL BE BLUNT:

We need to start raising significantly more in donations from our online community of readers, especially from those who read Mother Jones regularly but have never decided to pitch in because you figured others always will. We also need long-time and new donors, everyone, to keep showing up for us.

In "It's Not a Crisis. This Is the New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, how brutal it is to sustain quality journalism right now, what makes Mother Jones different than most of the news out there, and why support from readers is the only thing that keeps us going. Despite the challenges, we're optimistic we can increase the share of online readers who decide to donate—starting with hitting an ambitious $300,000 goal in just three weeks to make sure we can finish our fiscal year break-even in the coming months.

Please learn more about how Mother Jones works and our 47-year history of doing nonprofit journalism that you don't find elsewhere—and help us do it with a donation if you can. We've already cut expenses and hitting our online goal is critical right now.

payment methods

WE'LL BE BLUNT

We need to start raising significantly more in donations from our online community of readers, especially from those who read Mother Jones regularly but have never decided to pitch in because you figured others always will. We also need long-time and new donors, everyone, to keep showing up for us.

In "It's Not a Crisis. This Is the New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, how brutal it is to sustain quality journalism right now, what makes Mother Jones different than most of the news out there, and why support from readers is the only thing that keeps us going. Despite the challenges, we're optimistic we can increase the share of online readers who decide to donate—starting with hitting an ambitious $300,000 goal in just three weeks to make sure we can finish our fiscal year break-even in the coming months.

Please learn more about how Mother Jones works and our 47-year history of doing nonprofit journalism that you don't elsewhere—and help us do it with a donation if you can. We've already cut expenses and hitting our online goal is critical right now.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate