the Law, the Universe, and Everything 

Search

Concurring Opinions is a
general-interest legal blog
operated by Concurring
Opinions LLC, a Pennsylvania
Limited Liability Corporation.

lr_jkr9_15_08constific.jpg

ad-logo5.jpg

Our Podcast

Subscribe to Law Talk

Law-Rev-Forum-2.jpg

law-rev-contents2.jpg

Law-Prof-Blog-Census.jpg

Categories

Accounting
Administrative Announcements
Administrative Law
Admiralty
Advertising
Agricultural Law
Anonymity
Antitrust
Architecture
Articles and Books
Bankruptcy
Behavioral Law and Economics
Bioethics
Blogging
Book Reviews
Capital Punishment
Civil Procedure
Civil Rights
Conferences
Constitutional Law
Consumer Protection Law
Contract Law & Beyond
Corporate Finance
Corporate Law
Criminal Law
Criminal Procedure
Culture
Current Events
Cyberlaw
DRM
Economic Analysis of Law
Education
Empirical Analysis of Law
Employment Law
Environmental Law
Estates and Trusts
Evidence Law
Family Law
Feminism and Gender
First Amendment
Food
Google & Search Engines
Health Law
History of Law
Humor
Immigration
Insurance Law
Intellectual Property
International & Comparative Law
Interviews
Jurisprudence
Law and Humanities
Law and Inequality
Law and Psychology
Law Practice
Law Professor Blogger Census
Law Rev (Boston College)
Law Rev (Boston University)
Law Rev (California)
Law Rev (Chicago)
Law Rev (Columbia)
Law Rev (Cornell)
Law Rev (Duke)
Law Rev (Emory)
Law Rev (Fordham)
Law Rev (Georgetown)
Law Rev (GW)
Law Rev (Harvard)
Law Rev (Illinois)
Law Rev (Indiana)
Law Rev (Iowa)
Law Rev (Michigan)
Law Rev (Minnesota)
Law Rev (Northwestern)
Law Rev (Notre Dame)
Law Rev (NYU)
Law Rev (Penn)
Law Rev (S Cal)
Law Rev (Stanford)
Law Rev (Texas)
Law Rev (UCLA)
Law Rev (Vanderbilt)
Law Rev (Virginia)
Law Rev (Wash U)
Law Rev (Wm & Mary)
Law Rev (Yale)
Law Rev Contents
Law Rev Forum
Law School
Law School (Hiring & Laterals)
Law School (Law Reviews)
Law School (Rankings)
Law School (Scholarship)
Law School (Teaching)
Law Student Discussions
Law Talk
Legal Ethics
Legal Theory
Media Law
Movies & Television
Philosophy of Social Science
Politics
Privacy
Privacy (Consumer Privacy)
Privacy (Electronic Surveillance)
Privacy (Gossip & Shaming)
Privacy (ID Theft)
Privacy (Law Enforcement)
Privacy (Medical)
Privacy (National Security)
Property Law
Race
Religion
Reparations
Science Fiction
Second Amendment
Securities
Securities Regulation
Social Network Websites
Sociology of Law
Supreme Court
Tax
Teaching
Technology
Tort Law
Web 2.0
Weird
Wiki
Wills, Trusts, and Estates

Archives

November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
August 2005
July 2005
June 2005
May 2005

 

« On Academic Criticism | Main | Talking Urinal Cakes Issue DUI Warnings »

March 19, 2007

Why Are Judges Citing Fewer Law Review Articles?

posted by Daniel J. Solove

gavel1.jpgOver at the Volokh Conspiracy, Orin Kerr mulls the question of why judges are citing fewer law review articles these days than in the past. He refers to an article in the New York Times about the topic:

[T]he legal academy has become much less influential. In the 1970s, federal courts cited articles from The Harvard Law Review 4,410 times, according to a new report by the staff of The Cardozo Law Review. In the 1990s, the number of citations dropped by more than half, to 1,956. So far in this decade: 937.

Patterns at other leading law reviews are similar. And the drop in the number of citations understates the phenomenon, as the courts’ caseload has exploded in the meantime.

Orin explains the phenomenon as the result of the fact that "a lot of law review scholarship is not terribly serious about engaging with the law."

Other explanations commonly uttered: (1) law review articles are long and hard to read; (2) law review articles contain too much theory; and (3) law professors aren't interested in issues of legal practice.

I don't agree with any of these reasons. It is true that many law review articles are not written for judges or practicing lawyers. They are written for other academics. Or policymakers. Law review articles are written for many different audiences these days. But quite a few still have relevance for the practitioner.

I get rather annoyed at rather dismissive claims that law review articles are all useless or that the academy has abandoned caring about the practice of law. Such views often rest on the assumption that only doctrinal treatise-like articles are helpful for the practice of law. This is not necessarily the case -- good theoretical and normative articles really can make a big difference if engaged with. Historically, many of the greatest jurists and lawyers were also among the most widely read; they read philosophy, literature, and a wide array of scholarship in the humanities. Today, it seems, the view is that law review articles are worthwhile if they will help in the resolution of a case. But articles might be worth reading just for general educational purposes. The articles of the legal realists, for example, helped change the way the law is conceived and practiced, yet these were meta articles about the law, not ones that would assist in any one particular case.

This isn't the primary reason, though, why judges and lawyers don't read as many law review articles today. So what's my hypothesis? Why aren't law review articles on the reading lists of many judges and lawyers?

The reason is practical -- the good relevant articles are just too hard to find.

This is ironic given that all law review articles are available at everyone's fingertips in the Westlaw and Lexis databases. But in the past, there were hardly as many law reviews and hardly as many law review articles. I don't have stats to back me up, but I'm almost certain this is true. Only a small subset of law professors published articles with any regularity. Today, there are hundreds of law reviews, and they are all readily available. There are zillions of law review articles, as a much wider percentage of professors in the academy are writing.

The reality is that most law review articles aren't all that great. This is to be expected. In nearly any field, much of what is written isn't all that great. We'd be lucky if 10% is really good. Up the production level, and you get a lot more mediocre and bad work, and only a little more good work. What's happening, in other words, is that the worthwhile articles are becoming needles in an ever-growing haystack.

Combine this with the fact that many articles are not written with a practitioner or judicial audience in mind, and the percentage of good articles that are relevant is very low. It's just not efficient for the judge or practitioner to read articles. Good articles that are of use to judges and practitioners are still out there -- it's just increasingly harder for them to find these articles.

One possible solution: The academy needs a system where it recommends the cream of the crop. We should give judges and practitioners in our fields a list of some of the articles most worth reading. We should explain why they're worth reading. Perhaps if we do a better job separating the needles from the haystack, judges and practitioners will once again start paying more attention to law review articles.

UPDATE: Eugene Volokh has some very thoughtful commentary over at the Volokh Conspiracy:

While legal scholarship should be as clear, as thoughtful, and as useful as possible for its theme, there are many themes that are eminently legitimate despite being not helpful for the decision of actual cases.

Consider one example: legal history. Some legal history may be relevant to legal decisions (for instance, when it elucidates the original meaning of some text, and when the original meaning is relevant to some case). But some may not be. . . .

Should we reject, or even deprecate, legal history because it's not relevant enough to courts? Aren't there other ways history can be useful -- even if those are just a better understanding of what happened in the past, how our legal system came to be as it is, and what we might want to avoid in the future (even if it's not up to courts to avoid it)? . . . .

Or consider another example: articles that are aimed at suggesting legislative or regulatory changes. Perfectly legitimate, it seems to me, despite not being aimed at judges. . . .

Why should there be a demand that law be a purely practical discipline, either in the sense of always having an immediate payoff in court decisions or in the sense of always focusing on uncovering specific facts rather than setting up theoretical frameworks that help us understand the facts? . . . .

[W]e shouldn't, it seems to me, insist that all or even most legal scholarship be aimed at judges, or see certain genres' lack of desire to influence judges as a sign of those genres' inherent flaws.

I don't agree with Eugene on many issues, but I agree completely with his post.

Posted by Daniel J. Solove at March 19, 2007 01:58 AM

Trackback Pings

TrackBack URL for this entry:
http://www.concurringopinions.com/movabletype/mt-tb.cgi/1835.

Comments

The article itself contains another explanation: the workload of the judges. It is possible that in years past more judges read through law reviews as they would newspapers and magazines. They stayed up on the current legal theories as they would current legal events. Given their workload, and as you suggest a proliferation of journals, they may not have the time to do so any longer. If judges read journals more frequently, they may know some of what they would want to cite without having to look for it on a case-by-case basis.

Just a theory...

Posted by: Rick Swedloff at March 19, 2007 08:44 AM


"The academy needs a system where it recommends the cream of the crop." In other fields, that system is called "peer-reviewed journals." The editors of those journals are typically accomplished academics whose decision to accept an article in the journal is a form of certification that the article is worth reading. The underlying problem here is that student law review editors lack the perspective to identify articles worth reading.

Posted by: anonymous at March 19, 2007 08:45 AM


Huh. It sounds like you do agree with the proposed reasons, and just restated them.

Also, 08:45, I don't think anyone has ever seriously suggested that student-run journals publish the highest-quality scholarship. The problem is that law professors have so little incentive to shift to peer review- they'd have to shoulder the burden and, what's worse, they couldn't inundate the student law review editors with their dreck.

Solove/Kerr basically got it right, though both tried putting it more diplomatically: most law review articles are worthless. Student editors can't be blamed for sifting through the crap and picking the crap authored by the most prestigious name.

Posted by: RW at March 19, 2007 09:52 AM


Having recently (and thankfully) escaped the law review world, I must disagree with the argument that there is simply too much noise for anybody to find the good articles. First, as a previous poster noted, law journals are not peer reviewed. Articles are selected by the third-year students who, despite three years of training, still know little about the law. These students are easily impressed by star-power names and trip over themselves to publish the same people.

The authors frequently sought after are those who have perfected the game; people who have the budget to appear at every conference and shamelessly re-print the same article with minor tweaks to the hyper-coloned title, while citing primarily to their own work, creating a weak chain of authority, with the ultimate link being the author's own initial, generally unfounded conclusions.

The academy itself looks down on what are called "practitioner pieces," that is to say, journal articles that might actually be useful. Rather, the most desirable articles are those that expose new "paradigms".

If you doubt this, attend a symposium at any major law school. But take the sick bag from the seat pocket in front of you when you leave the plane, because you are about to be exposed to a sickening display of inbred sycophancy, self-congratulatory back patting, and mind-numbing double speak.

The goal of the legal academe today is to detach itself to the greatest extent possible from the legal profession. Which is why law schools now seek out PhDs rather than JDs and create public policy programs rather than practicums. The argument that the bench has turned its back on the academe relies on a misunderstanding as to the direction of causality.

Posted by: Anonymous OSU Grad at March 19, 2007 10:00 AM


haven't read the NYT article, but another reason is probably that there are so many more case opinions out there. They're more authoritative than law review articles, and sometimes it seems you can find a case to support almost any proposition.
When you can't find one, you might look to a law review.

Posted by: anon at March 19, 2007 10:23 AM


Anonymous -- Despite the oft-stated sentiment that peer reviewed journals are the solution, in my experience, I haven't found articles in peer reviewed journals to be significantly better than those in regular law reviews.

There's also the common belief that dozens of years ago, law review articles were better and more practice-oriented. There was, for sure, more practice-oriented scholarship (treatises, etc.) and probably a few more practice-oriented pieces. But I've read many older law review articles. They are often shorter than those of today, but I haven't otherwise noticed a dramatic difference. Many are still quite theoretical. Many aren't very good either.

The biggest change with law review articles from the mid-twentieth century to today, in my opinion, is that there are just more of them.

Posted by: Daniel J. Solove at March 19, 2007 10:40 AM


I think the issue with peer review is that the few law journals that use it are specialty journals, which limits the number of submissions.

Posted by: Steve at March 19, 2007 11:17 AM


I see three basic problems with many law review articles: 1) they're larded up with too many extraneous footnotes, in an attempt to pay obiesance to other scholars; 2) they rely on too much jargon that doesn't translate to the harried judge; and 3) they don't bother to cite judicial opinions.

As to the last point -- influence works both ways. If scholars want to be heard by judges, they also need to listen.

Posted by: David at March 19, 2007 11:17 AM


Does anyone else feel that citing cases in law reviews would be so much easier if we had better tools than lexus or westlaw to find pertinent cases? Compared to other areas of academia, these services leave much to be desired.

Posted by: Steve at March 19, 2007 03:12 PM


Perhaps another problem is the dominance of law and economics in the current scholarship, and its tendency to rely on crude assumptions, inaccurate psychological models, and "just so" story-telling. As Barbara Bergmann suggests for economics, perhaps legal scholarship could benefit from a "new empiricism."

http://www.bepress.com/cgi/viewcontent.cgi?article=1228&context=ev

Posted by: David at March 19, 2007 04:00 PM


Perhaps article titles these days also make courts reluctant to cite them.

Ever since the Crits blew the doors open in the 1970s and 80s, legal academics and student note writers have freighted hundreds, if not thousands, of otherwise solid articles with chatty, juvenile, punny, jargony, ridiculously argumentative, or otherwise awkward titles.

This isn't entirely a bad thing. No doubt many in the academic audience enjoy the fun. But I suspect that an undignified title often convinces a wavering judge (or law clerks) not to cite an article in a published judicial opinion -- even if the judge/clerks profited greatly from reading the article (as is often the case).

Posted by: Mike O'Shea at March 19, 2007 05:00 PM


Here's a comment on the state of law reviews, from someone thoroughly disgusted with them:

"There are two things wrong with almost all legal writing. One is its style. The other is its content."

Fred Rodell, Goodbye to Law Reviews, 23 Va. L. Rev. 38, 38 (1936). If law review articles are generally of poor quality, it doesn't appear to be a new problem.

Posted by: Bruce Boyden at March 19, 2007 05:42 PM


Anyone can do a case crunch. And many do such crunchers. They are called treatises and student notes.

Bit surprised that the judges came out so vehemently against the law reviews. Many clerks used to use regular good ole articles, treatises, student notes, etc, at least as a starting point to locate cases.

Um, perhaps the judges are a bit disconnected from the research?

Posted by: Lorna Filler at March 20, 2007 08:57 PM


I thought I had read that blogs may also be filling whatever possible gap is present. In other words the theory and other work to which Volokh refers is valuable but maybe not, as he indicates, be aimed at judges. In addition, it seems that law professors now use blogs and the Web to offer quick arguments regarding cases and in a way separate their academic writing from pieces that may have more readily apparent practical applications. This idea has been offered in a few places.

http://3lepiphany.typepad.com/3l_epiphany/2006/10/blogging_as_sch.html

and

Online Legal Scholarship: The Medium and the Message http://thepocketpart.org/2006/09/06/balkin.html

In short, it could be that the material written by law professors and most useful to judges and practioners is just in a different place than it has been in the past.

Posted by: Deven Desai at March 21, 2007 08:32 PM


Mike O'Shea,

Law articles have titles that would make them unlikely candidates for citation?

Why, I have no idea what the "fuck" you could be talking about.

Posted by: Kaimi at March 22, 2007 01:34 AM


Post a comment




Remember Me?

(you may use HTML tags for style)

Authors

Daniel J. Solove

Website
Understanding Privacy

Kaimipono Wenger

Website
SSRN Page

Dave Hoffman

Website
SSRN Page

Nate Oman

Website
SSRN Page

Frank Pasquale

Website
SSRN Page

Deven Desai

Website
SSRN Page

Michael O'Shea

Website
SSRN Page

Sarah Waldeck

Website
SSRN Page

Lawrence Cunningham

Website
SSRN Page

Danielle Citron

Website
SSRN Page

Jaya Ramji-Nogales

Website
SSRN Page


Guests

Robert Ahdieh
Miriam Cherry
Mark Edwards
Susan Kuo
Jonathan Lipson
Scott Moss
David Opderback
Kristen Osenga
Geoffrey Rapp
Susan Scafidi
Howard Wasserman






ad-logo3.jpg

blawg100_winner2.jpg

Previous Guests

Michael Abramowicz
Michelle Adams
Robert Ahdieh
Michelle Anderson
Laura Appleman
Francesca Bignami
Jeremy Blumenthal
Bruce Boyden
Donald Braman
Al Brophy
Neil H. Buchanan
Bill Burke-White
Scott Burris
Anupam Chander
Miriam Cherry
Jack Chin
Jennifer Collins
Allison Danner
Brannon Denning
Deven Desai
Mike Dimino
Christine Haight Farley
Kim Ferzan
Dan Filler
Amanda Frost
Timothy Glynn
Rachel Godsil
Eric Goldman
Craig Green
Jeffrey Harrison
Erica Hashimoto
Carissa Hessick
Laura Heymann
Christine Hurt
Darian Ibrahim
Dan Kahan
Sam Kamin
Heidi Kitrosser
Adam Kolber
Russell Korobkin
Anita S. Krishnakumar
Greg Lastowka
Sarah Lawsky
Erik Lillquist
Jeff Lipshaw
Joseph Liu
Solangel Maldonado
Jason Mazzone
William McGeveran
Salil Mehra
Carrie Menkel-Meadow
Max Minzner
Scott Moss
Eric Muller
Jaya Ramji-Nogales
Elizabeth Nowicki
Paul Ohm
Michael O'Shea
Rafael Pardo
Marcy Peek
Eduardo Peñalver
Neil RIchards
Lori Ringhand
Alice Ristroph
Paul Secunda
Jessica Silbey
Peter Smith
Charles Sullivan
Rick Swedloff
Steph Tai
Robert Tsai
Steve Vladeck
Sarah Waldeck
Melissa Waters
Alfred Yen
David Zaring
Timothy Zick
Jonathan Zittrain

Blogroll

Above the Law
ACS Blog
Althouse
Balkinization
Becker-Posner Blog
Beltway Blogroll
BlackProf
BoingBoing
Chicago Law Faculty Blog
Conglomerate
Convictions
CrimLaw
Crime & Federalism
CrimProf Blog
Crooked Timber
Discourse.net
Dorf on Law
Election Law
Emergent Chaos
Feminist Law Profs
43(B)log
Freakonomics Blog
Freedom to Tinker
Google Blogoscoped
How Appealing
Ideoblog
Info/Law
Instapundit.com
JD2B.com
Juris Novus
Jurisdynamics
Law and Letters
Legal Profession Blog
Legal Theory Blog
Legal Times Blog
Leiter Reports
Brian Leiter's Law School Reports
Lessig Blog
Madisonian
Mirror of Justice
National Security Advisors
Opinio Juris
Point of Law
Political Theory Daily Review
PrawfsBlawg
ProfessorBainbridge.com
Property Prof
Red Tape Chronicles
The Right Coast
Schneier on Security
SCOTUSBlog
Security Dilemmas
Sentencing Law and Policy
Simple Justice
Sivacracy.net
The Situationist
Susan Crawford
TalkLeft
Talking Points Memo
TaxProf Blog
Tech & Marketing Law
Truth on the Market
Volokh Conspiracy
WorkPlace Prof Blog
WSJ Law Blog
Wonkette
The Yin Blog

Pajamas Media BlogRoll Member