Home | About | RSS Feed | Contact and Publicity Guidelines | Comment Policy the Law, the Universe, and Everything 


advertise-here4


Slip Opinions


University governance as a new topic of public discussion.

An unusual profile of Mary Anne Franks (kw)

Aggressive copyright litigation run amok. (fp)

USA Today's Matt Krantz quoting me on Warren Buffett joining Twitter.  (LAC)

Private prisons? Why, sure! What could possibly go wrong? (kw)

TNR profiles Susan Crawford (kw)

Berkshire Hathaway is bigger than Warren Buffett.  Manual of Ideas (LAC).

Guns don't shoot people, kitchen appliances shoot people (kw)

Via Glom, Sat Eve Post review of The Essays of Warren Buffett.

Jack Coffee on Bad Plaintiffs' Counsel in M&A Deals and What Must Be Done to Break Them


Our Podcast

Subscribe to Law Talk


  • Posts by Author

  • Categories

  • Archives


  • Recent Comments


    • Daniel Barth-Jones on Re-Identification Risks and Myths, Superusers and Super Stories (Part II: Superusers and Super Stories)

    • Daniel Barth-Jones on Re-Identification Risks and Myths, Superusers and Super Stories (Part I: Risks and Myths)

    • Daniel Barth-Jones on Re-Identification Risks and Myths, Superusers and Super Stories (Part II: Superusers and Super Stories)

    • Daniel Barth-Jones on Re-Identification Risks and Myths, Superusers and Super Stories (Part I: Risks and Myths)

    • Shag from Brookline on Kentucky: Boy, 5, Kills Sister, 2

    • Brett Bellmore on Kentucky: Boy, 5, Kills Sister, 2

    • Peter Strauss on Copyright’s Constitutional Chameleon

    • John Duffy on Copyright’s Constitutional Chameleon

    • Andrew on BRIGHT IDEAS: Q&A with Bruce Schneier about Liars and Outliers

    • Joe on Kentucky: Boy, 5, Kills Sister, 2

    • John Duffy on Copyright’s Constitutional Chameleon

    • Marty Lederman on Copyright’s Constitutional Chameleon

    • Brett Bellmore on Copyright’s Constitutional Chameleon

    • Ryan Calo on Franks on "How to Feel Like a Woman, or Why Punishment Is a Drag"

    • Anon on Wachtell Lipton's Errors on Shareholder-Paid Director Bonuses
  •  

    Site Meter

    About the Blog

    Concurring Opinions is a multiple authored, general interest legal blog.

    (Image: Wikicommons)

Virtual Perils of Cyber Hate and the Need for a Conception of Digital Citizenship

posted by Danielle Citron

Although intermediaries’ services can facilitate and reinforce a citizenry’s activities, they pose dangers that work to undermine them.  Consider the anonymous and pseudonymous nature of online discourse.  Intermediaries permit individuals to create online identities unconnected to their legal identities.  Freed from a sense of accountability for their online activities, citizens might engage in productive discourse in ways that they might not if directly correlated with their offline identities.  Yet the sense of anonymity breeds destructive behavior as well.  Social science research suggests that people behave aggressively when they believe that they cannot be observed and caught.  Destructive online behavior spills offline, working a fundamental impairment of citizenship.

For instance, digital expressions of hatred helped inspire the 1999 shooting of African-Americans, Asian-Americans, and Jews in suburban Chicago by Benjamin Smith, a member of the white supremacist group World Church of the Creator (WCOTC) that promotes racial holy war.  Just months before the shootings, Smith told documentary filmmaker Beverly Peterson that: “It wasn’t really ‘til I got on the Internet, read some literature of these groups that . . . it really all came together.”  More recently, the Facebook group Kick a Ginger Day urged members to get their “steel toes ready” for a day of attacking individuals with red hair. The site achieved its stated goal: students punched and kicked children with red hair and dozens of Facebook members claimed credit for attacks.

Cyber hate can produce so much psychological damage as to undermine individuals’ ability to engage in public discourse.  For instance, posters on a white supremacist website targeted Bonnie Jouhari, a civil rights advocate and mother of a biracial girl.  They revealed Ms. Jouhari’s home address and her child’s picture.  The site showed a picture of Ms. Jouhari’s workplace exploding in flames next to the threat that “race traitors” are “hung from the neck from the nearest tree or lamp post.”  Posters included bomb-making instructions and a picture of a hooded Klansman holding a noose.  Aside from moving four times, Ms. Jouhari and her daughter have withdrawn completely from public life; neither has a driver’s license, a voter registration card or a bank account because they don’t want to create a public record of their whereabouts.

Search engines also ensure the persistence and production of cyber hate that undermines citizens’ capability to engage in offline and online civic engagement.  Because search engines reproduce information cached online, people cannot depend upon time’s passage to alleviate the damage that online postings cause.  Unlike leaflets or signs affixed to trees that would decay or disappear not long after their publication, now search engines index all of the content hosted by social media intermediaries, producing it instantaneously.

Jeremy Waldron contends that cyber hate produces a “permanent disfigurement” of group members.  Online hate mars our social environment by visibly and publicly conveying the message that a “group in the community is not worthy of equal citizenship.”  It denigrates group members’ basic standing in society and deprives them of their “civic dignity.”  Search engines ensure that cyber hate endures, instantly accessible far into the future.

Another distinct feature of the Internet is that it can facilitate “echo chambers” of extreme views.  As Cass Sunstein explored in Republic.com 2.0, people may tailor their online news, only seeking out those who reinforce their views and filtering out contrary information.  This leads to the hardening of positions into more extreme ones.  Sunstein explained that hate groups on the internet are so extreme because they often expose themselves to only to online groups with similar views and link exclusively to hateful content.

Intermediaries should recognize these particular challenges that cyber hate in networked spaces poses to individuals’ capability to participate meaningfully offline and online.  In our upcoming article Intermediaries and Hate Speech: Fostering Digital Citizenship for the Information Age (forthcoming Boston University Law Review 2011), Helen Norton and I invoke a concept of digital citizenship to ensure that intermediaries acknowledge and address these challenges.   In so doing, we do not mean to suggest that individuals are somehow citizens of a virtual space that is unconnected from our territorial polity.  Quite the contrary, we speak of digital citizenship as it relates to individuals rooted firmly in our territorial polity.  Digital citizenship acknowledges that our networked environment can be a blow to territorial polity in ways that intermediaries need to recognize and redress.


 November 27, 2010 at 3:49 pm   Posted in: Anonymity, Cyber Civil Rights, Cyberlaw, Google & Search Engines, Law and Inequality, Legal Ethics, Legal Theory, Politics, Psychology and Behavior, Race, Social Network Websites, Technology, Web 2.0   Print This Post Print This Post

Responses (3)

  1. Seth Finkelstein - November 28, 2010 at 12:51 am

    I’m unclear as to the implications. When you say “Intermediaries should recognize these particular challenges that cyber hate in networked spaces poses to individuals’ capability to participate meaningfully offline and online.”, do you mean e.g. that search engines should de-index “cyber hate”? Can I point out they’ve been asked, and said “No” – e.g. the case of “Jew Watch”

    By the way, Sunstein is telling a story akin to “moral panic”. Many people have pointed out that the reality of extremism contradicts his scare-mongering, but this does not seem to matter – precisely because it is a story appealing to the audience’s fears (and hence sort of self-refuting, in that contrary information does not make a difference).

  2. Frank Pasquale - November 28, 2010 at 9:40 am

    I think this is very important work, and I’m glad to see you pursuing it. Even the developing world is facing the problem:

    http://www.truth-out.org/for-women-cyber-crimes-are-all-too-real65458

    Moreover, folks should check out how some intermediaries are helping to increase the prominence of some of the worst businesses on the web…which seem to thrive on harassing people:

    http://www.nytimes.com/2010/11/28/business/28borker.html?ref=technology&pagewanted=print

    After a woman was cheated by an online company, this is what happened to her: [all below is a quote from the article]

    “she called Citibank, which administers her MasterCard account, and after submitting some paperwork, she won a provisional victory. Her $487 would be refunded as the bank looked into the charge and discussed it with the owner of [the company]. . . . Then Mr. Russo [from the online company] sent details of what appeared to be a lawsuit filed in Brooklyn. It included a hearing date and time, the address of the court, a docket number and a demand for $1,500, which, the e-mail said, “includes my legal fees.”

    “Ms. Rodriguez did not respond. A few hours later, Mr. Russo raised the stakes sharply by sending another e-mail, this one with a photograph of the front of the apartment building where she and her fiancé lived.

    “Then her cellphone started ringing. And ringing. . . . Two days later, she received another e-mail from Mr. Russo. “Close the dispute with the credit card company if you know whats good for you,” he wrote. “Do the right thing and everyone goes away. I AM WATCHING YOU!”

    That same day an e-mail from Citi arrived. “Thank you for contacting Citi Cards,” it read. “We have closed our investigation since you have indicated that you accept responsibility for this charge.” And there was this: “we have rebilled your account for this charge along with any related fees and interest charges.”

    Someone posing as Ms. Rodriguez, she says, had called the bank and said she had changed her mind and no longer wanted a refund.

    “Hello, My name is Stanley with [the online company],” the post began. “I just wanted to let you guys know that the more replies you people post, the more business and the more hits and sales I get. My goal is NEGATIVE advertisement.”

    It’s all part of a sales strategy, he said. Online chatter about [the online company], even furious online chatter, pushed the site higher in Google search results, which led to greater sales. He closed with a sardonic expression of gratitude: “I never had the amount of traffic I have now since my 1st complaint. I am in heaven.”
    ****

    [But for other purposes] He handles those transactions like a Boy Scout because Amazon doesn’t mess around, he says — the company just kicks you off its site if you infuriate customers.”

    ****

    [Note--I edited my comment to avoid referring to the company...because the more people write its name, the more it plays into their strategy!]

  3. Danielle Citron - November 28, 2010 at 9:58 am

    Thanks so much to you both. Seth, I promise to follow up today in a post about which sorts of intermediaries our piece speaks to as well as a brief overview of our prescriptions, including our upholding Google’s response to Jew Watch as a sort of model for counter speech (I will soon explain). As always, thanks so much Frank for your insights and examples. Your work is an inspiration to us, and to me, in general.

Leave a Reply

Spam protection by WP Captcha-Free


  • « Previous post
  • Next post »

Authors

Daniel J. Solove
Kaimipono Wenger
Dave Hoffman
Frank Pasquale
Deven Desai
Danielle Citron
Lawrence Cunningham
Sarah Waldeck
Jaya Ramji-Nogales
Solangel Maldonado
Gerard Magliocca

Guests

Kelli A. Alces
Taunya Lovell Banks
Ryan Calo
Claire Hill
Jay Kesten
William McGeveran
Meredith Render
Aaron Saiger
David L. Schwartz
Olivier Sylvain
Charles K. Whitehead
Aaron Zelinsky


















Previous Guests

Michael Abramowicz
Michelle Adams
Robert Ahdieh
Marvin Ammori
Michelle Anderson
Laura Appleman
Derek Bambauer
Taunya Lovell Banks
Ann Bartow
Steven Bellovin
Adam Benforado
Gaia Bernstein
Francesca Bignami
Josh Blackman
Joseph Blocher
Jeremy Blumenthal
Kathleen Boozang
Bruce Boyden
Donald Braman
Khiara Bridges
Al Brophy
Neil H. Buchanan
Bill Burke-White
Scott Burris
Paul Butler
Ryan Calo
Naomi Cahn
Anupam Chander
Miriam Cherry
Jack Chin
Glenn Cohen
Gabriella Coleman
Jennifer Collins
Caroline Mala Corbin
Thomas Crocker
andré douglas pond cummings
Allison Danner
Laura DeNardis
Brannon Denning
Deven Desai
Mike Dimino
Mark Edwards
Maxine Eichner
Jessica Erickson
David Fagundes
Lisa Fairfax
Joshua Fairfield
Christine Haight Farley
Kim Ferzan
Dan Filler
Mary Anne Franks
Susan Freiwald
Michael Froomkin
Amanda Frost
Brian Frye
Timothy Glynn
Rachel Godsil
Eric Goldman
Kyle Graham
David Gray
Craig Green
Tristin Green
Jonathan Hafetz
Vivian E. Hamilton
Meredith Harbach
Michelle Harner
Angela Harris
Jeffrey Harrison
Hosea Harvey
Erica Hashimoto
Jennifer Hendricks
Carissa Hessick
Laura Heymann
Robert Hillman
Gilbert A. Holmes
Nicole Huberfeld
Christine Hurt
Darian Ibrahim
Sherrilyn Ifill
John Ip
Shavar Jeffries
Kevin Johnson
Kristin Johnson
Jeff Jonas
Courtney Joslin
Dan Kahan
Jeffrey Kahn
Brian Kalt
Sam Kamin
Michael Kang
Chimène Keitner
Alicia Kelly
Orin Kerr
Nancy Kim
Heidi Kitrosser
Adam Kolber
Russell Korobkin
Alex Kreit
Anita S. Krishnakumar
Susan Kuo
Greg Lastowka
Sarah Lawsky
Youngjae Lee
Margaret Lewis
Erik Lillquist
Jeff Lipshaw
Jonathan Lipson
Jacqueline Lipton
Matthew Lister
Joseph Liu
Michael Madison
Tayyab Mahmud
Kevin Noble Maillard
Solangel Maldonado
Jason Mazzone
Linda McClain
William McGeveran
Salil Mehra
Carrie Menkel-Meadow
Max Minzner
Viva Moffat
Scott Moss
Eric Muller
Janai Nelson
Jaya Ramji-Nogales
Helen Norton
Elizabeth Nowicki
Paul Ohm
Angela Onwuachi-Willing
David Opderback
David Orentlicher
Michael O'Shea
Kristen Osenga
Mary-Rose Papandrea
Rafael Pardo
Marcy Peek
Eduardo Peñalver
Robert Percival
Michael J. Pitts
Marc Poirier
David Post
Amanda Pustilnik
Shruti Rana
Geoffrey Rapp
William Reynolds
Neil Richards
Lori Ringhand
Alice Ristroph
Marc Roark
Brishen Rogers
Sasha Romanosky
Tuan Samahon
Susan Scafidi
David Schleicher
David Schraub
Paul Secunda
Lea Shaver
Jonathan Siegel
Jessica Silbey
Peter Smith
Judd Sneirson
Adam Steinman
Charles Sullivan
Rick Swedloff
Peter Swire
Olivier Sylvain
Steph Tai
Andrew Taslitz
Robert Tsai
Jenia Turner
Joseph Turow
Steve Vladeck
Ari Waldman
Spencer Weber Waller
Howard Wasserman
Melissa Waters
Elizabeth A. Wilson
Frank Wu
Alfred Yen
Corey Yung
David Zaring
Timothy Zick
Michael Zimmer
Jonathan Zittrain

Ownership

Concurring Opinions is a
general-interest legal blog
operated by Concurring
Opinions LLC, a Pennsylvania
Limited Liability Corporation.

Blogroll

Above the Law
Access to Justice
ACS Blog
Althouse
Balkinization
Becker-Posner Blog
BlackProf
BoingBoing
Chicago Law Faculty Blog
Conglomerate
CrimLaw
Crime & Federalism
CrimProf Blog
Crooked Timber
Derechoalderecho
Discourse.net
Dorf on Law
Election Law
Emergent Chaos
The Faculty Lounge
Feminist Law Profs
43(B)log
Freakonomics Blog
Freedom to Tinker
Google Blogoscoped
How Appealing
Ideoblog
Info/Law
Instapundit.com
Juris Novus
Jurisdynamics
Just Books
Law and Humanities Blog
Law and Letters
Law Librarian Blog
Legal Profession Blog
Legal Theory Blog
Legal Times Blog
Leiter Reports
Brian Leiter's Law School Reports
Lessig Blog
Madisonian Theory
Media Law Blog
Mirror of Justice
The Moderate Voice
National Security Advisors
Opinio Juris
Point of Law
PrawfsBlawg
Privacy and Security Training
ProfessorBainbridge.com
Property Prof Blog
Red Tape Chronicles
The Right Coast
Schneier on Security
SCOTUSBlog
Security Dilemmas
Sentencing Law and Policy
Simple Justice
Sivacracy.net
The Situationist
Susan Crawford
TalkLeft
Talking Points Memo
TaxProf Blog
TeachPrivacy Blog
Tech & Marketing Law
Truth on the Market
Volokh Conspiracy
WorkPlace Prof Blog
WSJ Law Blog
Wonkette
The Yin Blog


© Concurring Opinions

Powered by WordPress