Thursday, November 19, 2020

Calling Bullshit - by Carl T. Bergstrom and Jevin D. West


At a recent meeting on information literacy on our campus a colleague from the Biology department called my attention to this work, which is based on a course the authors teach at the University of Washington. More than just how to spot fake news, the authors remind us that bullshit is everywhere. It is in local and national news, in our social media feeds, and yes, even in PR from University Administration. 

We cannot blame the messenger for any of this. Early in the work the authors describe the lament of fifteenth century priest and scribe Filippo de Strata who "railed against the damage wrought by the invention of the printing press". He worried that the low cost of printing materials would place written materials in the hands of the masses thereby lowering their value and authority. 

Five hundred years later in 1969 sociologist Neil Postman's comments on the pablum of mass media expresses concern that "infotainment" will distract the masses from real issues. Neither de Strata nor Postman could have imagined the level of bullshit brought on by the internet.
Publicly, Filippo de Strata fretted that the 'brothel of the printing press' would lead readers to cheap salacious entertainment...Privately, he may have been more concerned about his own job security.
I sometimes wonder about scholars, and some librarians who wish to guard certain information (under the guise of academic freedom). Is it the scholarship they are really attracted to, or simply the idea that they want others to believe that they are the ultimate authority?

A few years ago I read this article that discussed the issue of "abstract spin", the idea that authors of academic papers made their abstracts (sometimes the only part of a paper another person reads) focus on the juicy parts of the study. In this way they are more likely to get press coverage. Of course no one reporting on the story actually read the article, and may not have even read the abstract directly for that matter. The authors of Calling Bullshit likewise discussed the question of what gets covered in the popular press and what doesn't. Most notably that "negative results simply aren't exciting". Furthermore
The research studies that are reported in the popular press are not a random sample of those conducted or even of those published. The most surprising studies are the ones that mate the most exciting articles... When science writers cast scientific studies in popular language, they sometimes omit important caveats, offer stronger advice than is justified, present correlations as causal relationships, or extrapolate from findings in lab animals to suggest immediate application in humans
I attend a fair number of presentations on fake news and misinformation, and have occasionally given them myself. One thing that can be counted on at any of these kinds of workshops is a question about how to convince someone that they are spreading false information. I don't really have a good answer for them, and typically I've noticed other presenters don't either. Bergstrom and West provide some good advice including understanding that a person's identity may be tied to their world view so "decoupling" issues of identity from the story you want to debunk is important. To wit:

Keep it simple - "falsehoods can be crafted to be simple" (consider how often we see meme's reduced to two pictures demonstrating someone  - or something - as bad and the other as good). When offering a counterargument keep you story simple as well.

Take it offline - don't publicly humiliate another person - you will not convince them and you will surely piss them off.

Find common ground - recognize that the other person has concerns (just as you do).

Do not repeat the myth before debunking, this increases the likelihood that the myth will be perpetuated. A good piece of advice I got regarding debunking things on social media is not to simply put a comment with a link to the source. For one thing most people won't see it, and for another it is a bit embarrassing for the original poster who may have shared in good faith. I also learned not to share the post with my own commentary as that will likely perpetuate the myth as well. Instead I download the post, change it and repost so that is is clear that I am breaking the chain of sharing. Here is an example



And finally the authors provide these tips for detecting bullshit:

1. Questioning the Source of the Information
  • Who is telling me this?
  • How [do they] know it?
  • What is this person trying to sell me? - Hint they are always trying to sell you something - you may not necessarily have to part with your money in order to "buy it"

2. Beware of Unfair Comparisons
Find out how comparisons are being made between x and y. Comparisons may be between two different kinds of things (apples to oranges)  or there may be some arbitrary condition thrown in that skew the results

3.  If it's too good to be true - it is.
Statistics have been cherry picked so that readers will generalize, or an incomplete picture is drawn with only partial data reported. Go to the original source to get the real story. I actually practiced what I preached here with the story about abstract spin (above). Once I read the article in the in Inside Higer Ed I found the original study and read it, too. 


And remember "When you are using social media, remember the mantra 'think more, share less'".

Wednesday, November 18, 2020

Change the Subject - the movie

Change the Subject trailer

I received an email last week letting me know that Indiana University Bloomington was sponsoring a free screening of this film. I had not heard of the documentary before, but I did know the story of the Dartmouth College students who took on the Library of Congress (LoC) in order to have the pejorative catalog subject heading "Illegal Aliens" changed to Undocumented Immigrants. I was surprised to learn that the change has not yet happened (see this page from the Library of Congress Subject Headings). I followed the story at the time and remembered that Republicans in Congress (for the first time ever) decided to get involved with decisions on LoC subject headings. It is not unusual for Library of Congress Subject Headings to change as language and mores change, but in this case some lawmakers decided that this was too much and amounted to "political correctness run amok". Calls were made for more transparency in the process for changing LoC Subject headings (again, this had never been the case before). 

What both parties here understand is this: words matter. Language matters. 

The film follows the students from the CoFired (Coalition for Immigration Reform and Equality at Dartmouth) Student Group as they go from discovering that the subject heading exists to talking to the College librarians about it (and librarians' own awakening about the term) to the students' realization that the heading did not originate with Dartmouth's Baker-Berry Library but rather that the headings came from the authority of the Library of Congress and so they took their case to the United States Capitol.  

The term inspirational was used to describe the students. 

Inspirational? 

Yes. 

These students in fact inspired me to contact the editors of the popular Opposing Viewpoints database (Cengage) in 2017 when I discovered that the term "illegal aliens" was used as a heading in the database. I pointed out that the Library of Congress was considering changing their subject heading and that surely the editors of the database were aware of this. Furthermore, I suggested that the heading was judgmental, which seemed to be contrary to the purpose of the Opposing Viewpoints database - to inspire discussion. Unlike the Library of Congress Cengage did indeed "change the subject" after I sent them my message. The term "Undocumented Immigrants" is now used in the database.

Screenshot from Opposing Viewpoints database

I will continue to follow this story. Perhaps we will see a change in 2021.