Swamped with pseudoscience: How to discern real research from quackery

Determining what to believe is not an easy task. We are overloaded with information on the internet on just about every subject imaginable.

Determining what to believe is not an easy task. We are overloaded with information on the internet on just about every subject imaginable. A lot of that information is inaccurate and sorting out what is wheat and what is chaff is a real challenge for us non-experts.

This is particularly true when the information we find is contradictory. Recently I tried to get a handle on the appropriate amount of protein intake for a person trying to gain lean muscle mass. I expected that it would be a question on which there would be some amount of consensus.

Was I ever wrong.

The answers were all over the map. According to some sources a person of my weight and activity level should be getting about 300 grams of protein every day – an amount attainable only by consuming powdered supplements in copious amounts well beyond what’s recommended on the container.

Nonsense, said other sources. You only need about 100 grams per day which can be easily obtained through dietary sources without much effort. Anything beyond that is a waste. In fact, according to some sources, consuming too much can even be harmful to your health.

Thanks for the clarity, internet.

So how does one know what to believe on the web?

You’ll often hear we should get our information from peer reviewed studies rather than blogs and Youtube videos. I am not convinced that matters are so simple.

It is certainly true that all manner of pseudoscience and misinformation proliferates on social media where material can be easily posted by anyone with internet access and a keyboard.

But such sources can also provide quality information in a format that is understandable by people who aren’t experts in a field. For example, TED Talks – a series of speeches by knowledgeable people – are all available on Youtube, as are full episodes of many rigorously researched documentaries.

Meanwhile, blogs such as the Skepical Raptor and Science Based Medicine are written by qualified individuals who not only have consistently shown a dedication to the scientific method and sceptical inquiry but write in a style that is accessible to ordinary people. Surely it is not wise to dismiss everything that isn’t written in a reputable journal.

And speaking of reputable journals, asking lay people to read peer reviewed scientific research isn’t necessary a guarantee of a greater of level of understanding. We must beware the Dunning -Krueger effect – a cognitive bias that causes us humans to overestimate our own abilities.

Unfortunately, complex research is often misinterpreted and not properly understood. Specific statements from articles are routinely cherry picked and not seen within the greater context of a piece or even the exlicit caveats attached by the author. A misinformed individual misreading peer reviewed research will not only get a false impression of what they have read but will feel all the more confident about their opinions because they feel they have the stamp of scientific approval.

Moreover even scholarly research occasionally gets things wrong. A study may be an “outlier” that is inconsistent with the wider body of research on a subject. The methodology used or conclusions drawn by researchers in a particular piece may be questioned by other sources. Without a base of knowledge on research methodology and a particular subject area, relying on dense, complex, technical scholarly research replete with jargon may be no better than blogs and Youtube videos.

So if we can’t count on the medium to determine whether or not information is reliable and useful what are we to do?

I am still confident that “the truth is out there,” and – despite what some would have us believe – that the pursuit of knowledge is a largely objective process. I’m also confident that, while it is not always easy, even those of us without scientific training can comprehend the truth. There are a number of relatively easy short cuts for spotting untruthful and exaggerated claims.

For example, there was a clever meme I saw recently that pointed out that “the next time you hear that something killed cancer in a petri dish just remember that so will a handgun” – highlighting the danger of being over optimistic about extrapolating laboratory research done on tissues to direct medical application. At best such research is grounds for further research and cannot be taken by itself as proof that – for instance – marijuana cures cancer.

Try to wrap your head around the law of large numbers and how it warps our perceptions about coincidences. It is a big world out there and odds of very strange occurrences making their way to your computer screen via the internet are not nearly as remote as you might think. Be sceptical whenever you see conclusions drawn from anecdotes and wait for proper research.

And if a source has a history of peddling nonsense be highly sceptical of its reliability on anything. I think most reasonable people would scoff at someone advancing the fringe theory that HIV doesn’t cause causes AIDS and would back away slowly from someone propagating the notion that the government is poisoning us with “chemtrails” from aircraft. Yet for reasons that continue to confound me they flock by the millions to a popular website — naturalnews.com — for information on vaccines and cancer treatments despite the site’s willingness to publicize articles in support of both “theories”.

So read online with care. And if you figure out how much protein we should be consuming let me know.

Kyle Carruthers is a born-and-raised Yukoner who lives and practises law in Whitehorse.

Get local stories you won't find anywhere else right to your inbox.
Sign up here

Just Posted

The Yukon Department of Education building in Whitehorse on Dec. 22, 2020. Advocates are calling on the Department of Education to reverse their redefinition of Individualized Education Plans (IEPs) that led to 138 students losing the program this year. (John Hopkins-Hill/Yukon News file)
Advocates call redefinition of IEPs “hugely concerning,” call for reversal

At least 138 students were moved off the learning plans this year

Medical lab technologist Angela Jantz receives her first dose of the Moderna COVID-19 vaccine at the Whitehorse hospital on Jan. 13. (Haley Ritchie/Yukon News)
Online booking system for Moderna vaccine opens as mobile teams prepare to visit communities

“The goal is to protect everyone and stop the spread of COVID-19”


Wyatt’s World for Jan. 15, 2021

Zhùr, the ancient wolf pup found mummified in permafrost at Last Chance Creek mine in July 2016. (Government of Yukon/Submitted)
‘Mummy’ wolf pup unearthed in permafrost paints a picture of ice age ancestors

Zhùr is the best preserved and most complete mummy of an ancient wolf found to date.

The Fish Lake area viewed from the top of Haeckel Hill on Sept. 11, 2018. The Yukon government and Kwanlin Dün First Nation (KDFN) announced they are in the beginning stages of a local area planning process for the area. (Crystal Schick/Yukon News file)
Local area planning for Fish Lake announced

The Government of Yukon and Kwanlin Dün First Nation (KDFN) announced in… Continue reading

Whitehorse City Hall. (Joel Krahn/Yukon News file)
City hall, briefly

A look at decisions made by Whitehorse city council this week

Fire damage, photographed on Jan. 11, to a downtown apartment building which occurred late in the evening on Jan. 8. Zander Firth, 20, from Inuvik, was charged with the arson and is facing several other charges following his Jan. 12 court appearance. (Gabrielle Plonka/Yukon News)
More charges for arson suspect

The Inuvik man charged in relation to the fire at Ryder Apartments… Continue reading

The grace period for the new Yukon lobbyist registry has come to an end and those who seek to influence politicians will now need to report their efforts to a public database. (Mike Thomas/Yukon News file)
Grace period for new lobbyist registry ends

So far nine lobbyists have registered their activities with politicians in the territory

The Government of Yukon Main Administration Building in Whitehorse on Aug. 21, 2020. Some Yukon tourism and culture non-profit organizations may be eligible to receive up to $20,000 to help recover from losses due to the COVID-19 pandemic. (Crystal Schick/Yukon News file)
Details released on relief funding for tourism and culture non-profits

Some Yukon tourism and culture non-profit organizations may be eligible to receive… Continue reading

Mayo-Tatchun MLA Don Hutton won’t be runing for re-election. (Joel Krahn/Yukon News file)
Mayo-Tatchun MLA won’t run for re-election

Liberal MLA Don Hutton won’t be running for re-election. A former wildland… Continue reading

Large quantities of a substance believed to be cocaine, a large amount of cash, several cells phones and a vehicle were all seized after RCMP searched a Whistle Bend home on Jan. 6. (Photo courtesy RCMP)
Seven arrested after drug trafficking search

RCMP seized drugs, money from Whistle Bend residence on Jan. 6

Whitehorse City Hall. (Joel Krahn/Yukon News file)
City hall, briefly

A look at decisions made by Whitehorse city council this week

Most Read