Many news outlets, we suspected, basically were *already* mouthpieces for scientists, not by checking copy but by simply regurgitating the press releases associated with the work, that is, the PR material issued by universities or journals. 10/x
-
-
Fourth – if you really want accurate science news, avoid exaggeration in your own press releases and anticipate likely misunderstandings by including a section “What this study does NOT show”. If you allow hype in your PR then YOU share culpability for misreporting. 21/x
Show this thread -
Finally, accept that you're not special to journalism & neither is science. Independence is key to journalism. Sometimes journalists will screw up & sometimes you will do it all by yourself. Get media trained, find the good journos & trust them. Basically, get over yourself. /fin
Show this thread -
Postscript: for those asking about the next step in our work...it's not over yet!https://twitter.com/chrisdc77/status/960792083748589568 …
Show this thread -
I see this thread from last year is getting another round of attention. Results of our randomised trial to test the effect of press releases on the news are now in-press with
@BMCMedicine so stay tuned! cc@adamsrc86Show this thread -
We’ve just published the next step in our journey to understand the role of press releases in science news. It’s without doubt the most off-the-wall & unexpected research project I’ve ever been involved in. Our latest foray was a real-world experiment on the news media itself.
Show this thread -
That’s right. We did an experiment on the news. We took press releases on health-related science, altered them before they were issued to journalists, and then studied what effect the changes we made influenced science reporting.
Show this thread -
In this continuation of the thread I started last year, I want to take you through the results of the trial and what I think they mean. But I also want to take you behind the scenes of doing this sort of research because the project was a political roller coaster.
Show this thread -
To be honest, it’s amazing that the project happened at all. What follows is a pretty long thread that in retrospect feels like a kind of academic version of Billions. Feel free to mute me if this isn't your thing. Otherwise, saddle up for some Sunday night thrills…pic.twitter.com/3fkwD7Ew6n
Show this thread -
To recap tweet 14/x above, in Dec 2014 we published a retrospective study which found that most exaggeration found in health-related science news is already in the press releases issued by universitieshttps://twitter.com/chrisdc77/status/960309818430025766 …
Show this thread -
This was big news & it made a splash. When it came to bad sci reporting, university press releases were likely to be a major contributor. As someone put it, all these years it was assumed that *reporters* created hype, but in fact “the call was coming from inside the house” /26
Show this thread -
But those of us on the research team knew from the very beginning that as impactful as the project might be, it could never provide evidence that press releases *causally* influence science news. Why? /27
Show this thread -
Because the research was retrospective and observational, much like a lot of epidemiology. This meant we could only ever show *associations* between the content of press releases and the content of news stories. /28
Show this thread -
To demonstrate causality you would need to do an experiment. And to do it properly you would need a randomised controlled trial or RCT – the gold standard for testing the existence of causal effects. /29
Show this thread -
If we could show in an RCT that improving the quality of press releases improved the quality of science news – and, crucially, WITHOUT reducing news uptake – we could build an evidence-based policy for sci communication that press officers would have every reason to embrace /30
Show this thread -
Afterall, we knew already that press officers had no innate desire to issue inaccurate or hyped press releases. But from talking with them (lots of them) we also understood the pressure they face to generate media impact for their universities. /31
Show this thread -
One press officer we met took this so seriously that every week he'd get out his ruler and record the literal column inches of every print news story stemming from his university's research. He'd been doing it for decades. /32
Show this thread -
For running a randomised trial, the big problem I kept coming back to was feasibility. It seemed like one of those thought experiments that in theory would be beautiful but in reality you know is a pipedream. /33
Show this thread -
We needed the idea to pass the smoke test. So at the
@SMC_London Christmas drinks party in 2014 we worked the room to find out what journalists might make of an experiment on the news. Our BMJ paper had just come out & a lot of people were talking about it. /34Show this thread -
We asked the journalists: How would you feel about being guinea pigs in a trial where the press release you’re reading might have been manipulated? How would you feel not knowing what the manipulation was? Not even knowing if this press release was part of the trial or not? /35
Show this thread -
The response varied. A few of the specialist reporters liked the idea. Some didn’t give a crap. One guy spent the whole time glancing forlornly over my shoulder to see if someone more important might walk past who he could talk to. I felt a bit sorry for that guy /36
Show this thread -
Several journalists were quite disturbed by it. One BBC reporter told me that running controlled experiments on the news was undemocratic and dangerous. /37
Show this thread -
That raised a red flag for me. If we ran the trial, I wondered if journalists might crucify us. Visions of being doorstepped. ENEMY OF DEMOCRACY. MANIPULATOR OF THE NEWS. A laughable anxiety, really, given the state of the world now but these were the heady days of pre-2016. /38
Show this thread -
At the same time if we were going to run an experiment like this, our most important partners were not the journalists, they were the press officers. If we were going to intervene in press releases b4 they were issued, we'd need press officers to work with us. And trust us. /39
Show this thread -
But there was one major hurdle with getting them on board. Our BMJ paper, which by now was storming across the media and social media, pissed a lot of them off. Big time. Here's the paper as a refresher: http://www.bmj.com/content/bmj/349/bmj.g7015 … /40
Show this thread -
Not all of them, of course, but enough to make the prospect of a trial a diplomatic nightmare. Here we were, mostly nobodies with no sci comm background, detonating a nuclear warhead in the BMJ telling them that most exaggeration in science news begins in press releases. /41
Show this thread -
Many press officers felt that we’d just driven a bulldozer through their profession. Of course our work wasn't intended that way at all. We just wanted to know the answer to the question: Where does hype come from in science news? /42
Show this thread -
And as I pointed out earlier in this thread, this is important because if hype comes from universities then as scientists we can do something about it. /43
Show this thread -
We've got zero chance of changing newsroom culture (my earlier escapades in this area – see the very start of this thread – taught me that). But we can change what happens in the universities because we basically ARE the universities. /44
Show this thread -
And in our BMJ paper we were careful to attribute the main responsibility for the content of press releases to the scientists who approve them, not the press officers. /45
Show this thread -
We decided that to get the press offices on board for a possible randomised trial, we needed a kind of good will national diplomacy tour. I mean, JFC, if there is anything I am NOT built for... /46
Show this thread - 50 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.