Podcast mania
In letzter Zeit war ich zu Gast in einigen Podcasts, für Audiophile hier die links:
Deutschlandfunk Kultur
Wo Professor Zufall regiert
Zu wenige Versuchspersonen, unsauber geplante Experimente, keine Replikation der Untersuchung: viele biomedizinische Studien haben Schwächen. So große, dass man stattdessen genauso gut eine Münze werfen könnte, meint der Neurologe Ulrich Dirnagl.
7 min
Podcast Spektrum – Wirkstoffradio (André Lampe und Bernd Rupp)
WSR019 Schlaganfall, Stroke Units und die Verantwortung der Forschung
150 min!
Podcast Kritisches Denken (Philip Barth, Andreas Blessing)
Episode 25 – Qualität in der Forschung
Im ersten Teil des Gesprächs mit Prof. Ulrich Dirnagl von der Charité Berlin sprechen wir über strukturelle Probleme in der Forschungslandschaft, die Reproduzierbarkeitskrise und den p-Wert. Details zur Episode
https://kritisches-denken-podcast.de/episode-25-qualitaet-in-der-forschung/
40 min
Podcast Kritisches Denken (Philip Barth, Andreas Blessing)
Episode 26 – Mikrobiomforschung und andere Hype-Zyklen
In Teil 2 des Gesprächs mit Prof. Ulrich Dirnagl unterhalten wir uns über die Mikrobiomforschung und wie Hype-Zyklen in der Wissenschaft verlaufen.
https://kritisches-denken-podcast.de/episode-26-mikrobiomforschung-und-andere-hype-zyklen/
60 min
Podcast Gesundheit Macht Politik
Ulrich Dirnagl | Forschung: This is an intergalactic emergency
https://gmp-podcast.de/blog/gmp053/
And here’s a video cast from the European Academy of Neurology
EAN 2019: Charles Edouard Brown-Séquard Lecture – Interview with Prof. Ulrich Dirnagl
When carmakers hack brains
You got to see this youtube video! Hectically cut sequences of busy young scientists in high-tech laboratories wearing lab coats, nerdy looking guys are soldering electronic circuits and stare into oscilloscopes, we are taken on a roller coaster ride through an animated brain chockful of tangled nerve cells. And in between all this, on stage at the California Academy of Sciences, car and rocket manufacturer Elon Musk announces his latest vision in a messianic pose: The symbiosis of the human brain with artificial intelligence (AI)! This time his plan to save mankind does not involve mass evacuation to Mars, but will be realized by a revolutionary Brain Machine Interface (BMI), designed and manufactured by his company Neuralink. You may have guessed it, this has caused a tremendous media hype all over the world. The verdict in the press and on the net was: “Musk at his best, a bit over the edge, but if HE announces a breakthrough like that there must be something to it”. The more cautious asked: “But couldn’t this be dangerous for mankind? Do we need a new ethic for stuff like this?” Continue reading
Love thy NULL result as thy statistically most significant!
Damn! What an effort: Generation of a knockout mouse line, back crossing in background strain and litermates, all the genotyping. Followed by a plethora of experiments in a disease model: surgery, magnetic resonance imaging, histology, behavioral studies, and so on. Finally the result: No phenotype! The knockout mouse appears to be a mouse like any other. Not different from the wild type background strain. But wait, we rather need to phrase it like this: We did not find a statistically significant difference between knockout and wild type. So we cannot even conclude that wild type are like knowout mice, but rather: If there is a difference, it might be smaller than the detectable effect size, depended on sample size, error level (alpha and beta) and the variance of our results. But we had planned our experiments well: The sample size was determined a priori, and chosen so that we would have been able to detect a difference on the order of one standard deviation. This is what statisticians call a Cohen’s d of 1, which is considered a substantial effect. We could not have done more animals than the (34!), because of limited ressources, the duration of the PhD thesis, and the timing of the grant. But what now? Write a paper? Reporting a NULL result? How would this look like in a resume, besides, who cares about NULL results, and which reputable journal would publish them at all? Continue reading
Nature: Pig brains kept alive outside body for hours after death! Really?
A study in this weeks Nature (Vrselja et al. ) has created an immediate media frenzy. Nature puts it like this: ‘Pig brains kept alive outside body for hours after death’ and ‘Revival of disembodied organs raises slew of ethical and legal questions about the nature of death and consciousness.’ The New York Times: ‘In a study that raises profound questions about the line between life and death, researchers have restored some cellular activity to brains removed from slaughtered pigs.; STAT: ‘The pigs were dead. But four hours later, scientists restored cellular functions in their brains’ etc.
That sounds spectacular. But if one reads the study (and the commentaries) is easy to spot that there are two main deficiencies: 1) The study lacks novelty, and 2) The assertion that it presents a relevant step towards restoring brain function after a prolonged interruption of cerebral blood flow is not only exaggerated, but simply wrong. Continue reading
Enter the funding lottery!
‘Unfortunately, we have to inform you that after thorough review [YOUR FAVORITE FUNDING ORGANISATION] must reject your application’. Most of us know this sentence all to well, as most rejection letters of our grant applications contain it in a similar form. From a purely statistical point of view, we receive such letters quite frequently. In German biomedicine, the funding rates are between 5 and 25 %, depending on funder and program. Upon receiving a rejection we often feel personally offended. After all, we have put down our best ideas, often had already included some preliminary results and proposed experiments we had already conducted, even beautified the document with a lot of prose, and flattered the most important potential reviewers with strategically placed quotations, etc. And then the rejection! So we had to start over from the beginning, rewrite everything, submit it again, perhaps to another funding agency. This is how we spend a substantial fraction of our days at the office, if we don’t review applications of our colleagues. On average, scientists spend 40% of their time writing or reviewing applications. Continue reading
On triangulation in experimentation
Triangulation! The Egyptians used it to build their pyramids. The Greeks developed a branch of mathematics out of it. Until the 19th century whole countries were charted in this way. Far into the 20th century ships have determined their position with it. To determine your position by triangulation you only need a set square and a protractor, which the surveyors call a theodolite, as well as the coordinates of two visible landmarks. It’s that simple!
Could it be that triangulation is also an important methodological approach in biology? A cure even for the replication crisis? Munafo and Smith recently postulated this in a commentary in Nature. Sociologists call it triangulation when they use two or more different methods to investigate one particular research question. If the results converge at one point, i.e. lead to the same result, this increases validity and credibility. Don’t we do this routinely in the experimental life sciences? Does the knock-out mouse have the same phenotype as one in which the signalling pathway was pharmacologically blocked? Do transcript and protein expression correlate with the phenotype?
Thus, basic biomedical research is familiar with ‘targeting’ a goal with different methods grounded in already established knowledge (the landmarks of the surveyor!). Are the results converging? Bingo, we have located the biological mechanism! Therefore it leaves many of us cold, if spoilsports with gradschool statistics argue that most studies in biomedicine must be false positive despite significant p-value. Because we don’t just rely on ONE result. Instead we triangulate by means of different approaches! In order to validate results, this might even be superior to replication. If something is simply repeated, it is not unlikely that a systematic error will be repeated too. This would make the result reproducible, but still not correct.
Were the skeptics wrong when calling out a crisis in biomedical research? Are we already doing the right thing? Continue reading
