Doorgaan naar hoofdcontent

Posts

Posts uit 2015 tonen

Stepping in as Reviewers

Some years ago, when I served on the Academic Integrity Committee investigating allegations of fraud against Dirk Smeesters, it fell upon me to examine Word documents of some of his manuscripts (the few that were not “lost”). The “track changes” feature afforded me a glimpse of earlier versions of the manuscripts as well as of comments made by Smeesters and his co-authors. One thing that became immediately obvious was that while all authors had contributed to the introduction and discussion sections, Smeesters alone had pasted in the results sections. Sometimes, the results elicited comments from his co-authors: “Oh, I didn’t know we also collected these measures” to which Smeesters replied something like “Yeah, that’s what I routinely do.” Another comment I vividly remember is: “Wow, these results look even better than we expected. We’re smarter than we thought!” More than a little ironic in retrospect. On the one hand I found these discoveries reassuring. I had spent many hours ...

Diederik Stapel and the Effort After Meaning

Sir Frederic, back when professors still looked like professors. Take a look at these sentences: A burning cigarette was carelessly discarded. Several acres of virgin forest were destroyed. You could let them stand as two unrelated utterances. But that’s not what you did, right? You inferred that the cigarette caused a fire, which destroyed the forest. We interpret new information based on what we know (that burning cigarettes can cause fires) to form a coherent representation of a situation . Rather than leaving the sentences unconnected, we impose a causal connection between the events described by the sentences. George W. Bush exploited this tendency to create coherence by continuously juxtaposing Saddam and 9-11 , thus fooling three-quarters of the American public into believing that Saddam was behind the attacks, without stating this explicitly. Sir Frederic Bartlett proposed that we are continuously engaged in an effort after meaning. This is what r...

p=.20, what now? Adventures of the Good Ship DataPoint

his blog,  Drang naar Samenhang  will feature posts in Dutch from now on—but no worries, English speakers, I’ve got you covered too. I have launched Substack newsletter called  Craving Coherence :  https://rolfzwaan.substack.com . You don’t need to subscribe to read the posts—just hit  “No thanks”  if prompted. Of course, I’d really appreciate it if you  do  sign up. It’s completely free! So what is the newsletter about?  Why do we search for patterns, craft narratives, and cling to meaning? Craving Coherence explores the psychology of understanding—the mental shortcuts, biases, and frameworks that shape how we interpret reality. From cognitive science to philosophy, this newsletter examines how our minds construct coherence in an often chaotic world—and what happens when they fail. I hope to see you there! Back to the original post: You’ve dutifully conducted a power analysis, defined your sample size, and conducted your experiment. Alas, p=...

The End-of-Semester Effect Fallacy: Some Thoughts on Many Labs 3

The Many Labs enterprise is on a roll. This week, a manuscript reporting Many Labs 3  materialized on the already invaluable Open Science Framework. The manuscript reports a large-scale investigation, involving 20 American and Canadian research teams, into the “end-of-semester effect.” The lore among researchers is that subjects run at the end of the semester provide useless data. Effects that are found at the beginning of the semester somehow disappear or become smaller at the end. Often this is attributed to the notion that less-motivated/less-intelligent students procrastinate and postpone participation in experiments until the very last moment. Many Labs 3 notes that there is very little empirical evidence pertaining to the end-of-semester effect. To address this shortcoming in the literature, Many Labs 3 set out to conduct 10 replications of known effects to examine the end-of-semester effect. Each experiment was performed twice by each of the 20 participating teams...