tag:blogger.com,1999:blog-6322739827777311964.post7766718445137195370..comments2023-11-30T13:15:01.893+01:00Comments on Drang naar Samenhang: How to Cook up Your Own Social Priming ArticleRolf Zwaanhttp://www.blogger.com/profile/07617143491249303266noreply@blogger.comBlogger23125tag:blogger.com,1999:blog-6322739827777311964.post-36170250343109051912016-12-10T13:52:16.587+01:002016-12-10T13:52:16.587+01:00This post should integrate Neil's comments and...This post should integrate Neil's comments and it would be absolutely perfect.Unknownhttps://www.blogger.com/profile/04584930668407092090noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-194799065465390842016-11-04T15:14:01.405+01:002016-11-04T15:14:01.405+01:00The Journal of Porcine Aviation Potential just sco...The Journal of Porcine Aviation Potential just scored its first reference in the peer-reviewed literature: 10.1177/1948550616673876<br /><br />Presumably it now has an impact factor. Next stop: get it listed by the Web of Science.Nick Brownhttps://www.blogger.com/profile/18266307287741345798noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-27540466206769824022013-09-27T11:56:54.369+02:002013-09-27T11:56:54.369+02:00Can we do something more constructive?Can we do something more constructive?Anonymoushttps://www.blogger.com/profile/05847549476287080156noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-88761999840104985302013-09-19T21:04:03.112+02:002013-09-19T21:04:03.112+02:00Your own colleague Hal Pashler has a nice review o...Your own colleague Hal Pashler has a nice review on this, showing cognitive priming effects to be much smaller: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0042510. As he correctly points out, it is odd that social priming effects, which are much more indirect, should be so much bigger than cognitive effects. There is also this meta-analysis, which shows semantic priming effects to be between .10 and .30: http://www.ncbi.nlm.nih.gov/pubmed/11206202.<br /><br />Quite funny that I tried to make a parody and actually came up with something that makes more sense than the studies I was targeting. Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-26326786314313842322013-09-19T20:46:30.405+02:002013-09-19T20:46:30.405+02:00Rolf, of course I understand that your main point ...Rolf, of course I understand that your main point is the implausibility of a large effect size given a tenuous, indirect and fragile relation between an IV and DV in many of these studies (hence social psychologists often use massive amount of statistical control). But, again, somewhat ironically, the effect size in Sher and McKenzie glass-half-full/half-empty Study 1, is over .8. If you'd like, I can give you many cognitive priming studies with similar effect sizes -- a feat often accomplished by controlling the heck out of the stimuli, presentation times, distance, etc. In short, the effect size itself is not grounds for suspicions, only in the context of theoretically vague and implausible connection. I think there is no disagreement there. But I wanted to chime in since I am getting tired of people 'reflexively' criticizing a study if it reports a large effect.Anonymoushttps://www.blogger.com/profile/16486366231959868631noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-67126801029105222472013-09-19T18:30:54.940+02:002013-09-19T18:30:54.940+02:00Piotr, that's interesting. I agree with your p...Piotr, that's interesting. I agree with your point that the interestingness of a study depends on the context. Nevertheless, Step 1 seems to be an accurate description of many studies. As I've indicated in other fora, the main point is Step 7. These effect sizes are just unbelievable given the designs of these studies.Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-2404307279977421932013-09-19T18:09:47.571+02:002013-09-19T18:09:47.571+02:00Rolf,
Ironically, your half-empty/half-full manipu...Rolf,<br />Ironically, your half-empty/half-full manipulation (3) has been used in what I consider to be one of the best, and most solid papers in Cognitive Psychology. See Experiment 1, 2, and 3 here: <br />http://psy2.ucsd.edu/~mckenzie/Sher&McKenzie2006Cognition.pdf<br />My point here is that whether a specific manipulation or a dependent measure 'means' something, or seems 'smart' or 'silly', depends on its role in larger theoretical frameworks. For me, the above 2006 paper is all the better because it makes a profoundly interesting and novel theoretical point using such simple and ingenious methods.<br />Anonymoushttps://www.blogger.com/profile/16486366231959868631noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-25545964917151437472013-09-18T18:36:51.912+02:002013-09-18T18:36:51.912+02:00Oh yes, you need some good yeast to get those effe...Oh yes, you need some good yeast to get those effect sizes. <br /><br />I did once have a colleague in a seminar who said that "some manipulations worked and some didn't." When asked by the professor if his social priming experiments worked about "1 out of 20" manipulations, he replied "yes" without any realization of the irony or why we all started laughing and staring aghast. *facepalm*Neil Cohnhttps://www.blogger.com/profile/03705933006220475644noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-24484404917102124862013-09-18T09:45:30.468+02:002013-09-18T09:45:30.468+02:00Thanks Neil! I didn't know this was part of th...Thanks Neil! I didn't know this was part of the recipe.;) I merely told the aspiring cook to have confidence the batter will somehow will rise to the effect sizes we see in the literature of its own accord. Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-324147328982929012013-09-18T07:53:56.830+02:002013-09-18T07:53:56.830+02:00Great article Rolf! I think you forgot a few inter...Great article Rolf! I think you forgot a few intermediate steps though that go something like... <br /><br />- Realize that your results are not significant with 10+ different dependent measures. <br />- Find significance in 2 out of 20 experiments. <br />- Report on those 2 and disregard the others as if they never happened.Neil Cohnhttps://www.blogger.com/profile/03705933006220475644noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-24611260475128538042013-09-18T00:15:49.894+02:002013-09-18T00:15:49.894+02:00:) I only have one concern: how is candy going to ...:) I only have one concern: how is candy going to figure into this? Sugar cubes for the horse are out, since it's already dead.Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-88312759977465172362013-09-17T23:23:46.033+02:002013-09-17T23:23:46.033+02:00Excellent - I am now thinking of starting up a col...Excellent - I am now thinking of starting up a collaboration with the dept. of veterinary medicine and work on the expression "to flog a dead horse"Anonymoushttps://www.blogger.com/profile/14371292959659542293noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-38566660334779227922013-09-17T20:04:56.236+02:002013-09-17T20:04:56.236+02:00Ironically, I messed up a recipe a few hours ago. ...Ironically, I messed up a recipe a few hours ago. I wanted to make pasta alle vongole only to find out that I should have ordered the vongole in advance in order to get fresh ones. So I made Thai chicken instead. <br /><br />Ah, neuroscience! The Walhalla of researcher degrees of freedom.Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-75826453068010750112013-09-17T19:58:07.696+02:002013-09-17T19:58:07.696+02:00I always mess up recipes, it's probably my fau...I always mess up recipes, it's probably my fault. I most likely used the wrong kind of candy in Step 4. Also, I probably should have pre-heated the oven, but the subjects kept complaining. I give up -- I think I'm going to switch to neuroscience.Dave Nussbaumhttps://www.blogger.com/profile/08638557883580286521noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-41321675588852132302013-09-17T19:13:59.027+02:002013-09-17T19:13:59.027+02:00What is considered priming in this case? Apart fro...What is considered priming in this case? Apart from it being a stimulus providing semantic/embodied information I'm not sure what it means when you call it social priming. <br /><br />Since we can distinguish between subliminal, supraliminal and overt priming, priming simply equals providing information. It seems that social priming is often seen as unconscious (Bargh style) priming directly affecting behavioral outcomes. This is very much different from the embodiment-methapor example above in which often the outcome rather than the prime is social. If I would come up with a version for this I would defintely follow your guideline :)<br /><br />(love this blog!)<br />Anonymoushttps://www.blogger.com/profile/09535870471997909780noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-37977054642732007692013-09-17T18:11:31.784+02:002013-09-17T18:11:31.784+02:00You have a point there, Dave. The same goes for a ...You have a point there, Dave. The same goes for a lot of other studies labeled as "social priming." Maybe they should be called "environmental priming"?<br /><br />17 tries? Hmm, I based my recipe on the literature and there is no mention of multiple tries anywhere. So you cannot be right. Are you sure you did everything correctly? <br /><br />Depends on how those glasses got empty. Did you drink the contents?Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-17608169886870732852013-09-17T18:06:25.087+02:002013-09-17T18:06:25.087+02:00Are you sure this only applies to social priming r...Are you sure this only applies to social priming research?<br />Anonymoushttps://www.blogger.com/profile/10671573769384037110noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-16338902005562422212013-09-17T17:42:20.192+02:002013-09-17T17:42:20.192+02:00Sounds like fun, Rolf, I'd like to try it. But...Sounds like fun, Rolf, I'd like to try it. But I have a couple of questions:<br /><br />Why should I call this social priming? There's nobody else there to make it social, and it's all about processes that are happening in someone's mind, so shouldn't it be cognitive priming?<br /><br />Also, I have a limited research budget and I've been following your advice about only running 30 subjects. It finally worked, but it took me 17 tries. Does that mean that my first 16 attempts were wrong and I finally got it right? Does that mean I don't need to report the first 16 attempts? In any case, it turned out to be pretty expensive and time consuming because I had to run over 500 subjects to get one study to work. I feel slightly cheated -- you made it seem so easy. Are there any shortcuts?<br /><br />p.s. I meta-analyzed the 17 studies and found no effect, is that bad, or did I just see so many half-empty glasses that I'm being a pessimist?Dave Nussbaumhttps://www.blogger.com/profile/08638557883580286521noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-69106448233082100102013-09-17T17:21:11.876+02:002013-09-17T17:21:11.876+02:00Somehow, I anticipate this will happen.Somehow, I anticipate this will happen.Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-22693469116990789762013-09-17T17:14:30.424+02:002013-09-17T17:14:30.424+02:00Lol, very funny! On the serious side, blogging thi...Lol, very funny! On the serious side, blogging this may cause you to be scooped :)yairhttps://www.blogger.com/profile/14268060911218215323noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-38815093331192598432013-09-17T16:43:54.341+02:002013-09-17T16:43:54.341+02:00Great name for a journal! I learned about Porcine ...Great name for a journal! I learned about Porcine Automotive Behavior from Richard Scarry http://www.thingamababy.com/baby/2009/12/contest-5.html, so the sky is the limit.<br /><br />Given that this blog covers everything, I already have a post on flying pigs http://rolfzwaan.blogspot.nl/2013/05/fun-with-flying-pigs-importance-of.html. Rolf Zwaanhttps://www.blogger.com/profile/07617143491249303266noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-33135493355015421802013-09-17T15:51:09.252+02:002013-09-17T15:51:09.252+02:00+1! But oh boy, I wonder what the response will be...+1! But oh boy, I wonder what the response will be. I'll just post this on the social psych facebook page and see what happens.EJhttps://www.blogger.com/profile/14128820127410812375noreply@blogger.comtag:blogger.com,1999:blog-6322739827777311964.post-14911195048370435102013-09-17T15:11:02.402+02:002013-09-17T15:11:02.402+02:00I've been wanting to write an article like thi...I've been wanting to write an article like this for ages. I was thinking of researching whether people believe that something will happen "when pigs can fly", and submitting it to the Journal of Porcine Aviation Potential.Nick Brownhttps://www.blogger.com/profile/18266307287741345798noreply@blogger.com