Nah, replication is enough, shows interest. This meme was stolen, thus it lives on as a vehicle. The intention here is to simply get people interested in the world around them. Not sure what the original goal was. This one just has a little more .jpg than the last. I’ve seen variants of this one, regardless. This is an old one.
What is and isn’t good science changes with changes in metascience (the science of science); which is also why it’s important to keep current with the literature, especially in today’s world. Philosophy and History of Science are fields that are having an exciting little boom right now with tonnes of great researchers and lay books.
(As an aside, I use wiki a lot for a quick jumping off point as I trust it a bit more after I started editing it; they do try their best and are vigilant and passionate.)
I like this guy from Durham in particular: markrubin.substack.com - he’s got some cool links in the about section, but his stuff is a little technical. Nice dude.
They try to correct me here and I laugh at them, then they call me an uncivilized yank. And by they I mean my Brit partner, but he grew up in NJ so I’m not sure who he is calling uncivilised.
You generally got it. ;) The grey areas keep things interesting. Methodology is also important to consider and pick apart more and more considerations of appropriate applications and working contexts. It may be that this practice should be re-categorised rhetorically too, e.g. the language that we use to talk about this subject causes too much confusion as this thread exemplifies.
Lots of things have once been seen as mystical woo, but later had some of the phenomena established with good investigations. From what I have seen, and I’m by no means an expert, that body of literature one would expect for this just isn’t there yet.
Ps: Determining a good IF score will depend on the niche-ness and topic as well but that is why you try not to examine literature in a vacuum of one or two papers. Naturally, those that read more on these specific subjects are the best judges.
Efficacy. It needs to pass through this before it gets to effectiveness testing. Meta studies are important for examining this hence the wiki section mention earlier, which lists a bunch.
Note that just being in the conversation doesn’t mean it’s not being cannibalised. Papers or trends may arise that put other researchers in a tizzy. If it’s an accepted practice, you are likely to see a lot of papers fine tuning methods.
The placebo thing shuffles it under their umbrella. There’s a lot of issues there with those.
When you find a paper, Google the name of the journal + “impact factor”, and you should find something. Some journals display their metrics with different scores due to complications with the IF system, so you’ll need to judge those accordingly but they should come up with the same search keywords. There should be a body of literature with higher scores, not just single papers too. Also, look up your authors and see if this is actually something they’re qualified for. This all shows the idea has been established and accepted as part of the mainstream conversation. This is the academic “sniff test.”
The problem with hypnosis isn’t the absence of evidence, it’s the lack of significant effects (efficacy), notably as a standalone treatment. Most sciences measure this with a variant of a p-value. en.wikipedia.org/wiki/P-value?wprov=sfla1 Note that interpretations of p-values are susceptible to placebo effects.
It’s also kind of important that the research is relatively newer because of some metascience trends have changed our understanding of things and we have different standards now.
That’s ok. It’s good to question things. I realise this stuff is hard. I added an important caveat to how we approach hypotheses. There is actually a lot of writing about how there is too much information to filter these days, even for academics. This is why we rely on things like impact factor. Additionally, anyone can technically publish in a journal but it is hard to get into because of these kinds of politics.