Comment on How ChatGPT and other AI tools could disrupt scientific publishing

Zeth0s@lemmy.world ⁨11⁩ ⁨months⁩ ago

• Bal@lemm.ee ⁨11⁩ ⁨months⁩ ago

  It’s terrible but AI tools can only make it worse.

  source

  • Zeth0s@lemmy.world ⁨11⁩ ⁨months⁩ ago

    Worse than now? Is it even possible?

    I am an optimistic, let’s see in few years and finger crossed

    source
• flossdaily@lemmy.world ⁨11⁩ ⁨months⁩ ago

  The main probably with scientific publishing is that our threshold for statistical significance is way too low.

  If we allow the threshold to sit at a 1 percent chance that results of the study were random chance, it means that 1 percent of all publications at that level of certainly are going o mislead the public if the media reports on them. And with the volume of research published every day, that adds up to a LOT of misinformation.

  It’s not even bad science, it’s bad reporting and widespread scientific illiteracy. But neither of those are going away.

  source

  • sndrtj@feddit.nl ⁨11⁩ ⁨months⁩ ago

    Also certain fields (cough cough medicine) needs to consider more than just the p value. With any large sample size you’re almost guaranteed to find a “significant” result in some test, but the effect sizes are often so tiny to be basically meaningless.

    source
  • Zeth0s@lemmy.world ⁨11⁩ ⁨months⁩ ago

    Problem of science is corrupted funding, toxic environment, mafia-like organizations and practices, widespread corruption.

    The current amount of bad science is due only to that. Unmanageable excess of meaningless published work is just a side effect of all above. Clearly it cannot change from inside, as current system select only those who agree or compromise.

    A revolution must come from outside. Tools and platforms like arxiv, github, hugging face are already demonstrating that alternative exists, better ways to spread science and facilitate collaboration, increasing quality. Unfortunately they do not currently represent a real alternative outside niches, were quality, reproducibility and speed of evolution are critical. But also alternative tools such these can alleviate a minimal part of the huge problems.

    I am honestly curious too see how “scientific” system will evolve, because it will. Because as it is now it is doomed to miserably continue falling down until it fails…

    source
  • iwenthometobeafamilyman@lemmy.world ⁨11⁩ ⁨months⁩ ago

    I heard (from the internet) that the main problem is reproducibility.

    source

    • flossdaily@lemmy.world ⁨11⁩ ⁨months⁩ ago

      That might largely be a rephrasing of the same problem.

      source
    • sndrtj@feddit.nl ⁨11⁩ ⁨months⁩ ago

      That’s the exact problem OP is referring to.

      source
• Engywuck@lemm.ee ⁨11⁩ ⁨months⁩ ago

  +1, same source.

  source