An analysis of 15M+ biomedical abstracts from 2010 to 2024 finds researchers using AI to write abstracts use certain words far more often than those who don't

Comments

• trailee@sh.itjust.works ⁨9⁩ ⁨months⁩ ago

  Very interesting paper, and grade A irony to begin the title with “delving” while finding that “delve” is one of the top excess words/markers of LLM writing.

  Moreover, the authors highlight a few excerpts that “illustrate the LLM-style flowery language” including

  By meticulously delving into the intricate web connecting […] and […], this comprehensive chapter takes a deep dive into their involvement as significant risk factors for […].

  …and then they clearly intentionally conclude the discussion section thus

  We hope that future work will meticulously delve into tracking LLM usage more accurately and assess which policy changes are crucial to tackle the intricate challenges posed by the rise of LLMs in scientific publishing.

  Great work.

  source
• Plebcouncilman@sh.itjust.works ⁨9⁩ ⁨months⁩ ago

  Water is wet.

  source
• renzhexiangjiao@piefed.blahaj.zone ⁨9⁩ ⁨months⁩ ago

  tbh I don't see anything wrong with using AI just to write the abstract, assuming the author redacts it afterwards. It becomes much more problematic if AI is used in the middle section of the paper, where it is crucial to present information as accurately as possible.

  source