Comment on Weaver: New Specialised Writing LLMs Outperform GPT-4

<- View Parent
FunderPants@lemmy.ca ⁨7⁩ ⁨months⁩ ago

It’s doesn’t seem to be. Their Chinese website talks about buying AI creidts, their English website only has a waitlist but this looks more like a new closed product than anything else.

Also, check the appendix in the paper, I think it’s a bit concerning that the second author is responsible for the writebench benchmark they use to make their claims about the model. That is, the evaluation isn’t independent from the authors. I mean, I’m not saying they’re not right, just that this is a yellow flag to investigate more.

A. Appendix A.1. Author Contributions Tiannan Wang is the core contributor of Weaver. Tiannan is responsible for continual pre-training, supervised fine-tuning, and preference optimization. Tiannan is also a main contributor for the data synthesis and the benchmark/evaluation process.

Jiamin Chen is a main contributor of Weaver. Jiamin is responsible for WriteBench and is also main contributor for data synthesis and model evaluation process

source
Sort:hotnewtop