Comment on Musk's AI firm deletes posts after chatbot praises Hitler

• wise_pancake@lemmy.ca ⁨2⁩ ⁨months⁩ ago

  In February when Grok 3 was first on every chatbot arena metric – that was just a bit after deepseek r1, and o3, and the space has evolved a lot since then.

  However, checking wikipedia it actually seems like they juiced the metrics by using unfair comparisons and letting Grok try the problems 64 times and returning the best answer in their comparisons.

  en.wikipedia.org/wiki/Grok_(chatbot)#Grok-3

  source

  • Ulrich@feddit.org ⁨2⁩ ⁨months⁩ ago

    However, checking wikipedia it actually seems like they juiced the metrics by using unfair comparisons

    You’ll find that Elon’s companies do this a lot…

    source