Back to today’s briefing

Story perspectives

Researchers Accuse Chatbot Arena of Favoritism to Tech Giants

5/2/2025

50 6

Summary

Story summary

A coalition of researchers from Cohere, Stanford, MIT, and Ai2 has raised concerns about the Chatbot Arena, accusing it of favoritism towards tech giants like Meta and Google. They argue that these companies skew rankings by privately testing models, showcasing only their best. In response, Chatbot Arena defends its dedication to impartiality.

1 of 1

Story summary

A coalition of researchers from Cohere, Stanford, MIT, and Ai2 has raised concerns about the Chatbot Arena, accusing it of favoritism towards tech giants like Meta and Google. They argue that these companies skew rankings by privately testing models, showcasing only their best. In response, Chatbot Arena defends its dedication to impartiality.