Sunday, December 8, 2024

"Billboard Hot 100" for Chatbots

This weekend's WSJ had an article about a pair of grad students at Berkeley who, as part of a project, developed a system to rate chatbots.

Their site, Chatbot Arena, has exploded into one of the most-watched rankings for AI systems.  It works by letting visitors to the site ask a question, which is then answered by two anonymous chatbots.  The visitor then votes for which one answered best. It then tracks the chatbots on a leaderboard.

© 2024 Praveen Puri