This weekend's WSJ had an article about a pair of grad students at Berkeley who, as part of a project, developed a system to rate chatbots.
Their site, Chatbot Arena, has exploded into one of the most-watched rankings for AI systems. It works by letting visitors to the site ask a question, which is then answered by two anonymous chatbots. The visitor then votes for which one answered best. It then tracks the chatbots on a leaderboard.
© 2024 Praveen Puri