Archive — US — techcrunch
AI benchmarking platform Chatbot Arena forms a new company
Chatbot Arena, a crowdsourced AI benchmarking platform, is forming Arena Intelligence Inc. to enhance its capabilities and sustain its neutral testing ground for AI models. Founded in 2023, it collaborates with major companies like OpenAI and Google, having received initial funding through grants and donations, as it transitions to a formal company structure.
Key points
- Chatbot Arena is establishing a company called Arena Intelligence Inc. to improve its offerings.
- It aims to maintain an unbiased testing platform for AI models amidst external influences.
- Founded in 2023, the platform is backed by UC Berkeley researchers and has partnered with prominent AI firms.
- Previous funding sources include grants and donations from entities like Google’s Kaggle and Andreessen Horowitz.
- The new company's business model and potential backers have yet to be revealed.
Why it matters
- The formation of Arena Intelligence Inc. aligns with the growing emphasis on AI ethics and independent benchmarking.
- Historically, benchmarks in tech have been crucial for validating advancements, seen in past trends with companies like MINIO and DataRobot.
- By 2025, there is an increasing demand for transparent AI tools, amplified by previous controversies surrounding biased algorithms.
The establishment of Arena Intelligence Inc. marks a significant step in fostering independent AI evaluation frameworks, which may influence the future standards and ethics of AI development and deployment.