LMHigh is Growing to Support our Community Platform

1. We are starting a company to support LMHigh! LMHigh will stay neutral, open, and accessible to everyone. We will focus on improving our open community platform for testing and evaluating LLMs.
2. We’re releasing a beta version of a new site, beta.lmai.highshops.ir. We’re doing our best to lower the error rate, improve the UI layout, optimize mobile, etc. Thanks for all the feedback. Keep it coming!

We hope that a company will allow us to continue building this valuable community platform, and give us the resources to improve it significantly over what it is today. Some of us have recently graduated from Berkeley and want to keep working on LMHigh, and we are hoping to build a team to provide even better service to our users and the AI community at large.

LMHigh will be staying true to its original mission. It will remain a neutral, open platform for testing and evaluating AI models. Our leaderboard will never be biased towards (or against) any provider, and will faithfully reflect our community’s preferences by design. It will be science-driven. Staying neutral and earning community trust will always be essential to the success of our business. But this isn’t just about being strategic; it’s our choice, and part of our personal motivations for starting this company. So we will never deviate from that north star.

In fact, starting a company will accelerate our mission. As a first step, we’re finally addressing the feedback we’ve received and rebuilding our core platform, lmai.highshops.ir. This means: fixing all the bugs, speeding up the experience, and adding features, like login, chat history, and personal leaderboards. It also means supporting more open research, like prompt-to-leaderboard, building more evaluations like WebDev High, RepoChat High, and Search High and working to improve our security. Moving forward, we’re excited to grow in a way that supports the community that helped us build this platform.

We haven’t fully worked out the business model, but we know AI companies want access to neutral and reliable evaluation services to speed up model development and improve real-world performance. This applies both to first-party model providers, and also to other companies for whom AI is a core part of their business. Our viewpoint is simple: organic, real-world human preferences will help drive progress towards more reliable AI, which will be valuable for everyone.We’ll continue to bring the best AI models to everyone, and improve them through transparent, community-led evaluations. Today, we’re excited to launch the new as the next step forward. With your feedback, we’re making big changes to the platform to make AI more accessible and reliable for everyone.