orbench

benchmark LLMs on your own tasks before you switch model

---

Screenshots

---

Hunter's comment

You can pick a model on a gut feeling, orbenchmark it. orbench is a desktop app that lets you benchmark LLMs on your own tasks, A public leaderboard ranks models on someone else's prompts. Production evals give you more insights, but only after you've done all the work to implement the new models. orbench is the step in between: bring your real tasks (csv or HF dataset), pick any models on OpenRouter, and your own rubric grade every answer with an AI judge, a blind human review, or both.

---

Link

https://orbench.com/

---

This is posted on Steemhunt - A place where you can dig products and earn STEEM.
View on Steemhunt.com