Gallery
About
Hey HN! After the Car Wash Test post got quite a big discussion going (400+ comments, https://news.ycombinator.com/item?id=47128138), I spent the past few weeks building a tool so anyone can run these kinds of questions and get structured results. No signup and free to use.You type a question, define answer options, pick up to 50 models at a time from a pool of 200+, and they all answer independently under identical conditions. No system prompt, structured output, same setup for every model.You can also run a debate round where models see each other's reasoning and get a chance to change their minds. A reviewer model then summarizes the full transcript. All models are routed via my startup Opper. Any feedback is welcome!Hope you enjoy it, and would love to hear what you think!
Comments (2)
whats the per-query cost look like with 200 models?
200 api calls per question is wildly expensive
Related Products
Free Currency Converter API
Limestone Digital
AI-Powered Software Development, Engineering Team Augmentation,
ChangeSpec
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI A
IronFile - Completely Customizable
Turnkey Industrial SaaS Platform (80k+ LOC) • 12 Enterprise Connectors
Technologies.lat
Quality Assurance for software that is here for the long run
ComingUp