Experiential - Open source model gateway for unified AI access
Show HN: We built open OpenRouter that turns usage into a better model
Experiential is an open source gateway and router that provides a single control plane for closed, open-source, local, and custom models. It offers an OpenAI-compatible API, allowing you to use hosted, BYOK, and local models through one interface. You can control which users and agents can access which models, set budgets, and optimize routing based on production traffic. The platform also enables you to turn your usage data into a custom router or fine-tuned model, improving quality, speed, and cost. Whether you run it locally or use the hosted platform, Experiential simplifies AI integration and management.
Turn production traffic into a custom router or model optimized for quality, speed, and cost.
- Areibman
Could you say more about how caching works? One major advantage of sticking with a single model is saving money on cached input tokens. I'd imagine if you swap between a bunch of models, you may improve performance but cost would would balloon out of control
- gpiechnik2
great design! i love it
- akshay_akula
Open source and no markup is the right default for a gateway. The caching question above is the one I would want answered before swapping models though.
- ceroxylon
>The gateway adds under 1 ms for BYOK requests
Amazing! Really brilliant idea, thank you for sharing this project. There is so much ground to cover in the LLM gateway / routing / reporting world, and this is a great start. The Tinker implementation is my favorite part, fine tuning is much better than a sea of context files.
- cheema33
I have not tried it yet. Is it similar to LiteLLM? If so, what sets it apart?