OpenRouter
OpenRouter is a unified interface for LLMs. OpenRouter scouts for the lowest prices and best latencies/throughputs across dozens of providers, and lets you choose how to prioritize them. No need to change your code when switching between models or providers. You can even let users choose and pay for their own. Evals are flawed; instead, compare models by how often they're used for different purposes. Chat with multiple at once in the chatroom. Model usage can be paid by users, developers, or both, and may shift in availability. You can also fetch models, prices, and limits via API. OpenRouter routes requests to the best available providers for your model, given your preferences. By default, requests are load-balanced across the top providers to maximize uptime, but you can customize how this works using the provider object in the request body. Prioritize providers that have not seen significant outages in the last 10 seconds.
Learn more
Martian
By using the best-performing model for each request, we can achieve higher performance than any single model. Martian outperforms GPT-4 across OpenAI's evals (open/evals). We turn opaque black boxes into interpretable representations. Our router is the first tool built on top of our model mapping method. We are developing many other applications of model mapping including turning transformers from indecipherable matrices into human-readable programs. If a company experiences an outage or high latency period, automatically reroute to other providers so your customers never experience any issues. Determine how much you could save by using the Martian Model Router with our interactive cost calculator. Input your number of users, tokens per session, and sessions per month, and specify your cost/quality tradeoff.
Learn more
Arcade
Arcade.dev is an AI tool-calling platform that enables AI agents to securely perform real-world actions, like sending emails, messaging, updating systems, or triggering workflows, through authenticated, user-authorized integrations. By acting as an authenticated proxy based on the OpenAI API spec, Arcade.dev lets models invoke external services (such as Gmail, Slack, GitHub, Salesforce, Notion, and more) via pre-built connectors or custom tool SDKs, managing authentication, token handling, and security seamlessly. Developers work with a unified client interface (arcadepy for Python or arcadejs for JavaScript), facilitating tool execution and authorization without burdening application logic with credentials or API specifics. It supports secure deployments in the cloud, private VPCs, or on premises, and includes a control plane for managing tools, users, permissions, and observability.
Learn more
bolt.diy
bolt.diy is an open-source platform that enables developers to easily create, run, edit, and deploy full-stack web applications with a variety of large language models (LLMs). It supports a wide range of models, including OpenAI, Anthropic, Ollama, OpenRouter, Gemini, LMStudio, Mistral, xAI, HuggingFace, DeepSeek, and Groq. The platform offers seamless integration through the Vercel AI SDK, allowing users to customize and extend their applications with the LLMs of their choice. With its intuitive interface, bolt.diy is designed to simplify AI development workflows, making it a great tool for both experimentation and production-ready applications.
Learn more