FreeLLMAPI consolidates the free tiers of 34 LLM providers into a single OpenAI‑compatible /v1 endpoint, offering access to 635 free model endpoints spread across 474 model families and delivering roughly 7.4 billion tokens of monthly inference capacity. The service stores provider API keys encrypted with AES‑256‑GCM in a local SQLite database and presents apps with a unified bearer token. A router selects the optimal model for each request, automatically falling back to the next provider on 429/5xx errors, and enforces per‑key rate limits (RPM/RPD/TPM/TPD) to keep usage within each free‑tier cap. The router refreshes its model catalog from a signed feed twice daily; free installations receive a monthly snapshot (models appear ~30 days after they enter the live feed), while premium subscribers get same‑day updates. Beyond standard chat/completions, the API supports embeddings, image/audio/video generation, Anthropic Messages, Gemini native surfaces, tool calls, structured outputs, fusion (multi‑model synthesis), sticky sessions, prompt compression, and unified model profiles. Deployment options include a Docker one‑liner, Node 20+ servers, desktop tray apps for Windows/macOS, and ARM SBCs, with an idle RSS footprint of about 40 MB. An admin dashboard provides analytics, key management, and multilingual support, and the router can act as an MCP server for agents such as Claude Code, Codex CLI, and ChatGPT via a secure tunnel.

Read original