RateGate
Self-hosted API rate gateway, queue system & proxy router with Admin UI in Go
About
RateGate is a high-performance, self-hosted API Rate Gateway built with Go 1.22+ and Redis. It sits in front of any third-party or internal API (OpenAI, Anthropic, Custom LLMs, Webhooks) to manage rate limits, client authentication, automatic retries, and usage tracking.Key Features:• Dual Mode: In-memory mode for single-instance setups, or Redis for distributed deployments.• Fine-Grained Limiting: Set RPS, Burst, and Daily quotas per API Key and per Upstream service.• Embedded Admin UI: Clean management dashboard compiled directly into the single Go binary.• Smart Queue & Retries: Automatic retries with exponential backoff on HTTP 429 and 50x errors.• Key Cloaking: Protect provider API keys by injecting them gateway-side.• Production Ready: Docker Compose setup, Prometheus metrics (/metrics), and zero-loss usage persistence.Tech Stack:Go 1.22+, Redis, Docker, Embedded Web UI, Prometheus, YAML Configs.What's Included:• Complete Go source code & project structure.• Dockerfile + docker-compose.yml for instant deployment.• Embedded Admin Panel UI.• Cross-platform build scripts (Bash/PowerShell).• Full documentation & commercial license template.
Comments (1)
finally a proper selfhosted option for rate limiting ai apis
Related Products
Free Currency Converter API
Limestone Digital
AI-Powered Software Development, Engineering Team Augmentation,
ChangeSpec
Free Mermaid Live Editor & Diagram Maker
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI A
Universal Data Workbench
A thorough tool for cleaning, validating, and converting JSON, CSV, and more.
ComingUp