Nexus Gateway – A self-healing AI gateway in Go with 5ms caching

Show HN: Nexus Gateway – Reduce LLM API Costs Using Semantic Caching

Nexus Gateway – A self-healing AI gateway in Go with 5ms caching is a company in show hn launch.

Profile

Hi HN,I'm building Nexus Gateway, an AI gateway that helps developers reduce LLM API costs.Problem: Many applications send repeated or semantically similar prompts to LLMs, which leads to unnecessary API calls and higher costs.Solution: Nexus Gateway uses semantic caching to detect similar prompts and serve cached responses instead of calling the LLM again.Features: • Semantic caching to reduce repeated API calls • Multi-model support (OpenAI, Gemini, Llama, Anthropic) • BYOK support • PII protection and sovereign AI layer (in progress)Goal: Reduce LLM costs by 40–70% while improving latency.I’d really appreciate feedback from the community.Website: https://www.nexus-gateway.org

Nexus Gateway – A self-healing AI gateway in Go with 5ms caching is positioned in show hn launch, a segment that rewards a clear, focused offering.

The company is listed at the Show HN launch stage of development.

Website: www.nexus-gateway.org