Self tuning chat exposing it's semantic and agentic cache

Show HN: Self tuning chat exposing it's semantic and agentic cache

Self tuning chat exposing it's semantic and agentic cache is a business in show hn launch.

Profile

The weekend of last week I built chat.betterdb.com as a RAG over Valkey/Redis/Dragonfly docs. The goal was to eat our own dogfood and test publicly our caching libraries. It also saved me from having to come up with various demo/test scenarios, as I could extend the building in public to the demo.There is a tool-result cache sitting between the SDK and tools. Each call is normalized and then checked before executing. If it hits we return from the cache, and if not, we check the semantic cache, which embeds the prompt and checks with KNN via valkey-search. If the cosine distance is close enough, we again skip the LLM and stream the cached response. In both cases, if we miss, we store the prom

Self tuning chat exposing it's semantic and agentic cache is positioned in show hn launch, a segment that rewards a clear, focused offering.

It is recorded at the Show HN launch stage.

Website: chat.betterdb.com