Small hardware box that runs local LLMs and exposes an OpenAI API
Show HN: Small hardware box that runs local LLMs and exposes an OpenAI API
Small hardware box that runs local LLMs and exposes an OpenAI API is a company in show hn launch.
Profile
I’ve been building a small hardware box that runs local LLMs like Mistral, Qwen and Llama, and exposes an OpenAI compatible API on your local network. There’s no cloud, no login system and no telemetry. I built it because a lot of small firms want ChatGPTbstyle tools but can’t use cloud AI for privacy or compliance reasons, and most don’t want to deal with GPU servers, drivers, Docker or model configs. The aim is to make local AI feel as simple as plugging in a router.Right now the box boots into a very simple web UI where you choose a model and start using it. The API follows the OpenAI format for chat completions and embeddings. It can run different models depending on the hardware you pic
Its activity falls under show hn launch; the profile below is assembled from public directory data.
Its current recorded stage is Show HN launch.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: axis-one-psi.vercel.app
Browse related
Create a free account