I built a hypervisor and client for inference on consumer compute
Show HN: I built a hypervisor and client for inference on consumer compute
I built a hypervisor and client for inference on consumer compute operates in show hn launch.
Profile
I'm the founder of Scalattice, this is my second company, third total product. I'm a 2x founder building some challenging software, some easy software, and some curiosity based tools that I've just always wanted to be a part of!So here is Scalattice.Scalattice is an OpenAI-compatible inference API. You keep the OpenAI SDK, swap base_url + API key, and call open models (Qwen3, Llama 3.3 70B, Gemma 3, DeepSeek R1, etc.). Inference is performed by a provider node on our distributed network of consumer hosted inference machines, we run an open source agent (https://github.com/scalattice/scalattice-agent) which works in Rust to run the inference and get the provider paid.In short, anyone can beco
The company sits in the show hn launch segment, where it competes on its core product or service.
Directory data places it at the Show HN launch stage.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: scalattice.com/blog/openai-sdk-scalattice
Browse related
Create a free account