InferX – an AI-native OS for running 50 LLMs per GPU with hot swapping

Show HN: InferX – an AI-native OS for running 50 LLMs per GPU with hot swapping

InferX – an AI-native OS for running 50 LLMs per GPU with hot swapping is a business in show hn launch.

Profile

Hey folks , We’ve been building InferX. an AI-native runtime that snapshots the full GPU execution state of LLMs (weights, KV cache, CUDA context) and restores it in under 2s. This lets us hot-swap models like threads. no reloading, no cold starts.We treat each model as a lightweight, resumable process. like an OS for LLM inference.Why it matters:•Run 50+ LLMs per GPU (7B–13B range)•90% GPU utilization (vs ~30–40% with conventional setups)•Avoids cold starts by snapshotting and restoring directly on GPU •Designed for agentic workflows, toolchains, and multi-tenant use cases•Helpful for Codex CLI-style orchestration or bursty multi-model appsStill early, but we’re seeing strong interest from

The company sits in the show hn launch segment, where it competes on its core product or service.

It is recorded at the Show HN launch stage.

Website: inferx.net