Bodhi App – Local LLM Inference

Show HN: Bodhi App – Local LLM Inference

Bodhi App – Local LLM Inference is active in the show hn launch space.

Profile

Hi HN,Bodhi App is an open-source local LLM inference solution that takes a different and simpler approach. Instead of re-inventing the wheel, it leverages existing, tried and tested ecosystem and solutions:## Technical Architecture:- llama.cpp as inference engine- Rust/Axum backend for type-safe API layer- Tauri for multiplatform builds- HuggingFace integration- YAML based configurations and update at runtime (no restarts required)- OpenAI/Ollama API compatibility layer## Key Technical Decisions:1. No proprietary model format - directly use of GGUF files from HuggingFace2. Opt-in Authentication, provides RBAC for team access3. API design with proper authentication/authorization4. Built-in S

Bodhi App – Local LLM Inference is positioned in show hn launch, a segment that rewards a clear, focused offering.

Its current recorded stage is Show HN launch.

Website: getbodhi.app