Jinfer – AI inference engine for the JVM. AI in a jar

Show HN: Jinfer – AI inference engine for the JVM. AI in a jar

Jinfer – AI inference engine for the JVM. AI in a jar operates in show hn launch.

Profile

Hi HN, Some would call AI on the JVM quixotic. And so, Quixotic AI was born.jinfer is an inference engine for the JVM: chat, vision, audio, embeddings, reranking, and TTS. No Python runtime, no ONNX, no Docker containers, no sidecar process, no IPC. Finally, AI in a jar.The stack underneath is built for the JVM rather than bolted onto it: toknroll: pure-Java tokenizers, zero dependencies gguf / safetensors: read and write llama.cpp and HuggingFace model formats jam: quantized matmul kernels, competitive with llama.cpp on CPU jota: Tensor API targeting Java, C, CUDA, HIP, Metal, OpenCL, and Mojo It ships with integrations for Spring AI and LangChain4j, and is compatible with GraalVM Native Im

The company sits in the show hn launch segment, where it competes on its core product or service.

Directory data places it at the Show HN launch stage.

Website: qxotic.ai