Open Access Qwen3.6-35B-A3B-UD-Q5_K_M with TurboQuant

Show HN: Open Access Qwen3.6-35B-A3B-UD-Q5_K_M with TurboQuant

Operating in show hn launch, Open Access Qwen3.6-35B-A3B-UD-Q5_K_M with TurboQuant operates.

Profile

https://w418ufqpha7gzj-80.proxy.runpod.netStarted for myself, but since Im not using it continuously, sharing it:Open Access Qwen3.6-35B-A3B-UD-Q5_K_M with TurboQuant (TheTom/llama-cpp-turboquant) on RTX 3090 (Runpod spot instance).5 parallel requests supported.. full context available (please don't misuse..there are no safety guards in place)Open till spot instance lasts or max 4 hours.And yes, no request logging (I don't even know how to do it with llama-server)Prompt processing and generation speeds (at 8K context): 900t/s and 60t/s. And at 100K context: 450t/s and 30t/s.Command used: ./build/bin/llama-server \ -m ../Qwen3.6-35B-A3B-UD-Q5_K_M.gguf \ --alias 'Qwen3-6-35B-A3B-turbo' \ --ctx

Within the show hn launch space, the company focuses on its core offering rather than a broad product line.

It is recorded at the Show HN launch stage.

Website: w418ufqpha7gzj-80.proxy.runpod.netStarted