I fit a 9-agent LLM pipeline into 1.5GB of RAM on iOS

Show HN: I fit a 9-agent LLM pipeline into 1.5GB of RAM on iOS

I fit a 9-agent LLM pipeline into 1.5GB of RAM on iOS is a business in show hn launch.

Profile

"Hey HN. I've been building a completely offline AI journal. The biggest hurdle was the memory footprint of running multiple agent personas. I ended up bypassing standard wrappers and using Meta's ExecuTorch to compile the PyTorch graphs ahead-of-time for the Apple Neural Engine, plus 4-bit quantization. Happy to answer any questions about the CoreML backend or managing the 'Blackboard' state object for the agents without killing the battery."

As a business in show hn launch, I fit a 9-agent LLM pipeline into 1.5GB of RAM on iOS is listed here with the public details available about it.

Directory data places it at the Show HN launch stage.

Website: meetsansara.com/tech