Gemma 4 26B A4B running on an iPhone 17 Pro via model paging

Show HN: Gemma 4 26B A4B running on an iPhone 17 Pro via model paging

Gemma 4 26B A4B running on an iPhone 17 Pro via model paging operates in show hn launch.

Profile

I wanted to share a use case for Noema Overfit, a model-paging system available today in the Noema app. For disclosure, I founded Noema and I am part of the team that has helped develop the system.The way it works is that the non-expert weights remain resident in memory, while the model’s routed expert weights are read from storage as needed. This makes it possible to run models that would otherwise exceed the device’s available memory, with the expected tradeoff of higher time to first token and slower generation.For a 699-token initial prompt, I measured:Prefill speed: 34.4 tokens/s Prefill time: 20.34 seconds Decode speed: 3.5 tokens/sPhotos of Overfit in action: https://noemaai.com/overf

Its activity falls under show hn launch; the profile below is assembled from public directory data.

The company is listed at the Show HN launch stage of development.

Website: noemaai.com