I made a tiny MoE/Engram viz tool

Show HN: I made a tiny MoE/Engram viz tool

I made a tiny MoE/Engram viz tool is a business in show hn launch.

Profile

As part of a ML study group I've been building tools to experiment with ML concepts. I use AI Coding agents to develop software, mostly cloud-based but I keep trying local LLMs on 12G, 16G, and 24G VRAM GPUs. Freetoken has made it possible to run larger MoE models on smaller GPUs.This inspired me to use my ML tools to build a tiny MoE model from scratch so I can experiment with different agent optimizations and things like Engram, recursive models, hierarchical modeles, KV Cache compression etc.My link above shows results of building different tiny models, one dense, the rest MoE variants. There is a lot of code and tooling behind this.Goals: - build tiny MoE models that run in a browser to

The company sits in the show hn launch segment, where it competes on its core product or service.

Directory data places it at the Show HN launch stage.

Website: sw-ml-study.github.io/moe-microscope