WatchMachineGo – A visualizer to show hardware performing LLM inference

Show HN: WatchMachineGo – A visualizer to show hardware performing LLM inference

WatchMachineGo – A visualizer to show hardware performing LLM inference is a company in show hn launch.

Profile

I love learning new concepts by playing around with them (think explorable explanations (https://en.wikipedia.org/wiki/Explorable_explanation), and I got more and more interested in running local LLMs on my own hardware. Since we live in the age of "speak, and your side project will be done" (joking, but LLMs are really helpfull for me when it comes to frontend stuff and for brainstorming in general!), I built the tool I needed myself :)WatchMachineGo is basically a visual simulator that simulates how a local LLM model gets loaded, prefilled and then used for inference, while showing the effects of different hardware parameters like memory bandwitch or setups like no GPU, two GPUs and so on.

Its activity falls under show hn launch; the profile below is assembled from public directory data.

It is recorded at the Show HN launch stage.

Website: watchmachinego.com/llm-inference