RepoGauge – save token costs and compare agents on your own repos

Show HN: RepoGauge – save token costs and compare agents on your own repos

Operating in show hn launch, RepoGauge – save token costs and compare agents on your own repos operates.

Profile

I've grown increasingly skeptical that public coding benchmarks tell me much about which model is actually worth paying for and worried that as demand continues to spike model providers will silently drop performance.I did a few manual analyses but found it non-trivial to compare across models due to difference in token caching and tool-use efficiency and so wanted a tool for repeatable evaluations.So the goal was an OSS tool get data to help answer questions like:“Would Sonnet have solved most of the issues we gave Opus? "How much would that have actually saved?” “What about OSS models like Kimi K2.5 or GLM-1?” “The vibes are off, did model performance just regress from last month?”Right no

RepoGauge – save token costs and compare agents on your own repos is positioned in show hn launch, a segment that rewards a clear, focused offering.

Its current recorded stage is Show HN launch.

Website: repogauge.org