jj-benchmark – Evaluating AI agents on Jujutsu version control

Show HN: jj-benchmark – Evaluating AI agents on Jujutsu version control

Based, jj-benchmark – Evaluating AI agents on Jujutsu version control works in show hn launch.

Profile

Hi HN, Meng from TabbyML here.We decided to build this simply because we find Jujutsu (jj) really interesting, and many folks on our team have started trying it out recently. Since it introduces a very different workflow compared to traditional Git, we thought it would be a fun challenge to see how well current AI coding agents can actually use it.To build this, we created a semi-automated pipeline. We used AI to research the official Jujutsu documentation and websites, which then helped us bootstrap a dataset of 63 distinct evaluation tasks. Each task includes instructions, bootstrap scripts, and tests. We then ran the evaluations using the Harbor framework and our Pochi agent.Some interest

jj-benchmark – Evaluating AI agents on Jujutsu version control is positioned in show hn launch, a segment that rewards a clear, focused offering.

Its current recorded stage is Show HN launch.

Website: tabbyml.github.io/jj-benchmark