A registry of agent benchmarks (including many OSS agent trajectories)

Show HN: A registry of agent benchmarks (including many OSS agent trajectories)

A registry of agent benchmarks (including many OSS agent trajectories) is a business in show hn launch.

Profile

If you're interested in exploring what LLM-based agent systems these days actually do to solve certain benchmarks such as SWEBench or WebArena, we created a small leaderboard with our team, that allows to view a lot of public and OSS agent results including all the runtime traces (the step-by-step reasoning behind the scenes).Looking at traces is actually quite interesting, as they reveal a lot about the inner working and shortcomings of current agent system, e.g. see https://explorer.invariantlabs.ai/u/invariant/webarena--SteP... for an example trace.

Its activity falls under show hn launch; the profile below is assembled from public directory data.

The company is listed at the Show HN launch stage of development.

Website: explorer.invariantlabs.ai/benchmarks