OpenCastor Agent Harness Evaluator Leaderboard
Show HN: OpenCastor Agent Harness Evaluator Leaderboard
OpenCastor Agent Harness Evaluator Leaderboard is a company in show hn launch.
Profile
I've been building OpenCastor, a runtime layer that sits between a robot's hardware and its AI agent. One thing that surprised me: the order you arrange the skill pipeline (context builder → model router → error handler, etc.) and parameters like thinking_budget and context_budget affect task success rates as much as model choice does.So I built a distributed evaluator. Robots contribute idle compute to benchmark harness configurations against OHB-1, a small benchmark of 30 real-world robot tasks (grip, navigate, respond, etc.) using local LLM calls via Ollama. The search space is 263,424 configs (8 dimensions: model routing, context budget, retry logic, drift detection, etc.). The demo lead
OpenCastor Agent Harness Evaluator Leaderboard is positioned in show hn launch, a segment that rewards a clear, focused offering.
Its current recorded stage is Show HN launch.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: craigm26.github.io/OpenCastor
Browse related
Create a free account