Valohai LLM – Track and compare LLM evaluation results in one dashboard

Show HN: Valohai LLM – Track and compare LLM evaluation results in one dashboard

Valohai LLM – Track and compare LLM evaluation results in one dashboard is active in the show hn launch space.

Profile

We built Valohai LLM for tracking and comparing LLM evaluation results. Whether your evals live in notebooks and spreadsheets, or you're using an observability tool that wasn't built for comparison, this gives you a purpose-built eval comparison dashboard.Run evals with a Python library (pip install valohai-llm), results stream in, and you can compare up to 6 configurations side by side. Group by any dimension (model, category, difficulty) to see where each model excels.It doesn't do tracing or production observability, for now just eval tracking and comparison. What's cool is that you can define parameters you would like to test with and run a sweep across all of them.Feedback welcome, espe

Its activity falls under show hn launch; the profile below is assembled from public directory data.

Its current recorded stage is Show HN launch.

Website: valohai.com/llm