Sup AI, a confidence-weighted ensemble (52.15% on Humanity's Last Exam)

Show HN: Sup AI, a confidence-weighted ensemble (52.15% on Humanity's Last Exam)

Sup AI, a confidence-weighted ensemble (52.15% on Humanity's Last Exam) is a business in show hn launch.

Profile

Hi HN. I'm Ken, a 20-year-old Stanford CS student. I built Sup AI.I started working on this because no single AI model is right all the time, but their errors don’t strongly correlate. In other words, models often make unique mistakes relative to other models. So I run multiple models in parallel and synthesize the outputs by weighting segments based on confidence. Low entropy in the output token probability distributions correlates with accuracy. High entropy is often where hallucinations begin.My dad Scott (AI Research Scientist at TRI) is my research partner on this. He sends me papers at all hours, we argue about whether they actually apply and what modifications make sense, and then I b

Its activity falls under show hn launch; the profile below is assembled from public directory data.

Its current recorded stage is Show HN launch.

Website: sup.ai