Matching Jev on BANKING77 at a thousandth of the cost

Show HN: Matching Jev on BANKING77 at a thousandth of the cost

Based, Matching Jev on BANKING77 at a thousandth of the cost works in show hn launch.

Profile

We developed an early vector embedding model at Lawrence Berkeley National Lab and extended it called the Tuatara Vector Model. It's a blend and scored against Jev's 3,080 BANKING77 test messages resulting in 91.79% versus 92.40%, a statistical tie with some good cost savings.As most may know, BANKING77 is a public dataset from PolyAI with 13,083 messages to a bank, each labelled with intents. The split was 10,003 messages for training and 3,080 for testing.The run used the pinned model jev-1.13.0, all 77 intents as options in a single question, and up to 24 training examples retrieved for each message. Jev got 2,846 of 3,080 right.Recomputing Jev’s accuracy from the file gives 92.40%, the s

Within the show hn launch space, the company focuses on its core offering rather than a broad product line.

Directory data places it at the Show HN launch stage.

Website: cymetica.com/blog/matching-jev-on-banking77-at-a-tho