Augment your dataset with LLM distillation techniques
Show HN: Augment your dataset with LLM distillation techniques
Augment your dataset with LLM distillation techniques operates in show hn launch.
Profile
Do you know that Small Language Models (SLM) can outperform LLMs if trained (fine-tuned) on domain specific datasets, like your companies knowledge base?The issue: fine-tuning a SLM usually requires a dataset of 10k - 100k records, which is huge.I created a platform for applying "human in the loop" augmentation techniques on your small dataset, so that you can start with maybe 100 records and build-up quickly huge datasets and launch a training without prior knowledge.I implemented 2 techniques, based on LLM distillation, however: more to come.HN, what Do you think? Do you see value in this idea? Would you prefer a public API or CLI instead?I appreciate your help.Kind regards Pawel
Its activity falls under show hn launch; the profile below is assembled from public directory data.
Directory data places it at the Show HN launch stage.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: www.tunetrain.ai
Browse related
Create a free account