Offline GPT Store, run a pre-prompted LLM in your browser

Show HN: Offline GPT Store, run a pre-prompted LLM in your browser

Offline GPT Store, run a pre-prompted LLM in your browser is active in the show hn launch space.

Profile

Hi HNI wanted an LLM chat bot that runs locally and offline so I would feel comfortable about sharing personal details with it.Similar to how OpenAI GPTs have pre-configured instructions, this project provides the ability to encode a pre-prompt into the URL so it can be shared. Effectively, making a free, offline and decentralised GPT store albeit with lower quality for the responses. To make it easy to find these "GPTs", I'm using Twitter as a form of storage.This project uses webllm to run a Llama-2-7b model locally in the browser. Bigger models can be used (not supported yet) as well but they would take more time to download and require more RAM.WebGPU is required since the webllm model w

Its activity falls under show hn launch; the profile below is assembled from public directory data.

The company is listed at the Show HN launch stage of development.

Website: uneven-macaw-bef2.hony.ai/app