Tokiwi – An online tokenizer for any Hugging Face model

Show HN: Tokiwi – An online tokenizer for any Hugging Face model

Tokiwi – An online tokenizer for any Hugging Face model is active in the show hn launch space.

Profile

Hey HN,Like (perhaps?) many of you working with different open-weight LLMs, I often find myself wanting a quick way to check token counts for specific Hugging Face models without having to write a Python script each time. I often find myself googling something like "online Qwen tokenizer" and coming up empty-handed.So, I built Tokiwi (https://tokiwi.dev), the online tokenizer I've been looking for.What it does: - You paste your text. - You enter any model repository ID from Hugging Face (like `google/gemma-3-27b-it`, `deepseek-ai/DeepSeek-V3-0324`, etc.). - It fetches the tokenizer from HF and shows you the token count and the list of tokens. - It also supports gated models if you provide yo

The company sits in the show hn launch segment, where it competes on its core product or service.

The company is listed at the Show HN launch stage of development.

Website: www.tokiwi.dev