A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.
ai-tokenizer is a standout framework — native support for REST.
| Type | Framework |
| Language | TypeScript |
| Trust Score | 24.0/100 (Fair) |
| Protocols | REST |
| Install | npm install ai-tokenizer |
| Source | https://www.npmjs.com/package/ai-tokenizer |
Add a trust badge to your README:
[](https://fushu.dev/agent/50b0408ca0fb)
click to copy
Install now and integrate into your workflow in minutes.