anthropic-tokenizer

Approximation of the Claude 3 tokenizer by inspecting generation stream (by javirandor)

Anthropic-tokenizer Alternatives

Similar projects and alternatives to anthropic-tokenizer

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better anthropic-tokenizer alternative or higher similarity.

anthropic-tokenizer discussion

Log in or Post with

anthropic-tokenizer reviews and mentions

Posts with mentions or reviews of anthropic-tokenizer. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-06-17.

Stats

Basic anthropic-tokenizer repo stats
3
87
7.8
4 days ago

javirandor/anthropic-tokenizer is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of anthropic-tokenizer is Python.


Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com