tokencost
project-based-learning
tokencost | project-based-learning | |
---|---|---|
6 | 199 | |
1,170 | 179,219 | |
81.8% | 2.8% | |
9.1 | 0.0 | |
7 days ago | 8 days ago | |
Python | ||
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tokencost
-
Why is Everyone into Indie Development? - FAV0 Weekly Issue 004
Library for Estimating Token Costs
-
Show HN: Token price calculator for 400+ LLMs
I really appreciate your engagement here and think it has great value on a personal level, but the length and claims tend to hide two very obvious, straightforward things:
1. They only support GPT3.5 and GPT4.0. Note here: [1], and that gpt-4o would get swallowed into gpt-4-0613.
2. This will lead to massive, significant, embarrassingly large error in calculations. Tokenizers are not mostly the same, within 10% error.
1. responsive to ex. "It's not just C100K though. It is for a few models [0]",
The link is to Tiktoken, OpenAI's tokenization library. There are literally more than GPT3.5 and GPT4.0 there, but they're just OpenAI's models, no one else's, none of the others in the long list in their documentation, and certainly not 400.
every single one of them is for a deprecated model, not served anymore, except c100k and o200k. As described above and shown in [1], their own code kneecaps the o200k and will use c100k"
2. Let me know what you'd want to see if you're curious the 30%+ error thing. I don't want to go to the trouble to guess at a test suite, then run one, that would make you confident you need to revise a prior that there's only +/- 10% difference between arbitrary tokenizers. I will almost assuredly choose one that isn't comprehensive enough, with your input.
For context, I run about 20 unit tests, for each of the big 5 providers, with the same prompts, to capture their input and output token counts to make sure I'm billing accurately.
Just to save you time, you won't be able to talk me down to "eh, good enough!" --- It *matters*, if it didn't, they'd be much more up front about the truth. Every single sign around the library is absolutely damning, and triangulates somewhere between lying and naivete. From the marketing claiming 400+, to the complete lack of note of these extreme* caveats in any documentation, the only thing being what I understand is a warning log.
[1] https://github.com/AgentOps-AI/tokencost/blob/e1d52dbaa3ada2...
- Show HN: Easy token counting and price calculation for LLMs
project-based-learning
-
Why is Everyone into Indie Development? - FAV0 Weekly Issue 004
Project-Based Learning Programming Tutorials
-
Top 10 GitHub Repositories for Python and Java Developers
9. Practical-tutorials/project-based-learning - This repository provides links to project-based tutorials for various programming languages, with a focus on Python. It's a great way to gain practical experience and build your developer portfolio. https://github.com/practical-tutorials/project-based-learning
- Project-Based Learning: A curated list of project-based tutorials
-
How to Become a Software Engineer ?
View on GitHub
-
🕵️♂️ The Art of Self-Learning: How to Teach Yourself Any Programming Concept 🤓
Tired of the same old ideas or completely lost trying to find one? Check this great repo containing a bunch of different links to other lists of ideas!
-
Git from the Bottom Up
There's a whole load of these listed here: https://github.com/practical-tutorials/project-based-learnin...
- 18 Must-Bookmark GitHub Repositories Every Developer Should Know
-
Top 10 GitHub Repositories Every Developer Should Bookmark in 2024
3) Project-Based Learning: Break free from the shackles of theoretical frameworks and dive headfirst into practical projects. This repository curates a diverse range of project ideas, from building basic web applications to creating intricate 3D games, all designed to solidify your understanding through hands-on experience. (https://github.com/practical-tutorials/project-based-learning)
-
Resources I wish I knew when I started my career
4. Project Based Learning
-
The Top 10 GitHub Repositories Making Waves 🌊📊
View on GitHub
What are some alternatives?
openai-messages-token-helper - A utility library for dealing with token counting for messages sent to an LLM (currently OpenAI models only)
build-your-own-x - Master programming by recreating your favorite technologies from scratch.
llm_utils - Utilities for Llama.cpp, Openai, Anthropic, Mistral-rs.
build-your-own-x - 🤓 Build your own (insert technology here) [Moved to: https://github.com/codecrafters-io/build-your-own-x]
litellm - Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
project-based-tutorials-in-c - A curated list of project-based tutorials in C
anthropic-tokenizer - Approximation of the Claude 3 tokenizer by inspecting generation stream
Daily-Coding-DS-ALGO-Practice - A open source project🚀 for bringing all interview💥💥 and competative📘 programming💥💥 question under one repo📐📐
CPlusPlusThings - C++那些事
assignments
-Python-FF14-MB-Scraper - This is the FF14 Market Board scraper. Essentially this will create a csv of FF14 Market Board data for items in the game.
Crafting Interpreters - Repository for the book "Crafting Interpreters"