openai-messages-token-helper
llm-classifier
| openai-messages-token-helper | llm-classifier | |
|---|---|---|
| 3 | 4 | |
| 15 | 209 | |
| - | 9.6% | |
| 7.6 | 7.2 | |
| 27 days ago | 13 days ago | |
| Python | Python | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
openai-messages-token-helper
-
Show HN: Token price calculator for 400+ LLMs
I grappled with that issue for https://github.com/pamelafox/openai-messages-token-helper as I wanted to be able to use it for a quick token check with SLMs as well, so I ended up adding a parameter "fallback_to_default" for developers to indicate they're okay with assuming gpt-35 BPE encoding.
-
Lessons after a Half-billion GPT Tokens
Lol, nice truncation logic! If anyone’s looking for something slightly fancier, I made a micro-package for our tiktoken-based truncation here: https://github.com/pamelafox/llm-messages-token-helper
llm-classifier
-
Lessons after a Half-billion GPT Tokens
We do this for the null hypothesis - is uses an LLM to bootstrap a binary classifier - which handles null easily
https://github.com/lamini-ai/llm-classifier
- FLaNK Stack 29 Jan 2024
-
Good old-fashioned AI remains viable in spite of the rise of LLMs
LLMs introduced zero-shot learning, or “prompt engineering” which is drastically easier to use and more effective than labeling data.
You can also retrofit “prompt engineering” onto good old fashion ML like text classifiers. I wrote a library to do just that here: https://github.com/lamini-ai/llm-classifier
IMO, it’s a short matter of time before this takes over all of what used to be called “deep learning”.
- How to use a LLM to classify text
What are some alternatives?
tokencost - Easy token price estimates for 400+ LLMs
reor - Private & local AI personal knowledge management app.
ml-ferret
java-snapshot-testing - Facebook style snapshot testing for JAVA Tests
llm-routing-agent - Agent that routes to different tools - LLM classifier SDK
Deep_Object_Pose - Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
heynote - A dedicated scratchpad for developers
harlequin - The SQL IDE for Your Terminal.
langroid - Harness LLMs with Multi-Agent Programming
sendenv
FLaNK-VectorDB - NiFi and Vector Databases
async-profiler - Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events