nifi-llm
llm stuff (by Christopheraburns)
LLMLingua
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss. (by microsoft)
| nifi-llm | LLMLingua | |
|---|---|---|
| 1 | 3 | |
| 1 | 3,880 | |
| - | 16.3% | |
| 3.7 | 8.2 | |
| 2 months ago | 5 days ago | |
| Jupyter Notebook | Python | |
| - | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nifi-llm
Posts with mentions or reviews of nifi-llm.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-25.
LLMLingua
Posts with mentions or reviews of LLMLingua.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-25.
What are some alternatives?
When comparing nifi-llm and LLMLingua you can also consider the following projects:
huh - Build terminal forms and prompts 🤷🏻♀️
Zolver - Automatic jigsaw puzzle solver
mergekit - Tools for merging pretrained large language models.
k3s - Lightweight Kubernetes
kubernetes-client - Java client for Kubernetes & OpenShift
spring-ai - An Application Framework for AI Engineering
microagents - Agents Capable of Self-Editing Their Prompts / Python Code