Local LLMs: After Novelty Wanes

• open-llms

  22 10,366 6.9

  📋 A list of open LLMs available for commercial use.

There's also MPT, which has a 7B, and Falcon, with a 7B and 40B although they have not had the inference tuning in community projects that the llamas have had. This is a good repo for reviewing what's available atm: https://github.com/eugeneyan/open-llms

• llama.cpp

  788 59,389 10.0 C++

  LLM inference in C/C++

Grammar based sampling is just one recent idea.

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• lmql

  30 3,408 9.3 Python

  A language for constraint-guided and efficient LLM programming.

  

LMQL is another.

• SillyTavern

  76 6,322 10.0 JavaScript

  LLM Frontend for Power Users.

  

• SillyTavern-Extras

  14 494 9.6 Python

  Extensions API for SillyTavern.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project