New Mistral models just dropped (magnet links)

• megablocks

  6 1,083 8.7 Python
  

I guess with +40 GBs of VRAM (until quantized) and megablocks as run time. https://github.com/stanford-futuredata/megablocks

• llama-mistral

  5 373 8.4 Python

  Inference code for Mistral and Mixtral hacked up into original Llama implementation

Someone made this. https://github.com/dzhulgakov/llama-mistral

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• llama.cpp

  791 59,389 10.0 C++

  LLM inference in C/C++

Alright, somebody already created a llama.cpp issue: https://github.com/ggerganov/llama.cpp/issues/4381

• megablocks-public

  5 858 9.0
  

Repo: https://github.com/mistralai/megablocks-public

Suggest a related project