Mistral website was just updated

• mistral-src

  9 8,732 7.3 Jupyter Notebook

  Reference implementation of Mistral AI 7B v0.1 model.

  

• vllm

  31 18,931 9.9 Python

  A high-throughput and memory-efficient inference and serving engine for LLMs

  

official support for vllm: https://github.com/vllm-project/vllm/pull/2011/files

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama.cpp

  777 57,463 10.0 C++

  LLM inference in C/C++

We will have to wait until llama.cpp adds support for Mixtral: https://github.com/ggerganov/llama.cpp/issues/4381

Suggest a related project