Simplest Guide to DIY Your Own LLM Toy in 2024

• emqx

  7 13,344 10.0 Erlang

  The most scalable open-source MQTT broker for IoT, IIoT, and connected vehicles

  

EMQX (optional): Open-source MQTT broker for IoT, IIoT, and connected vehicles. Used for managing your toys.

• docker

  158 518 0.0 Go

  Docker - the open-source application container engine (by microsoft)

  

Docker (required): Understanding Docker is crucial for deploying software in containers, making your project portable and scalable. I use it for start Folo server.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  212 66,540 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

ollama (optional): If you want to run large language models locally, it's a good chooise.

• mqtt.org

  31 5,062 7.3 SCSS

  The mqtt.org website

  

MQTT (optional): If you're aiming for advanced customization, familiarity with MQTT (a lightweight messaging protocol) will be beneficial for communicating between the toy and the server.

Suggest a related project