Continue with LocalAI: An alternative to GitHub's Copilot that runs everything locally

• WizardLM

  38 7,531 9.4 Python

  Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath

If you pair this with the latest WizardCoder models, which have a fairly better performance than the standard Salesforce Codegen2 and Codegen2.5, you have a pretty solid alternative to GitHub Copilot that runs completely locally.

• LocalAI

  83 20,550 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

Here's my tutorial on how to run this setup on docker-compose to test it in a simple way

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• model-gallery

  1 244 8.5 Go

  :card_file_box: a curated collection of models ready-to-use with LocalAI

  

Here's an example on how to configure LocalAI with a WizardCoder prompt

• homelab

  2 112 9.9 HCL

  A self-managed ArgoCD homelab kubernetes cluster using Talos (by gruberdev)

Do you want to test this setup on Kubernetes? Here is my resources that deploy LocalAI on my cluster with GPU support. Not sure on how to use GPU with Kubernetes on homelab setups? I wrote an article explaining how I configured my k3s to run using Nvidia's drivers and how they integrate with containerd.

Suggest a related project