I've been working on Serge, a self-hosted alternative to ChatGPT. It's dockerized, easy to setup and it runs the models 100% locally. No remote API needed.

• serge

  40 5,568 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

this worked: git clone https://github.com/nsarrazin/serge.git && serge

• dalai

  59 13,067 6.5 CSS

  The simplest way to run LLaMA on your local machine

Just in time, i was trying to mess around with Dalai and the have a bit of a show stopper bug until the fix is merged https://github.com/cocktailpeanut/dalai/pull/223

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• text-generation-webui

  876 37,023 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Here's the link to it.

• Home Assistant

  1,411 69,033 10.0 Python

  :house_with_garden: Open source home automation that puts local control and privacy first.

  

Is this what is being discussed: https://www.home-assistant.io/

• ovos-core

  13 105 9.1 Python

  OpenVoiceOS Core, the FOSS Artificial Intelligence platform.

  

• LocalAI

  83 20,550 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

feel free to have a look for inspiration https://github.com/go-skynet/llama-cli, and if I can help and you want to use llama as an API, and keep the model loaded in memory between calls just let me know!

Suggest a related project