?Best LLM service for a tiny home server

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • Home Assistant

    :house_with_garden: Open source home automation that puts local control and privacy first.

  • My plan is to make a home-server by putting a Google Coral M.2 Accelerator in an m92p tiny thinkstation (after I've given it a Xeon E3-1265L V2 and 32gb of DDR3 RAM ofc, annnd once I connect the M.2(E) to the mini-PCIe socket and get past the BIOS whitelisting :facepalm: might take me a year to get around to, but heck when I do, I'll be the queen of 2015!). The only other things I want to serve are a 3-user Nextcloud instance, and a very basic home-assistant instance.

  • AGiXT

    AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

  • Even if my (for example, privateGPT) LLM is glacially slow I'd still love to be able to say "Mr Holmes, have Mrs Doubtfire verb the data object in order to verb a product for me, please." (eg: analyse the wikipedia article on the peace of westfalia in order to ELI5 a short summary of it). Hopefully she'd crunch away at the data, and at my convenience, I could have her brief me on her conclusions. I'm sure folks here would do something more clever using AGiXT, or having the old girl prepare lesson-plans for Mycroft to deliver (I just think that sort of thing is world-changing-bonkers for anyone wanting to learn anything, perhaps for kids one day), but I'd have to work up to that.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • Nextcloud

    ☁️ Nextcloud server, a safe home for all your data

  • My plan is to make a home-server by putting a Google Coral M.2 Accelerator in an m92p tiny thinkstation (after I've given it a Xeon E3-1265L V2 and 32gb of DDR3 RAM ofc, annnd once I connect the M.2(E) to the mini-PCIe socket and get past the BIOS whitelisting :facepalm: might take me a year to get around to, but heck when I do, I'll be the queen of 2015!). The only other things I want to serve are a 3-user Nextcloud instance, and a very basic home-assistant instance.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Docker App on Amber App Store

    2 projects | /r/u_AmberVanLatticework | 25 Jan 2022
  • Homelab Adventures: Crafting a Personal Tech Playground

    7 projects | dev.to | 22 Apr 2024
  • OpenBSD Upgrade 7.3 to 7.4

    3 projects | dev.to | 16 Feb 2024
  • Digitale Revolution in einer Physiotherapiepraxis: Ideen für den Neuanfang in der EDV

    3 projects | /r/de_EDV | 5 Jul 2023
  • Is data privacy something you all pay attention to? Is it important & in what ways?

    3 projects | /r/TwoXIndia | 15 Jun 2023