Distributed Inference and Fine-Tuning of Large Language Models over the Internet

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
volunteer-computing boinc Bloom Distributed Computing Deep Learning

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    • Can check out their project at https://github.com/bigscience-workshop/petals

  • boinc

    Open-source software for volunteer computing and grid computing.

    • Made me think of Gridcoin and BOINC https://boinc.berkeley.edu/

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • SETI@home type model for training Stable Diffusion?

    3 projects | /r/sdforall | 5 Dec 2022

  • Bitcoin Block 840000

    2 projects | news.ycombinator.com | 19 Apr 2024

  • Have you ever donated your computing power with BOINC? Take 5 minutes to fill out the 2023 BOINC Census!

    1 project | /r/pcmasterrace | 19 Nov 2023

  • Berkeley Open Infrastructure for Network Computing

    1 project | news.ycombinator.com | 17 Nov 2023

  • Ask HN: What should I do with my leftover bandwidth?

    2 projects | news.ycombinator.com | 3 Nov 2023