Distributed Computing

Open-source projects categorized as Distributed Computing
Edit details
Language: + Python + C# + Rust + Go + PHP + C++ + Java + C
Topics: Distributed Systems Machine Learning Cloud Python Distributed
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 Distributed Computing Open-Source Projects

  • ColossalAI

    Making large AI models cheaper, faster and more accessible

    • Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22

  • oceanbase

    OceanBase is an enterprise distributed relational database with high availability, high performance, horizontal scalability, and compatibility with SQL standards.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo

  • Hazelcast

    Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

    • Project mention: Does anyone know any good java implementations for distributed key-value store? | /r/ExperiencedDevs | 2023-06-08

    You're probably looking for Hazelcast here. Note that it does much more than just a distributed k/v, but it will get you where you need to go.

  • protoactor-go

    Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

    • Project mention: Is there a programming language that will blow my mind? | /r/ProgrammingLanguages | 2023-06-01

    https://github.com/asynkron/protoactor-go & this is a great lib, that implements a Erlang/Akka-like the Actor Model in Go.

  • Akka.net

    Canonical actor model implementation for .NET with local + distributed actors in C# and F#.

    • Project mention: What is the fastest producer consumer model in C# | /r/dotnet | 2023-11-06

    akka.net actors. Actors all the way! https://getakka.net

  • gleam

    Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly. (by chrislusf)

  • catalyst

    Accelerated deep learning R&D (by catalyst-team)

    • Project mention: Instance segmentation of small objects in grainy drone imagery | /r/computervision | 2023-12-09

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • alpa

    Training and serving large-scale neural networks with auto parallelization.

  • inference

    Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

    • Project mention: GreptimeAI + Xinference - Efficient Deployment and Monitoring of Your LLM Applications | dev.to | 2024-01-24

    Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integration of a wide array of AI models. With Xinference, you’re empowered to run inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on your own premises, and create robust AI-driven applications. It provides a RESTful API compatible with OpenAI API, Python SDK, CLI, and WebUI. Furthermore, it integrates third-party developer tools like LangChain, LlamaIndex, and Dify, facilitating model integration and development.

  • Graph Engine

    Microsoft Graph Engine (by microsoft)

  • boinc

    Open-source software for volunteer computing and grid computing.

    • Project mention: Bitcoin Block 840000 | news.ycombinator.com | 2024-04-19

    The only way I can foresee a cryptocoin actually holding value is if spending the coin meant spending processing cycles and RAM doing things like this:

    https://en.wikipedia.org/wiki/List_of_volunteer_computing_pr...

    But in more general sense, less like https://boinc.berkeley.edu/ and more like AWS...

    It's the only way to have value, actually holding computing power in a distributed network.

  • fugue

    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

    • Project mention: FLaNK Stack Weekly 22 January 2024 | dev.to | 2024-01-22

  • Daft

    Distributed DataFrame for Python designed for the cloud, powered by Rust

    • Project mention: Pg_lakehouse: Query Any Data Lake from Postgres | news.ycombinator.com | 2024-05-13

    We're actually using pyiceberg to retrieve metadata! All our IO and decoding happens in the rust side once the data has been passthrough.

    We expose something called a ScanOperator which allows integration into various catalogs through a thin layer that exposes ScanTasks.

    Iceberg's impl: https://github.com/Eventual-Inc/Daft/blob/416009138359a9d410...

  • protoactor-dotnet

    Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

  • MooseFS

    MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

    • Project mention: Ask HN: What distributed file system would you use in 2024? | news.ycombinator.com | 2024-05-10

  • distributed

    A distributed task scheduler for Dask

  • hashtopolis

    Hashtopolis - distributed password cracking with Hashcat

  • zenoh

    zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

    • Project mention: Zenoh: Zero Overhead Network Protocol | news.ycombinator.com | 2024-04-24

  • vizier

    Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

  • .NET port of LMAX Disruptor

    Port of LMAX Disruptor to .NET

  • IdGen

    Twitter Snowflake-alike ID generator for .Net

  • holochain

    The current, performant & industrial strength version of Holochain on Rust.

  • SmartSql

    SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Distributed Computing related posts

Index

What are some of the best open-source Distributed Computing projects? This list will help you:

Project Stars
1 ColossalAI 38,081
2 oceanbase 7,492
3 Hazelcast 5,940
4 protoactor-go 4,905
5 Akka.net 4,628
6 gleam 3,389
7 catalyst 3,237
8 alpa 2,995
9 inference 2,952
10 Graph Engine 2,185
11 boinc 1,937
12 fugue 1,892
13 Daft 1,792
14 protoactor-dotnet 1,675
15 MooseFS 1,601
16 distributed 1,544
17 hashtopolis 1,382
18 zenoh 1,287
19 vizier 1,182
20 .NET port of LMAX Disruptor 1,172
21 IdGen 1,143
22 holochain 1,125
23 SmartSql 1,052

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com