Python Parallel

Open-source Python projects categorized as Parallel
Edit details
Topics: Python Distributed Machine Learning Python3 Optimization
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 23 Python Parallel Projects

  • Ray

    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    • Project mention: Ray: Unified framework for scaling AI and Python applications | news.ycombinator.com | 2024-05-03

  • tqdm

    :zap: A Fast, Extensible Progress Bar for Python and CLI

    • Project mention: FLaNK-AIM: 20 May 2024 Weekly | dev.to | 2024-05-20

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • optuna

    A hyperparameter optimization framework

    • Project mention: Optuna – A Hyperparameter Optimization Framework | news.ycombinator.com | 2024-04-06

    I didn’t even know WandB did hyperparameter optimization, I figured it was a neural network visualizer based on 2 minute papers. Didn’t seem like many alternatives out there to Optuna with TPE + persistence in conditional continuous & discrete spaces.

    Anyway, it’s doable to make a multi objective decide_to_prune function with Optuna, here’s an example https://github.com/optuna/optuna/issues/3450#issuecomment-19...

  • Numba

    NumPy aware dynamic Python compiler using LLVM

    • Project mention: Mojo🔥: Head -to-Head with Python and Numba | dev.to | 2023-09-27

    Around the same time, I discovered Numba and was fascinated by how easily it could bring huge performance improvements to Python code.

  • pandarallel

    A simple and efficient tool to parallelize Pandas operations on all available CPUs

  • redo

    Smaller, easier, more powerful, and more reliable than make. An implementation of djb's redo.

  • parallel-ssh

    Asynchronous parallel SSH client library.

    • Project mention: I built a remote file browser and shell connection hub that supports k8s clusters | /r/kubernetes | 2023-06-09

    Okay I have no idea how to interpret this comment, are you talking about https://parallel-ssh.org/? These two things have not really anything in common

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • adaptive

    :chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

  • optuna-examples

    Examples for https://github.com/optuna/optuna

  • malib

    A parallel framework for population-based multi-agent reinforcement learning.

  • msrsync

    Multi-stream rsync wrapper

  • lithops

    A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

  • fast-cma-es

    A Python 3 gradient-free optimization library

  • entangle

    A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.

  • behavex

    BDD test wrapper on top of Behave for parallel test executions and more!

  • 🚀 IPpy

    :rocket: Ping IP addresses and domains in parallel to find the accessible and inaccessible ones. (by shivammathur)

  • eSCAPE

    Earth Landscape Evolution Model: https://escape-model.github.io/

  • pyfuncol

    Functional collections extension functions for Python

  • fluidml

    FluidML is a lightweight framework for developing machine learning pipelines.

  • pyeventbus

    Python Eventbus

  • git-pull

    Parallelized web scraper for Github

  • raffiot.py

    Robust And Fast Functional IO Toolkit

  • AutoParaSelenium

    A library to make concurrent selenium tests that automatically download and setup webdrivers

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Parallel related posts

Index

What are some of the best open-source Parallel projects in Python? This list will help you:

Project Stars
1 Ray 31,414
2 tqdm 27,570
3 optuna 9,751
4 Numba 9,512
5 pandarallel 3,511
6 redo 1,762
7 parallel-ssh 1,183
8 adaptive 1,115
9 optuna-examples 609
10 malib 467
11 msrsync 452
12 lithops 306
13 fast-cma-es 106
14 entangle 105
15 behavex 76
16 🚀 IPpy 57
17 eSCAPE 36
18 pyfuncol 32
19 fluidml 19
20 pyeventbus 17
21 git-pull 16
22 raffiot.py 15
23 AutoParaSelenium 9

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com