Python Data Science

Open-source Python projects categorized as Data Science
Edit details
Topics: Python Machine Learning Deep Learning Data Analysis Pandas
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 Python Data Science Projects

  • Keras

    Deep Learning for humans

    • Project mention: Library for Machine learning and quantum computing | dev.to | 2024-04-27

    Keras

  • scikit-learn

    scikit-learn: machine learning in Python

    • Project mention: AutoCodeRover resolves 22% of real-world GitHub in SWE-bench lite | news.ycombinator.com | 2024-04-09

    Thank you for your interest. There are some interesting examples in the SWE-bench-lite benchmark which are resolved by AutoCodeRover:

    - From sympy: https://github.com/sympy/sympy/issues/13643. AutoCodeRover's patch for it: https://github.com/nus-apr/auto-code-rover/blob/main/results...

    - Another one from scikit-learn: https://github.com/scikit-learn/scikit-learn/issues/13070. AutoCodeRover's patch (https://github.com/nus-apr/auto-code-rover/blob/main/results...) modified a few lines below (compared to the developer patch) and wrote a different comment.

    There are more examples in the results directory (https://github.com/nus-apr/auto-code-rover/tree/main/results).

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Pandas

    Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

    • Project mention: AWS Serverless Diversity: Multi-Language Strategies for Optimal Solutions | dev.to | 2024-04-28

    Python is a natural fit for serverless development. It boasts a vast array of libraries, including Powertools for AWS and robust libraries for data engineers. Its versatility and excellent developer experience make it a top choice for serverless projects, offering a seamless and enjoyable development experience.

  • Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    • Project mention: Building in Public: Leveraging Tublian's AI Copilot for My Open Source Contributions | dev.to | 2024-02-12

    Contributing to Apache Airflow's open-source project immersed me in collaborative coding. Experienced maintainers rigorously reviewed my contributions, providing constructive feedback. This ongoing dialogue refined the codebase and honed my understanding of best practices.

  • streamlit

    Streamlit — A faster way to build and share data apps.

    • Project mention: Creando Subtítulos Automáticos para Vídeos con Python, Faster-Whisper, FFmpeg, Streamlit, Pillow | dev.to | 2024-04-29

    Streamlit (https://streamlit.io/)

  • Ray

    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    • Project mention: Ray: Unified framework for scaling AI and Python applications | news.ycombinator.com | 2024-05-03

  • gradio

    Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

    • Project mention: AI enthusiasm #9 - A multilingual chatbot📣🈸 | dev.to | 2024-05-01

    gradio is a package developed to ease the development of app interfaces in python and other languages (GitHub)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • spaCy

    💫 Industrial-strength Natural Language Processing (NLP) in Python

    • Project mention: Step by step guide to create customized chatbot by using spaCy (Python NLP library) | dev.to | 2024-03-23

    Hi Community, In this article, I will demonstrate below steps to create your own chatbot by using spaCy (spaCy is an open-source software library for advanced natural language processing, written in the programming languages Python and Cython):

  • pytorch-lightning

    Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

    • Project mention: SB-1047 will stifle open-source AI and decrease safety | news.ycombinator.com | 2024-04-29

    It's very easy to get started, right in your Terminal, no fees! No credit card at all.

    And there are cloud providers like https://replicate.com/ and https://lightning.ai/ that will let you use your LLM via an API key just like you did with OpenAI if you need that.

    You don't need OpenAI - nobody does.

  • data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

  • ML-From-Scratch

    Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

  • d2l-en

    Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

  • dash

    Data Apps & Dashboards for Python. No JavaScript Required.

    • Project mention: dash VS solara - a user suggested alternative | libhunt.com/r/dash | 2023-10-13

  • matplotlib

    matplotlib: plotting with Python

    • Project mention: How and where is matplotlib package making use of PySide? | /r/learnpython | 2023-12-07

  • recommenders

    Best Practices on Recommendation Systems

    • Project mention: My kernel dies when I fit my LightFm model from Microsoft Recommenders | /r/Jupyter | 2023-06-16

  • ipython

    Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.

    • Project mention: The new pdbp (Pdb+) Python debugger! | dev.to | 2023-08-02

    If you’re already using ipython, this isn’t a problem because you’ll already need to download most of these dependencies anyway. But if you’re not using ipython… you’ll still need to download those dependencies.

  • best-of-ml-python

    🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

  • gensim

    Topic Modelling for Humans

    • Project mention: Aggregating news from different sources | /r/learnprogramming | 2023-07-08

  • Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    • Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13

  • nni

    An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

  • dvc

    🦉 ML Experiments and Data Management with Git

    • Project mention: My Favorite DevTools to Build AI/ML Applications! | dev.to | 2024-04-23

    Collaboration and version control are crucial in AI/ML development projects due to the iterative nature of model development and the need for reproducibility. GitHub is the leading platform for source code management, allowing teams to collaborate on code, track issues, and manage project milestones. DVC (Data Version Control) complements Git by handling large data files, data sets, and machine learning models that Git can't manage effectively, enabling version control for the data and model files used in AI projects.

  • ydata-profiling

    1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

    • Project mention: FLaNK 25 December 2023 | dev.to | 2023-12-26

  • seaborn

    Statistical data visualization in Python

    • Project mention: "No" is not an actionable error message | news.ycombinator.com | 2024-05-03

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Data Science related posts

Index

What are some of the best open-source Data Science projects in Python? This list will help you:

Project Stars
1 Keras 60,972
2 scikit-learn 58,130
3 Pandas 41,983
4 Airflow 34,570
5 streamlit 31,717
6 Ray 31,179
7 gradio 28,987
8 spaCy 28,751
9 pytorch-lightning 26,952
10 data-science-ipython-notebooks 26,490
11 ML-From-Scratch 23,189
12 d2l-en 21,704
13 dash 20,502
14 matplotlib 19,310
15 recommenders 17,980
16 ipython 16,135
17 best-of-ml-python 15,364
18 gensim 15,256
19 Prefect 14,645
20 nni 13,742
21 dvc 13,139
22 ydata-profiling 12,053
23 seaborn 11,958

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com