Top 16 Python Redshift Projects

• Redash

  38 25,057 9.5 Python

  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

  

Project mention: Redash: Connect to data source, easily visualize, dashboard and share your data | news.ycombinator.com | 2024-03-20

• airbyte

  140 14,296 10.0 Python

  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

  

Project mention: How to Build a Chat App with Your Postgres Data using Agent Cloud | dev.to | 2024-05-13

AgentCloud uses Airbyte to build data pipelines, which allow us to split, chunk, and embed data from over 300 data sources, including Postgres.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• awesome-aws

  2 12,195 2.6 Python

  A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

• sqlglot

  56 5,679 9.9 Python

  Python SQL Parser and Transpiler

Project mention: The Future of MySQL is PostgreSQL: an extension for the MySQL wire protocol | news.ycombinator.com | 2024-04-26

This is probably referring to "zero changes to your driver code" and not "zero changes to the SQL you send over this driver".

Translating between SQL dialects is notoriously hard and attempts to translate [1] are working in 95% of cases. But the last 5% would require 5x amount of work. That's because "SQL dialect" also includes weird edge cases of type inference of things like COALESCE(5, FALSE) and emulation of system catalogs (pg_catalog, information_schema).

[1] https://github.com/tobymao/sqlglot

• AWS Data Wrangler

  9 3,816 9.4 Python

  pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

  

Project mention: Read files from s3 using Pandas/s3fs or AWS Data Wrangler? | /r/dataengineering | 2023-12-06

I had no problem with awswrangler (https://github.com/aws/aws-sdk-pandas) and it supports reading and writing partitions which was really helpful and a few other optimizations that made it a great tool

• jupysql

  8 615 9.1 Python

  Better SQL in Jupyter. 📊

  

Project mention: Show HN: JupySQL – a SQL client for Jupyter (ipython-SQL successor) | news.ycombinator.com | 2023-12-06

Hey, HN community!

We're stoked to launch JupySQL today! JupySQL is an open-source library that brings a modern SQL experience to Jupyter. JupySQL is compatible with all major databases, such as Snowflake, Redshift, PostgreSQL, MySQL, MariaDB, DuckDB, SQL Server, Clickhouse, Trino, and more!

To get started, check out our tutorial: https://jupysql.ploomber.io/en/latest/quick-start.html

SQL is the defacto language for data analysis; however, analysis often requires a mix of SQL and Python. JupySQL bridges this gap, allowing users to execute SQL queries seamlessly in Jupyter and continue their analysis in Python. Add %%sql to the top of your cell and start writing SQL.

Here are some of JupySQL's main features:

- Syntax highlighting

• grai-core

  6 270 9.5 Python
  

Project mention: Launch HN: Grai (YC S22) – Open-Source Data Observability Platform | news.ycombinator.com | 2023-07-17

Elastic v2 if one is interested in such things: https://github.com/grai-io/grai-core/blob/v0.1.33/LICENSE

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• dataall

  1 213 9.4 Python

  A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

  

• dbt-coves

  1 210 9.2 Python

  CLI tool for dbt users to simplify creation of staging models (yml and sql) files

  

• CueObserve

  6 208 0.0 Python

  Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

  

• dbt-ml-preprocessing

  2 176 3.7 Python

  A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

  

• pytest-mock-resources

  1 173 5.8 Python

  Pytest Fixtures that let you actually test against external resource (Postgres, Mongo, Redshift...) dependent code.

  

• prism

  7 79 8.9 Python

  Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python. (by runprism)

  

Project mention: Prism: the easiest way to create robust data workflows. Accessible via CLI | /r/coolgithubprojects | 2023-09-21

• dbd

  4 56 0.0 Python

  dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

• TrueColorTools

  2 19 9.5 Python

  GUI application for calculating human-visible colors of celestial bodies from their photometry data

• dotfiles

  1 4 4.2 Python

  eternal quest of crafting an environment that works for me (by kirillbobyrev)

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Redshift related posts

• New to wm, I choose i3-gaps, any suggestions?

  2 projects | /r/linux4noobs | 19 Aug 2022

• [Project] Open-source Anomaly detection on SQL data

  1 project | /r/MachineLearning | 27 Jul 2021

• CueObserve - Anomaly detection on SQL data warehouses and databases

  1 project | /r/aws | 23 Jul 2021

• CueObserve - Anomaly detection on SQL data warehouses and databases

  1 project | /r/SQL | 23 Jul 2021

• CueObserve - Anomaly detection on SQL data warehouses and databases

  1 project | /r/Database | 23 Jul 2021

• Show HN: CueObserve – Open-source Anomaly detection on SQL data

  2 projects | news.ycombinator.com | 22 Jul 2021
• A note from our sponsor - InfluxDB
  www.influxdata.com | 22 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!