pgsink

Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc) (by lawrencejones)

Pgsink Alternatives

Similar projects and alternatives to pgsink

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better pgsink alternative or higher similarity.

pgsink reviews and mentions

Posts with mentions or reviews of pgsink. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-01-10.
  • GitHub - go-jet/jet: Type safe SQL builder with code generation and automatic query result data mapping
    2 projects | /r/golang | 10 Jan 2023
    This is a really awesome project. I’ve used it on https://github.com/lawrencejones/pgsink to generate type safe bindings to the Postgres catalog tables, along with a few of the tables the project maintains itself.
  • Trade-offs from using ULIDs at incident.io
    2 projects | /r/programming | 3 Jan 2023
    pgx is really good: it's what I used to write logical decoders in https://github.com/lawrencejones/pgsink
  • A modern data stack for startups
    4 projects | dev.to | 21 Apr 2022
    It used to be that companies would write their own hacky scripts to perform this extraction - I've had terrible incidents caused by ETL database triggers in the past, and even built a few generic ETL tools myself.
  • Sync Postgres to BigQuery, possible? How?
    3 projects | /r/bigquery | 5 Apr 2021
  • Ask HN: Show me your Half Baked project
    154 projects | news.ycombinator.com | 9 Jan 2021
    Postgres change-capture device that supports high-throughput and low-latency capture to a variety of sinks (at first release, just Google BigQuery):

    https://github.com/lawrencejones/pgsink

    I know there's debezium and Netflix's dblog, but this project aims to be much simpler.

    Forget about kafka and any other dependency: just point it at Postgres, and your data will be pushed into BigQuery. And for people with highly-performance-sensitive databases, the read workload has been designed with Postgres efficiency in mind.

    I'm hoping pgsink could be a gateway drug to get small companies up and running with a data warehouse. If your datastore of choice is Postgres, it's a huge help to replicate everything into an analytics datastore. A similar tool has helped my company extract expensive work out of our primary database, which is super useful for scaling.

    The project is 90% there, about 10hrs and some testing away from being useable. Once there, I'll be hitting up some start-up friends and seeing if they want to give it a whirl.

  • A note from our sponsor - InfluxDB
    www.influxdata.com | 3 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic pgsink repo stats
5
76
0.0
about 1 year ago

lawrencejones/pgsink is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of pgsink is Go.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com