How to Listen to Database Changes Using Postgres Triggers in Elixir

• walex

  18 264 9.1 Elixir

  Postgres change events (CDC) in Elixir

If you want to stay in the Elixir world, I’ve created WalEx which listens to the Postgres WAL similar to Debezium and doesn’t suffer from scale issues of the trigger notify approach:

https://github.com/cpursley/walex

• supavisor

  15 1,616 8.9 Elixir

  A cloud-native, multi-tenant Postgres connection pooler.

  

Phoenix.PubSub is basically a noop service. It really just works. You should try it!

If discovering nodes is difficult in your env, try using a listen/notify libcluster strategy:

https://github.com/supabase/supavisor/blob/main/lib/cluster/...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• realtime

  56 6,510 9.2 Elixir

  Broadcast, Presence, and Postgres Changes via WebSockets

  

I believe #2 was the main driver for the supabase team to build their real-time component: https://github.com/supabase/realtime

Background/announcement: https://supabase.com/blog/supabase-realtime-multiplayer-gene...

• debezium

  80 9,983 9.9 Java

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  

• pgcat

  3 2,590 8.0 Rust

  PostgreSQL pooler with sharding, load balancing and failover support.

  

For #1 I've been keeping a keen eye on pgcat [1], in particular the https://github.com/postgresml/pgcat/issues/303 which

• cainophile

  2 235 1.7 Elixir
  

If you want to listen to database changes in Elixir you can also get really good stuff done by using Cainophile (https://github.com/cainophile/cainophile). Same mechanism. I don't know the details of Debezium so I can't say if you are leaving fantastic things on the table. But I've had good fun with Cainophile. For example I've used it in my videos on Electric SQL to react to changes in a Postgres database. It matches nicely with realtime-ish UI via LiveView. So meshes really good with the current Elixir stack.

• postgrex_pubsub

  1 11 0.0 Elixir

  A helper to turn postgres mutations into a pubsub channel

https://github.com/bnchrch/postgrex_pubsub

And But it you want something even better I recommend WalEx

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• mssql-changefeed

  4 14 6.6 Go
  

We made mssql-changefeed for this purpose:

https://github.com/vippsas/mssql-changefeed

V1 requires to run a sweeper procedure in the background, but an upcoming v2 version does without the sweep loop. Unfortunately too fresh for readme to be updated, but relevant lines in tests to show it off:

https://github.com/vippsas/mssql-changefeed/blob/v1-lazy/go/...

https://github.com/vippsas/mssql-changefeed/blob/v1-lazy/go/...

https://github.com/vippsas/mssql-changefeed/blob/v1-lazy/go/...

Library itself:

https://github.com/vippsas/mssql-changefeed/blob/v1-lazy/mig...

Suggest a related project