Go Bigquery

Open-source Go projects categorized as Bigquery
Edit details
Topics: Golang Snowflake Redshift Go ETL
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 10 Go Bigquery Projects

  • cloudquery

    The open source high performance ELT framework powered by Apache Arrow

    • Project mention: We might want to regularly keep track of how important each server is | news.ycombinator.com | 2024-02-06

    Check out CloudQuery - https://github.com/cloudquery/cloudquery for an easy cloud asset inventory.

  • Rudderstack

    Privacy and Security focused Segment-alternative, in Golang and React

    • Project mention: Rudderstack Switches to Elastic License | news.ycombinator.com | 2023-09-08

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • tbls

    tbls is a CI-Friendly tool for document a database, written in Go.

    • Project mention: FLaNK 25 December 2023 | dev.to | 2023-12-26

  • peerdb

    Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

    • Project mention: PeerDB Streams – Simple, Native Postgres Change Data Capture | news.ycombinator.com | 2024-05-06

  • scratchdata

    Scratch is a swiss army knife for big data.

    • Project mention: Debugging a Golang Bug with Non-Blocking Reads | news.ycombinator.com | 2024-03-12

    Go team does acknowledge [1] it as a bug, so there is some point here

    However, that said, I wonder if OP (duckdb) could have written their solution [2] differently. Shouldn't they be able to select from a Pipe as well as Error channel simultaneously? (similar to how they are doing it inside here [3]). If not, I would have create a go-routine that does blocking read on the Pipe and then pass it on to another channel to select on.

    [1] https://github.com/golang/go/issues/66239

    [2] https://github.com/scratchdata/scratchdata/blob/7c1a0fcd0e20...

    [3] https://github.com/scratchdata/scratchdata/blob/7c1a0fcd0e20...

  • optimus

    Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management. (by raystack)

    • Project mention: Data Engineering Tools in Go | /r/dataengineering | 2023-05-18

    You can check odpf github, they created some dataops tools using go, one of the example is optimus (https://github.com/odpf/optimus) which is a data pipeline orchestrator

  • bigquery-emulator

    BigQuery emulator server implemented in Go

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • transfer

    Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

    • Project mention: Migrate mongodb Datawarehouse to snowflake | /r/snowflake | 2023-12-04

  • pgsink

    Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)

  • protobuf-bigquery-go

    Seamlessly save and load protocol buffers to and from BigQuery using Go.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Bigquery related posts

  • Show HN: ScratchDB – Open-Source Snowflake on ClickHouse

    1 project | /r/hackernews | 29 Oct 2023

  • Show HN: ScratchDB – Open-Source Snowflake on ClickHouse

    3 projects | news.ycombinator.com | 27 Oct 2023

  • Benchmarking Postgres Replication: PeerDB vs. Airbyte

    1 project | news.ycombinator.com | 10 Oct 2023

  • Launch HN: PeerDB (YC S23) – Fast, Native ETL/ELT for Postgres

    2 projects | news.ycombinator.com | 27 Jul 2023

  • A modern data stack for startups

    4 projects | dev.to | 21 Apr 2022

  • Sync Postgres to BigQuery, possible? How?

    3 projects | /r/bigquery | 5 Apr 2021
  • A note from our sponsor - SaaSHub
    www.saashub.com | 16 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Bigquery projects in Go? This list will help you:

Project Stars
1 cloudquery 5,600
2 Rudderstack 3,947
3 tbls 3,111
4 peerdb 1,842
5 scratchdata 1,042
6 optimus 737
7 bigquery-emulator 721
8 transfer 537
9 pgsink 76
10 protobuf-bigquery-go 43

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com