Go Data

Open-source Go projects categorized as Data
Edit details
Topics: Golang Kubernetes Go data-engineering Data Science
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 Go Data Projects

  • cloudquery

    The open source high performance ELT framework powered by Apache Arrow

    • Project mention: We might want to regularly keep track of how important each server is | news.ycombinator.com | 2024-02-06

    Check out CloudQuery - https://github.com/cloudquery/cloudquery for an easy cloud asset inventory.

  • flyte

    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

    • Project mention: First 15 Open Source Advent projects | dev.to | 2023-12-15

    9. Flyte by Union AI | Github | tutorial

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • cue

    The home of the CUE language! Validate and define text-based and dynamic configuration

    • Project mention: Ask HN: Anyone dislike GitHub action yml syntax | news.ycombinator.com | 2024-05-17

    I write my GHA in CUE now, though I am moving to Argo more generally (which I also write in CUE)

    https://cuelang.org | https://cuetorials.com

  • gofakeit

    Random fake data generator written in go

    • Project mention: I've made my first PR. | /r/cscareerquestions | 2023-11-03

  • memphis

    Memphis.dev is a highly scalable and effortless data streaming platform

  • Stats

    A well tested and comprehensive Golang statistics library package with no dependencies. (by montanaflynn)

  • incubator-devlake

    Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • rill

    Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code. (by rilldata)

    • Project mention: Governments on GitHub | news.ycombinator.com | 2023-06-09

  • tigris

    Tigris is an Open Source Serverless NoSQL Database and Search Platform.

    • Project mention: 17 Best Developer Productivity Tools to Try | dev.to | 2024-05-10

    Tigris is a globally distributed S3-compatible object storage service that stores data as objects within buckets. An object is a file and any metadata that describes the file. A bucket is a container for objects.

  • finance-go

    :bar_chart: Financial markets data library implemented in go.

  • tyson

    🥊 TypeScript as a Configuration Language. TySON stands for TypeScript Object Notation

    • Project mention: TySON: TypeScript Object Notation | news.ycombinator.com | 2024-02-04

  • aqueduct

    Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure. (by RunLLM)

  • webpalm

    🕸️ Crawl in the web network

    • Project mention: Modern automated data miner (scrapper) | news.ycombinator.com | 2024-02-08

  • ArtiVC

    A version control system to manage large files.

  • Dataplane

    Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.

  • guardian

    Guardian is universal data access management tool with automated access workflows and security controls across data stores, analytical systems, and cloud products. (by raystack)

  • pgsink

    Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)

  • steampipe-postgres-fdw

    The Steampipe foreign data wrapper (FDW) is a zero-ETL product that provides Postgres foreign tables which translate queries into API calls to cloud services and APIs. It's bundled with Steampipe and also available as a set of standalone extensions for use in your own Postgres database.

  • steampipe-sqlite

    Steampipe SQLite is a zero-ETL engine for SQLite. Virtual tables translate queries into live API calls for cloud services and APIs. Hundreds of plugins with thousands of documented examples.

    • Project mention: Steampipe SQLite – Virtual tables translated for common APIs | news.ycombinator.com | 2023-12-20

  • rtdl

    rtdl makes it easy to build and maintain a real-time data lake (by realtimedatalake)

  • go-notebook

    Go-Notebook is inspired by Jupyter Project (link) in order to document Golang code.

  • turbine-go

    Turbine Library for Go

  • pippin

    Go library to create and manage data pipelines on your machine

    • Project mention: Go concurrency simplified. Part 4: Post office as a data pipeline | dev.to | 2023-12-21

    take a look at the concurrent code written by other devs out there: for example, feel free to check the internals of my library Pippin, but I bet there are many better projects out there to learn from - Google/Bing/DuckDuckGo/Kagi and ChatGPT can help to find the right one

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Data related posts

  • Ask HN: Anyone dislike GitHub action yml syntax

    1 project | news.ycombinator.com | 17 May 2024

  • Really: Policy language for infra that doesn't suck

    1 project | news.ycombinator.com | 16 May 2024

  • How to use fly.io and Tigris to deploy a Next.js app

    3 projects | dev.to | 2 Apr 2024

  • Tigris: Globally Distributed S3-Compatible Object Storage

    1 project | news.ycombinator.com | 8 Feb 2024

  • TySON: TypeScript Object Notation

    1 project | news.ycombinator.com | 4 Feb 2024

  • TySON (TypeScript Object Notation)

    1 project | news.ycombinator.com | 23 Jan 2024

  • Go concurrency simplified. Part 1: Channels and goroutines

    2 projects | dev.to | 8 Dec 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 20 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Data projects in Go? This list will help you:

Project Stars
1 cloudquery 5,609
2 flyte 4,853
3 cue 4,779
4 gofakeit 4,244
5 memphis 3,164
6 Stats 2,888
7 incubator-devlake 2,444
8 rill 1,382
9 tigris 887
10 finance-go 688
11 tyson 531
12 aqueduct 521
13 webpalm 328
14 ArtiVC 285
15 Dataplane 186
16 guardian 134
17 pgsink 76
18 steampipe-postgres-fdw 61
19 steampipe-sqlite 44
20 rtdl 43
21 go-notebook 38
22 turbine-go 16
23 pippin 14

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com