Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Go Data Projects
-
flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Stats
A well tested and comprehensive Golang statistics library package with no dependencies. (by montanaflynn)
-
incubator-devlake
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
rill
Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code. (by rilldata)
-
aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure. (by RunLLM)
-
Dataplane
Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
-
guardian
Guardian is universal data access management tool with automated access workflows and security controls across data stores, analytical systems, and cloud products. (by raystack)
-
steampipe-postgres-fdw
The Steampipe foreign data wrapper (FDW) is a zero-ETL product that provides Postgres foreign tables which translate queries into API calls to cloud services and APIs. It's bundled with Steampipe and also available as a set of standalone extensions for use in your own Postgres database.
-
steampipe-sqlite
Steampipe SQLite is a zero-ETL engine for SQLite. Virtual tables translate queries into live API calls for cloud services and APIs. Hundreds of plugins with thousands of documented examples.
-
amplify
Bacalhau Amplify: automatic enrichment, enhancement, and explanation of your data (by bacalhau-project)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: We might want to regularly keep track of how important each server is | news.ycombinator.com | 2024-02-06Check out CloudQuery - https://github.com/cloudquery/cloudquery for an easy cloud asset inventory.
9. Flyte by Union AI | Github | tutorial
Project mention: TypeSpec: A New Language for API-Centric Development | news.ycombinator.com | 2024-04-29If you are in a situation where you have a backend and you want to expose an API and then you would eventually want a client, you would need format specs as the starting point where server and clients are generated from that one source.
At the moment, OpenAPI with YAML is the only way to go but you can't easily split the spec into separate files as you would do any program with packages, modules and what not.
There are third party tools[0] which are archived and the libraries they depend upon are up for adoption.
In that space, either you can use something like cue language 1] or something like TypeSpec which is purpose built for this so yet, this seems like a great tool although I have not tried it yet myself.
[0]. https://github.com/APIDevTools/swagger-cli
[1]. https://cuelang.org/
EDIT: formating
You can learn more about fly.io and tigris, we will need to create an account on both platforms for this project regardless. Anyway with the theory out of the way let's get started in the next section as we create our accounts and start building the app.
Project mention: Steampipe SQLite – Virtual tables translated for common APIs | news.ycombinator.com | 2023-12-20
Project mention: Go concurrency simplified. Part 4: Post office as a data pipeline | dev.to | 2023-12-21take a look at the concurrent code written by other devs out there: for example, feel free to check the internals of my library Pippin, but I bet there are many better projects out there to learn from - Google/Bing/DuckDuckGo/Kagi and ChatGPT can help to find the right one
Project mention: Jupyter Lab Extension to run your GPU-heavy stuff (for free for now) on somebody's else server without blocking yours | /r/datascience | 2023-09-22When using Jupyter Lab and running GPU-heavy notebooks are you annoyed that your computer is not usable for anything else? I made an extension which allows you to run complex AI inference, training,... remotely on decentralized servers [see bacalhau.org]. This allows you to work on multiple GPU-heavy notebooks in parallel. For now Bacalhau is free, so this is a really cool way to run GPU stuff.
Go Data related posts
-
How to use fly.io and Tigris to deploy a Next.js app
-
Tigris: Globally Distributed S3-Compatible Object Storage
-
TySON: TypeScript Object Notation
-
TySON (TypeScript Object Notation)
-
Go concurrency simplified. Part 1: Channels and goroutines
-
Migrate mongodb Datawarehouse to snowflake
-
Lua is a viable alternative for JSON
-
A note from our sponsor - InfluxDB
www.influxdata.com | 2 May 2024
Index
What are some of the best open-source Data projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | cloudquery | 5,584 |
2 | flyte | 4,761 |
3 | cue | 4,765 |
4 | gofakeit | 4,218 |
5 | memphis | 3,149 |
6 | Stats | 2,885 |
7 | incubator-devlake | 2,430 |
8 | rill | 1,348 |
9 | tigris | 885 |
10 | finance-go | 683 |
11 | tyson | 531 |
12 | aqueduct | 521 |
13 | ArtiVC | 285 |
14 | Dataplane | 184 |
15 | guardian | 134 |
16 | pgsink | 76 |
17 | steampipe-postgres-fdw | 61 |
18 | rtdl | 43 |
19 | steampipe-sqlite | 44 |
20 | go-notebook | 38 |
21 | turbine-go | 16 |
22 | pippin | 14 |
23 | amplify | 10 |
Sponsored