Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 13 Rust Arrow Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Python's Substrait seems like the biggest/most-used competitor-ish out there. I'd love some compare & contrast; my sense is that Substrait has a smaller ambition, and more wants to be a language for talking about execution rather than a full on execution engine. https://github.com/substrait-io/substrait
We can also see from the DataFusion discussion that they too see themselves as a bit of a Velox competitor. https://github.com/apache/arrow-datafusion/discussions/6441
Project mention: Full-fledged APIs for slowly moving datasets without writing code | news.ycombinator.com | 2023-10-25
But why. Just ditch Spark and use https://github.com/apache/datafusion-ballista directly.
Fulcrum | Software Engineer | London or New York | ONSITE | Full-Time
Fulcrum is building next generation storage platform for diverse data of the future. We believe users will need to process non tabular and tabular data together and we need to develop new methods to support them.
We develop Vortex (our core storage primitive) in the open https://github.com/spiraldb/vortex and currently are looking to hire more people to our 5 person team to help build our product.
Tech: Rust, Python, Zig
Reach out to me at hn[at]fulcrum[dot]so
Rust Arrow related posts
-
DataFusion Comet: Apache Spark Accelerator
-
Velox: Meta's Unified Execution Engine [pdf]
-
Apache Arrow DataFusion Comet Spark Accelerator
-
Why Python's Integer Division Floors (2010)
-
Transforming Postgres into a Fast OLAP Database
-
Polars
-
Polars 0.20 Released
-
A note from our sponsor - InfluxDB
www.influxdata.com | 1 Jun 2024
Index
What are some of the best open-source Arrow projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | polars | 26,779 |
2 | datafusion | 5,266 |
3 | roapi | 3,105 |
4 | datafusion-ballista | 1,327 |
5 | parquet-wasm | 476 |
6 | datafusion-comet | 461 |
7 | duckdb-rs | 384 |
8 | pqrs | 257 |
9 | biobear | 133 |
10 | s2protocol-rs | 101 |
11 | fastexcel | 74 |
12 | myval | 61 |
13 | vortex | 48 |
Sponsored