Rust Spark

Open-source Rust projects categorized as Spark
Edit details
Topics: Rust SQL datafusion Big Data Kubernetes
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 5 Rust Spark Projects

  • risingwave

    SQL stream processing, analytics, and management. We decouple storage and compute to offer instant failover, dynamic scaling, speedy bootstrapping, and efficient joins.

    • Project mention: Proton, a fast and lightweight alternative to Apache Flink | news.ycombinator.com | 2024-01-30

    How does this compare to RisingWave and Materialize?

    https://github.com/risingwavelabs/risingwave

  • blaze

    Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core. (by kwai)

    • Project mention: DataFusion Comet: Apache Spark Accelerator | news.ycombinator.com | 2024-05-31

    I've been keeping an eye on these kinds of Spark accelerator libraries for a while now.

    How does it compare to Blaze[1] and Gluten[2]?

    I'm interested in running some benchmarks soon against all three for my project to see how they all go.

    [1] https://github.com/kwai/blaze

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • datafusion-comet

    Apache DataFusion Comet Spark Accelerator

    • Project mention: DataFusion Comet: Apache Spark Accelerator | news.ycombinator.com | 2024-05-31

  • kamu-cli

    New generation decentralized data lake and a streaming data pipeline

  • databricks-kube-operator

    A Kubernetes operator to enable GitOps style deploys for Databricks resources

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Spark related posts

  • DataFusion Comet: Apache Spark Accelerator

    4 projects | news.ycombinator.com | 31 May 2024

  • Apache Arrow DataFusion Comet Spark Accelerator

    1 project | news.ycombinator.com | 7 Mar 2024

  • Show HN: SQL Polyglot

    4 projects | news.ycombinator.com | 16 Dec 2023

  • Ideas/Suggestions around setting up a data pipeline from scratch

    3 projects | /r/dataengineering | 9 Jun 2023

  • biobear -- python package with minimal dependencies for bioinformatic file parsing and querying using rust and polars as the backend

    5 projects | /r/bioinformatics | 24 Apr 2023

  • Apache Iceberg-based opensource analytics stack demo

    2 projects | /r/bigdata | 6 Feb 2023

  • Kami CLI: Git for data, decentralized data warehouse, P2P stream processing

    1 project | news.ycombinator.com | 3 Feb 2022
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 1 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Spark projects in Rust? This list will help you:

Project Stars
1 risingwave 6,407
2 blaze 914
3 datafusion-comet 461
4 kamu-cli 280
5 databricks-kube-operator 14

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com