Java Stream Processing

Open-source Java projects categorized as Stream Processing
Edit details
Topics: Java Kafka Big Data Real-time Distributed Applications
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 14 Java Stream Processing Projects

  • Hazelcast

    Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

    • Project mention: Does anyone know any good java implementations for distributed key-value store? | /r/ExperiencedDevs | 2023-06-08

    You're probably looking for Hazelcast here. Note that it does much more than just a distributed k/v, but it will get you where you need to go.

  • ksql

    The database purpose-built for stream processing applications.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    • Project mention: Getting Started with Flink SQL, Apache Iceberg and DynamoDB Catalog | dev.to | 2023-12-18

    Apache Iceberg is one of the three types of lakehouse, the other two are Apache Hudi and Delta Lake.

  • Siddhi

    Stream Processing and Complex Event Processing Engine

  • Hazelcast Jet

    Distributed Stream and Batch Processing

  • spring-cloud-dataflow

    A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

  • Smooks

    Extensible data integration Java framework for building XML and non-XML fragment-based applications

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • kafka-streams-in-action

    Source code for the Kafka Streams in Action Book

  • dagger

    Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data. (by raystack)

  • RemoteCodeCompiler

    An online code compiler supporting 11 programming languages (Java, Kotlin, Scala, C, C++, C#, Golang, Python, Ruby, Rust and Haskell) for competitive programming and coding interviews.

  • scotty-window-processor

    This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

    • Project mention: Implementing a “Lookback” Window Using Apache Flink’s KeyedProcessFunction | /r/RedditEng | 2023-10-10

    This concept is similar to a sliding window with a small step size, but with a more memory-efficient implementation. By using “slice sharing” instead of duplicating events into every overlapping window, the memory footprint is reduced. Scotty window processor is an open-source implementation of memory-efficient window aggregations with connectors for popular stream processors like Flink. This is a promising avenue for approximating a “lookback” window when aggregations like count, sum or histogram are required.

  • hash4j

    Dynatrace hash library for Java

  • kafka-streams-cassandra-state-store

    'Drop-in' Kafka Streams State Store implementation that persists data to Apache Cassandra / ScyllaDB

    • Project mention: Finished!! Live-Coding series on implementing ‘VersionedKeyValueStore’ for ‘kafka-streams-cassandra-state-store’ | /r/apachekafka | 2023-08-22

    The PR is ready. Feel welcome to review: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/27

  • Event-Meshinery

    A new Framework for asynchronous signaling of processes via Kafka/Mysql/anything.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Java Stream Processing related posts

  • Apache Pulsar VS quix-streams - a user suggested alternative

    2 projects | 7 Dec 2023

  • flink-statefun VS quix-streams - a user suggested alternative

    2 projects | 7 Dec 2023

  • beam VS quix-streams - a user suggested alternative

    2 projects | 7 Dec 2023

  • debezium VS quix-streams - a user suggested alternative

    2 projects | 7 Dec 2023

  • Seeking Feedback on Siddhi

    3 projects | /r/dataengineering | 13 Mar 2023

  • Supercharge your Kafka Clusters with Consumer Best Practices

    1 project | /r/programming | 12 Mar 2023

  • PranaDB

    2 projects | news.ycombinator.com | 28 Apr 2022
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 1 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Stream Processing projects in Java? This list will help you:

Project Stars
1 Hazelcast 5,931
2 ksql 5,843
3 hudi 5,136
4 Siddhi 1,501
5 Hazelcast Jet 1,091
6 spring-cloud-dataflow 1,078
7 Smooks 386
8 kafka-streams-in-action 259
9 dagger 257
10 RemoteCodeCompiler 135
11 scotty-window-processor 75
12 hash4j 77
13 kafka-streams-cassandra-state-store 20
14 Event-Meshinery 8

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com