Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Java kafka-connect Projects
-
debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
-
langstream
LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka. (by LangStream)
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
kafka-connect-file-pulse
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
-
ksql-udf-deep-learning-mqtt-iot
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
-
-
-
-
kryptonite-for-kafka
Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project
-
-
-
-
kafka-connect-quickstart
Example project to play around with Apache Kafka Connect. There are examples to develop and deploy Kafka Connect plugins (connectors, transforms, etc.) from a Java Maven project.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10They manage data in the application layer and your original data stays where it is. This way data consistency is no longer an issue as it was with streaming databases. You can use Change Data Capture (CDC) services like Debezium by directly connecting to your primary database, doing computational work, and saving the result back or sending real-time data to output streams.
Project mention: Knative switchboard series, part 1. Setup Knative Eventing with Kafka from scratch, scale based on events volume, and monitor | dev.to | 2024-01-04Knative dashboards together with Kafka's dashboards it sheds light on almost any aspect of what's going on in the system.
Project mention: Difficulty configuring log4j when deploying code as plugin for an app | /r/CodingHelp | 2023-10-27I am working on a custom Kafka-Mongo sink connector (specifically, a custom WriteModelStrategy to be used with the official Mongo sink connector here: https://github.com/mongodb/mongo-kafka ). My code is not a standalone, executable Java application but rather a JAR that augments the functionality of another Java application.
Project mention: Show HN: Kafbat UI for Apache Kafka v1.0 is out | news.ycombinator.com | 2024-03-22
Project mention: Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀 | /r/apachekafka | 2023-09-15
Project mention: Saving Kafka headers as mongo fields with mongo sink connector | /r/dotnet | 2023-07-15But I get the following error: "MAP is not supported type", even though I'm sending as a string. Looking at the source code (https://github.com/jcustenborder/kafka-connect-transform-common/blob/master/src/main/java/com/github/jcustenborder/kafka/connect/transform/common/BaseTransformation.java) it blows at line 120, because it thinks it's Map type. I think the issue with this is because the header it not being correctly sent, because Azure EventHubs sends with Amqp protocol that adds a few bytes in the string...
Project mention: Dashdive (YC W23) – Track your cloud costs precisely | news.ycombinator.com | 2024-01-29We actually use Kafka rather than Kinesis, although they're very similar. For writing to ClickHouse from Kafka, we use the ClickHouse Kafka sink connector: https://github.com/ClickHouse/clickhouse-kafka-connect.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Java kafka-connect related posts
-
debezium VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023 -
How the heck do I validate records with this kind of data??
-
Difficulty configuring log4j when deploying code as plugin for an app
-
Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀
-
Managed Relational Databases with AWS RDS and Aurora
-
Postgresql to hadoop in real time
-
ClickHouse Advanced Tutorial: Apply CDC from MySQL to ClickHouse
-
A note from our sponsor - InfluxDB
www.influxdata.com | 19 May 2024
Index
What are some of the best open-source kafka-connect projects in Java? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | debezium | 9,933 |
| 2 | kafka-ui | 8,653 |
| 3 | ksql | 5,830 |
| 4 | strimzi-kafka-operator | 4,531 |
| 5 | kafka-connect-elasticsearch | 746 |
| 6 | langstream | 364 |
| 7 | kcctl | 353 |
| 8 | mongo-kafka | 325 |
| 9 | kafka-ui | 334 |
| 10 | kafka-connect-file-pulse | 305 |
| 11 | ksql-udf-deep-learning-mqtt-iot | 284 |
| 12 | kafka-connect-transform-common | 147 |
| 13 | clickhouse-kafka-connect | 131 |
| 14 | kafka-connect-twitter | 126 |
| 15 | snowflake-kafka-connector | 125 |
| 16 | jdbc-connector-for-apache-kafka | 81 |
| 17 | kryptonite-for-kafka | 78 |
| 18 | ns4kafka | 67 |
| 19 | gcs-connector-for-apache-kafka | 65 |
| 20 | kafka-connect-cosmosdb | 45 |
| 21 | connor | 27 |
| 22 | kafka-connect-quickstart | 23 |
| 23 | kafka-connect-transform-xml | 22 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com