Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 12 Java S3 Projects
-
cyberduck
Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
automq
AutoMQ is a cloud-native fork of Kafka by separating storage to S3. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.
-
S3Mock
A simple mock implementation of the AWS S3 API startable as Docker image, TestContainer, JUnit 4 rule, JUnit Jupiter extension or TestNG listener
-
rumble
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more (by RumbleDB)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
kafka-large-message-serde
A Kafka Serde that reads and writes records from and to Blob storage (S3, Azure, Google) transparently.
-
s3-stream-unzip
Lightweight Java library to manage unzipping of large files and data in AWS S3 without knowing the size beforehand and without keeping it all in memory or writing to disk.
Cyberduck: a cloud storage browser for Mac and Windows.
Project mention: Ask HN: AWS S3, Cloudflare R2, GCS, Wasabi, or B2? | news.ycombinator.com | 2024-04-01
I agree with your viewpoint. The crux of the matter is not whether to use tiered storage or not, but what trade-offs have been made in the specific storage architecture and what benefits have been gained. Here(https://github.com/AutoMQ/automq?tab=readme-ov-file#-automq-...) is a qualitative comparison chart of streaming systems including kafka/confluent/redpanda/warpstream/automq. This comparison chart does not have specific numerical comparisons, but purely based on their trade-offs at the storage level, I think this will be of some use to you.
Project mention: Ask HN: Is there any good open-source alternative to MinIO? | news.ycombinator.com | 2023-09-21
Java S3 related posts
-
Tiered storage won't fix Kafka
-
Streaming Platform Comparision:Kafka/Confluent/Pulsar/AutoMQ/Redpanda/Warpstream
-
Streaming Platform Comparision:Kafka/Confluent/Pulsar/AutoMQ/Redpanda/Warpstream
-
Show HN: AutoMQ – A Cost-Effective Kafka distro that can autoscale in seconds
-
Ask HN: AWS S3, Cloudflare R2, GCS, Wasabi, or B2?
-
Ask HN: Is there any good open-source alternative to MinIO?
-
Ask HN: P2P Databases?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 19 May 2024
Index
What are some of the best open-source S3 projects in Java? This list will help you:
Project | Stars | |
---|---|---|
1 | cyberduck | 3,001 |
2 | s3proxy | 1,607 |
3 | automq | 1,421 |
4 | S3Mock | 782 |
5 | ozone | 767 |
6 | rumble | 207 |
7 | fluency | 152 |
8 | kafka-large-message-serde | 52 |
9 | aws-java-nio-spi-for-s3 | 52 |
10 | beekeeper | 44 |
11 | s3-stream-unzip | 36 |
12 | delta-fetch | 1 |
Sponsored