Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 9 Go Posix Projects
-
seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
You can visit the official website for more information on using Cobra: Cobra Documentation
> When it gets too out of hand, people will paper it over with a new, simpler abstraction layer, and the process starts again, only with a layer of garbage spaghetti underneath.
I'm pretty happy that there are S3 compatible stores that you can host yourself, that aren't insanely complex.
MinIO: https://min.io/
SeaweedFS: https://github.com/seaweedfs/seaweedfs (this one's particularly nice and is permissively licensed, in contrast to everything else)
There was also Zenko, but I don't think they gained a lot of traction for the most part: https://www.zenko.io/
Of course, many will prefer hosted/managed solutions and that's perfectly fine, but at least when you run software yourself, you are more in control over it and for the most part can also make the judgement on how hard it is to operate and keep operational (e.g. similar to what you'd experience when running PostgreSQL/MariaDB/MySQL or trying to run Oracle).
Project mention: Low-Cost Read/Write Separation: Jerry Builds a Primary-Replica ClickHouse Architecture | dev.to | 2024-05-30To solve our pain points, we chose JuiceFS due to the following reasons:
* The shell itself is https://github.com/mvdan/sh, a bash-like command interpreter
The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).
Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.
So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that
Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX
That's why the blog post has the following links to POSIX-on-top-of-S3-objects :
https://github.com/s3fs-fuse/s3fs-fuse
https://github.com/kahing/goofys
https://www.cuno.io/
Project mention: Ask HN: What distributed file system would you use in 2024? | news.ycombinator.com | 2024-05-10
Go Posix related posts
-
Ask HN: What distributed file system would you use in 2024?
-
Google Cloud Storage FUSE
-
An open-source distributed object storage service
-
Migrating instance to AWS GovCloud
-
Looking for libraries ideas to develop
-
How should I go about creating a program that holds various MP4 files?
-
Massive widespread malware attack on GitHub
-
A note from our sponsor - InfluxDB
www.influxdata.com | 3 Jun 2024
Index
What are some of the best open-source Posix projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | cobra | 36,384 |
2 | seaweedfs | 21,385 |
3 | juicefs | 9,905 |
4 | sh | 6,886 |
5 | goofys | 5,065 |
6 | kapow | 591 |
7 | juicefs-csi-driver | 195 |
8 | cmdr | 132 |
9 | fil | 89 |
Sponsored