C++ Filesystem

Open-source C++ projects categorized as Filesystem
Edit details
Topics: Fuse fuse-filesystem Linux CPP Cpp17
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 C++ Filesystem Projects

  • s3fs-fuse

    FUSE-based file system backed by Amazon S3

    • Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • react-native-fs

    Native filesystem access for react-native

    • Project mention: react-native-tvos with expo-file-system? | /r/reactnative | 2023-12-09

    Maybe https://github.com/itinance/react-native-fs would work? Or does TVOS even have a filesystem API?

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • mergerfs

    a featureful union filesystem

    • Project mention: Mergerfs – A Featureful Union Filesystem | news.ycombinator.com | 2024-04-26

  • btfs

    A bittorrent filesystem based on FUSE.

    • Project mention: BTFS (BitTorrent Filesystem) | news.ycombinator.com | 2024-04-15

  • dwarfs

    A fast high compression read-only file system for Linux, Windows and macOS

    • Project mention: DwarFS – The Deduplicating Warp-Speed Advanced Read-Only File System | news.ycombinator.com | 2024-04-11

    https://github.com/mhx/dwarfs/blob/main/doc/mkdwarfs.md#nils...

  • cryfs

    Cryptographic filesystem for the cloud

    • Project mention: Syncthing: Untrusted Device Encryption | news.ycombinator.com | 2023-12-07

    I know that cryfs[1] is resilient to at least the first of these, and possibly the second as well. I don't know if cryfs allows to modify the base directory while the filesystem is online, if it does then it might already be a better solution for syncthing, if you only care about Linux.

    On the flip side syncthing could incorporate cryfs's base directory format instead of their home-grown one.

    [1] https://www.cryfs.org/

  • apfs-fuse

    FUSE driver for APFS (Apple File System)

    • Project mention: I used to work for apple | /r/computer | 2023-06-03

    OR to attempt to recover data from the old drive, you can use a USB and boot into a Linux Live instance, install apfs-fuse to mount the partition if it is not encrypted. Here's a tutorial to boot into Ubuntu Live. And here is a link to the github repository for apfs-fuse.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • filesystem

    An implementation of C++17 std::filesystem for C++11 /C++14/C++17/C++20 on Windows, macOS, Linux and FreeBSD.

  • securefs

    Filesystem in userspace (FUSE) with transparent authenticated encryption

  • io

    Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO (by tensorflow)

    • Project mention: Has anyone gotten tensorflow_io to work on their M1 Mac? As far as I can tell there are no solutions. | /r/tensorflow | 2023-07-23

    Been stuck on this for days. The issue is mentioned in this year old thread, with multiple solutions that dont end up working. https://github.com/tensorflow/io/issues/1625 . If we're on Mac are we just SOL? Never encountered this type of problem before where you straight up cant work because your Mac is incompatible with the necessary software.

  • watcher

    Filesystem watcher. Works anywhere. Simple, efficient and friendly. (by e-dant)

  • sparsebundlefs

    FUSE filesystem for reading macOS sparse-bundle disk images

  • fatcat

    FAT filesystems explore, extract, repair, and forensic tool

  • hypergrep

    Recursively search directories for a regex pattern

    • Project mention: Ugrep – a more powerful, ultra fast, user-friendly, compatible grep | news.ycombinator.com | 2023-12-30

    Another issue with Hyperscan is that if you enable HS_FLAG_UTF8[1], which hypergrep does[2,3], and then search invalid UTF-8, then the result is UB.

    > This flag instructs Hyperscan to treat the pattern as a sequence of UTF-8 characters. The results of scanning invalid UTF-8 sequences with a Hyperscan library that has been compiled with one or more patterns using this flag are undefined.

    That's another issue you'll need to grapple with if you use Hyperscan. PCRE2 used to have this issue[4], but they've since defined the semantics of searching invalid UTF-8 with Unicode mode enabled. ripgrep 14 uses that new mode, but I haven't updated that FAQ answer yet.

    [1]: https://intel.github.io/hyperscan/dev-reference/api_files.ht...

    [2]: https://github.com/p-ranav/hypergrep/blob/ee85b713aa84e0050a...

    [3]: https://github.com/p-ranav/hypergrep/blob/ee85b713aa84e0050a...

    [4]: https://github.com/BurntSushi/ripgrep/blob/master/FAQ.md#why...

  • fuse-archive

    FUSE file system for archives and compressed files (ZIP, RAR, 7Z, ISO, TGZ, XZ...)

  • mount-zip

    FUSE file system for ZIP archives

    • Project mention: Nextcloud alternative with less file number overhead | /r/DataHoarder | 2023-07-03

    there's a project from Google called mount-zip where you can mount zips (and it actually works really well even with 1TB zips)

  • loggedfs

    LoggedFS - Filesystem monitoring with Fuse

  • 11Zip

    Dead simple zipping / unzipping C++ Lib

  • MaslOS

    Masl OS

  • Katalog

    Katalog is an application to manage catalogs of disks and files to search and get statistics.

  • WinFsp-MemFs-Extended

    tmpfs for Windows / Fully dynamic RAM disk by extending WinFsp's memfs to be variable size and maximally resource efficient without compromising performance

    • Project mention: Tmpfs for Windows / Memefs | news.ycombinator.com | 2023-12-04

  • psfiles

    A CLI tool to monitor file system activity of a Linux process

    • Project mention: FLaNK Stack 26 February 2024 | dev.to | 2024-02-26

  • tff

    Terminal File Finder Written In C++

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Filesystem related posts

Index

What are some of the best open-source Filesystem projects in C++? This list will help you:

Project Stars
1 s3fs-fuse 8,122
2 react-native-fs 4,890
3 mergerfs 3,904
4 btfs 3,832
5 dwarfs 1,990
6 cryfs 1,947
7 apfs-fuse 1,664
8 filesystem 1,284
9 securefs 708
10 io 690
11 watcher 629
12 sparsebundlefs 310
13 fatcat 286
14 hypergrep 163
15 fuse-archive 133
16 mount-zip 120
17 loggedfs 110
18 11Zip 89
19 MaslOS 86
20 Katalog 58
21 WinFsp-MemFs-Extended 44
22 psfiles 39
23 tff 4

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com