35 Open Source Distributed Storage Software Projects
Free and open source distributed storage code projects including engines, APIs, generators, and tools.
Seaweedfs 10789 ⭐
SeaweedFS is a distributed object store and file system to store and serve billions of files fast! Object store has O(1) disk seek, transparent cloud integration. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.
Braft 2259 ⭐
An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.
Storj 1140 ⭐
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
Moosefs 935 ⭐
MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System
Vasto 195 ⭐
A distributed key-value store. On Disk. Able to grow or shrink without service interruption.
Sfs 77 ⭐
The distributed object storage server used by PitchPoint Solutions to securely store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index.
Kertish Dfs 72 ⭐
Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.
Layr 62 ⭐
A decentralized (p2p) file storage system built atop Kademlia DHT that enforces data integrity, privacy, and availability through sharding, proofs of retrievability, redundancy, and encryption, with smart-contract powered incentive scheme
Wenweihu86 Distkv 40 ⭐
Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.
Filestorage.js 22 ⭐
Filestorage.js is client library for SKALE sidechain decentralized file storage. Used to transfer files between a browser and a SKALE sidechain.
Oaklight Vesper 18 ⭐
A fault-tolerant distributed key-value store using the Raft consensus algorithm.
Ariaddna 11 ⭐
Web services and desktop application management strategy to use available space in the public cloud available to the user. It provides a single point of connection to the massive clouds GoogleDrive, iCloud, DropBox, Box, OneDrive in version 1.0 and clouds for developers Amazone S3, Azure, OpenStack Swift in version 2.0. User web service will be able to set strategy for the use of space: the mirroring of files, the sum of the space, clouds priority for the use and combination of these strategies. Desktop applications installed on your computer (Windows, Mac OS X, Linux) version 1.0 and mobile app in version 2.0, will provide selective synchronization of generalized storage space in the clouds with local storage.