45 Open Source Distributed Storage Software Projects
Free and open source distributed storage code projects including engines, APIs, generators, and tools.
Seaweedfs 13640 ⭐
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Braft 3023 ⭐
An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.
Storj 2173 ⭐
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
Moosefs 1202 ⭐
MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Vasto 231 ⭐
A distributed key-value store. On Disk. Able to grow or shrink without service interruption.
Sfs 81 ⭐
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
Kertish Dfs 87 ⭐
Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.
Layr 89 ⭐
A decentralized (p2p) file storage system built atop Kademlia DHT that enforces data integrity, privacy, and availability through sharding, proofs of retrievability, redundancy, and encryption, with smart-contract powered incentive scheme
Wenweihu86 Distkv 47 ⭐
Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.
Filestorage.js 25 ⭐
Filestorage.js is client library for SKALE sidechain decentralized file storage. Used to transfer files between a browser and a SKALE sidechain.
Oaklight Vesper 37 ⭐
A fault-tolerant distributed key-value store using the Raft consensus algorithm.
Ariaddna 15 ⭐
Web services and desktop application management strategy to use available space in the public cloud available to the user. It provides a single point of connection to the massive clouds GoogleDrive, iCloud, DropBox, Box, OneDrive in version 1.0 and clouds for developers Amazone S3, Azure, OpenStack Swift in version 2.0. User web service will be able to set strategy for the use of space: the mirroring of files, the sum of the space, clouds priority for the use and combination of these strategies. Desktop applications installed on your computer (Windows, Mac OS X, Linux) version 1.0 and mobile app in version 2.0, will provide selective synchronization of generalized storage space in the clouds with local storage.
Cortx 536 ⭐
CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.
Eclipse Zenoh Zenoh 354 ⭐
zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.
Good Karma Kit 132 ⭐
😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...
Deepfabric Beehive 97 ⭐
Fundamental Building Block for Elastic Storage With Strong Consistency and Reliability
Flowerinthenight Hedge 21 ⭐
A distributed systems library for Kubernetes deployments built on top of spindle and Cloud Spanner.
Dtc8 Dtc 20 ⭐
DTC is a high performance Distributed Table Cache system designed by JD.com that offering hotspot data cache for databases in order to reduce pressure of database and promote QPS zoom. 京东自研的高性能分布式表级缓存系统，为数据库提供热点数据缓存，减少数据库的访问压力，提高请求查询效率。