Home - YADL/yadl GitHub Wiki

Welcome to the yadl wiki!

YADL "Yet Another Dedupe Library" is an attempt to have provide a common user space dedupe linux library for file/block/object storage systems. The goal is to provide a stream interface (read/write) to these storage systems so that they save their data in a de-duplicated format. YADL doesnot require any extra service it would run in the same process space of the consuming storage system, hence less management hassles. The consumer of YADL will be agnostic to how the data is deduped. Even though agnostic to the dedupe mechanism, the storage system would be responsible of storing and protecting the YADL Store (YADL Hash Store, YADL Block Store, YADL Metadata Catalog, YADL Config store and YADL Stub store). For the first few versions we are just having stand-alone library. As the project gets mature and stable, we will expand into distributed dedupe space i.e YADL-Ecosystem or simply YADL-E.