#fastcdc

An implementation of the FastCDC algorithm for content-defined chunking.

FastCDC builds on the Gear-based CDC function with the following improvements.

1. simplified and enhanced hash judgement;
2. sub-minimum chunk cut-point skipping; and
3. normalized chunking.

For more details, sett the FastCDC [1] paper which this implementation is based on.

#References

• [1] Wen Xia, Yukon Zhou, Dan Feng, Yu Hua, Yuchong Hu, Yucheng Zhang, and Qing Liu. “FastCDC: A Fast and Efficient Content-Defined Chunking Approach for Data Deduplication” USENIX ATC’16, June 2016, 101–14. DOI 10.5555/3026959.3026969.