dedup

deduplicating backup program
git clone git://git.2f30.org/dedup.git
Log | Files | Refs | README | LICENSE

commit 08600b08eec99d0c6fce2749ade192cadd4a0ba5
parent af4f203b687f0d19bb16036c882fbf2dad994393
Author: sin <sin@2f30.org>
Date:   Thu, 16 May 2019 16:43:35 +0300

Explain the chunker a bit in the DESIGN document

Diffstat:
MDESIGN | 10+++++++++-
1 file changed, 9 insertions(+), 1 deletion(-)

diff --git a/DESIGN b/DESIGN @@ -51,4 +51,12 @@ block hashes of the data stored in the snapshot. The chunker interface --------------------- -TBD +The chunker issues variable length blocks. The minimum block size is +512KB, the maximum block size is 8MB and the average block size is +2MB. These configuration parameters can be modified by editing +config.h but it can be tricky to tune it properly. + +The buzhash[0] rolling hash algorithm is used to fingerprint the input +stream. + +[0] http://www.serve.net/buz/Notes.1st.year/HTML/C6/rand.012.html