Merge pull request #1416 from terrelln/rsync
- Factor out LDM's hash function for reuse - Add rsyncable mode to zstdmt and expose it via the advanced API - Fix `-B`/`--block-size` to actually set the job size - Add rsyncable tests to `zstreamtest` and `playTests.sh` Tested by: ``` > cat A.100MB B.100MB C.100MB D.100MB E.100MB | zstd --rsyncable -fo src/file.zst /*stdin*\ : 48.22% (524288000 => 252837782 bytes, src/file.zst) > rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test Total bytes sent: 252868779 total size is 252837782 speedup is 1.00 > echo test > test > cat test A.100MB test B.100MB test C.100MB test D.100MB test E.100MB | zstd --rsyncable -fo src/file.zst /*stdin*\ : 48.23% (524288025 => 252838025 bytes, src/unicorn.tar.zst) > rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test Total bytes sent: 4605696 total size is 252838025 speedup is 53.60 ``` Close #1155.
No related branches found
No related tags found
Showing
- lib/compress/zstd_compress.c 17 additions, 1 deletionlib/compress/zstd_compress.c
- lib/compress/zstd_compress_internal.h 59 additions, 0 deletionslib/compress/zstd_compress_internal.h
- lib/compress/zstd_ldm.c 7 additions, 57 deletionslib/compress/zstd_ldm.c
- lib/compress/zstd_ldm.h 0 additions, 4 deletionslib/compress/zstd_ldm.h
- lib/compress/zstdmt_compress.c 112 additions, 17 deletionslib/compress/zstdmt_compress.c
- lib/compress/zstdmt_compress.h 2 additions, 1 deletionlib/compress/zstdmt_compress.h
- lib/zstd.h 21 additions, 0 deletionslib/zstd.h
- programs/fileio.c 8 additions, 0 deletionsprograms/fileio.c
- programs/fileio.h 1 addition, 0 deletionsprograms/fileio.h
- programs/zstd.1.md 8 additions, 0 deletionsprograms/zstd.1.md
- programs/zstdcli.c 5 additions, 1 deletionprograms/zstdcli.c
- tests/playTests.sh 6 additions, 0 deletionstests/playTests.sh
- tests/zstreamtest.c 2 additions, 0 deletionstests/zstreamtest.c
Loading
Please register or sign in to comment