Skip to content
Snippets Groups Projects
  1. Nov 28, 2018
  2. Nov 27, 2018
    • Yann Collet's avatar
      Merge pull request #1426 from lzutao/upgrade-mesonbuild · 74f8a5c5
      Yann Collet authored
      Update meson build system
      74f8a5c5
    • Lzu Tao's avatar
      Update meson build system · 9a721e52
      Lzu Tao authored
      NOTE: This commit only tested on Linux (Ubuntu 18.04). Windows
      build may not work as expected.
      
      * Use meson >= 0.47.0 cause we use install_man function
      * Add three helper Python script:
        * CopyFile.py: To copy file
        * CreateSymlink.py: To make symlink (both Windows and Unix)
        * GetZstdLibraryVersion.py: Parse lib/zstd.h to get zstd version
        These help emulating equivalent functions in CMake and Makefile.
      * Use subdir from meson to split meson.build
        * Add contrib build
        * Fix other build
      * Add new build options
        * build_programs: Enable programs build
        * build_contrib: Enable contrib build
        * build_tests: Enable tests build
        * use_static_runtime: Link to static run-time libraries on MSVC
        * zlib_support: Enable zlib support
        * lzma_support: Enable lzma support
      9a721e52
    • Lzu Tao's avatar
    • Lzu Tao's avatar
      Add meson build guide · 2abd5139
      Lzu Tao authored
      2abd5139
    • Yann Collet's avatar
      Merge pull request #1419 from ryandesign/universal · 64569a18
      Yann Collet authored
      Fix feature detection with multiple -arch flags
      64569a18
  3. Nov 16, 2018
  4. Nov 15, 2018
    • Nick Terrell's avatar
      Merge pull request #1416 from terrelln/rsync · f15f1bfe
      Nick Terrell authored
      - Factor out LDM's hash function for reuse
      - Add rsyncable mode to zstdmt and expose it via the advanced API
      - Fix `-B`/`--block-size` to actually set the job size
      - Add rsyncable tests to `zstreamtest` and `playTests.sh`
      
      Tested by:
      
      ```
      > cat A.100MB B.100MB C.100MB D.100MB E.100MB | zstd --rsyncable -fo src/file.zst
      /*stdin*\            : 48.22%   (524288000 => 252837782 bytes, src/file.zst)
      > rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test
      Total bytes sent: 252868779
      total size is 252837782  speedup is 1.00
      > echo test > test
      > cat test A.100MB test B.100MB test C.100MB test D.100MB test E.100MB | zstd --rsyncable -fo src/file.zst
      /*stdin*\            : 48.23%   (524288025 => 252838025 bytes, src/unicorn.tar.zst)
      > rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test
      Total bytes sent: 4605696
      total size is 252838025  speedup is 53.60
      ```
      
      Close #1155.
      f15f1bfe
    • Nick Terrell's avatar
      [tests] Add rsyncable tests · 71fe78cb
      Nick Terrell authored
      71fe78cb
    • Nick Terrell's avatar
      [cli] Set the job size · 43164094
      Nick Terrell authored
      43164094
    • Nick Terrell's avatar
      [cli] Add rsyncable · f9a671ac
      Nick Terrell authored
      f9a671ac
    • Nick Terrell's avatar
      [lib] Add rsyncable mode · b9693d3a
      Nick Terrell authored
      - Add rsyncable mode to multithreaded mode
      - Factor out LDM's hash function for reuse
      b9693d3a
  5. Nov 14, 2018
  6. Nov 13, 2018
  7. Nov 12, 2018
  8. Nov 09, 2018
    • Yann Collet's avatar
      Merge pull request #1411 from facebook/prefetch_dict · 7b0c551b
      Yann Collet authored
      Improves decompression speed when using cold dictionary
      7b0c551b
    • Yann Collet's avatar
      Merge pull request #1410 from facebook/prefetch_dec · 1b4a9c51
      Yann Collet authored
       improve long-range decoder speed
      1b4a9c51
    • Yann Collet's avatar
      Improves decompression speed when using cold dictionary · 483759a3
      Yann Collet authored
      by triggering the prefetching decoder path
      (which used to be dedicated to long-range offsets only).
      
      Figures on my laptop :
      no content prefetch : ~300 MB/s (for reference)
      full content prefetch : ~325 MB/s (before this patch)
      new prefetch path : ~375 MB/s (after this patch)
      
      The benchmark speed is already significant,
      but another side-effect is that this version
      prefetch less data into memory,
      since it only prefetches what's needed, instead of the full dictionary.
      
      This is supposed to help highly active environments
      such as active databases,
      that can't be properly measured in benchmark environment (too clean).
      
      Also :
      fixed the largeNbDict test program
      which was working improperly when setting nbBlocks > nbFiles.
      483759a3
  9. Nov 08, 2018
Loading