Date: Sat, 15 Apr 2017 19:47:17 +0000 (UTC) From: Baptiste Daroussin <bapt@FreeBSD.org> To: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-vendor@freebsd.org Subject: svn commit: r316975 - in vendor/zstd: . dist dist/build dist/build/VS2005 dist/build/VS2005/fullbench dist/build/VS2005/fuzzer dist/build/VS2005/zstd dist/build/VS2005/zstdlib dist/build/VS2008 dis... Message-ID: <201704151947.v3FJlHl4094446@repo.freebsd.org>
next in thread | raw e-mail | index | archive | help
Author: bapt Date: Sat Apr 15 19:47:16 2017 New Revision: 316975 URL: https://svnweb.freebsd.org/changeset/base/316975 Log: Import zstd 1.1.4 Added: vendor/zstd/ vendor/zstd/dist/ vendor/zstd/dist/.buckconfig vendor/zstd/dist/.buckversion vendor/zstd/dist/.gitattributes vendor/zstd/dist/.gitignore vendor/zstd/dist/.travis.yml vendor/zstd/dist/CONTRIBUTING.md vendor/zstd/dist/LICENSE vendor/zstd/dist/LICENSE-examples vendor/zstd/dist/Makefile (contents, props changed) vendor/zstd/dist/NEWS vendor/zstd/dist/PATENTS vendor/zstd/dist/README.md vendor/zstd/dist/TESTING.md vendor/zstd/dist/appveyor.yml vendor/zstd/dist/build/ vendor/zstd/dist/build/.gitignore vendor/zstd/dist/build/README.md vendor/zstd/dist/build/VS2005/ vendor/zstd/dist/build/VS2005/fullbench/ vendor/zstd/dist/build/VS2005/fullbench/fullbench.vcproj vendor/zstd/dist/build/VS2005/fuzzer/ vendor/zstd/dist/build/VS2005/fuzzer/fuzzer.vcproj vendor/zstd/dist/build/VS2005/zstd/ vendor/zstd/dist/build/VS2005/zstd.sln vendor/zstd/dist/build/VS2005/zstd/zstd.vcproj vendor/zstd/dist/build/VS2005/zstdlib/ vendor/zstd/dist/build/VS2005/zstdlib/zstdlib.vcproj vendor/zstd/dist/build/VS2008/ vendor/zstd/dist/build/VS2008/fullbench/ vendor/zstd/dist/build/VS2008/fullbench/fullbench.vcproj vendor/zstd/dist/build/VS2008/fuzzer/ vendor/zstd/dist/build/VS2008/fuzzer/fuzzer.vcproj vendor/zstd/dist/build/VS2008/zstd/ vendor/zstd/dist/build/VS2008/zstd.sln vendor/zstd/dist/build/VS2008/zstd/zstd.vcproj vendor/zstd/dist/build/VS2008/zstdlib/ vendor/zstd/dist/build/VS2008/zstdlib/zstdlib.vcproj vendor/zstd/dist/build/VS2010/ vendor/zstd/dist/build/VS2010/CompileAsCpp.props vendor/zstd/dist/build/VS2010/datagen/ vendor/zstd/dist/build/VS2010/datagen/datagen.vcxproj vendor/zstd/dist/build/VS2010/fullbench/ vendor/zstd/dist/build/VS2010/fullbench-dll/ vendor/zstd/dist/build/VS2010/fullbench-dll/fullbench-dll.vcxproj vendor/zstd/dist/build/VS2010/fullbench/fullbench.vcxproj vendor/zstd/dist/build/VS2010/fuzzer/ vendor/zstd/dist/build/VS2010/fuzzer/fuzzer.vcxproj vendor/zstd/dist/build/VS2010/libzstd/ vendor/zstd/dist/build/VS2010/libzstd-dll/ vendor/zstd/dist/build/VS2010/libzstd-dll/libzstd-dll.rc vendor/zstd/dist/build/VS2010/libzstd-dll/libzstd-dll.vcxproj vendor/zstd/dist/build/VS2010/libzstd/libzstd.vcxproj vendor/zstd/dist/build/VS2010/zstd/ vendor/zstd/dist/build/VS2010/zstd.sln vendor/zstd/dist/build/VS2010/zstd/zstd.rc vendor/zstd/dist/build/VS2010/zstd/zstd.vcxproj vendor/zstd/dist/build/VS_scripts/ vendor/zstd/dist/build/VS_scripts/README.md vendor/zstd/dist/build/VS_scripts/build.VS2010.cmd vendor/zstd/dist/build/VS_scripts/build.VS2012.cmd vendor/zstd/dist/build/VS_scripts/build.VS2013.cmd vendor/zstd/dist/build/VS_scripts/build.VS2015.cmd vendor/zstd/dist/build/VS_scripts/build.generic.cmd vendor/zstd/dist/build/cmake/ vendor/zstd/dist/build/cmake/.gitignore vendor/zstd/dist/build/cmake/CMakeLists.txt (contents, props changed) vendor/zstd/dist/build/cmake/CMakeModules/ vendor/zstd/dist/build/cmake/CMakeModules/AddExtraCompilationFlags.cmake vendor/zstd/dist/build/cmake/cmake_uninstall.cmake.in (contents, props changed) vendor/zstd/dist/build/cmake/contrib/ vendor/zstd/dist/build/cmake/contrib/CMakeLists.txt (contents, props changed) vendor/zstd/dist/build/cmake/contrib/pzstd/ vendor/zstd/dist/build/cmake/contrib/pzstd/CMakeLists.txt (contents, props changed) vendor/zstd/dist/build/cmake/lib/ vendor/zstd/dist/build/cmake/lib/CMakeLists.txt (contents, props changed) vendor/zstd/dist/build/cmake/programs/ vendor/zstd/dist/build/cmake/programs/.gitignore vendor/zstd/dist/build/cmake/programs/CMakeLists.txt (contents, props changed) vendor/zstd/dist/build/cmake/tests/ vendor/zstd/dist/build/cmake/tests/.gitignore vendor/zstd/dist/build/cmake/tests/CMakeLists.txt (contents, props changed) vendor/zstd/dist/circle.yml vendor/zstd/dist/contrib/ vendor/zstd/dist/contrib/gen_html/ vendor/zstd/dist/contrib/gen_html/.gitignore vendor/zstd/dist/contrib/gen_html/Makefile (contents, props changed) vendor/zstd/dist/contrib/gen_html/README.md vendor/zstd/dist/contrib/gen_html/gen-zstd-manual.sh (contents, props changed) vendor/zstd/dist/contrib/gen_html/gen_html.cpp (contents, props changed) vendor/zstd/dist/contrib/meson/ vendor/zstd/dist/contrib/meson/README vendor/zstd/dist/contrib/meson/meson.build vendor/zstd/dist/contrib/meson/meson_options.txt (contents, props changed) vendor/zstd/dist/contrib/pzstd/ vendor/zstd/dist/contrib/pzstd/.gitignore vendor/zstd/dist/contrib/pzstd/BUCK vendor/zstd/dist/contrib/pzstd/ErrorHolder.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/Logging.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/Makefile (contents, props changed) vendor/zstd/dist/contrib/pzstd/Options.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/Options.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/Pzstd.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/Pzstd.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/README.md vendor/zstd/dist/contrib/pzstd/SkippableFrame.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/SkippableFrame.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/images/ vendor/zstd/dist/contrib/pzstd/images/Cspeed.png (contents, props changed) vendor/zstd/dist/contrib/pzstd/images/Dspeed.png (contents, props changed) vendor/zstd/dist/contrib/pzstd/main.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/test/ vendor/zstd/dist/contrib/pzstd/test/BUCK vendor/zstd/dist/contrib/pzstd/test/OptionsTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/test/PzstdTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/test/RoundTrip.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/test/RoundTripTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/ vendor/zstd/dist/contrib/pzstd/utils/BUCK vendor/zstd/dist/contrib/pzstd/utils/Buffer.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/FileSystem.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/Likely.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/Range.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/ResourcePool.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/ScopeGuard.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/ThreadPool.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/WorkQueue.h (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/ vendor/zstd/dist/contrib/pzstd/utils/test/BUCK vendor/zstd/dist/contrib/pzstd/utils/test/BufferTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/RangeTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/ResourcePoolTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/ScopeGuardTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/ThreadPoolTest.cpp (contents, props changed) vendor/zstd/dist/contrib/pzstd/utils/test/WorkQueueTest.cpp (contents, props changed) vendor/zstd/dist/doc/ vendor/zstd/dist/doc/README.md vendor/zstd/dist/doc/educational_decoder/ vendor/zstd/dist/doc/educational_decoder/README.md vendor/zstd/dist/doc/educational_decoder/harness.c (contents, props changed) vendor/zstd/dist/doc/educational_decoder/zstd_decompress.c (contents, props changed) vendor/zstd/dist/doc/educational_decoder/zstd_decompress.h (contents, props changed) vendor/zstd/dist/doc/images/ vendor/zstd/dist/doc/images/Cspeed4.png (contents, props changed) vendor/zstd/dist/doc/images/DCspeed5.png (contents, props changed) vendor/zstd/dist/doc/images/Dspeed4.png (contents, props changed) vendor/zstd/dist/doc/images/dict-cr.png (contents, props changed) vendor/zstd/dist/doc/images/dict-cs.png (contents, props changed) vendor/zstd/dist/doc/images/dict-ds.png (contents, props changed) vendor/zstd/dist/doc/zstd_compression_format.md vendor/zstd/dist/doc/zstd_manual.html (contents, props changed) vendor/zstd/dist/examples/ vendor/zstd/dist/examples/.gitignore vendor/zstd/dist/examples/Makefile (contents, props changed) vendor/zstd/dist/examples/README.md vendor/zstd/dist/examples/dictionary_compression.c (contents, props changed) vendor/zstd/dist/examples/dictionary_decompression.c (contents, props changed) vendor/zstd/dist/examples/multiple_streaming_compression.c (contents, props changed) vendor/zstd/dist/examples/simple_compression.c (contents, props changed) vendor/zstd/dist/examples/simple_decompression.c (contents, props changed) vendor/zstd/dist/examples/streaming_compression.c (contents, props changed) vendor/zstd/dist/examples/streaming_decompression.c (contents, props changed) vendor/zstd/dist/lib/ vendor/zstd/dist/lib/.gitignore vendor/zstd/dist/lib/BUCK vendor/zstd/dist/lib/Makefile (contents, props changed) vendor/zstd/dist/lib/README.md vendor/zstd/dist/lib/common/ vendor/zstd/dist/lib/common/bitstream.h (contents, props changed) vendor/zstd/dist/lib/common/entropy_common.c (contents, props changed) vendor/zstd/dist/lib/common/error_private.c (contents, props changed) vendor/zstd/dist/lib/common/error_private.h (contents, props changed) vendor/zstd/dist/lib/common/fse.h (contents, props changed) vendor/zstd/dist/lib/common/fse_decompress.c (contents, props changed) vendor/zstd/dist/lib/common/huf.h (contents, props changed) vendor/zstd/dist/lib/common/mem.h (contents, props changed) vendor/zstd/dist/lib/common/pool.c (contents, props changed) vendor/zstd/dist/lib/common/pool.h (contents, props changed) vendor/zstd/dist/lib/common/threading.c (contents, props changed) vendor/zstd/dist/lib/common/threading.h (contents, props changed) vendor/zstd/dist/lib/common/xxhash.c (contents, props changed) vendor/zstd/dist/lib/common/xxhash.h (contents, props changed) vendor/zstd/dist/lib/common/zstd_common.c (contents, props changed) vendor/zstd/dist/lib/common/zstd_errors.h (contents, props changed) vendor/zstd/dist/lib/common/zstd_internal.h (contents, props changed) vendor/zstd/dist/lib/compress/ vendor/zstd/dist/lib/compress/fse_compress.c (contents, props changed) vendor/zstd/dist/lib/compress/huf_compress.c (contents, props changed) vendor/zstd/dist/lib/compress/zstd_compress.c (contents, props changed) vendor/zstd/dist/lib/compress/zstd_opt.h (contents, props changed) vendor/zstd/dist/lib/compress/zstdmt_compress.c (contents, props changed) vendor/zstd/dist/lib/compress/zstdmt_compress.h (contents, props changed) vendor/zstd/dist/lib/decompress/ vendor/zstd/dist/lib/decompress/huf_decompress.c (contents, props changed) vendor/zstd/dist/lib/decompress/zstd_decompress.c (contents, props changed) vendor/zstd/dist/lib/deprecated/ vendor/zstd/dist/lib/deprecated/zbuff.h (contents, props changed) vendor/zstd/dist/lib/deprecated/zbuff_common.c (contents, props changed) vendor/zstd/dist/lib/deprecated/zbuff_compress.c (contents, props changed) vendor/zstd/dist/lib/deprecated/zbuff_decompress.c (contents, props changed) vendor/zstd/dist/lib/dictBuilder/ vendor/zstd/dist/lib/dictBuilder/cover.c (contents, props changed) vendor/zstd/dist/lib/dictBuilder/divsufsort.c (contents, props changed) vendor/zstd/dist/lib/dictBuilder/divsufsort.h (contents, props changed) vendor/zstd/dist/lib/dictBuilder/zdict.c (contents, props changed) vendor/zstd/dist/lib/dictBuilder/zdict.h (contents, props changed) vendor/zstd/dist/lib/dll/ vendor/zstd/dist/lib/dll/example/ vendor/zstd/dist/lib/dll/example/Makefile (contents, props changed) vendor/zstd/dist/lib/dll/example/README.md vendor/zstd/dist/lib/dll/example/build_package.bat vendor/zstd/dist/lib/dll/example/fullbench-dll.sln vendor/zstd/dist/lib/dll/example/fullbench-dll.vcxproj vendor/zstd/dist/lib/dll/libzstd.def vendor/zstd/dist/lib/legacy/ vendor/zstd/dist/lib/legacy/zstd_legacy.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v01.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v01.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v02.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v02.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v03.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v03.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v04.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v04.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v05.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v05.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v06.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v06.h (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v07.c (contents, props changed) vendor/zstd/dist/lib/legacy/zstd_v07.h (contents, props changed) vendor/zstd/dist/lib/libzstd.pc.in (contents, props changed) vendor/zstd/dist/lib/zstd.h (contents, props changed) vendor/zstd/dist/programs/ vendor/zstd/dist/programs/.gitignore vendor/zstd/dist/programs/BUCK vendor/zstd/dist/programs/Makefile (contents, props changed) vendor/zstd/dist/programs/README.md vendor/zstd/dist/programs/bench.c (contents, props changed) vendor/zstd/dist/programs/bench.h (contents, props changed) vendor/zstd/dist/programs/datagen.c (contents, props changed) vendor/zstd/dist/programs/datagen.h (contents, props changed) vendor/zstd/dist/programs/dibio.c (contents, props changed) vendor/zstd/dist/programs/dibio.h (contents, props changed) vendor/zstd/dist/programs/fileio.c (contents, props changed) vendor/zstd/dist/programs/fileio.h (contents, props changed) vendor/zstd/dist/programs/platform.h (contents, props changed) vendor/zstd/dist/programs/util.h (contents, props changed) vendor/zstd/dist/programs/windres/ vendor/zstd/dist/programs/windres/generate_res.bat vendor/zstd/dist/programs/windres/verrsrc.h (contents, props changed) vendor/zstd/dist/programs/windres/zstd.rc vendor/zstd/dist/programs/windres/zstd32.res (contents, props changed) vendor/zstd/dist/programs/windres/zstd64.res (contents, props changed) vendor/zstd/dist/programs/zstd.1 (contents, props changed) vendor/zstd/dist/programs/zstdcli.c (contents, props changed) vendor/zstd/dist/programs/zstdgrep (contents, props changed) vendor/zstd/dist/programs/zstdless (contents, props changed) vendor/zstd/dist/tests/ vendor/zstd/dist/tests/.gitignore vendor/zstd/dist/tests/Makefile (contents, props changed) vendor/zstd/dist/tests/README.md vendor/zstd/dist/tests/datagencli.c (contents, props changed) vendor/zstd/dist/tests/decodecorpus.c (contents, props changed) vendor/zstd/dist/tests/fullbench.c (contents, props changed) vendor/zstd/dist/tests/fuzzer.c (contents, props changed) vendor/zstd/dist/tests/gzip/ vendor/zstd/dist/tests/gzip/Makefile (contents, props changed) vendor/zstd/dist/tests/gzip/gzip-env.sh (contents, props changed) vendor/zstd/dist/tests/gzip/helin-segv.sh (contents, props changed) vendor/zstd/dist/tests/gzip/help-version.sh (contents, props changed) vendor/zstd/dist/tests/gzip/hufts-segv.gz (contents, props changed) vendor/zstd/dist/tests/gzip/hufts.sh (contents, props changed) vendor/zstd/dist/tests/gzip/init.cfg vendor/zstd/dist/tests/gzip/init.sh (contents, props changed) vendor/zstd/dist/tests/gzip/keep.sh (contents, props changed) vendor/zstd/dist/tests/gzip/list.sh (contents, props changed) vendor/zstd/dist/tests/gzip/memcpy-abuse.sh (contents, props changed) vendor/zstd/dist/tests/gzip/mixed.sh (contents, props changed) vendor/zstd/dist/tests/gzip/null-suffix-clobber.sh (contents, props changed) vendor/zstd/dist/tests/gzip/stdin.sh (contents, props changed) vendor/zstd/dist/tests/gzip/test-driver.sh (contents, props changed) vendor/zstd/dist/tests/gzip/trailing-nul.sh (contents, props changed) vendor/zstd/dist/tests/gzip/unpack-invalid.sh (contents, props changed) vendor/zstd/dist/tests/gzip/z-suffix.sh (contents, props changed) vendor/zstd/dist/tests/gzip/zdiff.sh (contents, props changed) vendor/zstd/dist/tests/gzip/zgrep-context.sh (contents, props changed) vendor/zstd/dist/tests/gzip/zgrep-f.sh (contents, props changed) vendor/zstd/dist/tests/gzip/zgrep-signal.sh (contents, props changed) vendor/zstd/dist/tests/gzip/znew-k.sh (contents, props changed) vendor/zstd/dist/tests/invalidDictionaries.c (contents, props changed) vendor/zstd/dist/tests/legacy.c (contents, props changed) vendor/zstd/dist/tests/longmatch.c (contents, props changed) vendor/zstd/dist/tests/namespaceTest.c (contents, props changed) vendor/zstd/dist/tests/paramgrill.c (contents, props changed) vendor/zstd/dist/tests/playTests.sh (contents, props changed) vendor/zstd/dist/tests/pool.c (contents, props changed) vendor/zstd/dist/tests/roundTripCrash.c (contents, props changed) vendor/zstd/dist/tests/symbols.c (contents, props changed) vendor/zstd/dist/tests/test-zstd-speed.py (contents, props changed) vendor/zstd/dist/tests/test-zstd-versions.py (contents, props changed) vendor/zstd/dist/tests/zbufftest.c (contents, props changed) vendor/zstd/dist/tests/zstreamtest.c (contents, props changed) vendor/zstd/dist/zlibWrapper/ vendor/zstd/dist/zlibWrapper/.gitignore vendor/zstd/dist/zlibWrapper/BUCK vendor/zstd/dist/zlibWrapper/Makefile (contents, props changed) vendor/zstd/dist/zlibWrapper/README.md vendor/zstd/dist/zlibWrapper/examples/ vendor/zstd/dist/zlibWrapper/examples/example.c (contents, props changed) vendor/zstd/dist/zlibWrapper/examples/example_original.c (contents, props changed) vendor/zstd/dist/zlibWrapper/examples/fitblk.c (contents, props changed) vendor/zstd/dist/zlibWrapper/examples/fitblk_original.c (contents, props changed) vendor/zstd/dist/zlibWrapper/examples/minigzip.c (contents, props changed) vendor/zstd/dist/zlibWrapper/examples/zwrapbench.c (contents, props changed) vendor/zstd/dist/zlibWrapper/gzclose.c (contents, props changed) vendor/zstd/dist/zlibWrapper/gzcompatibility.h (contents, props changed) vendor/zstd/dist/zlibWrapper/gzguts.h (contents, props changed) vendor/zstd/dist/zlibWrapper/gzlib.c (contents, props changed) vendor/zstd/dist/zlibWrapper/gzread.c (contents, props changed) vendor/zstd/dist/zlibWrapper/gzwrite.c (contents, props changed) vendor/zstd/dist/zlibWrapper/zstd_zlibwrapper.c (contents, props changed) vendor/zstd/dist/zlibWrapper/zstd_zlibwrapper.h (contents, props changed) Added: vendor/zstd/dist/.buckconfig ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/.buckconfig Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,9 @@ +[cxx] + cppflags = -DXXH_NAMESPACE=ZSTD_ -DZSTD_LEGACY_SUPPORT=4 + cflags = -Wall -Wextra -Wcast-qual -Wcast-align -Wshadow -Wstrict-aliasing=1 -Wswitch-enum -Wdeclaration-after-statement -Wstrict-prototypes -Wundef -Wpointer-arith + cxxppflags = -DXXH_NAMESPACE=ZSTD_ -DZSTD_LEGACY_SUPPORT=4 + cxxflags = -std=c++11 -Wno-deprecated-declarations + gtest_dep = //contrib/pzstd:gtest + +[httpserver] + port = 0 Added: vendor/zstd/dist/.buckversion ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/.buckversion Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1 @@ +c8dec2e8da52d483f6dd7c6cd2ad694e8e6fed2b Added: vendor/zstd/dist/.gitattributes ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/.gitattributes Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,24 @@ +# Set the default behavior +* text eol=lf + +# Explicitly declare source files +*.c text eol=lf +*.h text eol=lf + +# Denote files that should not be modified. +*.odt binary +*.png binary + +# Visual Studio +*.sln text eol=crlf +*.vcxproj* text eol=crlf +*.vcproj* text eol=crlf +*.suo binary +*.rc text eol=crlf + +# Windows +*.bat text eol=crlf +*.cmd text eol=crlf + +# .travis.yml merging +.travis.yml merge=ours Added: vendor/zstd/dist/.gitignore ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/.gitignore Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,41 @@ +# Object files +*.o +*.ko +*.dSYM + +# Libraries +*.lib +*.a + +# Shared objects (inc. Windows DLLs) +*.dll +*.so +*.so.* +*.dylib + +# Executables +zstd +zstdmt +*.exe +*.out +*.app + +# Test artefacts +tmp* +dictionary* + +# Other files +.directory +_codelite/ +_zstdbench/ +.clang_complete +*.idea +*.swp +.DS_Store +googletest/ +*.d + +# Directories +bin/ +.buckd/ +buck-out/ Added: vendor/zstd/dist/.travis.yml ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/.travis.yml Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,51 @@ +# Long tests: run on commits to master branch/cron builds + +language: c +sudo: required +dist: trusty +matrix: + include: + # Ubuntu 14.04 + - env: Cmd='make gcc6install && CC=gcc-6 make clean uasan-test' + - env: Cmd='make gcc6install libc6install && CC=gcc-6 make clean uasan-test32' + - env: Cmd='make clang38install && CC=clang-3.8 make clean msan-test' + - env: Cmd='make clang38install && CC=clang-3.8 make clean tsan-test-zstream' + - env: Cmd='make valgrindinstall && make -C tests clean valgrindTest' + + - env: Cmd='make arminstall && make armtest' + - env: Cmd='make arminstall && make aarch64test' + - env: Cmd='make ppcinstall && make ppctest' + - env: Cmd='make ppcinstall && make ppc64test' + + + - env: Cmd='make gpp6install valgrindinstall && make -C zlibWrapper test && make -C zlibWrapper valgrindTest' + - env: Cmd='make -C tests versionsTest' + - env: Cmd='make gpp6install && cd contrib/pzstd && make test-pzstd && make test-pzstd32 && make test-pzstd-tsan && make test-pzstd-asan' + install: + - export CXX="g++-6" CC="gcc-6" + - env: Cmd='make gcc6install && CC=gcc-6 make uasan-test-zstd-nolegacy' + - env: Cmd='make gcc6install && CC=gcc-6 make uasan-test-zbuff' + + # OS X Mavericks + - env: Cmd="make gnu90build && make clean && make test && make clean && make travis-install" + os: osx + +git: + depth: 1 + +branches: + only: + - dev + - master + +script: + - JOB_NUMBER=$(echo $TRAVIS_JOB_NUMBER | sed -e 's:[0-9][0-9]*\.\(.*\):\1:') + - echo JOB_NUMBER=$JOB_NUMBER TRAVIS_BRANCH=$TRAVIS_BRANCH TRAVIS_EVENT_TYPE=$TRAVIS_EVENT_TYPE TRAVIS_PULL_REQUEST=$TRAVIS_PULL_REQUEST + - export FUZZERTEST=-T5mn; + export ZSTREAM_TESTTIME=-T5mn; + export DECODECORPUS_TESTTIME=-T1mn; + if [ "$TRAVIS_EVENT_TYPE" = "cron" ]; then + git fetch origin dev; + git checkout -f FETCH_HEAD; + fi; + sh -c "$Cmd" || travis_terminate 1; Added: vendor/zstd/dist/CONTRIBUTING.md ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/CONTRIBUTING.md Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,42 @@ +# Contributing to Zstandard +We want to make contributing to this project as easy and transparent as +possible. + +## Our Development Process +New versions are being developed in the "dev" branch, +or in their own feature branch. +When they are deemed ready for a release, they are merged into "master". + +As a consequences, all contributions must stage first through "dev" +or their own feature branch. + +## Pull Requests +We actively welcome your pull requests. + +1. Fork the repo and create your branch from `dev`. +2. If you've added code that should be tested, add tests. +3. If you've changed APIs, update the documentation. +4. Ensure the test suite passes. +5. Make sure your code lints. +6. If you haven't already, complete the Contributor License Agreement ("CLA"). + +## Contributor License Agreement ("CLA") +In order to accept your pull request, we need you to submit a CLA. You only need +to do this once to work on any of Facebook's open source projects. + +Complete your CLA here: <https://code.facebook.com/cla>; + +## Issues +We use GitHub issues to track public bugs. Please ensure your description is +clear and has sufficient instructions to be able to reproduce the issue. + +Facebook has a [bounty program](https://www.facebook.com/whitehat/) for the safe +disclosure of security bugs. In those cases, please go through the process +outlined on that page and do not file a public issue. + +## Coding Style +* 4 spaces for indentation rather than tabs + +## License +By contributing to Zstandard, you agree that your contributions will be licensed +under the [LICENSE](LICENSE) file in the root directory of this source tree. Added: vendor/zstd/dist/LICENSE ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/LICENSE Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,30 @@ +BSD License + +For Zstandard software + +Copyright (c) 2016-present, Facebook, Inc. All rights reserved. + +Redistribution and use in source and binary forms, with or without modification, +are permitted provided that the following conditions are met: + + * Redistributions of source code must retain the above copyright notice, this + list of conditions and the following disclaimer. + + * Redistributions in binary form must reproduce the above copyright notice, + this list of conditions and the following disclaimer in the documentation + and/or other materials provided with the distribution. + + * Neither the name Facebook nor the names of its contributors may be used to + endorse or promote products derived from this software without specific + prior written permission. + +THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND +ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED +WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE +DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR +ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES +(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; +LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON +ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS +SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. Added: vendor/zstd/dist/LICENSE-examples ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/LICENSE-examples Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,11 @@ +Copyright (c) 2016-present, Facebook, Inc. All rights reserved. + +The examples provided by Facebook are for non-commercial testing and evaluation +purposes only. Facebook reserves all rights not expressly granted. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL +FACEBOOK BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN +ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION +WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. Added: vendor/zstd/dist/Makefile ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/Makefile Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,315 @@ +# ################################################################ +# Copyright (c) 2016-present, Yann Collet, Facebook, Inc. +# All rights reserved. +# +# This source code is licensed under the BSD-style license found in the +# LICENSE file in the root directory of this source tree. An additional grant +# of patent rights can be found in the PATENTS file in the same directory. +# ################################################################ + +PRGDIR = programs +ZSTDDIR = lib +BUILDIR = build +ZWRAPDIR = zlibWrapper +TESTDIR = tests + +# Define nul output +VOID = /dev/null + +ifneq (,$(filter Windows%,$(OS))) +EXT =.exe +else +EXT = +endif + +.PHONY: default +default: lib-release zstd-release + +.PHONY: all +all: | allmost examples manual + +.PHONY: allmost +allmost: + $(MAKE) -C $(ZSTDDIR) all + $(MAKE) -C $(PRGDIR) all + $(MAKE) -C $(TESTDIR) all + $(MAKE) -C $(ZWRAPDIR) all + +#skip zwrapper, can't build that on alternate architectures without the proper zlib installed +.PHONY: allarch +allarch: + $(MAKE) -C $(ZSTDDIR) all + $(MAKE) -C $(PRGDIR) all + $(MAKE) -C $(TESTDIR) all + +.PHONY: all32 +all32: + $(MAKE) -C $(PRGDIR) zstd32 + $(MAKE) -C $(TESTDIR) all32 + +.PHONY: lib +lib: + @$(MAKE) -C $(ZSTDDIR) $@ + +.PHONY: lib-release +lib-release: + @$(MAKE) -C $(ZSTDDIR) + +.PHONY: zstd +zstd: + @$(MAKE) -C $(PRGDIR) $@ + cp $(PRGDIR)/zstd$(EXT) . + +.PHONY: zstd-release +zstd-release: + @$(MAKE) -C $(PRGDIR) + cp $(PRGDIR)/zstd$(EXT) . + +.PHONY: zstdmt +zstdmt: + @$(MAKE) -C $(PRGDIR) $@ + cp $(PRGDIR)/zstd$(EXT) ./zstdmt$(EXT) + +.PHONY: zlibwrapper +zlibwrapper: + $(MAKE) -C $(ZWRAPDIR) test + +.PHONY: shortest +shortest: + $(MAKE) -C $(TESTDIR) $@ + +.PHONY: test +test: + $(MAKE) -C $(TESTDIR) $@ + +.PHONY: examples +examples: + CPPFLAGS=-I../lib LDFLAGS=-L../lib $(MAKE) -C examples/ all + +.PHONY: manual +manual: + $(MAKE) -C contrib/gen_html $@ + +.PHONY: clean +clean: + @$(MAKE) -C $(ZSTDDIR) $@ > $(VOID) + @$(MAKE) -C $(PRGDIR) $@ > $(VOID) + @$(MAKE) -C $(TESTDIR) $@ > $(VOID) + @$(MAKE) -C $(ZWRAPDIR) $@ > $(VOID) + @$(MAKE) -C examples/ $@ > $(VOID) + @$(MAKE) -C contrib/gen_html $@ > $(VOID) + @$(RM) zstd$(EXT) zstdmt$(EXT) tmp* + @echo Cleaning completed + +#------------------------------------------------------------------------------ +# make install is validated only for Linux, OSX, Hurd and some BSD targets +#------------------------------------------------------------------------------ +ifneq (,$(filter $(shell uname),Linux Darwin GNU/kFreeBSD GNU FreeBSD DragonFly NetBSD)) +HOST_OS = POSIX +.PHONY: install uninstall travis-install clangtest gpptest armtest usan asan uasan + +install: + @$(MAKE) -C $(ZSTDDIR) $@ + @$(MAKE) -C $(PRGDIR) $@ + +uninstall: + @$(MAKE) -C $(ZSTDDIR) $@ + @$(MAKE) -C $(PRGDIR) $@ + +travis-install: + $(MAKE) install PREFIX=~/install_test_dir + +gppbuild: clean + g++ -v + CC=g++ $(MAKE) -C programs all CFLAGS="-O3 -Wall -Wextra -Wundef -Wshadow -Wcast-align -Werror" + +gcc5build: clean + gcc-5 -v + CC=gcc-5 $(MAKE) all MOREFLAGS="-Werror" + +gcc6build: clean + gcc-6 -v + CC=gcc-6 $(MAKE) all MOREFLAGS="-Werror" + +clangbuild: clean + clang -v + CXX=clang++ CC=clang $(MAKE) all MOREFLAGS="-Werror -Wconversion -Wno-sign-conversion -Wdocumentation" + +m32build: clean + gcc -v + $(MAKE) all32 + +armbuild: clean + CC=arm-linux-gnueabi-gcc CFLAGS="-Werror" $(MAKE) allarch + +aarch64build: clean + CC=aarch64-linux-gnu-gcc CFLAGS="-Werror" $(MAKE) allarch + +ppcbuild: clean + CC=powerpc-linux-gnu-gcc CLAGS="-m32 -Wno-attributes -Werror" $(MAKE) allarch + +ppc64build: clean + CC=powerpc-linux-gnu-gcc CFLAGS="-m64 -Werror" $(MAKE) allarch + +armfuzz: clean + CC=arm-linux-gnueabi-gcc QEMU_SYS=qemu-arm-static MOREFLAGS="-static" $(MAKE) -C $(TESTDIR) fuzztest + +aarch64fuzz: clean + CC=aarch64-linux-gnu-gcc QEMU_SYS=qemu-aarch64-static MOREFLAGS="-static" $(MAKE) -C $(TESTDIR) fuzztest + +ppcfuzz: clean + CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc-static MOREFLAGS="-static" $(MAKE) -C $(TESTDIR) fuzztest + +ppc64fuzz: clean + CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc64-static MOREFLAGS="-m64 -static" $(MAKE) -C $(TESTDIR) fuzztest + +gpptest: clean + CC=g++ $(MAKE) -C $(PRGDIR) all CFLAGS="-O3 -Wall -Wextra -Wundef -Wshadow -Wcast-align -Werror" + +gcc5test: clean + gcc-5 -v + $(MAKE) all CC=gcc-5 MOREFLAGS="-Werror" + +gcc6test: clean + gcc-6 -v + $(MAKE) all CC=gcc-6 MOREFLAGS="-Werror" + +clangtest: clean + clang -v + $(MAKE) all CXX=clang-++ CC=clang MOREFLAGS="-Werror -Wconversion -Wno-sign-conversion -Wdocumentation" + +armtest: clean + $(MAKE) -C $(TESTDIR) datagen # use native, faster + $(MAKE) -C $(TESTDIR) test CC=arm-linux-gnueabi-gcc QEMU_SYS=qemu-arm-static ZSTDRTTEST= MOREFLAGS="-Werror -static" + +aarch64test: + $(MAKE) -C $(TESTDIR) datagen # use native, faster + $(MAKE) -C $(TESTDIR) test CC=aarch64-linux-gnu-gcc QEMU_SYS=qemu-aarch64-static ZSTDRTTEST= MOREFLAGS="-Werror -static" + +ppctest: clean + $(MAKE) -C $(TESTDIR) datagen # use native, faster + $(MAKE) -C $(TESTDIR) test CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc-static ZSTDRTTEST= MOREFLAGS="-Werror -Wno-attributes -static" + +ppc64test: clean + $(MAKE) -C $(TESTDIR) datagen # use native, faster + $(MAKE) -C $(TESTDIR) test CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc64-static ZSTDRTTEST= MOREFLAGS="-m64 -static" + +arm-ppc-compilation: + $(MAKE) -C $(PRGDIR) clean zstd CC=arm-linux-gnueabi-gcc QEMU_SYS=qemu-arm-static ZSTDRTTEST= MOREFLAGS="-Werror -static" + $(MAKE) -C $(PRGDIR) clean zstd CC=aarch64-linux-gnu-gcc QEMU_SYS=qemu-aarch64-static ZSTDRTTEST= MOREFLAGS="-Werror -static" + $(MAKE) -C $(PRGDIR) clean zstd CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc-static ZSTDRTTEST= MOREFLAGS="-Werror -Wno-attributes -static" + $(MAKE) -C $(PRGDIR) clean zstd CC=powerpc-linux-gnu-gcc QEMU_SYS=qemu-ppc64-static ZSTDRTTEST= MOREFLAGS="-m64 -static" + +# run UBsan with -fsanitize-recover=signed-integer-overflow +# due to a bug in UBsan when doing pointer subtraction +# https://gcc.gnu.org/bugzilla/show_bug.cgi?id=63303 + +usan: clean + $(MAKE) test CC=clang MOREFLAGS="-g -fno-sanitize-recover=all -fsanitize-recover=signed-integer-overflow -fsanitize=undefined" + +asan: clean + $(MAKE) test CC=clang MOREFLAGS="-g -fsanitize=address" + +asan-%: clean + LDFLAGS=-fuse-ld=gold MOREFLAGS="-g -fno-sanitize-recover=all -fsanitize=address" $(MAKE) -C $(TESTDIR) $* + +msan: clean + $(MAKE) test CC=clang MOREFLAGS="-g -fsanitize=memory -fno-omit-frame-pointer" # datagen.c fails this test for no obvious reason + +msan-%: clean + LDFLAGS=-fuse-ld=gold MOREFLAGS="-fno-sanitize-recover=all -fsanitize=memory -fno-omit-frame-pointer" $(MAKE) -C $(TESTDIR) $* + +asan32: clean + $(MAKE) -C $(TESTDIR) test32 CC=clang MOREFLAGS="-g -fsanitize=address" + +uasan: clean + $(MAKE) test CC=clang MOREFLAGS="-g -fno-sanitize-recover=all -fsanitize-recover=signed-integer-overflow -fsanitize=address,undefined" + +uasan-%: clean + LDFLAGS=-fuse-ld=gold MOREFLAGS="-Og -fno-sanitize-recover=all -fsanitize-recover=signed-integer-overflow -fsanitize=address,undefined" $(MAKE) -C $(TESTDIR) $* + +tsan-%: clean + LDFLAGS=-fuse-ld=gold MOREFLAGS="-g -fno-sanitize-recover=all -fsanitize=thread" $(MAKE) -C $(TESTDIR) $* +apt-install: + sudo apt-get -yq --no-install-suggests --no-install-recommends --force-yes install $(APT_PACKAGES) + +apt-add-repo: + sudo add-apt-repository -y ppa:ubuntu-toolchain-r/test + sudo apt-get update -y -qq + +ppcinstall: + APT_PACKAGES="qemu-system-ppc qemu-user-static gcc-powerpc-linux-gnu" $(MAKE) apt-install + +arminstall: + APT_PACKAGES="qemu-system-arm qemu-user-static gcc-arm-linux-gnueabi libc6-dev-armel-cross gcc-aarch64-linux-gnu libc6-dev-arm64-cross" $(MAKE) apt-install + +valgrindinstall: + APT_PACKAGES="valgrind" $(MAKE) apt-install + +libc6install: + APT_PACKAGES="libc6-dev-i386 gcc-multilib" $(MAKE) apt-install + +gcc6install: apt-add-repo + APT_PACKAGES="libc6-dev-i386 gcc-multilib gcc-6 gcc-6-multilib" $(MAKE) apt-install + +gpp6install: apt-add-repo + APT_PACKAGES="libc6-dev-i386 g++-multilib gcc-6 g++-6 g++-6-multilib" $(MAKE) apt-install + +clang38install: + APT_PACKAGES="clang-3.8" $(MAKE) apt-install + +endif + + +ifneq (,$(filter MSYS%,$(shell uname))) +HOST_OS = MSYS +CMAKE_PARAMS = -G"MSYS Makefiles" +endif + + +#------------------------------------------------------------------------ +#make tests validated only for MSYS, Linux, OSX, kFreeBSD and Hurd targets +#------------------------------------------------------------------------ +ifneq (,$(filter $(HOST_OS),MSYS POSIX)) +cmakebuild: + cmake --version + $(RM) -r $(BUILDIR)/cmake/build + mkdir $(BUILDIR)/cmake/build + cd $(BUILDIR)/cmake/build ; cmake -DPREFIX:STRING=~/install_test_dir $(CMAKE_PARAMS) .. ; $(MAKE) install ; $(MAKE) uninstall + +c90build: clean + gcc -v + CFLAGS="-std=c90" $(MAKE) allmost # will fail, due to missing support for `long long` + +gnu90build: clean + gcc -v + CFLAGS="-std=gnu90" $(MAKE) allmost + +c99build: clean + gcc -v + CFLAGS="-std=c99" $(MAKE) allmost + +gnu99build: clean + gcc -v + CFLAGS="-std=gnu99" $(MAKE) allmost + +c11build: clean + gcc -v + CFLAGS="-std=c11" $(MAKE) allmost + +bmix64build: clean + gcc -v + CFLAGS="-O3 -mbmi -Werror" $(MAKE) -C $(TESTDIR) test + +bmix32build: clean + gcc -v + CFLAGS="-O3 -mbmi -mx32 -Werror" $(MAKE) -C $(TESTDIR) test + +bmi32build: clean + gcc -v + CFLAGS="-O3 -mbmi -m32 -Werror" $(MAKE) -C $(TESTDIR) test + +staticAnalyze: clean + gcc -v + CPPFLAGS=-g scan-build --status-bugs -v $(MAKE) all +endif Added: vendor/zstd/dist/NEWS ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/NEWS Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,261 @@ +v1.1.4 +cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski +cli : new : advanced benchmark command --priority=rt +cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77 +cli : fix : --rm remains silent when input is stdin +cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski +speed : improved decompression speed in streaming mode for single shot scenarios (+5%) +memory : DDict (decompression dictionary) memory usage down from 150 KB to 20 KB +arch : 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell +API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize() +API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value) +build: new: meson build system in contrib/meson, by Dima Krasner +build: improved cmake script, by @Majlen +build: added -Wformat-security flag, as recommended by Padraig Brady +doc : new : educational decoder, by Sean Purcell + +v1.1.3 +cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`) +cli : new : experimental target `make zstdmt`, with multi-threading support +cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell, based on prior work by Giuseppe Ottaviano. +cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski +cli : fix zstdless on Mac OS-X, by Andrew Janke +cli : fix #232 "compress non-files" +dictBuilder : improved dictionary generation quality, thanks to Nick Terrell +API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental) +API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul +API : new : ZDICT_finalizeDictionary() +API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511) +API : fix : all symbols properly exposed in libzstd, by Nick Terrell +build : support for Solaris target, by Przemyslaw Skibinski +doc : clarified specification, by Sean Purcell + +v1.1.2 +API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init +API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize() +API : zbuff : changed : prototypes now generate deprecation warnings +lib : improved : faster decompression speed at ultra compression settings and 32-bits mode +lib : changed : only public ZSTD_ symbols are now exposed +lib : changed : reduced usage of stack memory +lib : fixed : several corner case bugs, by Nick Terrell +cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski +cli : new : preserve file attributes +cli : new : added zstdless and zstdgrep tools +cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd) +cli : fixed : zstdcat +zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski +install : better compatibility with FreeBSD, by Dimitry Andric +source tree : changed : zbuff source files moved to lib/deprecated + +v1.1.1 +New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption +New : doc/zstd_manual.html, by Przemyslaw Skibinski +Improved : slightly better compression ratio at --ultra levels (>= 20) +Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report +Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section) +Added : example/multiple_streaming_compression.c +Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h) +Updated man page +Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets + +v1.1.0 +New : contrib/pzstd, parallel version of zstd, by Nick Terrell +added : NetBSD install target (#338) +Improved : speed for batches of small files +Improved : speed of zlib wrapper, by Przemyslaw Skibinski +Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier +Fixed : CLI -d output to stdout by default when input is stdin (#322) +Fixed : CLI correctly detects console on Mac OS-X +Fixed : CLI supports recursive mode `-r` on Mac OS-X +Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski +Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319) +Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365) +Fixed : zstd-pgo, reported by octoploid (#329) + +v1.0.0 +Change Licensing, all project is now BSD, Copyright Facebook +Small decompression speed improvement +API : Streaming API supports legacy format +API : ZDICT_getDictID(), ZSTD_sizeof_{CCtx, DCtx, CStream, DStream}(), ZSTD_setDStreamParamter() +CLI supports legacy formats v0.4+ +Fixed : compression fails on certain huge files, reported by Jesse McGrew +Enhanced documentation, by Przemyslaw Skibinski + +v0.8.1 +New streaming API +Changed : --ultra now enables levels beyond 19 +Changed : -i# now selects benchmark time in second +Fixed : ZSTD_compress* can now compress > 4 GB in a single pass, reported by Nick Terrell +Fixed : speed regression on specific patterns (#272) +Fixed : support for Z_SYNC_FLUSH, by Dmitry Krot (#291) +Fixed : ICC compilation, by Przemyslaw Skibinski + +v0.8.0 +Improved : better speed on clang and gcc -O2, thanks to Eric Biggers +New : Build on FreeBSD and DragonFly, thanks to JrMarino +Changed : modified API : ZSTD_compressEnd() +Fixed : legacy mode with ZSTD_HEAPMODE=0, by Christopher Bergqvist +Fixed : premature end of frame when zero-sized raw block, reported by Eric Biggers +Fixed : large dictionaries (> 384 KB), reported by Ilona Papava +Fixed : checksum correctly checked in single-pass mode +Fixed : combined --test amd --rm, reported by Andreas M. Nilsson +Modified : minor compression level adaptations +Updated : compression format specification to v0.2.0 +changed : zstd.h moved to /lib directory + +v0.7.5 +Transition version, supporting decoding of v0.8.x + +v0.7.4 +Added : homebrew for Mac, by Daniel Cade +Added : more examples +Fixed : segfault when using small dictionaries, reported by Felix Handte +Modified : default compression level for CLI is now 3 +Updated : specification, to v0.1.1 + +v0.7.3 +New : compression format specification +New : `--` separator, stating that all following arguments are file names. Suggested by Chip Turner. +New : `ZSTD_getDecompressedSize()` +New : OpenBSD target, by Juan Francisco Cantero Hurtado +New : `examples` directory +fixed : dictBuilder using HC levels, reported by Bartosz Taudul +fixed : legacy support from ZSTD_decompress_usingDDict(), reported by Felix Handte +fixed : multi-blocks decoding with intermediate uncompressed blocks, reported by Greg Slazinski +modified : removed "mem.h" and "error_public.h" dependencies from "zstd.h" (experimental section) +modified : legacy functions no longer need magic number + +v0.7.2 +fixed : ZSTD_decompressBlock() using multiple consecutive blocks. Reported by Greg Slazinski. +fixed : potential segfault on very large files (many gigabytes). Reported by Chip Turner. +fixed : CLI displays system error message when destination file cannot be created (#231). Reported by Chip Turner. + +v0.7.1 +fixed : ZBUFF_compressEnd() called multiple times with too small `dst` buffer, reported by Christophe Chevalier +fixed : dictBuilder fails if first sample is too small, reported by Руслан Ковалёв +fixed : corruption issue, reported by cj +modified : checksum enabled by default in command line mode + +v0.7.0 +New : Support for directory compression, using `-r`, thanks to Przemyslaw Skibinski +New : Command `--rm`, to remove source file after successful de/compression +New : Visual build scripts, by Christophe Chevalier +New : Support for Sparse File-systems (do not use space for zero-filled sectors) +New : Frame checksum support +New : Support pass-through mode (when using `-df`) +API : more efficient Dictionary API : `ZSTD_compress_usingCDict()`, `ZSTD_decompress_usingDDict()` +API : create dictionary files from custom content, by Giuseppe Ottaviano +API : support for custom malloc/free functions +New : controllable Dictionary ID +New : Support for skippable frames + +v0.6.1 +New : zlib wrapper API, thanks to Przemyslaw Skibinski +New : Ability to compile compressor / decompressor separately +Changed : new lib directory structure +Fixed : Legacy codec v0.5 compatible with dictionary decompression +Fixed : Decoder corruption error (#173) +Fixed : null-string roundtrip (#176) +New : benchmark mode can select directory as input +Experimental : midipix support, VMS support + +v0.6.0 +Stronger high compression modes, thanks to Przemyslaw Skibinski +API : ZSTD_getFrameParams() provides size of decompressed content +New : highest compression modes require `--ultra` command to fully unleash their capacity +Fixed : zstd cli return error code > 0 and removes dst file artifact when decompression fails, thanks to Chip Turner + +v0.5.1 +New : Optimal parsing => Very high compression modes, thanks to Przemyslaw Skibinski +Changed : Dictionary builder integrated into libzstd and zstd cli +Changed (!) : zstd cli now uses "multiple input files" as default mode. See `zstd -h`. +Fix : high compression modes for big-endian platforms +New : zstd cli : `-t` | `--test` command + +v0.5.0 +New : dictionary builder utility +Changed : streaming & dictionary API +Improved : better compression of small data + +v0.4.7 +Improved : small compression speed improvement in HC mode +Changed : `zstd_decompress.c` has ZSTD_LEGACY_SUPPORT to 0 by default +fix : bt search bug + +v0.4.6 +fix : fast compression mode on Windows +New : cmake configuration file, thanks to Artyom Dymchenko +Improved : high compression mode on repetitive data +New : block-level API +New : ZSTD_duplicateCCtx() + +v0.4.5 +new : -m/--multiple : compress/decompress multiple files + +v0.4.4 +Fixed : high compression modes for Windows 32 bits +new : external dictionary API extended to buffered mode and accessible through command line +new : windows DLL project, thanks to Christophe Chevalier + +v0.4.3 : +new : external dictionary API +new : zstd-frugal + +v0.4.2 : +Generic minor improvements for small blocks +Fixed : big-endian compatibility, by Peter Harris (#85) + +v0.4.1 +Fixed : ZSTD_LEGACY_SUPPORT=0 build mode (reported by Luben) +removed `zstd.c` + +v0.4.0 +Command line utility compatible with high compression levels +Removed zstdhc => merged into zstd +Added : ZBUFF API (see zstd_buffered.h) +Rolling buffer support + +v0.3.6 +small blocks params + +v0.3.5 +minor generic compression improvements + +v0.3.4 +Faster fast cLevels + +v0.3.3 +Small compression ratio improvement + +v0.3.2 +Fixed Visual Studio + +v0.3.1 : +Small compression ratio improvement + +v0.3 +HC mode : compression levels 2-26 + +v0.2.2 +Fix : Visual Studio 2013 & 2015 release compilation, by Christophe Chevalier + +v0.2.1 +Fix : Read errors, advanced fuzzer tests, by Hanno Böck + +v0.2.0 +**Breaking format change** +Faster decompression speed +Can still decode v0.1 format + +v0.1.3 +fix uninitialization warning, reported by Evan Nemerson + +v0.1.2 +frame concatenation support + +v0.1.1 +fix compression bug +detects write-flush errors + +v0.1.0 +first release Added: vendor/zstd/dist/PATENTS ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/PATENTS Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,33 @@ +Additional Grant of Patent Rights Version 2 + +"Software" means the Zstandard software distributed by Facebook, Inc. + +Facebook, Inc. ("Facebook") hereby grants to each recipient of the Software +("you") a perpetual, worldwide, royalty-free, non-exclusive, irrevocable +(subject to the termination provision below) license under any Necessary +Claims, to make, have made, use, sell, offer to sell, import, and otherwise +transfer the Software. For avoidance of doubt, no license is granted under +Facebook’s rights in any patent claims that are infringed by (i) modifications +to the Software made by you or any third party or (ii) the Software in +combination with any software or other technology. + +The license granted hereunder will terminate, automatically and without notice, +if you (or any of your subsidiaries, corporate affiliates or agents) initiate +directly or indirectly, or take a direct financial interest in, any Patent +Assertion: (i) against Facebook or any of its subsidiaries or corporate +affiliates, (ii) against any party if such Patent Assertion arises in whole or +in part from any software, technology, product or service of Facebook or any of +its subsidiaries or corporate affiliates, or (iii) against any party relating +to the Software. Notwithstanding the foregoing, if Facebook or any of its +subsidiaries or corporate affiliates files a lawsuit alleging patent +infringement against you in the first instance, and you respond by filing a +patent infringement counterclaim in that lawsuit against that party that is +unrelated to the Software, the license granted hereunder will not terminate +under section (i) of this paragraph due to such counterclaim. + +A "Necessary Claim" is a claim of a patent owned by Facebook that is +necessarily infringed by the Software standing alone. + +A "Patent Assertion" is any lawsuit or other action alleging direct, indirect, +or contributory infringement or inducement to infringe any patent, including a +cross-claim or counterclaim. Added: vendor/zstd/dist/README.md ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/README.md Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,141 @@ + __Zstandard__, or `zstd` as short version, is a fast lossless compression algorithm, + targeting real-time compression scenarios at zlib-level and better compression ratios. + +It is provided as an open-source BSD-licensed **C** library, +and a command line utility producing and decoding `.zst` and `.gz` files. +For other programming languages, +you can consult a list of known ports on [Zstandard homepage](http://www.zstd.net/#other-languages). + +|Branch |Status | +|------------|---------| +|master | [](https://travis-ci.org/facebook/zstd) | +|dev | [](https://travis-ci.org/facebook/zstd) | + +As a reference, several fast compression algorithms were tested and compared +on a server running Linux Mint Debian Edition (`Linux version 4.8.0-1-amd64`), +with a Core i7-6700K CPU @ 4.0GHz, +using [lzbench v1.6], an open-source in-memory benchmark by @inikep +compiled with GCC 6.3.0, +on the [Silesia compression corpus]. + +[lzbench v1.6]: https://github.com/inikep/lzbench +[Silesia compression corpus]: http://sun.aei.polsl.pl/~sdeor/index.php?page=silesia + +| Compressor name | Ratio | Compression| Decompress.| +| --------------- | ------| -----------| ---------- | +| **zstd 1.1.3 -1** | 2.877 | 430 MB/s | 1110 MB/s | +| zlib 1.2.8 -1 | 2.743 | 110 MB/s | 400 MB/s | +| brotli 0.5.2 -0 | 2.708 | 400 MB/s | 430 MB/s | +| quicklz 1.5.0 -1 | 2.238 | 550 MB/s | 710 MB/s | +| lzo1x 2.09 -1 | 2.108 | 650 MB/s | 830 MB/s | +| lz4 1.7.5 | 2.101 | 720 MB/s | 3600 MB/s | +| snappy 1.1.3 | 2.091 | 500 MB/s | 1650 MB/s | +| lzf 3.6 -1 | 2.077 | 400 MB/s | 860 MB/s | + +[zlib]:http://www.zlib.net/ +[LZ4]: http://www.lz4.org/ + +Zstd can also offer stronger compression ratios at the cost of compression speed. +Speed vs Compression trade-off is configurable by small increments. Decompression speed is preserved and remains roughly the same at all settings, a property shared by most LZ compression algorithms, such as [zlib] or lzma. + +The following tests were run on a Core i7-3930K CPU @ 4.5GHz, using [lzbench], an open-source in-memory benchmark by @inikep compiled with GCC 5.2.1, on the [Silesia compression corpus]. + +Compression Speed vs Ratio | Decompression Speed +---------------------------|-------------------- + |  + +Several algorithms can produce higher compression ratios, but at slower speeds, falling outside of the graph. +For a larger picture including very slow modes, [click on this link](doc/images/DCspeed5.png) . + + +### The case for Small Data compression + +Previous charts provide results applicable to typical file and stream scenarios (several MB). Small data comes with different perspectives. + +The smaller the amount of data to compress, the more difficult it is to compress. This problem is common to all compression algorithms, and reason is, compression algorithms learn from past data how to compress future data. But at the beginning of a new data set, there is no "past" to build upon. + +To solve this situation, Zstd offers a __training mode__, which can be used to tune the algorithm for a selected type of data. +Training Zstandard is achieved by provide it with a few samples (one file per sample). The result of this training is stored in a file called "dictionary", which must be loaded before compression and decompression. +Using this dictionary, the compression ratio achievable on small data improves dramatically. + +The following example uses the `github-users` [sample set](https://github.com/facebook/zstd/releases/tag/v1.1.3), created from [github public API](https://developer.github.com/v3/users/#get-all-users). +It consists of roughly 10K records weighting about 1KB each. + +Compression Ratio | Compression Speed | Decompression Speed +------------------|-------------------|-------------------- + |  |  + + +These compression gains are achieved while simultaneously providing _faster_ compression and decompression speeds. + +Training works if there is some correlation in a family of small data samples. The more data-specific a dictionary is, the more efficient it is (there is no _universal dictionary_). +Hence, deploying one dictionary per type of data will provide the greatest benefits. +Dictionary gains are mostly effective in the first few KB. Then, the compression algorithm will gradually use previously decoded content to better compress the rest of the file. + +#### Dictionary compression How To : + +1) Create the dictionary + +`zstd --train FullPathToTrainingSet/* -o dictionaryName` + +2) Compress with dictionary + +`zstd -D dictionaryName FILE` + +3) Decompress with dictionary + +`zstd -D dictionaryName --decompress FILE.zst` + + +### Build + +Once you have the repository cloned, there are multiple ways provided to build Zstandard. + +#### Makefile + +If your system is compatible with a standard `make` (or `gmake`) binary generator, +you can simply run it at the root directory. +It will generate `zstd` within root directory. + +Other available options include : +- `make install` : create and install zstd binary, library and man page +- `make test` : create and run `zstd` and test tools on local platform + +#### cmake + +A `cmake` project generator is provided within `build/cmake`. +It can generate Makefiles or other build scripts +to create `zstd` binary, and `libzstd` dynamic and static libraries. + +#### Meson + +A Meson project is provided within `contrib/meson`. + +#### Visual Studio (Windows) + +Going into `build` directory, you will find additional possibilities : +- Projects for Visual Studio 2005, 2008 and 2010 + + VS2010 project is compatible with VS2012, VS2013 and VS2015 +- Automated build scripts for Visual compiler by @KrzysFR , in `build/VS_scripts`, + which will build `zstd` cli and `libzstd` library without any need to open Visual Studio solution. + + +### Status + +Zstandard is currently deployed within Facebook. It is used daily to compress and decompress very large amounts of data in multiple formats and use cases. +Zstandard is considered safe for production environments. + +### License + +Zstandard is [BSD-licensed](LICENSE). We also provide an [additional patent grant](PATENTS). + +### Contributing + +The "dev" branch is the one where all contributions will be merged before reaching "master". +If you plan to propose a patch, please commit into the "dev" branch or its own feature branch. +Direct commit to "master" are not permitted. +For more information, please read [CONTRIBUTING](CONTRIBUTING.md). + +### Miscellaneous + +Zstd entropy stage is provided by [Huff0 and FSE, from Finite State Entropy library](https://github.com/Cyan4973/FiniteStateEntropy). Added: vendor/zstd/dist/TESTING.md ============================================================================== --- /dev/null 00:00:00 1970 (empty, because file is newly added) +++ vendor/zstd/dist/TESTING.md Sat Apr 15 19:47:16 2017 (r316975) @@ -0,0 +1,44 @@ +Testing +======= *** DIFF OUTPUT TRUNCATED AT 1000 LINES ***
](https://travis-ci.org/facebook/zstd){kind=link}
](https://travis-ci.org/facebook/zstd){kind=link}
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201704151947.v3FJlHl4094446>