tile38/vendor/github.com/pierrec/lz4
tidwall 712da8aefa Updated Kafka client 2020-06-24 14:20:22 -07:00
..
internal/xxh32 Updated Kafka client 2020-06-24 14:20:22 -07:00
.gitignore Updated Kafka client 2020-06-24 14:20:22 -07:00
.travis.yml Updated Kafka client 2020-06-24 14:20:22 -07:00
LICENSE Refactor repository and build scripts 2019-11-18 10:33:15 -07:00
README.md Updated Kafka client 2020-06-24 14:20:22 -07:00
block.go Updated Kafka client 2020-06-24 14:20:22 -07:00
debug.go Updated Kafka client 2020-06-24 14:20:22 -07:00
debug_stub.go Updated Kafka client 2020-06-24 14:20:22 -07:00
decode_amd64.go Updated Kafka client 2020-06-24 14:20:22 -07:00
decode_amd64.s Updated Kafka client 2020-06-24 14:20:22 -07:00
decode_other.go Updated Kafka client 2020-06-24 14:20:22 -07:00
errors.go Updated Kafka client 2020-06-24 14:20:22 -07:00
lz4.go Updated Kafka client 2020-06-24 14:20:22 -07:00
lz4_go1.10.go Updated Kafka client 2020-06-24 14:20:22 -07:00
lz4_notgo1.10.go Updated Kafka client 2020-06-24 14:20:22 -07:00
reader.go Updated Kafka client 2020-06-24 14:20:22 -07:00
writer.go Updated Kafka client 2020-06-24 14:20:22 -07:00

README.md

lz4 : LZ4 compression in pure Go

GoDoc Build Status Go Report Card GitHub tag (latest SemVer)

Overview

This package provides a streaming interface to LZ4 data streams as well as low level compress and uncompress functions for LZ4 data blocks. The implementation is based on the reference C one.

Install

Assuming you have the go toolchain installed:

go get github.com/pierrec/lz4

There is a command line interface tool to compress and decompress LZ4 files.

go install github.com/pierrec/lz4/cmd/lz4c

Usage

Usage of lz4c:
  -version
        print the program version

Subcommands:
Compress the given files or from stdin to stdout.
compress [arguments] [<file name> ...]
  -bc
        enable block checksum
  -l int
        compression level (0=fastest)
  -sc
        disable stream checksum
  -size string
        block max size [64K,256K,1M,4M] (default "4M")

Uncompress the given files or from stdin to stdout.
uncompress [arguments] [<file name> ...]

Example

// Compress and uncompress an input string.
s := "hello world"
r := strings.NewReader(s)

// The pipe will uncompress the data from the writer.
pr, pw := io.Pipe()
zw := lz4.NewWriter(pw)
zr := lz4.NewReader(pr)

go func() {
	// Compress the input string.
	_, _ = io.Copy(zw, r)
	_ = zw.Close() // Make sure the writer is closed
	_ = pw.Close() // Terminate the pipe
}()

_, _ = io.Copy(os.Stdout, zr)

// Output:
// hello world

Contributing

Contributions are very welcome for bug fixing, performance improvements...!

  • Open an issue with a proper description
  • Send a pull request with appropriate test case(s)

Contributors

Thanks to all contributors so far!

Special thanks to @Zariel for his asm implementation of the decoder.

Special thanks to @klauspost for his work on optimizing the code.