ledisdb/README.md

190 lines
5.2 KiB
Markdown
Raw Normal View History

2014-11-21 05:32:33 +03:00
# LedisDB
[![Build Status](https://travis-ci.org/siddontang/ledisdb.svg?branch=develop)](https://travis-ci.org/siddontang/ledisdb)
2014-05-22 04:52:38 +04:00
2015-03-03 04:21:00 +03:00
Ledisdb is a high-performance NoSQL database, similar to Redis, written in [Go](http://golang.org/). It supports many data structures including kv, list, hash, zset, set.
2014-07-26 05:22:09 +04:00
2014-11-24 04:25:25 +03:00
LedisDB now supports multiple different databases as backends.
2014-05-22 04:52:38 +04:00
2014-11-24 04:25:25 +03:00
### **You must run `ledis-upgrade-ttl` before using LedisDB version 0.4, I fixed a very serious bug for key expiration and TTL.**
2014-11-21 05:32:33 +03:00
2014-07-11 13:30:40 +04:00
## Features
2015-03-03 04:21:00 +03:00
+ Rich data structure: KV, List, Hash, ZSet, Set.
2014-11-24 04:25:25 +03:00
+ Data storage is not limited by RAM.
+ Various backends supported: LevelDB, goleveldb, LMDB, RocksDB, BoltDB, RAM.
+ Supports Lua scripting.
+ Supports expiration and TTL.
+ Can be managed via redis-cli.
2014-08-06 05:30:44 +04:00
+ Easy to embed in your own Go application.
2014-11-24 04:25:25 +03:00
+ HTTP API support, JSON/BSON/msgpack output.
+ Replication to guarantee data safety.
+ Supplies tools to load, dump, and repair database.
2014-12-04 15:59:16 +03:00
+ Supports cluster, use [xcodis](https://github.com/siddontang/xcodis)
+ Authentication (though, not via http)
2014-07-11 13:30:40 +04:00
2014-05-22 04:52:38 +04:00
## Build and Install
2014-07-26 05:22:09 +04:00
Create a workspace and checkout ledisdb source
mkdir $WORKSPACE
cd $WORKSPACE
git clone git@github.com:siddontang/ledisdb.git src/github.com/siddontang/ledisdb
cd src/github.com/siddontang/ledisdb
2014-05-22 04:52:38 +04:00
#install godep and be sure godep command can be found in $PATH
go get github.com/tools/godep
2014-10-09 07:04:58 +04:00
2014-07-28 10:20:18 +04:00
#set build and run environment
source dev.sh
2014-07-28 08:46:17 +04:00
make
make test
2014-05-22 04:52:38 +04:00
2014-10-01 12:47:35 +04:00
## Godep support
LedisDB now prefers using [godep](https://github.com/tools/godep) to build, godep can manage the go dependences easily.
If you don't want to use godep, you can first run `sh bootstrap.sh` to download the depencenecs and then `make`,
but I will not guarantee the dependence compatibility.
2014-07-28 10:20:18 +04:00
2014-07-26 05:22:09 +04:00
## LevelDB support
2014-05-22 04:52:38 +04:00
2014-07-26 14:39:54 +04:00
+ Install leveldb and snappy.
2014-05-22 04:52:38 +04:00
2014-07-27 03:01:01 +04:00
LedisDB supplies a simple script to install leveldb and snappy:
2014-05-22 04:52:38 +04:00
2014-08-27 10:31:46 +04:00
sudo sh tools/build_leveldb.sh
2014-05-22 04:52:38 +04:00
2014-11-24 04:25:25 +03:00
It will install leveldb at /usr/local/leveldb and snappy at /usr/local/snappy by default.
2014-07-21 06:46:11 +04:00
2014-11-24 04:25:25 +03:00
LedisDB uses the modified LevelDB for better performance. [Details.](https://github.com/siddontang/ledisdb/wiki/leveldb-source-modification)
2014-05-22 04:52:38 +04:00
2014-11-24 04:25:25 +03:00
You can easily use other LevelDB versions (like Hyper LevelDB or Basho LevelDB) instead, as long as the header files are in `include/leveldb`, not `include/hyperleveldb` or any other location.
2014-09-13 10:11:05 +04:00
+ Set `LEVELDB_DIR` and `SNAPPY_DIR` to the actual install path in dev.sh.
+ `make clean && make`
2014-05-22 04:52:38 +04:00
2014-07-26 05:22:09 +04:00
## RocksDB support
2014-05-22 04:52:38 +04:00
2014-08-12 10:44:16 +04:00
+ [Install rocksdb](https://github.com/facebook/rocksdb/blob/master/INSTALL.md)(`make shared_lib`) and snappy first.
2014-07-26 14:39:54 +04:00
2014-11-24 04:25:25 +03:00
LedisDB has not yet supplied a simple script to install.
2014-07-26 14:39:54 +04:00
2014-09-13 10:11:05 +04:00
+ Set `ROCKSDB_DIR` and `SNAPPY_DIR` to the actual install path in `dev.sh`.
+ `make clean && make`
2014-07-26 14:39:54 +04:00
2014-10-05 04:56:35 +04:00
2014-11-24 04:25:25 +03:00
If the RocksDB API changes, LedisDB may not build successfully. LedisDB currently supports RocksDB version 3.5 or later.
2014-08-12 10:44:16 +04:00
2014-07-26 14:39:54 +04:00
## Choose store database
2014-11-24 04:25:25 +03:00
LedisDB now supports goleveldb, lmdb, leveldb, rocksdb, boltdb, and RAM. It will use goleveldb by default.
2014-07-26 14:39:54 +04:00
2014-11-24 04:25:25 +03:00
Choosing a store database to use is very simple.
2014-07-26 14:39:54 +04:00
+ Set in server config file
db_name = "leveldb"
2014-07-26 14:39:54 +04:00
+ Set in command flag
ledis-server -config=/etc/ledis.conf -db_name=leveldb
2014-07-26 14:39:54 +04:00
2014-11-24 04:25:25 +03:00
Flag command set will overwrite config setting.
2014-07-26 14:39:54 +04:00
2014-09-07 06:58:18 +04:00
## Lua support
2014-07-26 14:39:54 +04:00
2014-11-24 04:25:25 +03:00
+ Compile and install Lua
2014-09-13 10:11:05 +04:00
+ Set `LUA_DIR` to the actual path in `dev.sh`
+ `make clean && make`
2014-05-22 04:52:38 +04:00
## Configuration
2014-08-27 11:37:42 +04:00
LedisDB uses [toml](https://github.com/toml-lang/toml) as the configuration format. The basic configuration ```./etc/ledis.conf``` in LedisDB source may help you.
If you don't use a configuration, LedisDB will use the default for you.
2014-07-21 06:46:11 +04:00
## Server Example
2014-07-28 10:20:18 +04:00
//set run environment if not
source dev.sh
2014-05-22 04:52:38 +04:00
ledis-server -config=/etc/ledis.conf
2014-05-22 04:52:38 +04:00
2014-06-12 11:56:04 +04:00
//another shell
2014-06-22 17:05:52 +04:00
ledis-cli -p 6380
2014-06-12 11:56:04 +04:00
2014-06-22 17:05:52 +04:00
ledis 127.0.0.1:6380> set a 1
2014-06-12 11:56:04 +04:00
OK
2014-06-22 17:05:52 +04:00
ledis 127.0.0.1:6380> get a
2014-06-12 11:56:04 +04:00
"1"
2014-08-04 07:55:39 +04:00
//use curl
curl http://127.0.0.1:11181/SET/hello/world
→ {"SET":[true,"OK"]}
curl http://127.0.0.1:11181/0/GET/hello?type=json
→ {"GET":"world"}
2014-07-21 06:46:11 +04:00
## Package Example
2014-06-12 11:56:04 +04:00
import "github.com/siddontang/ledisdb/ledis"
l, _ := ledis.Open(cfg)
2014-06-12 11:56:04 +04:00
db, _ := l.Select(0)
db.Set(key, value)
db.Get(key)
2014-07-21 06:46:11 +04:00
## Replication Example
2014-06-12 11:56:04 +04:00
2014-07-16 10:34:08 +04:00
Set slaveof in config or dynamiclly
2014-06-12 11:56:04 +04:00
2014-06-22 17:05:52 +04:00
ledis-cli -p 6381
2014-06-12 11:56:04 +04:00
2014-07-24 08:16:42 +04:00
ledis 127.0.0.1:6381> slaveof 127.0.0.1 6380
2014-06-12 11:56:04 +04:00
OK
2014-12-04 15:59:16 +03:00
## Cluster support
LedisDB uses a proxy named [xcodis](https://github.com/siddontang/xcodis) to support cluster.
2014-05-22 04:52:38 +04:00
## Benchmark
2014-07-28 10:31:31 +04:00
See [benchmark](https://github.com/siddontang/ledisdb/wiki/Benchmark) for more.
2014-05-22 04:52:38 +04:00
## Todo
2014-07-21 06:46:11 +04:00
See [Issues todo](https://github.com/siddontang/ledisdb/issues?labels=todo&page=1&state=open)
2014-05-22 04:52:38 +04:00
2014-10-17 06:30:48 +04:00
## Client
See [Clients](https://github.com/siddontang/ledisdb/wiki/Clients) to find or contribute LedisDB client.
2014-06-30 07:48:09 +04:00
2014-07-16 12:58:03 +04:00
## Links
2014-06-30 07:48:09 +04:00
2014-07-16 12:58:03 +04:00
+ [Official Website](http://ledisdb.com)
2014-07-16 12:59:42 +04:00
+ [GoDoc](https://godoc.org/github.com/siddontang/ledisdb)
2014-07-16 12:59:59 +04:00
+ [Server Commands](https://github.com/siddontang/ledisdb/wiki/Commands)
2014-06-30 07:48:09 +04:00
2014-09-07 06:58:18 +04:00
## Caveat
2014-11-24 04:25:25 +03:00
+ Changing the backend database at runtime is very dangerous. Data validation is not guaranteed if this is done.
+ `pcall` and `xpcall` are not supported in Lua. See the README in [golua](https://github.com/aarzilli/golua).
2014-09-07 06:58:18 +04:00
2014-06-30 07:48:09 +04:00
## Requirement
2014-07-21 06:46:11 +04:00
2014-11-24 04:25:25 +03:00
+ Go version >= 1.3
2014-07-16 10:34:08 +04:00
2014-05-22 04:52:38 +04:00
## Feedback
2014-12-03 12:27:15 +03:00
+ Gmail: siddontang@gmail.com
+ Skype: live:siddontang_1