ledisdb/README.md

186 lines
5.0 KiB
Markdown
Raw Normal View History

2014-07-10 05:29:34 +04:00
# LedisDB
2014-05-22 04:52:38 +04:00
2014-08-27 11:10:04 +04:00
Ledisdb is a high performance NoSQL like Redis written by go. It supports some data structure like kv, list, hash, zset, bitmap,set.
2014-07-26 05:22:09 +04:00
2014-08-12 10:44:16 +04:00
LedisDB now supports multiple databases as backend to store data, you can test and choose the proper one for you.
2014-05-22 04:52:38 +04:00
2014-07-11 13:30:40 +04:00
## Features
2014-08-15 20:08:01 +04:00
+ Rich data structure: KV, List, Hash, ZSet, Bitmap, Set.
2014-07-26 05:22:09 +04:00
+ Stores lots of data, over the memory limit.
+ Various backend database to use: LevelDB, goleveldb, LMDB, RocksDB, BoltDB, Memory.
2014-08-25 10:18:23 +04:00
+ Supports transaction using LMDB or BotlDB.
2014-09-02 18:36:50 +04:00
+ Supports lua scripting.
2014-07-11 13:30:40 +04:00
+ Supports expiration and ttl.
2014-09-09 06:01:46 +04:00
+ Supports using redis-cli directly.
2014-08-06 05:30:44 +04:00
+ Easy to embed in your own Go application.
+ HTTP API support, json/bson/msgpack output.
2014-07-11 13:30:40 +04:00
+ Replication to guarantee data safe.
+ Supplies tools to load, dump, repair database.
2014-05-22 04:52:38 +04:00
## Build and Install
2014-07-26 05:22:09 +04:00
Create a workspace and checkout ledisdb source
mkdir $WORKSPACE
cd $WORKSPACE
git clone git@github.com:siddontang/ledisdb.git src/github.com/siddontang/ledisdb
cd src/github.com/siddontang/ledisdb
2014-05-22 04:52:38 +04:00
2014-10-09 07:04:58 +04:00
#install go dependences
./bootstrap.sh
2014-07-28 10:20:18 +04:00
#set build and run environment
source dev.sh
2014-07-28 08:46:17 +04:00
make
make test
2014-05-22 04:52:38 +04:00
2014-10-01 12:47:35 +04:00
## Godep support
LedisDB supports building with [godep](https://github.com/tools/godep) which can manage LedisDB go dependence automatically.
2014-07-28 10:20:18 +04:00
2014-07-26 05:22:09 +04:00
## LevelDB support
2014-05-22 04:52:38 +04:00
2014-07-26 14:39:54 +04:00
+ Install leveldb and snappy.
2014-05-22 04:52:38 +04:00
2014-07-27 03:01:01 +04:00
LedisDB supplies a simple script to install leveldb and snappy:
2014-05-22 04:52:38 +04:00
2014-08-27 10:31:46 +04:00
sudo sh tools/build_leveldb.sh
2014-05-22 04:52:38 +04:00
2014-07-21 06:46:11 +04:00
It will default install leveldb at /usr/local/leveldb and snappy at /usr/local/snappy.
2014-07-21 06:47:25 +04:00
LedisDB use the modified LevelDB for better performance, see [here](https://github.com/siddontang/ledisdb/wiki/leveldb-source-modification).
2014-05-22 04:52:38 +04:00
You can use other LevelDB (like Hyper LevelDB, Basho LevelDB) instead easily, the only thing you may pay attention to is that the header files must be in `include/leveldb` folder not `include/hyperleveldb` or other.
2014-09-13 10:11:05 +04:00
+ Set `LEVELDB_DIR` and `SNAPPY_DIR` to the actual install path in dev.sh.
+ `make clean && make`
2014-05-22 04:52:38 +04:00
2014-07-26 05:22:09 +04:00
## RocksDB support
2014-05-22 04:52:38 +04:00
2014-08-12 10:44:16 +04:00
+ [Install rocksdb](https://github.com/facebook/rocksdb/blob/master/INSTALL.md)(`make shared_lib`) and snappy first.
2014-07-26 14:39:54 +04:00
2014-07-28 08:46:17 +04:00
LedisDB has not supplied a simple script to install, maybe later.
2014-07-26 14:39:54 +04:00
2014-09-13 10:11:05 +04:00
+ Set `ROCKSDB_DIR` and `SNAPPY_DIR` to the actual install path in `dev.sh`.
+ `make clean && make`
2014-07-26 14:39:54 +04:00
2014-10-05 04:56:35 +04:00
Because RocksDB API may change sometimes, LedisDB may not build successfully. Now LedisDB supports RocksDB version 3.5 or newest master branch.
2014-08-12 10:44:16 +04:00
2014-07-26 14:39:54 +04:00
## Choose store database
LedisDB now supports goleveldb, lmdb, leveldb, rocksdb, boltdb, memory. it will use goleveldb as default to store data if you don't set.
2014-07-26 14:39:54 +04:00
Choosing a store database to use is very simple, you have two ways:
+ Set in server config file
db_name = "leveldb"
2014-07-26 14:39:54 +04:00
+ Set in command flag
ledis-server -config=/etc/ledis.conf -db_name=leveldb
2014-07-26 14:39:54 +04:00
Flag command set will overwrite config set.
2014-09-07 06:58:18 +04:00
## Lua support
2014-07-26 14:39:54 +04:00
2014-09-13 10:11:05 +04:00
+ Compile and install lua
+ Set `LUA_DIR` to the actual path in `dev.sh`
+ `make clean && make`
2014-05-22 04:52:38 +04:00
## Configuration
2014-08-27 11:37:42 +04:00
LedisDB uses [toml](https://github.com/toml-lang/toml) as the configuration format. The basic configuration ```./etc/ledis.conf``` in LedisDB source may help you.
If you don't use a configuration, LedisDB will use the default for you.
2014-07-21 06:46:11 +04:00
## Server Example
2014-07-28 10:20:18 +04:00
//set run environment if not
source dev.sh
2014-05-22 04:52:38 +04:00
ledis-server -config=/etc/ledis.conf
2014-05-22 04:52:38 +04:00
2014-06-12 11:56:04 +04:00
//another shell
2014-06-22 17:05:52 +04:00
ledis-cli -p 6380
2014-06-12 11:56:04 +04:00
2014-06-22 17:05:52 +04:00
ledis 127.0.0.1:6380> set a 1
2014-06-12 11:56:04 +04:00
OK
2014-06-22 17:05:52 +04:00
ledis 127.0.0.1:6380> get a
2014-06-12 11:56:04 +04:00
"1"
2014-08-04 07:55:39 +04:00
//use curl
curl http://127.0.0.1:11181/SET/hello/world
→ {"SET":[true,"OK"]}
curl http://127.0.0.1:11181/0/GET/hello?type=json
→ {"GET":"world"}
2014-07-21 06:46:11 +04:00
## Package Example
2014-06-12 11:56:04 +04:00
import "github.com/siddontang/ledisdb/ledis"
l, _ := ledis.Open(cfg)
2014-06-12 11:56:04 +04:00
db, _ := l.Select(0)
db.Set(key, value)
db.Get(key)
2014-07-21 06:46:11 +04:00
## Replication Example
2014-06-12 11:56:04 +04:00
2014-07-16 10:34:08 +04:00
Set slaveof in config or dynamiclly
2014-06-12 11:56:04 +04:00
2014-06-22 17:05:52 +04:00
ledis-cli -p 6381
2014-06-12 11:56:04 +04:00
2014-07-24 08:16:42 +04:00
ledis 127.0.0.1:6381> slaveof 127.0.0.1 6380
2014-06-12 11:56:04 +04:00
OK
2014-05-22 04:52:38 +04:00
## Benchmark
2014-07-28 10:31:31 +04:00
See [benchmark](https://github.com/siddontang/ledisdb/wiki/Benchmark) for more.
2014-05-22 04:52:38 +04:00
## Todo
2014-07-21 06:46:11 +04:00
See [Issues todo](https://github.com/siddontang/ledisdb/issues?labels=todo&page=1&state=open)
2014-05-22 04:52:38 +04:00
2014-10-17 06:30:48 +04:00
## Client
See [Clients](https://github.com/siddontang/ledisdb/wiki/Clients) to find or contribute LedisDB client.
2014-06-30 07:48:09 +04:00
2014-07-16 12:58:03 +04:00
## Links
2014-06-30 07:48:09 +04:00
2014-07-16 12:58:03 +04:00
+ [Official Website](http://ledisdb.com)
2014-07-16 12:59:42 +04:00
+ [GoDoc](https://godoc.org/github.com/siddontang/ledisdb)
2014-07-16 12:59:59 +04:00
+ [Server Commands](https://github.com/siddontang/ledisdb/wiki/Commands)
2014-06-30 07:48:09 +04:00
2014-09-07 06:58:18 +04:00
## Caveat
+ You must known that changing store database runtime is very dangerous, LedisDB will not guarantee the data validation if you do it.
+ Begin a transaction will block any other write operators before you call `commit` or `rollback`. Don't use long-time transaction.
+ `pcall` and `xpcall` are not supported in lua, you can see the readme in [golua](https://github.com/aarzilli/golua).
2014-06-30 07:48:09 +04:00
2014-06-12 11:58:50 +04:00
## Thanks
2014-07-02 06:23:13 +04:00
Gmail: cenqichao@gmail.com
2014-07-09 05:33:44 +04:00
2014-07-02 06:23:13 +04:00
Gmail: chendahui007@gmail.com
2014-06-12 11:58:50 +04:00
2014-07-21 06:46:11 +04:00
Gmail: cppgohan@gmail.com
Gmail: tiaotiaoyly@gmail.com
Gmail: wyk4true@gmail.com
2014-07-16 10:34:08 +04:00
2014-05-22 04:52:38 +04:00
## Feedback
2014-07-16 12:59:59 +04:00
Gmail: siddontang@gmail.com