evio/README.md

185 lines
5.4 KiB
Markdown
Raw Normal View History

2017-07-04 06:39:18 +03:00
# `✨ shiny ✨`
2017-07-04 21:22:02 +03:00
[![Build Status](https://img.shields.io/travis/tidwall/shiny.svg?style=flat-square)](https://travis-ci.org/tidwall/shiny)
[![GoDoc](https://img.shields.io/badge/api-reference-blue.svg?style=flat-square)](https://godoc.org/github.com/tidwall/shiny)
2017-07-04 16:11:27 +03:00
Shiny is an alternative server framework for Go that uses I/O multiplexing.
2017-07-06 20:11:46 +03:00
It makes direct [epoll](https://en.wikipedia.org/wiki/Epoll) and [kqueue](https://en.wikipedia.org/wiki/Kqueue) syscalls rather than the standard Go [net](https://golang.org/pkg/net/) package.
2017-07-04 06:39:18 +03:00
2017-07-06 20:11:46 +03:00
It uses the [Reactor](https://en.wikipedia.org/wiki/Reactor_pattern) pattern where the server waits for the OS to signal a readiness event. This is similar to the way that [libuv](https://github.com/libuv/libuv), [libevent](https://github.com/libevent/libevent), [haproxy](http://www.haproxy.org/), [nginx](http://nginx.org/), [redis](http://redis.io/), and other high performance servers work.
2017-07-04 06:39:18 +03:00
2017-07-04 16:11:27 +03:00
The goal of this project is to create a simple server framework for Go that performs on par with Redis and Haproxy for packet handling, but without having to interop with Cgo. My hope is to use this as a foundation for [Tile38](http://github.com/tidwall/tile38) and other projects. Early benchmarks are exceeding my expectations.
2017-07-04 06:39:18 +03:00
2017-07-04 16:11:27 +03:00
**This project is a work in progress. The API will likely change between now and Tile38 v2.0 release.**
2017-07-04 06:39:18 +03:00
## Features
- Simple API. Only one entrypoint and four event functions
- Low memory usage
- Very fast single-threaded support
- Support for non-epoll/kqueue operating systems by simulating events with the net package.
## Getting Started
### Installing
To start using Shiny, install Go and run `go get`:
```sh
$ go get -u github.com/tidwall/shiny
```
This will retrieve the library.
### Usage
There's only the one function:
```go
func Serve(net, addr string,
handle func(id int, data []byte, ctx interface{}) (send []byte, keepopen bool),
accept func(id int, addr string, wake func(), ctx interface{}) (send []byte, keepopen bool),
closed func(id int, err error, ctx interface{}),
ticker func(ctx interface{}) (keepserving bool),
2017-07-04 16:41:32 +03:00
ctx interface{}) error
2017-07-04 06:39:18 +03:00
```
2017-07-04 16:41:32 +03:00
- All events are executed in the same thread as the `Serve` call.
- `handle`, `accept`, and `closed` events have an `id` param which is a unique number assigned to the client socket.
- `data` represents a network packet.
- `ctx` is a user-defined context or nil.
- `wake` is a function that when called will trigger the `handle` event with zero data for the specified `id`. It can be called safely from other Goroutines.
2017-08-04 21:48:13 +03:00
- `ticker` is an event that fires between 1 and 60 times a second, depending on the packet traffic.
2017-07-04 16:41:32 +03:00
2017-07-04 06:39:18 +03:00
## Example
2017-07-04 21:43:52 +03:00
Please check out the [examples](examples) subdirectory for a simplified [redis](examples/redis-server/main.go) clone and an [echo](examples/echo-server/main.go) server.
2017-07-04 06:39:18 +03:00
Here's a basic echo server:
```go
package main
import (
"flag"
"fmt"
"log"
"github.com/tidwall/shiny"
)
var shutdown bool
var started bool
var port int
func main() {
flag.IntVar(&port, "port", 9999, "server port")
flag.Parse()
log.Fatal(shiny.Serve("tcp", fmt.Sprintf(":%d", port),
handle, accept, closed, ticker, nil))
}
// handle - the incoming client socket data.
func handle(id int, data []byte, ctx interface{}) (send []byte, keepopen bool) {
if shutdown {
return nil, false
}
keepopen = true
if string(data) == "shutdown\r\n" {
shutdown = true
} else if string(data) == "quit\r\n" {
keepopen = false
}
return data, keepopen
}
// accept - a new client socket has opened.
// 'wake' is a function that when called will fire a 'handle' event
// for the specified ID, and is goroutine-safe.
func accept(id int, addr string, wake func(), ctx interface{}) (send []byte, keepopen bool) {
if shutdown {
return nil, false
}
// this is a good place to create a user-defined socket context.
return []byte(
"Welcome to the echo server!\n" +
"Enter 'quit' to close your connection or " +
"'shutdown' to close the server.\n"), true
}
// closed - a client socket has closed
func closed(id int, err error, ctx interface{}) {
// teardown the socket context here
}
// ticker - a ticker that fires between 1 and 1/20 of a second
// depending on the traffic.
func ticker(ctx interface{}) (keepserving bool) {
if shutdown {
// do server teardown here
return false
}
if !started {
fmt.Printf("echo server started on port %d\n", port)
started = true
}
2017-07-04 16:11:27 +03:00
// perform various non-socket io related operations here
2017-07-04 06:39:18 +03:00
return true
}
```
Run the example:
```
2017-07-04 21:43:52 +03:00
$ go run examples/echo-server/main.go
2017-07-04 06:39:18 +03:00
```
Connect to the server:
```
$ telnet localhost 9999
```
## Performance
The benchmarks below use pipelining which allows for combining multiple Redis commands into a single packet.
**Redis**
```
$ redis-server --port 6379 --appendonly no
```
```
redis-benchmark -p 6379 -t ping,set,get -q -P 128
PING_INLINE: 961538.44 requests per second
PING_BULK: 1960784.38 requests per second
SET: 943396.25 requests per second
GET: 1369863.00 requests per second
```
**Shiny**
```
2017-07-04 21:43:52 +03:00
$ go run examples/redis-server/main.go --port 6380 --appendonly no
2017-07-04 06:39:18 +03:00
```
```
redis-benchmark -p 6380 -t ping,set,get -q -P 128
PING_INLINE: 3846153.75 requests per second
PING_BULK: 4166666.75 requests per second
SET: 3703703.50 requests per second
GET: 3846153.75 requests per second
```
*Running on a MacBook Pro 15" 2.8 GHz Intel Core i7 using Go 1.7*
## Contact
Josh Baker [@tidwall](http://twitter.com/tidwall)
## License
Shiny source code is available under the MIT [License](/LICENSE).