logrus/README.md

443 lines
18 KiB
Markdown
Raw Normal View History

# Logrus <img src="http://i.imgur.com/hTeVwmJ.png" width="40" height="40" alt=":walrus:" class="emoji" title=":walrus:"/>&nbsp;[![Build Status](https://travis-ci.org/Sirupsen/logrus.svg?branch=master)](https://travis-ci.org/Sirupsen/logrus)&nbsp;[![GoDoc](https://godoc.org/github.com/Sirupsen/logrus?status.svg)](https://godoc.org/github.com/Sirupsen/logrus)
2013-10-16 23:27:10 +04:00
2016-12-02 02:55:03 +03:00
**Seeing weird case-sensitive problems?** See [this
issue](https://github.com/sirupsen/logrus/issues/451#issuecomment-264332021).
This change has been reverted. I apologize for causing this. I greatly
underestimated the impact this would have. Logrus strives for stability and
backwards compatibility and failed to provide that.
2014-03-11 04:07:22 +04:00
Logrus is a structured logger for Go (golang), completely API compatible with
2014-07-27 04:47:50 +04:00
the standard library logger. [Godoc][godoc]. **Please note the Logrus API is not
yet stable (pre 1.0). Logrus itself is completely stable and has been used in
many large deployments. The core API is unlikely to change much but please
version control your Logrus to make sure you aren't fetching latest `master` on
every build.**
2013-10-16 23:27:10 +04:00
2014-03-11 04:00:07 +04:00
Nicely color-coded in development (when a TTY is attached, otherwise just
plain text):
2014-03-11 03:59:18 +04:00
2014-03-11 04:00:07 +04:00
![Colored](http://i.imgur.com/PY7qMwd.png)
2014-03-11 03:59:18 +04:00
With `log.SetFormatter(&log.JSONFormatter{})`, for easy parsing by logstash
2014-03-11 04:01:07 +04:00
or Splunk:
2014-03-11 03:59:18 +04:00
```json
{"animal":"walrus","level":"info","msg":"A group of walrus emerges from the
2014-03-15 00:17:18 +04:00
ocean","size":10,"time":"2014-03-10 19:57:38.562264131 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"level":"warning","msg":"The group's number increased tremendously!",
"number":122,"omg":true,"time":"2014-03-10 19:57:38.562471297 -0400 EDT"}
{"animal":"walrus","level":"info","msg":"A giant walrus appears!",
2014-03-15 00:17:18 +04:00
"size":10,"time":"2014-03-10 19:57:38.562500591 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"animal":"walrus","level":"info","msg":"Tremendously sized cow enters the ocean.",
2014-03-15 00:17:18 +04:00
"size":9,"time":"2014-03-10 19:57:38.562527896 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"level":"fatal","msg":"The ice breaks!","number":100,"omg":true,
"time":"2014-03-10 19:57:38.562543128 -0400 EDT"}
2014-03-11 03:59:18 +04:00
```
With the default `log.SetFormatter(&log.TextFormatter{})` when a TTY is not
2014-04-24 04:21:38 +04:00
attached, the output is compatible with the
[logfmt](http://godoc.org/github.com/kr/logfmt) format:
```text
time="2015-03-26T01:27:38-04:00" level=debug msg="Started observing beach" animal=walrus number=8
time="2015-03-26T01:27:38-04:00" level=info msg="A group of walrus emerges from the ocean" animal=walrus size=10
time="2015-03-26T01:27:38-04:00" level=warning msg="The group's number increased tremendously!" number=122 omg=true
time="2015-03-26T01:27:38-04:00" level=debug msg="Temperature changes" temperature=-4
time="2015-03-26T01:27:38-04:00" level=panic msg="It's over 9000!" animal=orca size=9009
time="2015-03-26T01:27:38-04:00" level=fatal msg="The ice breaks!" err=&{0x2082280c0 map[animal:orca size:9009] 2015-03-26 01:27:38.441574009 -0400 EDT panic It's over 9000!} number=100 omg=true
exit status 1
```
2014-04-14 01:51:46 +04:00
#### Example
The simplest way to use Logrus is simply the package-level exported logger:
2014-04-14 01:51:46 +04:00
```go
package main
import (
log "github.com/Sirupsen/logrus"
2014-04-14 01:51:46 +04:00
)
func main() {
2016-06-01 14:32:10 +03:00
log.WithFields(log.Fields{
2014-07-27 06:51:23 +04:00
"animal": "walrus",
}).Info("A walrus appears")
}
```
Note that it's completely api-compatible with the stdlib logger, so you can
replace your `log` imports everywhere with `log "github.com/Sirupsen/logrus"`
and you'll now have the flexibility of Logrus. You can customize it all you
want:
```go
package main
import (
"os"
log "github.com/Sirupsen/logrus"
)
2014-04-14 01:51:46 +04:00
func init() {
// Log as JSON instead of the default ASCII formatter.
2014-08-06 07:09:02 +04:00
log.SetFormatter(&log.JSONFormatter{})
// Output to stdout instead of the default stderr
// Can be any io.Writer, see below for File example
log.SetOutput(os.Stdout)
// Only log the warning severity or above.
2014-08-06 07:09:02 +04:00
log.SetLevel(log.WarnLevel)
2014-04-14 01:51:46 +04:00
}
func main() {
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"animal": "walrus",
"size": 10,
}).Info("A group of walrus emerges from the ocean")
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"omg": true,
"number": 122,
}).Warn("The group's number increased tremendously!")
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"omg": true,
"number": 100,
}).Fatal("The ice breaks!")
2015-03-31 18:24:31 +03:00
2015-03-31 18:30:41 +03:00
// A common pattern is to re-use fields between logging statements by re-using
// the logrus.Entry returned from WithFields()
2015-03-31 18:24:31 +03:00
contextLogger := log.WithFields(log.Fields{
"common": "this is a common field",
"other": "I also should be logged always",
})
contextLogger.Info("I'll be logged with common and other field")
contextLogger.Info("Me too")
2014-04-14 01:51:46 +04:00
}
```
For more advanced usage such as logging to multiple locations from the same
application, you can also create an instance of the `logrus` Logger:
```go
package main
import (
"github.com/Sirupsen/logrus"
)
// Create a new instance of the logger. You can have any number of instances.
var log = logrus.New()
func main() {
// The API for setting attributes is a little different than the package level
// exported logger. See Godoc.
log.Out = os.Stdout
// You could set this to any `io.Writer` such as a file
// file, err := os.OpenFile("logrus.log", os.O_CREATE|os.O_WRONLY, 0666)
// if err == nil {
// log.Out = file
// } else {
// log.Info("Failed to log to file, using default stderr")
// }
2014-10-28 00:22:57 +03:00
log.WithFields(logrus.Fields{
"animal": "walrus",
"size": 10,
}).Info("A group of walrus emerges from the ocean")
}
```
2014-03-07 06:20:13 +04:00
#### Fields
2013-10-16 23:27:10 +04:00
2014-04-24 04:21:38 +04:00
Logrus encourages careful, structured logging though logging fields instead of
long, unparseable error messages. For example, instead of: `log.Fatalf("Failed
to send event %s to topic %s with key %d")`, you should log the much more
discoverable:
2013-10-16 23:27:10 +04:00
2014-03-07 06:20:13 +04:00
```go
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-03-07 06:20:13 +04:00
"event": event,
"topic": topic,
"key": key,
2014-03-07 06:20:13 +04:00
}).Fatal("Failed to send event")
```
We've found this API forces you to think about logging in a way that produces
2014-03-11 19:01:18 +04:00
much more useful logging messages. We've been in countless situations where just
a single added field to a log statement that was already there would've saved us
hours. The `WithFields` call is optional.
2014-03-07 06:20:13 +04:00
2014-03-07 06:26:05 +04:00
In general, with Logrus using any of the `printf`-family functions should be
2014-04-24 04:21:38 +04:00
seen as a hint you should add a field, however, you can still use the
2014-03-07 06:26:05 +04:00
`printf`-family functions with Logrus.
2014-03-07 06:20:13 +04:00
#### Hooks
2013-10-16 23:27:10 +04:00
2014-03-07 06:26:05 +04:00
You can add hooks for logging levels. For example to send errors to an exception
2014-04-24 04:21:38 +04:00
tracking service on `Error`, `Fatal` and `Panic`, info to StatsD or log to
multiple places simultaneously, e.g. syslog.
2013-10-16 23:27:10 +04:00
Logrus comes with [built-in hooks](hooks/). Add those, or your custom hook, in
`init`:
```go
import (
log "github.com/Sirupsen/logrus"
"gopkg.in/gemnasium/logrus-airbrake-hook.v2" // the package is named "aibrake"
logrus_syslog "github.com/Sirupsen/logrus/hooks/syslog"
2014-11-23 05:09:39 +03:00
"log/syslog"
)
func init() {
// Use the Airbrake hook to report errors that have Error severity or above to
// an exception tracker. You can create custom hooks, see the Hooks section.
log.AddHook(airbrake.NewHook(123, "xyz", "production"))
2014-11-23 05:09:39 +03:00
hook, err := logrus_syslog.NewSyslogHook("udp", "localhost:514", syslog.LOG_INFO, "")
if err != nil {
log.Error("Unable to connect to local syslog daemon")
} else {
log.AddHook(hook)
}
}
```
Note: Syslog hook also support connecting to local syslog (Ex. "/dev/log" or "/var/run/syslog" or "/var/run/log"). For the detail, please check the [syslog hook README](hooks/syslog/README.md).
| Hook | Description |
| ----- | ----------- |
| [Airbrake](https://github.com/gemnasium/logrus-airbrake-hook) | Send errors to the Airbrake API V3. Uses the official [`gobrake`](https://github.com/airbrake/gobrake) behind the scenes. |
| [Airbrake "legacy"](https://github.com/gemnasium/logrus-airbrake-legacy-hook) | Send errors to an exception tracking service compatible with the Airbrake API V2. Uses [`airbrake-go`](https://github.com/tobi/airbrake-go) behind the scenes. |
| [Papertrail](https://github.com/polds/logrus-papertrail-hook) | Send errors to the [Papertrail](https://papertrailapp.com) hosted logging service via UDP. |
| [Syslog](https://github.com/Sirupsen/logrus/blob/master/hooks/syslog/syslog.go) | Send errors to remote syslog server. Uses standard library `log/syslog` behind the scenes. |
2015-10-22 23:20:45 +03:00
| [Bugsnag](https://github.com/Shopify/logrus-bugsnag/blob/master/bugsnag.go) | Send errors to the Bugsnag exception tracking service. |
| [Sentry](https://github.com/evalphobia/logrus_sentry) | Send errors to the Sentry error logging and aggregation service. |
| [Hiprus](https://github.com/nubo/hiprus) | Send errors to a channel in hipchat. |
| [Logrusly](https://github.com/sebest/logrusly) | Send logs to [Loggly](https://www.loggly.com/) |
| [Slackrus](https://github.com/johntdyer/slackrus) | Hook for Slack chat. |
| [Journalhook](https://github.com/wercker/journalhook) | Hook for logging to `systemd-journald` |
| [Graylog](https://github.com/gemnasium/logrus-graylog-hook) | Hook for logging to [Graylog](http://graylog2.org/) |
| [Raygun](https://github.com/squirkle/logrus-raygun-hook) | Hook for logging to [Raygun.io](http://raygun.io/) |
| [LFShook](https://github.com/rifflock/lfshook) | Hook for logging to the local filesystem |
2015-06-09 02:55:33 +03:00
| [Honeybadger](https://github.com/agonzalezro/logrus_honeybadger) | Hook for sending exceptions to Honeybadger |
2015-06-10 12:09:59 +03:00
| [Mail](https://github.com/zbindenren/logrus_mail) | Hook for sending exceptions via mail |
| [Rollrus](https://github.com/heroku/rollrus) | Hook for sending errors to rollbar |
| [Fluentd](https://github.com/evalphobia/logrus_fluent) | Hook for logging to fluentd |
2015-08-27 04:54:11 +03:00
| [Mongodb](https://github.com/weekface/mgorus) | Hook for logging to mongodb |
| [Influxus] (http://github.com/vlad-doru/influxus) | Hook for concurrently logging to [InfluxDB] (http://influxdata.com/) |
2015-10-12 20:41:37 +03:00
| [InfluxDB](https://github.com/Abramovic/logrus_influxdb) | Hook for logging to influxdb |
| [Octokit](https://github.com/dorajistyle/logrus-octokit-hook) | Hook for logging to github via octokit |
2015-11-07 01:47:10 +03:00
| [DeferPanic](https://github.com/deferpanic/dp-logrus) | Hook for logging to DeferPanic |
2016-01-26 23:01:36 +03:00
| [Redis-Hook](https://github.com/rogierlommers/logrus-redis-hook) | Hook for logging to a ELK stack (through Redis) |
2016-02-12 13:30:56 +03:00
| [Amqp-Hook](https://github.com/vladoatanasov/logrus_amqp) | Hook for logging to Amqp broker (Like RabbitMQ) |
2016-02-19 03:38:25 +03:00
| [KafkaLogrus](https://github.com/goibibo/KafkaLogrus) | Hook for logging to kafka |
2016-03-10 07:13:41 +03:00
| [Typetalk](https://github.com/dragon3/logrus-typetalk-hook) | Hook for logging to [Typetalk](https://www.typetalk.in/) |
| [ElasticSearch](https://github.com/sohlich/elogrus) | Hook for logging to ElasticSearch|
| [Sumorus](https://github.com/doublefree/sumorus) | Hook for logging to [SumoLogic](https://www.sumologic.com/)|
2016-09-18 22:42:16 +03:00
| [Scribe](https://github.com/sagar8192/logrus-scribe-hook) | Hook for logging to [Scribe](https://github.com/facebookarchive/scribe)|
| [Logstash](https://github.com/bshuster-repo/logrus-logstash-hook) | Hook for logging to [Logstash](https://www.elastic.co/products/logstash) |
2016-10-09 14:02:24 +03:00
| [logz.io](https://github.com/ripcurld00d/logrus-logzio-hook) | Hook for logging to [logz.io](https://logz.io), a Log as a Service using Logstash |
| [Logmatic.io](https://github.com/logmatic/logmatic-go) | Hook for logging to [Logmatic.io](http://logmatic.io/) |
2016-09-19 17:09:08 +03:00
| [Pushover](https://github.com/toorop/logrus_pushover) | Send error via [Pushover](https://pushover.net) |
2016-11-04 04:59:20 +03:00
| [PostgreSQL](https://github.com/gemnasium/logrus-postgresql-hook) | Send logs to [PostgreSQL](http://postgresql.org) |
| [Logentrus](https://github.com/puddingfactory/logentrus) | Hook for logging to [Logentries](https://logentries.com/) |
2015-02-19 21:51:02 +03:00
2014-03-07 06:20:13 +04:00
#### Level logging
2013-10-16 23:27:10 +04:00
2014-03-11 04:06:39 +04:00
Logrus has six logging levels: Debug, Info, Warning, Error, Fatal and Panic.
2013-10-16 23:27:10 +04:00
2014-02-24 05:19:34 +04:00
```go
2014-03-07 06:49:10 +04:00
log.Debug("Useful debugging information.")
2014-03-07 06:20:13 +04:00
log.Info("Something noteworthy happened!")
log.Warn("You should probably take a look at this.")
log.Error("Something failed but I'm not quitting.")
2014-03-12 16:00:18 +04:00
// Calls os.Exit(1) after logging
2014-03-07 06:20:13 +04:00
log.Fatal("Bye.")
2014-03-12 16:00:18 +04:00
// Calls panic() after logging
2014-03-07 06:20:13 +04:00
log.Panic("I'm bailing.")
```
2014-03-11 04:06:39 +04:00
You can set the logging level on a `Logger`, then it will only log entries with
that severity or anything above it:
2014-03-07 06:49:10 +04:00
```go
2014-03-11 04:06:39 +04:00
// Will log anything that is info or above (warn, error, fatal, panic). Default.
2014-07-27 06:51:23 +04:00
log.SetLevel(log.InfoLevel)
2014-03-07 06:49:10 +04:00
```
2014-07-27 06:23:41 +04:00
It may be useful to set `log.Level = logrus.DebugLevel` in a debug or verbose
2014-03-11 04:06:39 +04:00
environment if your application has that.
2014-03-07 06:20:13 +04:00
#### Entries
Besides the fields added with `WithField` or `WithFields` some fields are
automatically added to all logging events:
1. `time`. The timestamp when the entry was created.
2. `msg`. The logging message passed to `{Info,Warn,Error,Fatal,Panic}` after
the `AddFields` call. E.g. `Failed to send event.`
3. `level`. The logging level. E.g. `info`.
#### Environments
2014-03-14 23:21:54 +04:00
Logrus has no notion of environment.
2014-03-11 04:06:39 +04:00
If you wish for hooks and formatters to only be used in specific environments,
you should handle that yourself. For example, if your application has a global
variable `Environment`, which is a string representation of the environment you
could do:
2014-03-07 06:20:13 +04:00
```go
import (
log "github.com/Sirupsen/logrus"
)
2014-03-07 06:20:13 +04:00
init() {
// do something here to set environment depending on an environment variable
// or command-line flag
if Environment == "production" {
2015-08-18 21:15:02 +03:00
log.SetFormatter(&log.JSONFormatter{})
2014-03-07 06:20:13 +04:00
} else {
// The TextFormatter is default, you don't actually have to do this.
log.SetFormatter(&log.TextFormatter{})
2014-03-07 06:20:13 +04:00
}
2013-10-16 23:27:10 +04:00
}
```
2014-02-24 05:19:34 +04:00
2014-03-11 04:06:39 +04:00
This configuration is how `logrus` was intended to be used, but JSON in
production is mostly only useful if you do log aggregation with tools like
Splunk or Logstash.
#### Formatters
2014-03-07 06:20:13 +04:00
2014-03-14 23:21:54 +04:00
The built-in logging formatters are:
2014-03-07 06:20:13 +04:00
* `logrus.TextFormatter`. Logs the event in colors if stdout is a tty, otherwise
2014-03-07 21:51:29 +04:00
without colors.
* *Note:* to force colored output when there is no TTY, set the `ForceColors`
field to `true`. To force no colored output even if there is a TTY set the
2014-08-15 02:04:57 +04:00
`DisableColors` field to `true`
2014-03-07 21:51:29 +04:00
* `logrus.JSONFormatter`. Logs fields as JSON.
2015-02-20 19:02:11 +03:00
2014-03-14 23:21:54 +04:00
Third party logging formatters:
2016-07-12 23:21:34 +03:00
* [`logstash`](https://github.com/bshuster-repo/logrus-logstash-hook). Logs fields as [Logstash](http://logstash.net) Events.
* [`prefixed`](https://github.com/x-cray/logrus-prefixed-formatter). Displays log entry source along with alternative layout.
* [`zalgo`](https://github.com/aybabtme/logzalgo). Invoking the P͉̫o̳̼̊w̖͈̰͎e̬͔̭͂r͚̼̹̲ ̫͓͉̳͈ō̠͕͖̚f̝͍̠ ͕̲̞͖͑Z̖̫̤̫ͪa͉̬͈̗l͖͎g̳̥o̰̥̅!̣͔̲̻͊̄ ̙̘̦̹̦.
2014-03-14 23:21:54 +04:00
2014-03-11 04:06:39 +04:00
You can define your formatter by implementing the `Formatter` interface,
requiring a `Format` method. `Format` takes an `*Entry`. `entry.Data` is a
`Fields` type (`map[string]interface{}`) with all your fields as well as the
default ones (see Entries section above):
2014-03-07 06:20:13 +04:00
```go
2014-03-11 03:27:19 +04:00
type MyJSONFormatter struct {
}
log.SetFormatter(new(MyJSONFormatter))
2014-03-11 03:27:19 +04:00
func (f *MyJSONFormatter) Format(entry *Entry) ([]byte, error) {
// Note this doesn't include Time, Level and Message which are available on
// the Entry. Consult `godoc` on information about those fields or read the
// source of the official loggers.
2014-03-11 03:27:19 +04:00
serialized, err := json.Marshal(entry.Data)
if err != nil {
return nil, fmt.Errorf("Failed to marshal fields to JSON, %v", err)
}
return append(serialized, '\n'), nil
}
2014-03-07 06:20:13 +04:00
```
2014-03-11 05:15:25 +04:00
#### Logger as an `io.Writer`
2015-07-01 00:20:00 +03:00
Logrus can be transformed into an `io.Writer`. That writer is the end of an `io.Pipe` and it is your responsibility to close it.
```go
w := logger.Writer()
defer w.Close()
srv := http.Server{
// create a stdlib log.Logger that writes to
// logrus.Logger.
ErrorLog: log.New(w, "", 0),
}
```
Each line written to that writer will be printed the usual way, using formatters
and hooks. The level for those entries is `info`.
2014-07-27 05:46:04 +04:00
#### Rotation
Log rotation is not provided with Logrus. Log rotation should be done by an
external program (like `logrotate(8)`) that can compress and delete old log
2014-07-27 05:46:04 +04:00
entries. It should not be a feature of the application-level logger.
2015-10-19 09:19:45 +03:00
#### Tools
| Tool | Description |
| ---- | ----------- |
2015-11-16 13:22:07 +03:00
|[Logrus Mate](https://github.com/gogap/logrus_mate)|Logrus mate is a tool for Logrus to manage loggers, you can initial logger's level, hook and formatter by config file, the logger will generated with different config at different environment.|
|[Logrus Viper Helper](https://github.com/heirko/go-contrib/tree/master/logrusHelper)|An Helper arround Logrus to wrap with spf13/Viper to load configuration with fangs! And to simplify Logrus configuration use some behavior of [Logrus Mate](https://github.com/gogap/logrus_mate). [sample](https://github.com/heirko/iris-contrib/blob/master/middleware/logrus-logger/example) |
2014-07-27 05:46:04 +04:00
2015-10-09 17:07:29 +03:00
#### Testing
Logrus has a built in facility for asserting the presence of log messages. This is implemented through the `test` hook and provides:
* decorators for existing logger (`test.NewLocal` and `test.NewGlobal`) which basically just add the `test` hook
* a test logger (`test.NewNullLogger`) that just records log messages (and does not output any):
```go
logger, hook := NewNullLogger()
logger.Error("Hello error")
assert.Equal(1, len(hook.Entries))
assert.Equal(logrus.ErrorLevel, hook.LastEntry().Level)
assert.Equal("Hello error", hook.LastEntry().Message)
hook.Reset()
assert.Nil(hook.LastEntry())
```
#### Fatal handlers
Logrus can register one or more functions that will be called when any `fatal`
level message is logged. The registered handlers will be executed before
logrus performs a `os.Exit(1)`. This behavior may be helpful if callers need
to gracefully shutdown. Unlike a `panic("Something went wrong...")` call which can be intercepted with a deferred `recover` a call to `os.Exit(1)` can not be intercepted.
```
...
handler := func() {
// gracefully shutdown something...
}
logrus.RegisterExitHandler(handler)
...
```
2016-08-10 20:39:36 +03:00
2016-11-29 21:52:28 +03:00
#### Thread safety
2016-08-10 20:39:36 +03:00
By default Logger is protected by mutex for concurrent writes, this mutex is invoked when calling hooks and writing logs.
If you are sure such locking is not needed, you can call logger.SetNoLock() to disable the locking.
Situation when locking is not needed includes:
* You have no hooks registered, or hooks calling is already thread-safe.
* Writing to logger.Out is already thread-safe, for example:
1) logger.Out is protected by locks.
2) logger.Out is a os.File handler opened with `O_APPEND` flag, and every write is smaller than 4k. (This allow multi-thread/multi-process writing)
(Refer to http://www.notthewizard.com/2014/06/17/are-files-appends-really-atomic/)