logrus/README.md

497 lines
18 KiB
Markdown
Raw Normal View History

2017-05-15 13:45:16 +03:00
# Logrus <img src="http://i.imgur.com/hTeVwmJ.png" width="40" height="40" alt=":walrus:" class="emoji" title=":walrus:"/>&nbsp;[![Build Status](https://travis-ci.org/sirupsen/logrus.svg?branch=master)](https://travis-ci.org/sirupsen/logrus)&nbsp;[![GoDoc](https://godoc.org/github.com/sirupsen/logrus?status.svg)](https://godoc.org/github.com/sirupsen/logrus)
2013-10-16 23:27:10 +04:00
2014-03-11 04:07:22 +04:00
Logrus is a structured logger for Go (golang), completely API compatible with
2017-07-25 17:52:40 +03:00
the standard library logger.
2013-10-16 23:27:10 +04:00
2017-06-30 03:54:20 +03:00
**Seeing weird case-sensitive problems?** It's in the past been possible to
import Logrus as both upper- and lower-case. Due to the Go package environment,
this caused issues in the community and we needed a standard. Some environments
experienced problems with the upper-case variant, so the lower-case was decided.
Everything using `logrus` will need to use the lower-case:
`github.com/sirupsen/logrus`. Any package that isn't, should be changed.
2017-07-10 17:32:56 +03:00
To fix Glide, see [these
comments](https://github.com/sirupsen/logrus/issues/553#issuecomment-306591437).
2017-07-10 17:32:56 +03:00
For an in-depth explanation of the casing issue, see [this
comment](https://github.com/sirupsen/logrus/issues/570#issuecomment-313933276).
**Are you interested in assisting in maintaining Logrus?** Currently I have a
lot of obligations, and I am unable to provide Logrus with the maintainership it
needs. If you'd like to help, please reach out to me at `simon at author's
username dot com`.
2013-10-16 23:27:10 +04:00
2014-03-11 04:00:07 +04:00
Nicely color-coded in development (when a TTY is attached, otherwise just
plain text):
2014-03-11 03:59:18 +04:00
2014-03-11 04:00:07 +04:00
![Colored](http://i.imgur.com/PY7qMwd.png)
2014-03-11 03:59:18 +04:00
With `log.SetFormatter(&log.JSONFormatter{})`, for easy parsing by logstash
2014-03-11 04:01:07 +04:00
or Splunk:
2014-03-11 03:59:18 +04:00
```json
{"animal":"walrus","level":"info","msg":"A group of walrus emerges from the
2014-03-15 00:17:18 +04:00
ocean","size":10,"time":"2014-03-10 19:57:38.562264131 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"level":"warning","msg":"The group's number increased tremendously!",
"number":122,"omg":true,"time":"2014-03-10 19:57:38.562471297 -0400 EDT"}
{"animal":"walrus","level":"info","msg":"A giant walrus appears!",
2014-03-15 00:17:18 +04:00
"size":10,"time":"2014-03-10 19:57:38.562500591 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"animal":"walrus","level":"info","msg":"Tremendously sized cow enters the ocean.",
2014-03-15 00:17:18 +04:00
"size":9,"time":"2014-03-10 19:57:38.562527896 -0400 EDT"}
2014-03-11 04:06:39 +04:00
{"level":"fatal","msg":"The ice breaks!","number":100,"omg":true,
"time":"2014-03-10 19:57:38.562543128 -0400 EDT"}
2014-03-11 03:59:18 +04:00
```
With the default `log.SetFormatter(&log.TextFormatter{})` when a TTY is not
2014-04-24 04:21:38 +04:00
attached, the output is compatible with the
[logfmt](http://godoc.org/github.com/kr/logfmt) format:
```text
time="2015-03-26T01:27:38-04:00" level=debug msg="Started observing beach" animal=walrus number=8
time="2015-03-26T01:27:38-04:00" level=info msg="A group of walrus emerges from the ocean" animal=walrus size=10
time="2015-03-26T01:27:38-04:00" level=warning msg="The group's number increased tremendously!" number=122 omg=true
time="2015-03-26T01:27:38-04:00" level=debug msg="Temperature changes" temperature=-4
time="2015-03-26T01:27:38-04:00" level=panic msg="It's over 9000!" animal=orca size=9009
time="2015-03-26T01:27:38-04:00" level=fatal msg="The ice breaks!" err=&{0x2082280c0 map[animal:orca size:9009] 2015-03-26 01:27:38.441574009 -0400 EDT panic It's over 9000!} number=100 omg=true
```
To ensure this behaviour even if a TTY is attached, set your formatter as follows:
```go
log.SetFormatter(&log.TextFormatter{
DisableColors: true,
FullTimestamp: true,
})
```
2017-08-03 03:35:14 +03:00
#### Logging Method Name
If you wish to add the calling method as a field, instruct the logger via:
```go
log.SetReportCaller(true)
```
This adds the caller as 'method' like so:
```json
{"animal":"penguin","level":"fatal","method":"github.com/sirupsen/arcticcreatures.migrate","msg":"a penguin swims by",
"time":"2014-03-10 19:57:38.562543129 -0400 EDT"}
```
```text
time="2015-03-26T01:27:38-04:00" level=fatal method=github.com/sirupsen/arcticcreatures.migrate msg="a penguin swims by" animal=penguin
```
Note that this does add measurable overhead - the cost will depend on the version of Go, but is
2016-12-02 20:57:30 +03:00
between 20 and 40% in recent tests with 1.6 and 1.7. You can validate this in your
2019-06-05 10:36:14 +03:00
environment via benchmarks:
```
go test -bench=.*CallerTracing
```
2017-05-12 22:09:01 +03:00
#### Case-sensitivity
The organization's name was changed to lower-case--and this will not be changed
back. If you are getting import conflicts due to case sensitivity, please use
the lower-case import: `github.com/sirupsen/logrus`.
2014-04-14 01:51:46 +04:00
#### Example
The simplest way to use Logrus is simply the package-level exported logger:
2014-04-14 01:51:46 +04:00
```go
package main
import (
2017-05-11 13:19:16 +03:00
log "github.com/sirupsen/logrus"
2014-04-14 01:51:46 +04:00
)
func main() {
2016-06-01 14:32:10 +03:00
log.WithFields(log.Fields{
2014-07-27 06:51:23 +04:00
"animal": "walrus",
}).Info("A walrus appears")
}
```
Note that it's completely api-compatible with the stdlib logger, so you can
2017-05-11 13:19:16 +03:00
replace your `log` imports everywhere with `log "github.com/sirupsen/logrus"`
and you'll now have the flexibility of Logrus. You can customize it all you
want:
```go
package main
import (
"os"
2017-05-11 13:19:16 +03:00
log "github.com/sirupsen/logrus"
)
2014-04-14 01:51:46 +04:00
func init() {
// Log as JSON instead of the default ASCII formatter.
2014-08-06 07:09:02 +04:00
log.SetFormatter(&log.JSONFormatter{})
// Output to stdout instead of the default stderr
// Can be any io.Writer, see below for File example
log.SetOutput(os.Stdout)
// Only log the warning severity or above.
2014-08-06 07:09:02 +04:00
log.SetLevel(log.WarnLevel)
2014-04-14 01:51:46 +04:00
}
func main() {
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"animal": "walrus",
"size": 10,
}).Info("A group of walrus emerges from the ocean")
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"omg": true,
"number": 122,
}).Warn("The group's number increased tremendously!")
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-04-14 01:51:46 +04:00
"omg": true,
"number": 100,
}).Fatal("The ice breaks!")
2015-03-31 18:24:31 +03:00
2015-03-31 18:30:41 +03:00
// A common pattern is to re-use fields between logging statements by re-using
// the logrus.Entry returned from WithFields()
2015-03-31 18:24:31 +03:00
contextLogger := log.WithFields(log.Fields{
"common": "this is a common field",
"other": "I also should be logged always",
})
contextLogger.Info("I'll be logged with common and other field")
contextLogger.Info("Me too")
2014-04-14 01:51:46 +04:00
}
```
For more advanced usage such as logging to multiple locations from the same
application, you can also create an instance of the `logrus` Logger:
```go
package main
import (
2017-02-24 06:58:06 +03:00
"os"
2017-05-11 13:19:16 +03:00
"github.com/sirupsen/logrus"
)
// Create a new instance of the logger. You can have any number of instances.
var log = logrus.New()
func main() {
// The API for setting attributes is a little different than the package level
// exported logger. See Godoc.
log.Out = os.Stdout
// You could set this to any `io.Writer` such as a file
2019-05-11 01:40:04 +03:00
// file, err := os.OpenFile("logrus.log", os.O_CREATE|os.O_WRONLY|os.O_APPEND, 0666)
// if err == nil {
// log.Out = file
// } else {
// log.Info("Failed to log to file, using default stderr")
// }
2014-10-28 00:22:57 +03:00
log.WithFields(logrus.Fields{
"animal": "walrus",
"size": 10,
}).Info("A group of walrus emerges from the ocean")
}
```
2014-03-07 06:20:13 +04:00
#### Fields
2013-10-16 23:27:10 +04:00
2017-02-10 18:30:30 +03:00
Logrus encourages careful, structured logging through logging fields instead of
2014-04-24 04:21:38 +04:00
long, unparseable error messages. For example, instead of: `log.Fatalf("Failed
to send event %s to topic %s with key %d")`, you should log the much more
discoverable:
2013-10-16 23:27:10 +04:00
2014-03-07 06:20:13 +04:00
```go
2014-07-27 06:51:23 +04:00
log.WithFields(log.Fields{
2014-03-07 06:20:13 +04:00
"event": event,
"topic": topic,
"key": key,
2014-03-07 06:20:13 +04:00
}).Fatal("Failed to send event")
```
We've found this API forces you to think about logging in a way that produces
2014-03-11 19:01:18 +04:00
much more useful logging messages. We've been in countless situations where just
a single added field to a log statement that was already there would've saved us
hours. The `WithFields` call is optional.
2014-03-07 06:20:13 +04:00
2014-03-07 06:26:05 +04:00
In general, with Logrus using any of the `printf`-family functions should be
2014-04-24 04:21:38 +04:00
seen as a hint you should add a field, however, you can still use the
2014-03-07 06:26:05 +04:00
`printf`-family functions with Logrus.
2017-02-07 21:34:08 +03:00
#### Default Fields
Often it's helpful to have fields _always_ attached to log statements in an
application or parts of one. For example, you may want to always log the
`request_id` and `user_ip` in the context of a request. Instead of writing
`log.WithFields(log.Fields{"request_id": request_id, "user_ip": user_ip})` on
every line, you can create a `logrus.Entry` to pass around instead:
```go
2017-02-15 03:37:12 +03:00
requestLogger := log.WithFields(log.Fields{"request_id": request_id, "user_ip": user_ip})
2017-02-07 21:34:08 +03:00
requestLogger.Info("something happened on that request") # will log request_id and user_ip
requestLogger.Warn("something not great happened")
```
2014-03-07 06:20:13 +04:00
#### Hooks
2013-10-16 23:27:10 +04:00
2014-03-07 06:26:05 +04:00
You can add hooks for logging levels. For example to send errors to an exception
2014-04-24 04:21:38 +04:00
tracking service on `Error`, `Fatal` and `Panic`, info to StatsD or log to
multiple places simultaneously, e.g. syslog.
2013-10-16 23:27:10 +04:00
Logrus comes with [built-in hooks](hooks/). Add those, or your custom hook, in
`init`:
```go
import (
2017-05-11 13:19:16 +03:00
log "github.com/sirupsen/logrus"
2018-02-05 23:59:23 +03:00
"gopkg.in/gemnasium/logrus-airbrake-hook.v2" // the package is named "airbrake"
2017-05-11 13:19:16 +03:00
logrus_syslog "github.com/sirupsen/logrus/hooks/syslog"
2014-11-23 05:09:39 +03:00
"log/syslog"
)
func init() {
// Use the Airbrake hook to report errors that have Error severity or above to
// an exception tracker. You can create custom hooks, see the Hooks section.
log.AddHook(airbrake.NewHook(123, "xyz", "production"))
2014-11-23 05:09:39 +03:00
hook, err := logrus_syslog.NewSyslogHook("udp", "localhost:514", syslog.LOG_INFO, "")
if err != nil {
log.Error("Unable to connect to local syslog daemon")
} else {
log.AddHook(hook)
}
}
```
Note: Syslog hook also support connecting to local syslog (Ex. "/dev/log" or "/var/run/syslog" or "/var/run/log"). For the detail, please check the [syslog hook README](hooks/syslog/README.md).
A list of currently known of service hook can be found in this wiki [page](https://github.com/sirupsen/logrus/wiki/Hooks)
2015-02-19 21:51:02 +03:00
2014-03-07 06:20:13 +04:00
#### Level logging
2013-10-16 23:27:10 +04:00
2018-08-28 18:13:29 +03:00
Logrus has seven logging levels: Trace, Debug, Info, Warning, Error, Fatal and Panic.
2013-10-16 23:27:10 +04:00
2014-02-24 05:19:34 +04:00
```go
2018-08-28 18:13:29 +03:00
log.Trace("Something very low level.")
2014-03-07 06:49:10 +04:00
log.Debug("Useful debugging information.")
2014-03-07 06:20:13 +04:00
log.Info("Something noteworthy happened!")
log.Warn("You should probably take a look at this.")
log.Error("Something failed but I'm not quitting.")
2014-03-12 16:00:18 +04:00
// Calls os.Exit(1) after logging
2014-03-07 06:20:13 +04:00
log.Fatal("Bye.")
2014-03-12 16:00:18 +04:00
// Calls panic() after logging
2014-03-07 06:20:13 +04:00
log.Panic("I'm bailing.")
```
2014-03-11 04:06:39 +04:00
You can set the logging level on a `Logger`, then it will only log entries with
that severity or anything above it:
2014-03-07 06:49:10 +04:00
```go
2014-03-11 04:06:39 +04:00
// Will log anything that is info or above (warn, error, fatal, panic). Default.
2014-07-27 06:51:23 +04:00
log.SetLevel(log.InfoLevel)
2014-03-07 06:49:10 +04:00
```
2014-07-27 06:23:41 +04:00
It may be useful to set `log.Level = logrus.DebugLevel` in a debug or verbose
2014-03-11 04:06:39 +04:00
environment if your application has that.
2014-03-07 06:20:13 +04:00
#### Entries
Besides the fields added with `WithField` or `WithFields` some fields are
automatically added to all logging events:
1. `time`. The timestamp when the entry was created.
2. `msg`. The logging message passed to `{Info,Warn,Error,Fatal,Panic}` after
the `AddFields` call. E.g. `Failed to send event.`
3. `level`. The logging level. E.g. `info`.
#### Environments
2014-03-14 23:21:54 +04:00
Logrus has no notion of environment.
2014-03-11 04:06:39 +04:00
If you wish for hooks and formatters to only be used in specific environments,
you should handle that yourself. For example, if your application has a global
variable `Environment`, which is a string representation of the environment you
could do:
2014-03-07 06:20:13 +04:00
```go
import (
2017-05-11 13:19:16 +03:00
log "github.com/sirupsen/logrus"
)
2014-03-07 06:20:13 +04:00
init() {
// do something here to set environment depending on an environment variable
// or command-line flag
if Environment == "production" {
2015-08-18 21:15:02 +03:00
log.SetFormatter(&log.JSONFormatter{})
2014-03-07 06:20:13 +04:00
} else {
// The TextFormatter is default, you don't actually have to do this.
log.SetFormatter(&log.TextFormatter{})
2014-03-07 06:20:13 +04:00
}
2013-10-16 23:27:10 +04:00
}
```
2014-02-24 05:19:34 +04:00
2014-03-11 04:06:39 +04:00
This configuration is how `logrus` was intended to be used, but JSON in
production is mostly only useful if you do log aggregation with tools like
Splunk or Logstash.
#### Formatters
2014-03-07 06:20:13 +04:00
2014-03-14 23:21:54 +04:00
The built-in logging formatters are:
2014-03-07 06:20:13 +04:00
* `logrus.TextFormatter`. Logs the event in colors if stdout is a tty, otherwise
2014-03-07 21:51:29 +04:00
without colors.
* *Note:* to force colored output when there is no TTY, set the `ForceColors`
field to `true`. To force no colored output even if there is a TTY set the
`DisableColors` field to `true`. For Windows, see
[github.com/mattn/go-colorable](https://github.com/mattn/go-colorable).
* When colors are enabled, levels are truncated to 4 characters by default. To disable
truncation set the `DisableLevelTruncation` field to `true`.
2019-06-05 10:41:05 +03:00
* When outputting to a TTY, its often helpful to visually scan down a column where all the levels are the same width. Setting the `PadLevelText` field to `true` enables this behavior, by adding padding to the level text.
* All options are listed in the [generated docs](https://godoc.org/github.com/sirupsen/logrus#TextFormatter).
2014-03-07 21:51:29 +04:00
* `logrus.JSONFormatter`. Logs fields as JSON.
* All options are listed in the [generated docs](https://godoc.org/github.com/sirupsen/logrus#JSONFormatter).
2015-02-20 19:02:11 +03:00
2014-03-14 23:21:54 +04:00
Third party logging formatters:
2017-11-15 00:58:00 +03:00
* [`FluentdFormatter`](https://github.com/joonix/log). Formats entries that can be parsed by Kubernetes and Google Container Engine.
2018-10-24 12:03:07 +03:00
* [`GELF`](https://github.com/fabienm/go-logrus-formatters). Formats entries so they comply to Graylog's [GELF 1.1 specification](http://docs.graylog.org/en/2.4/pages/gelf.html).
2016-07-12 23:21:34 +03:00
* [`logstash`](https://github.com/bshuster-repo/logrus-logstash-hook). Logs fields as [Logstash](http://logstash.net) Events.
* [`prefixed`](https://github.com/x-cray/logrus-prefixed-formatter). Displays log entry source along with alternative layout.
* [`zalgo`](https://github.com/aybabtme/logzalgo). Invoking the P͉̫o̳̼̊w̖͈̰͎e̬͔̭͂r͚̼̹̲ ̫͓͉̳͈ō̠͕͖̚f̝͍̠ ͕̲̞͖͑Z̖̫̤̫ͪa͉̬͈̗l͖͎g̳̥o̰̥̅!̣͔̲̻͊̄ ̙̘̦̹̦.
* [`nested-logrus-formatter`](https://github.com/antonfisher/nested-logrus-formatter). Converts logrus fields to a nested structure.
2014-03-14 23:21:54 +04:00
2014-03-11 04:06:39 +04:00
You can define your formatter by implementing the `Formatter` interface,
requiring a `Format` method. `Format` takes an `*Entry`. `entry.Data` is a
`Fields` type (`map[string]interface{}`) with all your fields as well as the
default ones (see Entries section above):
2014-03-07 06:20:13 +04:00
```go
2014-03-11 03:27:19 +04:00
type MyJSONFormatter struct {
}
log.SetFormatter(new(MyJSONFormatter))
2014-03-11 03:27:19 +04:00
func (f *MyJSONFormatter) Format(entry *Entry) ([]byte, error) {
// Note this doesn't include Time, Level and Message which are available on
// the Entry. Consult `godoc` on information about those fields or read the
// source of the official loggers.
2014-03-11 03:27:19 +04:00
serialized, err := json.Marshal(entry.Data)
if err != nil {
return nil, fmt.Errorf("Failed to marshal fields to JSON, %v", err)
}
return append(serialized, '\n'), nil
}
2014-03-07 06:20:13 +04:00
```
2014-03-11 05:15:25 +04:00
#### Logger as an `io.Writer`
2015-07-01 00:20:00 +03:00
Logrus can be transformed into an `io.Writer`. That writer is the end of an `io.Pipe` and it is your responsibility to close it.
```go
w := logger.Writer()
defer w.Close()
srv := http.Server{
// create a stdlib log.Logger that writes to
// logrus.Logger.
ErrorLog: log.New(w, "", 0),
}
```
Each line written to that writer will be printed the usual way, using formatters
and hooks. The level for those entries is `info`.
This means that we can override the standard library logger easily:
```go
logger := logrus.New()
logger.Formatter = &logrus.JSONFormatter{}
// Use logrus for standard log output
// Note that `log` here references stdlib's log
// Not logrus imported under the name `log`.
log.SetOutput(logger.Writer())
```
2014-07-27 05:46:04 +04:00
#### Rotation
Log rotation is not provided with Logrus. Log rotation should be done by an
external program (like `logrotate(8)`) that can compress and delete old log
2014-07-27 05:46:04 +04:00
entries. It should not be a feature of the application-level logger.
2015-10-19 09:19:45 +03:00
#### Tools
| Tool | Description |
| ---- | ----------- |
2015-11-16 13:22:07 +03:00
|[Logrus Mate](https://github.com/gogap/logrus_mate)|Logrus mate is a tool for Logrus to manage loggers, you can initial logger's level, hook and formatter by config file, the logger will generated with different config at different environment.|
2017-03-07 19:02:20 +03:00
|[Logrus Viper Helper](https://github.com/heirko/go-contrib/tree/master/logrusHelper)|An Helper around Logrus to wrap with spf13/Viper to load configuration with fangs! And to simplify Logrus configuration use some behavior of [Logrus Mate](https://github.com/gogap/logrus_mate). [sample](https://github.com/heirko/iris-contrib/blob/master/middleware/logrus-logger/example) |
2014-07-27 05:46:04 +04:00
2015-10-09 17:07:29 +03:00
#### Testing
Logrus has a built in facility for asserting the presence of log messages. This is implemented through the `test` hook and provides:
* decorators for existing logger (`test.NewLocal` and `test.NewGlobal`) which basically just add the `test` hook
* a test logger (`test.NewNullLogger`) that just records log messages (and does not output any):
```go
2017-05-12 22:15:51 +03:00
import(
"github.com/sirupsen/logrus"
"github.com/sirupsen/logrus/hooks/test"
2017-05-12 22:15:51 +03:00
"github.com/stretchr/testify/assert"
"testing"
)
2015-10-09 17:07:29 +03:00
2017-05-12 22:15:51 +03:00
func TestSomething(t*testing.T){
logger, hook := test.NewNullLogger()
2017-05-12 22:15:51 +03:00
logger.Error("Helloerror")
2015-10-09 17:07:29 +03:00
2017-05-12 22:15:51 +03:00
assert.Equal(t, 1, len(hook.Entries))
assert.Equal(t, logrus.ErrorLevel, hook.LastEntry().Level)
assert.Equal(t, "Helloerror", hook.LastEntry().Message)
hook.Reset()
2017-05-12 22:15:51 +03:00
assert.Nil(t, hook.LastEntry())
}
2015-10-09 17:07:29 +03:00
```
#### Fatal handlers
Logrus can register one or more functions that will be called when any `fatal`
level message is logged. The registered handlers will be executed before
logrus performs a `os.Exit(1)`. This behavior may be helpful if callers need
to gracefully shutdown. Unlike a `panic("Something went wrong...")` call which can be intercepted with a deferred `recover` a call to `os.Exit(1)` can not be intercepted.
```
...
handler := func() {
// gracefully shutdown something...
}
logrus.RegisterExitHandler(handler)
...
```
2016-08-10 20:39:36 +03:00
2016-11-29 21:52:28 +03:00
#### Thread safety
2016-08-10 20:39:36 +03:00
2018-03-10 08:57:56 +03:00
By default, Logger is protected by a mutex for concurrent writes. The mutex is held when calling hooks and writing logs.
2016-08-10 20:39:36 +03:00
If you are sure such locking is not needed, you can call logger.SetNoLock() to disable the locking.
Situation when locking is not needed includes:
* You have no hooks registered, or hooks calling is already thread-safe.
* Writing to logger.Out is already thread-safe, for example:
1) logger.Out is protected by locks.
2) logger.Out is a os.File handler opened with `O_APPEND` flag, and every write is smaller than 4k. (This allow multi-thread/multi-process writing)
(Refer to http://www.notthewizard.com/2014/06/17/are-files-appends-really-atomic/)