Configuration

Flowgger reads its configuration from a TOML file given as an argument:

flowgger flowgger.toml

The sample flowgger.toml file shows the file structure. Most properties are optional and have sensible defaults.

A configuration file consists of two main sections: [input] and [output], describing how messages are pulled, split, parsed, transformed and finally pushed to a data store.

• Input section:
  • input type: where messages are pulled from
  • splitter: how individual messages are extracted from a stream
  • format: how messages are parsed
• Output section:
  • format: what format the messages will be stored as
  • output type: where processed messages are pushed to.