Skip to main content

Read Log Files

You can use Proton as a lightweight and high-performance tool for log analysis. Please check the blog for more details.

info

Please note this feature is in Technical Preview. More settings to be added/tuned.

Syntax​

Create an external stream with the log type to monitor log files, e.g.

CREATE EXTERNAL STREAM proton_log(
  raw string
)
SETTINGS
type='log',
   log_files='proton-server.log',
   log_dir='/var/log/proton-server',
   timestamp_regex='^(\d{4}\.\d{2}\.\d{2} \d{2}:\d{2}:\d{2}\.\d+)',
   row_delimiter='(\d{4}\.\d{2}\.\d{2} \d{2}:\d{2}:\d{2}\.\d+) \[ \d+ \] \{'

The required settings:

  • log_files
  • log_dir
  • timestamp_regex
  • row_delimiter. Only 1 capturing group is expected in the regex.