v203.0.0

New Feature

• Add ability to limit the number of messages in the queue. Will stop ingesting new messages when the limit is reached. - 524b3a3
  • This will prevent the redis.aof file to become larger than the available memory if the queue dies.

properties:
  redis:
    congestion_interval: 10
    congestion_threshold: 1000000

Improvements

• Remove monit network check on the Ingestor - 468015a

  • Sometimes, monit keeps restarting the process without waiting enough time.

• Better readability on filter_pre.conf - 3e9026a

• Try to extract the deployment name after all rules - baefb33 ef5f130

• Compile python3 and HAProxy in parallel - 414349b

• Move blobstore to AWS EU - adc5706

• Don't use static IPs for the Parsers by default - 5e64ef1

• Document ARP issue - 2c26f8e

• Calculate Redis max memory as a percentage of system memory - d07ec70

  • Defaults to 90% of VM RAM. Configurable by defining redis.maxmemory property:

  properties:
    redis:
      maxmemory: 90

• Bump logstash version to 2.3.1 - 07dc0f7

Bug fixes:

• Templating of curator specs - 3a83f83