Heka is an open source stream processing software system developed by Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, useful for a wide variety of different tasks, such as:

  • Loading and parsing log files from a file system.
  • Accepting statsd type metrics data for aggregation and forwarding to upstream time series data stores such as graphite or InfluxDB.
  • Launching external processes to gather operational data from the local system.
  • Performing real time analysis, graphing, and anomaly detection on any data flowing through the Heka pipeline.
  • Shipping data from one location to another via the use of an external transport (such as AMQP) or directly (via TCP).
  • Delivering processed data to one or more persistent data stores.

Comments

    Related Tools

    • log-shuttle.io

      Log-shuttle is an open source command line program that reads line ...

    • fluentd.org

      Fluentd is an open source data collector, which lets you unify the ...

    • graylog.org

      Graylog is a fully integrated open source log management platform f...

    • logstash.net

      logstash is a tool for managing events and logs. You can use it to ...

    • flume.apache.org

      Flume is a distributed, reliable, and available service for efficie...

    • splunkstorm.com

      Splunk Storm is the new Splunk service for analyzing and troublesho...

    • loggly.com

      The world's most popular cloud log management service delivers appl...

    • logentries.com

      Log management and analytics by Logentries for development, IT oper...

    • sumologic.com

      Sumo Logic immediately transforms Big Data logs into new sources of...

    • papertrailapp.com

      How Papertrail Makes Life Easier: Instant log visibility. Use Pape...