Computer Science

Fast Log Analysis by Automatically Parsing Heterogeneous Log

Who is the main audience the talk is targeting?

The talk is mainly targeting people who design/architect log analytics solutions and are focused on making the troubleshooting operational problems faster by analyzing logs.  When a computer operates, it generates logs to communicate with humans -- logs act as tweets to inform system status. If something fails, somebody has to understand the logs and take necessary steps to correct it. This talk is about how people parse those logs in a form that is one level up in analytics.

What's the motivation for the talk?

When we initially started building the log analysis product for commercial purposes, we experienced bottleneck situations pretty quick.  You have a log, but, unless you parse it, you cannot build any useful tools/analytics with it -- this is kind of limited. Since every log is really different (I mean there is no consistent form of logging), it's become very hard to automate.