Recorded at https://www.DevConf.co.za on March 27 2018 in Johannesburg South Africa.
About the talk
Log files hold a vault of useful information for operations as well as business.
Processing your log files could reveal a host of useful information.
Who uses that brand new web solution you have just deployed?
Which country are they in?
What device are they using?
When your host is under load, what else is happening in the environment?
That pesky, intermittent error is back! How do you find it?
Our build server is slow, why?
Processing application and server log files used to be such a chore. Getting a unified view of all logs required wizard-like skills! But over the past few years simple and easy solutions have emerged. Best of all, they’re free. That’s right, they’re all open source!
Join me for a hands-on presentation, where we’ll pull some useful open source Docker containers and set to work making them weave some magic on our log files.
We’ll cover some Docker Compose basics to get you started with a simple ELK stack (Elastic Search, Log Stash and Kibana), configure some endpoints and setup log shipping (for Linux and Windows) so that we can process log files.
Once we’re processing logs, we’ll look at ways to transform and embellish our log data to add IT operational, as well as business value.
Using our transformed data, we’ll also cover visualising the data using Kibana.
To close out we’ll also consider alternative technologies such as Prometheus and Grafana, and discuss the pros and cons of the different technologies.
Mining log files has never been so simple.
Join me to see how easy it is to get started.
About the speaker
Chris is a software architect with 20+ years’ experience, committed to evolutionary and constant learning, often tinkering with new tools, technologies, techniques and architectures. He is passionate about quality software and great architecture, while forging the growth of this generation of software developers. Chris enjoys sharing his learnings, often accompanied by good beer. Chris can be found either overseeing the architecture at Kaleidocode, mentoring on the Kaleidocode apprenticeship program, or working hands on with his team.
Follow Christ on Twitter: https://www.twitter.com/Tite_Chris
These videos are made possible by sponsorship from Obsidian: https://obsidian.co.za/