Machine Data

Home/Machine Data

IBM Log Analysis (SCALA) Tuning App v1

By | 2014-08-08T17:12:14+00:00 August 7th, 2014|IBM Log Analytics, IT Operations Analytics, Log Analytics, Logstash, Machine Data, Monitoring, Smart Cloud Analytics|

As part of this BlueMix Fabric Log Solution project, getting visibility into everything in my log solution architecture is pretty important. I've got a lot of instrumentation across the end-to-end pipeline so metrics are overflowing in my environment. I started to work on a simple app to pull all of this together so I can trend and visualize it over time and be able to see the impacts of tuning activities. This is a first [...]

Swimming in the BIG BlueMix Sea – Design and Deployment of a Log Analysis Solution for IBM’s BlueMix Cloud Foundry PaaS

By | 2014-08-07T15:06:06+00:00 August 7th, 2014|Analytics, Anomaly Detection, Application Analytics, Big Data, Event Analytics, IBM, IBM Log Analytics, IT Operations Analytics, Log Analytics, Logstash, Machine Data, Predictive Analytics, Smart Cloud Analytics, Uncategorized, Usability, User Experience|

A few months back, I was asked to help deploy our Log Analysis solution for our BlueMix Fabric Dev/Ops team. Their pain point - getting value and insights from massive amounts of Cloud Foundry (CF) log data across multiple development, staging and production environments in order to provide a highly available BlueMix offering. No problem I thought. A log is a log is a log. I'd done this a number of times for various applications [...]

Consolidating local system & app logs using rsyslog for shipping to Smart Cloud Analytics Log Analysis Open Beta

By | 2013-09-27T20:32:07+00:00 May 13th, 2013|Analytics, Best Practices, Big Data, BigAnalytics, BigSearch, IBM, IBM Log Analytics, Implementation, Machine Data, Smart Cloud Analytics, Tivoli|

With the basics of Smart Cloud Analytics Log Analysis (SCALA) in place from scenario1, I'll begin to share additional scenarios that place emphasis on getting system and application log data into the tool for processing. With both OpenBeta milestone 1 and 2 drivers, the main emphasis has been on log acquisition based upon what's called "batch mode". Basically, there's a local copy of Tivoli's Log File Agent (LFA) installed on the SCALA box and it's [...]

Load More Posts