Big Data

Home/Big Data

Swimming in the BIG BlueMix Sea – Design and Deployment of a Log Analysis Solution for IBM’s BlueMix Cloud Foundry PaaS

By | 2014-08-07T15:06:06+00:00 August 7th, 2014|Analytics, Anomaly Detection, Application Analytics, Big Data, Event Analytics, IBM, IBM Log Analytics, IT Operations Analytics, Log Analytics, Logstash, Machine Data, Predictive Analytics, Smart Cloud Analytics, Uncategorized, Usability, User Experience|

A few months back, I was asked to help deploy our Log Analysis solution for our BlueMix Fabric Dev/Ops team. Their pain point - getting value and insights from massive amounts of Cloud Foundry (CF) log data across multiple development, staging and production environments in order to provide a highly available BlueMix offering. No problem I thought. A log is a log is a log. I'd done this a number of times for various applications [...]

Consolidating local system & app logs using rsyslog for shipping to Smart Cloud Analytics Log Analysis Open Beta

By | 2013-09-27T20:32:07+00:00 May 13th, 2013|Analytics, Best Practices, Big Data, BigAnalytics, BigSearch, IBM, IBM Log Analytics, Implementation, Machine Data, Smart Cloud Analytics, Tivoli|

With the basics of Smart Cloud Analytics Log Analysis (SCALA) in place from scenario1, I'll begin to share additional scenarios that place emphasis on getting system and application log data into the tool for processing. With both OpenBeta milestone 1 and 2 drivers, the main emphasis has been on log acquisition based upon what's called "batch mode". Basically, there's a local copy of Tivoli's Log File Agent (LFA) installed on the SCALA box and it's [...]

Kick the Smart Cloud Analytics for Applications “Tires” in 5 Steps

By | 2013-05-03T08:25:00+00:00 May 3rd, 2013|Big Data, BigAnalytics, BigSearch, IBM, IBM Log Analytics, Implementation, Log Analytics, Tivoli|

With a lot of iterations and feedback from "Uncle Charlie", we've got things in my Git repo and with Vagrant in a pretty good state. I'm confident that if our product manager can do this, anyone can! Give it a try yourself and let me know what you think. Step 1: Install Virtualbox (https://www.virtualbox.org/) Step 2: Install Vagrant (http://www.vagrantup.com/) Step 3: Download / clone my Git repo here. Unzip if you downloaded the zip file. [...]

Load More Posts