{"id":3159,"date":"2014-08-07T22:19:50","date_gmt":"2014-08-08T02:19:50","guid":{"rendered":"http:\/\/dougmcclure.net\/blog\/?p=3159"},"modified":"2014-08-08T17:12:14","modified_gmt":"2014-08-08T21:12:14","slug":"ibm-log-analysis-scala-tuning-app-v1","status":"publish","type":"post","link":"https:\/\/dougmcclure.net\/blog\/2014\/08\/ibm-log-analysis-scala-tuning-app-v1\/","title":{"rendered":"IBM Log Analysis (SCALA) Tuning App v1"},"content":{"rendered":"<p><a href=\"http:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2014\/08\/SCALA-Log-Analysis-Tuning-App-v2.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2014\/08\/SCALA-Log-Analysis-Tuning-App-v2-300x170.png\" alt=\"SCALA Log Analysis Tuning App v2\" width=\"300\" height=\"170\" class=\"alignleft size-medium wp-image-3167\" srcset=\"https:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2014\/08\/SCALA-Log-Analysis-Tuning-App-v2-300x170.png 300w, https:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2014\/08\/SCALA-Log-Analysis-Tuning-App-v2-1024x583.png 1024w, https:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2014\/08\/SCALA-Log-Analysis-Tuning-App-v2.png 1574w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>  As part of this BlueMix Fabric Log Solution project, getting visibility into everything in my log solution architecture is pretty important.  I&#8217;ve got a lot of instrumentation across the end-to-end pipeline so metrics are overflowing in my environment.  I started to work on a simple app to pull all of this together so I can trend and visualize it over time and be able to see the impacts of tuning activities.<\/p>\n<p>This is a first cut at pulling some of the metrics out of the Distributed EIF Receiver \/ Unity Generic Receiver logs. I&#8217;m shipping them with the logstash-forwarder, parsing them in logstash and sending them to the internal elasticsearch server for easy search and visualization using kibana. ELK at its finest!<\/p>\n<p>I&#8217;ll update this as I go for other SCALA logs as well as others I&#8217;m using frequently such as rsyslog impstats.<\/p>\n<p>Ping me or check my github soon for the configurations.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As part of this BlueMix Fabric Log Solution project, getting visibility into everything in my log solution architecture is pretty important. I&#8217;ve got a lot of instrumentation across the end-to-end pipeline so metrics are overflowing in my environment. I started to work on a simple app to pull all of this together so I can [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[867,894,856,859,857,121,879],"tags":[863,933,862,914,861,941,800,900,423],"class_list":{"0":"post-3159","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-ibm-log-analytics","7":"category-it-ops-analytics","8":"category-log-analytics","9":"category-logstash","10":"category-machine-data","11":"category-monitoring","12":"category-smart-cloud-analytics","13":"tag-elasticsearch-2","14":"tag-ibm","15":"tag-kibana","16":"tag-log-analysis","17":"tag-logstash-2","18":"tag-metrics","19":"tag-performance","20":"tag-scala","21":"tag-tuning"},"_links":{"self":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/3159","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/comments?post=3159"}],"version-history":[{"count":8,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/3159\/revisions"}],"predecessor-version":[{"id":3169,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/3159\/revisions\/3169"}],"wp:attachment":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/media?parent=3159"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/categories?post=3159"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/tags?post=3159"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}