SCALA System Side<\/strong><\/p>\nOn the SCALA server side we\u2019re using netcat in a listener mode on a specified port. We start netcat in listen mode by using the \u2013l option. Also in this case, we\u2019re going to start \u2018nc\u2019 using the \u2013d option so we can send the command to the background and ignore anything on STDIN. Remember, the port in use needs to be higher than 1024.<\/p>\n
The power of netcat comes next when we redirect the output received from listening on the specified port and write that to a file on the SCALA system. In this case, we\u2019re conveniently creating and writing to the log in the [SCALAHOME]\/logsources\/WASInsightPack\/ directory so it\u2019s automatically picked up by the local SCALA LFA and indexed by SCALA.<\/p>\n
The command we\u2019ll execute looks like this: (change to fit your environment)<\/p>\n
nc \u2013dl 1235 > \/opt\/scala\/driver\/logsources\/WASInsightPack\/SystemOut-165.log &<\/strong><\/em><\/p>\nRemote System Side<\/strong><\/p>\nOne the remote system, identify the log file of interest. In our case, we\u2019re using the standard SystemOut.log for the WAS server. On this system we\u2019re going to execute the tail \u2013F command on that file and pipe it into the \u2018nc\u2019 command for sending over the network. We use the \u2013F flag for tail so it follows any logfile that gets rolled over. You could just as easy use \u2018cat\u2019 to send the entire logfile over at that point in time.<\/p>\n
This command is piped into the netcat command \u2018nc\u2019. We\u2019re specifying the remote SCALA v1102 system IP address 10.10.10.1 and the port we\u2019ll be using in the netcat command issued on the SCALA server as 1235. We\u2019ll send this to the background so it runs all the time. We are tailing a file after all!<\/p>\n
The command we\u2019ll execute looks like this: (change to fit your environment)<\/p>\n
tail -F \/opt\/IBM\/WebSphere\/AppServer\/profiles\/AppSrv01\/logs\/TradeServer2\/SystemOut.log | nc 10.10.10.1 1235 &<\/strong><\/em><\/p>\nCreating a SCALA Logsource<\/strong><\/p>\nBefore we start up our netcat connections, let\u2019s get a new SCALA log source defined so we\u2019re ready for indexing from the start. Within the SCALA Administrative GUI, create a new logsource for the file. As we\u2019re running netcat on the SCALA server, we\u2019ll just use the local SCALA hostname and the full path and log file name in our log source definition. In our case we\u2019ll use the standard WebSphere SystemOut source type and collection, but you\u2019ll need to choose the appropriate ones for your log type.<\/p>\n
Starting up Netcat<\/strong><\/p>\nStart the netcat listener on the SCALA server first:<\/p>\n
nc \u2013dl 1235 > \/opt\/scala\/driver\/logsources\/WASInsightPack\/SystemOut-165.log &<\/strong><\/em><\/p>\nNext, start the netcat client on the remote system:<\/p>\n
tail -F \/opt\/IBM\/WebSphere\/AppServer\/profiles\/AppSrv01\/logs\/TradeServer2\/SystemOut.log | nc 10.10.10.1 1235 &<\/strong><\/em><\/p>\nTo verify things are working, tail the file you\u2019re creating on the SCALA server side as well as run some queries in the SCALA GUI for the log source you created.<\/p>\n","protected":false},"excerpt":{"rendered":"
I’ve been working on our big demo for the upcoming IOD Big Data and Analytics conference in November where we’ll highlight our Smart Cloud Analytics portfolio and ran into what’s likely a common challenge in many client environments. We include the right to use the IBM Tivoli Log File Agent (LFA) and I was happily […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[869,880,895,867,856,879],"tags":[886,899,891,898,900],"class_list":{"0":"post-2998","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-analytics-2","7":"category-application-analytics","8":"category-event-analytics","9":"category-ibm-log-analytics","10":"category-log-analytics","11":"category-smart-cloud-analytics","12":"tag-loganalytics","13":"tag-logfile","14":"tag-logshipping","15":"tag-netcat","16":"tag-scala"},"_links":{"self":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/2998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/comments?post=2998"}],"version-history":[{"count":5,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/2998\/revisions"}],"predecessor-version":[{"id":3004,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/posts\/2998\/revisions\/3004"}],"wp:attachment":[{"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/media?parent=2998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/categories?post=2998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dougmcclure.net\/blog\/wp-json\/wp\/v2\/tags?post=2998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"SendingLogsToSCALAwithNetCat\"](\"http:\/\/dougmcclure.net\/blog\/wp-content\/uploads\/2013\/10\/SendingLogsToSCALAwithNetCat.png\")
<\/a>\n