User Tools

Site Tools


syslogngek

Syslog-ng / Elasticsearch / Kibana

Elasticsearch is used index and make all logs searchable.

Kibana provides a web interface to the search and configure visualization.

Syslog-ng can send logs directly to elasticsearch, so the setup is like ELK without using logstash.

I am using Ubuntu 14.04 LTS Server.

Installation

Syslog-ng

Install syslog-ng, this will replace the current rsyslog.

:~# aptitude install syslog-ng
Syslog-ng 3.7 can run elasticsearch directly, because the version in Ubuntu 14.04 is 3.5 we use a glue module.

Puppet Manifest: https://bitbucket.org/snippets/iansamuel/LLEag

puppet apply /etc/puppet/manifests/syslog-ng-mod-elasticsearch.pp

ElasticSearch / Kibana

Configuration

Syslog-ng

/etc/syslog-ng/conf.d/elasticsearch.conf:

@include "scl/elasticsearch/plugin.conf"

source s_net { udp(); };  # All interfaces

destination d_elastic {
       elasticsearch(
         host("localhost")
         index("syslog-ng")
       );
};

log {
    source(s_net);
    destination(d_elastic);
    flags(flow-control);
};
:~# service syslog-ng reload 
 * Reload system logging syslog-ng

Kibana

Visit your kibana URL http://hostname:5601/

Set your index pattern to syslog-ng to match the index() of syslog-ng.

Start by clicking on the Discover tab to verify your syslog data is being captured and categorized correctly.

syslogngek.txt · Last modified: 2020/02/13 22:55 (external edit)

free spam filter