Logging

Tools and applications | Logging
In computing, a log file is a file that records either events that occur in an operating system or other software runs, or messages between different users of a communication software. Logging is the act of keeping a log. In the simplest case, messages are written to a single log file. Source: Wikipedia
Collectd
Used to collect metrics from our system(s). We could be using Collectd in multiple systems to collect each system’s metrics.
Logstash
Used to transport and aggregate our metrics from each system into our destination. This destination could be a file or a database or something else. Logstash works on a system of plugins for input, filtering and output. In this case, our input is Collectd and out output is Elasticsearch.
Elasticsearch
Used to store and search our collected metrics. This is our Logstash output.
Kibana
Used to display our metrics stored in Elasticsearch.
Webalizer
The Webalizer is a fast, free web server log file analysis program. It produces highly detailed, easily configurable usage reports in HTML format, for viewing with a standard web browser.
Logz
ELK and Grafana as a Service. Use the world’s most popular open source monitoring and troubleshooting technologies as a service on the cloud. Scalability, availability and security assured.
Datadog
Modern monitoring & analytics. See inside any stack, any app, at any scale, anywhere.
Heka
Heka is an open source stream processing software system developed by Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, useful for a wide variety of different tasks.
Splunk
We make machine data accessible, usable and valuable to everyone. Get the answers you need to grow your business and deliver the best customer experience.
Sumo Logic
Sumo Logic simplifies how you collect and analyze machine data so that you can gain deep visibility across your full application and infrastructure stack. With the Sumo Logic service, you can accelerate modern application delivery, monitor and troubleshoot in real time and improve your security and compliance posture.
CEM – IBM® Cloud Event Management
Cloud Event Management can receive events from various monitoring sources, either on premise or in the cloud. Events indicate that something has happened on an application, service, or another monitored object.
IBM Cloud Log Analysis
IBM Cloud Log Analysis is deprecated. As of 30 April 2019, you cannot provision new Log Analysis instances, and all Lite plan instances are deleted. Existing premium plan instances are supported until 30 September 2019. To continue managing system and application logs in IBM Cloud, set up IBM Log Analysis with LogDNA.
IBM Log Analysis with LogDNA
Use IBM® Log Analysis with LogDNA to add log management capabilities to your IBM Cloud architecture. IBM Log Analysis with LogDNA is operated by LogDNA in partnership with IBM.
Fluentd
Fluentd is an open source data collector for unified logging layer. Fluentd allows you to unify data collection and consumption for a better use and understanding of data.

More Information

Articles or documentation about this category:
  • Monitoring With Collectd And Kibana
  • Videos

    Youtube links or videos about this topic:

    Resources

  • %d bloggers like this: