Increasing the number of devices, compliance requirement, business needs to capture the data for events are necessary for all types of business. Analyzing logs can give you real insights into what’s happening within your IT environment. Some of the real-time examples:
- Capacity planning
- Early problem detection
- Actionable reporting
- Availability management
If you have few MB of logs file then it’s possible to review them manually, however, when you are working for Medium to Enterprise business where logs are available in GB, then manual log analysis is the nightmare.
If you are looking for a solution to monitor and analyze your web applications logs including infrastructure, then you may consider the following cloud-based log management. Most of them are having the free plan with some limitation where you can try out to see how it works.
Loggly is one of the most popular log management to analyze almost any kind of log source type including the following.
- OS – Linux, Windows
With Loggly, you can collect the data (logs) to analyze and create the meaningful dashboard to monitor the metrics you need. And of course, you can perform the search within logs from Loggly interface.
Loggly got powerful search where you can customize and filter for full-text, single field & Booleans. you can also integrate with email, PageDuty, Slack, HipChat, etc to trigger the alerts.
Get the real-time IT operational insight with SumoLogic to monitor, analyze, troubleshoot and secure business applications & infrastructure.
Sumologic has its collector agent/cloud collector who needs to be installed on your server to collect and push the logs to Sumologic. You can transform any types of logs into a real-time dashboard to monitor and alert when the threshold is reached.
Sumologic has preconfigured some applications based on most common use cases to accelerate the operational tasks and issues investigation.
- mongoDB – overall general health, query optimization, security monitoring
- AWS Lambada – Proactive monitoring, cost visibility, deep insight
- AWS – identify performance issue, proactive security monitoring, advanced analytics
- Salesforce – increase user adaption, audit trails, compare data
- Trend Micro – drill down into vulnerabilities, event history, enhanced attack visualisation
- Github – visualize team productivity, team productivity, create usage baselines
- Docker – advanced analytics, troubleshooting
- Linux – Troubleshoot & optimize OS, alert on access/audit and security events, performance dashboard
- Nginx – overview, visitor location, response time, identify performance bottlenecks
- Apache – understand visitors, optimize performance, visitor visualization
- IIS – comprehensive insights, traffic details, slowest pages
- MySQL – general health, top errors, monitor query performance
In the free account, you will get 500 MB per day volume with 7 days data retention with any source type of data collection.
Splunk Cloud is available in 10 AWS regions worldwide to collect and index from any machine data. Splunk is a fast and easy way to analyze and visualize the data generated from physical, cloud or virtual devices.
With the help of Splunk, you can monitor and visualize your data and configure the metrics threshold for alerting. I don’t see FREE plan, but they do have a trial which let you analyze and visualize 5 GB data for 15 days.
Papertrail can aggregate data from Syslog, text, apache, MySQL, Heroku apps, windows events, routers, firewall, ruby on rails and much more.
You can perform a real-time search using the browser, command-line or API and get alerted through email or slack.
Logz.io provide hosted ELK as a service. ELK (Elastic Search, Logstash, Kibana) is one of the most popular open source analysis platforms. If you are looking for a flexible platform for your log analysis, then Logz.io would be helpful.
Logz.io can index data from almost all latest technologies and provide you actionable insights analysis with data visualization and alerts.
Some of the supported technologies
- Apache HTTP/Tomcat
The free plan offers three days retention with 1 GB data per day.
A real-time tailing, advanced filtering, and fast searching logging platform integrate within an application.
Timber can be integrated with your application and platform.
Libraries are available for Node, Ruby, and Elixir and support many platforms including the following.
- Zeit (Now)
- AWS Lambda
You can get it started with the FREE plan to experience the platform.
Send any types of data to Logentries for immediate search and data visualization. You can monitor live logs in Logentries UI and get alerted immediately for the threshold you configure.
Alerts can be integrated with slack, hipchat, pagerduty or custom webhook. It provides REST API to query your logs for visualization.
In the free account, you can send up to 5 GB data and retention period is seven days.
Logsene by Sematext is your managed ELK stack in the cloud to manage and analyze the logs. You can ship the logs via encrypted channels from any source including Syslog.
It runs on AWS and adheres to compliance as SOC, SSAE, FISMA, DIACAP, HIPPA, etc.
Check out the DEMO to see how it works.
I hope above cloud log analyzer helps you to search, analyze and visualize your data and ease the IT operations.