Open source and free log analysis and log management tools.
Maintained by Dr. Anton Chuvakin
Version 1 created 3/3/2010
Version 1.1 updated 4/15/2010
This page lists a few popular free open-source log management and log analysis tools. The page is a supplement to "Critical Log Review Checklist for Security Incidents" that can be found here or as PDF or DOC (feel free to modify it for your own purposes or for internal distribution - but please keep the attribution).
The log cheat sheet presents a checklist for reviewing critical system,
network and security logs when responding to a security incident. It
can also be used for routine
periodic log review. It was authored by Dr. Anton Chuvakin and Lenny Zeltser.
The open source log management tools are:
- OSSEC (ossec.net)
an open source tool for analysis of real-time log data from Unix
systems,
Windows servers and network devices. It includes a set of useful
default alerting rules as well as a web-based graphical user interface.
This is THE tool to use, if you are starting up your log review
program. It even has a book written about it.
- Snare agent
(intersectalliance.com/projects/index.html) and ProjectLasso remote collector (sourceforge.net/projects/lassolog)
are used to convert Windows Event Logs into syslog, a key component of any log management infrastructure today (at
least until Visa/W7 log aggregation tools become mainstream).
- syslog-ng (balabit.com/network-security/syslog-ng/) is a replacement and improvement of classic syslog service - it also has a Windows version that can be used the same way as Snare
- Among the somewhat dated tools, Logwatch (logwatch.org), Lire (logreport.org) and LogSurfer (crypt.gen.nz/logsurfer) can all be used to summarize logs into readable reports.
- sec (simple-evcorr.sourceforge.net) can be used for correlating logs, even though most people will likely find OSSEC correlation a bit easier to use
- LogHound (ristov.users.sourceforge.net/loghound) and slct (ristov.users.sourceforge.net/slct) are more "research-grade" tools, that are still very useful for going thru a large pool of barely-structured log data.
- Log2timeline (log2timeline.net/) is a useful tool for investigative review of logs; it can create a timeline view out of raw log data.
- LogZilla (aka php-syslog-ng) (code.google.com/p/php-syslog-ng)
is a simple PHP-based visual front-end for a syslog server to do searches, reports, etc
The next list is "an honorable mentions" list which inlcudes logging tools that don't quite fit the definition above:
- Splunk is neither free nor open source, but is has a free
version usable for searching up to 500MB of log data per day - think
of it as a smart search engine for logs.
- OSSIM is not just for logs and also includes OSSEC; it is an
open source SIEM tool and can be used much the same way as commercial
Security Information and Event Management tools are used (SIEM use cases)
- Microsoft Log Parser is a handy free tool to cut thru various Windows logs, not just Windows Event Logs. A somewhat similar tool for Windows Event log analysis is Mandiant Highlighter (mandiant.com/products/free_software/highlighter)
- Sguil is not a log analysis tools, but a network security monitoring (NSM) tool, but it uses logs in its analysis.
- Inspekt Online (inspektonline.com/) is a SaaS / cloud log management service which offers a free one log source license.
For a list of commercial log management tools go to Security
Scoreboard site. A few of the commercial tools offer free trials for
up to 30 days.
Back to Security Warrior Consulting by Dr. Anton Chuvakin.
UPDATED: 4/15/2010