Open Source Python Log Analysis Software - Page 2

This is a web log file analyzer we are making using python. First the IIS parsing engine wil be built and then Apache and possibly other servers. It is going to support multiple log files from any date and output the statistics in html formatted files, incorporating automatically build charts. It will be a pure python solution which is going to be self contained, ie no installation will be required other from the standard python modules.

PyEximon is a GNOME monitor/manager for the popular MTA, Exim. It includes real-time status graphs and log updates, colored log browsing, hierarchial message lists, as well as a graphical interface to common message functions.

pt_BR: Um programa que le o conteúdo do log do sistema e gera um arquivo "RSS". us: A program that reads the content of the system log and will generate a "RSS".

py-rrdtool is a Python module provides an interface to RRDTool, the well known graphing/logging tool.

This is a collection of REST specifications, and implementations of those specs, for very low-level information sharing and workflow operations using REST actions over HTTP. Implementations are in various languages, mainly Java, Python, and Ruby.

RRFiller provides an easy-to-use solution for logging statistics into an RRDTool database. Designed to complement RRGrapher, the project also provides configurations for creation and updating RRD databases using standard tools like vmstat and netstat.

The Secure Remote Log Monitor (SRLM) project provides client and server utilities that collect application or system log files from multiple systems over an untrusted network onto a central server for analysis and action.

This is a Firewall and IDS front-end, the main purpose is simplify configuration of Iptables and Fwsnort and Psad management. The Firewall provides an experimental feature to decide in real-time about each outgoing connection.

Shadow Watcher is a Peer to Peer log sharing tool for the security analyst. Consider it a "community watch" program which allows you to keep your system secure from the threats on the internet and help others do the same.

This is my Master Degree project, I am trying to improve the movie prediction by using machine learning techniques, for the Netflix data set. This project is done under guidance of Dr. Richard Maclin, at University of Minnesota Duluth.

This project is a Python-based HTTP web proxy server that hooks into MySQL to store a full history of your browsing. Allows you to check out statistics about your browsing habits. Creates a personal portal page, has search features, multi-user, filters.

A tool to visualize interactively huge amounts of eventdata. Uses an innovative hierarchical zoomlens scaling from quarters down to 50 ms.

Apache Log Parser and Data Normalization Application Python handles File Processing & MySQL handles Data Processing ApacheLogs2MySQL consists of two Python Modules & one MySQL Schema to automate importing Access & Error files and normalizing data into database designed for reports & data analysis. Runs on Windows, Linux and MacOS & tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 & 9.1.0. 4 LogFormats & 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python `ProcessLogs function` execution. Database system designed to accommodate unlimited domains. Step-by-step guide for easy installation. Web interface with Drill Down Capability and apache/echarts Log Visualization integration in development. MySQL apache_logs schema currently has 49 Tables, 853 Columns, 168 Indexes, 66 Views, 7 Stored Procedures and 43 Functions to process Apache Access log in 4 formats & Apache Error log in 2 formats. Database normalization at work!

Use python to parse privoxy log in clf format and refer to wot ratings of the site and then dump the data in a sqlite database for statistics generation later.

d3vscan is a simple yet powerful network and Bluetooth scanner which is based on PyGTK.

Find out where your website visitors are from: generates statistics on hits per top level domain (e.g. .com, .org, .uk, .se, .fr). Currently works with apache log format, but can easily be extended to understand other formats. Written in vanilla Python.

This program сonstantly reads the file(like "tail -f") and сompares every line with expression in file and executing some actions.

frangen's misc projects

fwgraph is an attempt to characterize and present network traffic including network devices, QoS, and iptables under Linux.

This project (ICAL - Intelligent Collector Algorithms) presents a flexible and configurable proposal for monitoring and management of real and virtual HPC infrastructures, compatible with paradigm of cloud computing. Made for LINUX. Note: This is not a calendar. This project can now be found here: https://sourceforge.net/projects/theminder/

This is a Python script to parse your irssi logs and input them into a MySQL database which you can then use to search and display your logs on the web. It incrementally updates the database from the logs and is ideally run as a cronjob often.

A python based adaptive network analyzer. The aim of the project is to identify illegitimate uses of bandwidth in a network. Uses tshark for network data gathering.

process runtime detection with xml/image statistic output - like xfire .com

pyLastFM graph is commandline tool for creating a nice looking graph time graph from Last.fm profile data. It uses the audioscrobbler.net XML interface and can create very high resolution output images.

Module to allow for reading lines from a continuously-growing file (such as a system log). Handles log files that get rotated/trucated out from under us. Inspired by the Perl File::Tail module.