About Sarah
Articles with the tag: proxy logs
Internet proxy log analysis preprocessing
Sat, 28 May 2011 01:01PM
Proxy logs need a bit of work done to them before you can start analysing the content. This is of course assuming you don't have a fancy product to do all this work for you ;). First, you need to work out the regular expression that defines a line in the proxy log to parse it into a nicer format such as CSV. A lot of the CSV columns can probably be removed; the most useful columns are URL, date & time, user agent string (to work out what browser the user was using for example) and request status code (to work out if the user was able to access the content or if it was blocked, unavailable etc).
Previous blog entries
Blog categories
- Forensics & science (7)
- Homemade arts & crafts (11)
- Rabbits (8)
- Programming (6)
- Miscellaneous (25)
- Recipes (5)
- Reviews (14)
- Digital Forensics & Malware (42)
- Trips & Visits (16)
- Cyber Security & Threat Management (12)
- IT & Computers (7)
- HCI & Design (6)
Blog tags
thumbs.db NSA Routine Activities Theory hacking public lecture file headers induction facts guidelines training cloud pork Shellbags Firefox cheatsheet encryption Tineye Fort William gardening rock iMessage etiquette General Election coffee answers iPod Touch AES Moroccan cuisine batch files Skye masters risk CSS Turkey programming Geocities threat assessment Internet Explorer Microsoft Word Edinburgh Fringe canvas internet history Lenzie thesis File tunnelling qualifications lectures beach reference management O2 cake ACPO Brigitte Reusch CV Pixel Webscavator MP3 sharing Megalosaurus bacon moving flat
