About Sarah
Articles with the tag: proxy logs
Internet proxy log analysis preprocessing
Sat, 28 May 2011 01:01PM
Proxy logs need a bit of work done to them before you can start analysing the content. This is of course assuming you don't have a fancy product to do all this work for you ;). First, you need to work out the regular expression that defines a line in the proxy log to parse it into a nicer format such as CSV. A lot of the CSV columns can probably be removed; the most useful columns are URL, date & time, user agent string (to work out what browser the user was using for example) and request status code (to work out if the user was able to access the content or if it was blocked, unavailable etc).
Previous blog entries
Blog categories
- Forensics & science (7)
- Homemade arts & crafts (11)
- Rabbits (8)
- Programming (6)
- Miscellaneous (25)
- Recipes (5)
- Reviews (14)
- Digital Forensics & Malware (42)
- Trips & Visits (16)
- Cyber Security & Threat Management (12)
- IT & Computers (7)
- HCI & Design (6)
Blog tags
coffee Girl Geeks masters foreman favicon free courses captcha UK Cyber Security Strategy internet history Lockheed Martin SANS unicode shoes Cyber Academy SECC Pixel microsoft edge cybercrime guidelines cards sophisticated cyber attack digital forensics cake tea kill chain steganography PNG data privacy Data Protection Act coasters conference nudge theory web history Machame camp chicken beach Moo Microsoft Word chemistry stand-up Dean Village General Election snob Routine Activities Theory induction Woodilee Chilli confirmation bias walks chain of custody Myxomatosis MP3 sharing threat assessment Deterrence Theory Opera Geocities visualisation Fort William qualitative link files
