About Sarah
Articles with the tag: proxy logs
Internet proxy log analysis preprocessing
Sat, 28 May 2011 01:01PM
Proxy logs need a bit of work done to them before you can start analysing the content. This is of course assuming you don't have a fancy product to do all this work for you ;). First, you need to work out the regular expression that defines a line in the proxy log to parse it into a nicer format such as CSV. A lot of the CSV columns can probably be removed; the most useful columns are URL, date & time, user agent string (to work out what browser the user was using for example) and request status code (to work out if the user was able to access the content or if it was blocked, unavailable etc).
Previous blog entries
Blog categories
- Forensics & science (7)
- Homemade arts & crafts (11)
- Rabbits (8)
- Programming (6)
- Miscellaneous (25)
- Recipes (5)
- Reviews (14)
- Digital Forensics & Malware (42)
- Trips & Visits (16)
- Cyber Security & Threat Management (12)
- IT & Computers (7)
- HCI & Design (6)
Blog tags
rabbit vision cookies favicon Myxomatosis foamcore magic polaroid England kill chain train etiquette St Nicholas Pentlands cybercrime celebrities Humyo internet history threat assessment security Edinburgh Fringe nudge theory web browser forensics chemistry Tineye heatmap Google Chrome Barafu qualitative malware analysis compSIA. Security+ fabrics 30 Seconds to Mars microsoft edge IE Mesh computers bibliography presents unicode new Derren Brown thumbs.db NSA crafts Safari text draught excluder search Belgium foreman paintings promotion case management comedy Cyber Academy Mendeley chew RHD bacon Amazon encryption chicken
