Web Crawler 2011

From Derek
Revision as of 00:23, 9 November 2011 by A1162034 (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Web Crawler

This page contains instructions for downloading and installing the Web Crawler created in the 2011 project, Code Cracking: Who murdered the Somerton Man? (Cipher Cracking 2011).

Instructions

  1. Download the Web Crawler Graphical User interface, found here.
  2. Extract to your desired location. You should have a folder labelled Crawler, containing a java archive file, Crawler.jar, and a README.txt file (containing instructions for use of the crawler).
  3. This Crawler.jar file is an executable file so can be run through double click. However it requires some libraries. These libraries can be found on the site which should be the top link from Googling "crawler4j". Download the crawler4j-dependencies-lib.zip libraries as shown in the image below.
crawler4j website with the dependencies library download (click to enlarge).