Difference between revisions of "Web Crawler 2011"

Latest revision as of 09:57, 9 November 2011

Web Crawler

This page contains instructions for downloading and installing the Web Crawler created in the 2011 project, Code Cracking: Who murdered the Somerton Man?

Instructions

1. Download the Web Crawler Graphical User Interface, found here.
2. Extract to your desired location. You should have a folder labelled Crawler, containing a java archive file, Crawler.jar, and a README.txt file (containing instructions for use of the crawler).
3. This Crawler.jar file is an executable file so can be run through double click. However it requires some libraries. These libraries can be found on the crawler4j site which should also be the top link from Googling "crawler4j". Download the crawler4j-dependencies-lib.zip libraries as shown in the image below.
   

   

   crawler4j website with the dependencies library download (click to enlarge).
4. Extract the downloaded libraries into your Crawler folder you have just formed in Step 2. It should appear as a folder titled "lib".
5. Change the name of the folder from "lib" to "Crawler_lib".
6. You are now ready to run the Web Crawler! Simply double click the Crawler.jar file and providing the above steps have been followed correctly, the crawler should function. From this point on, for instructions, see the README.txt file.

See also

• Cipher Cracking 2011
• Final Report 2011
• Stage 1 Design Document 2011
• Stage 2 Progress Report 2011
• Cipher Cross-off List
• Cipher GUI
• 2011 YouTube Project Video

Back

• Back to MyUni
• Back to Derek Abbott's homepage
• Back to EEE Department page
• Back to the University of Adelaide homepage