Difference between revisions of "Web Crawler 2011"

From Derek
Jump to: navigation, search
(Instructions)
(Web Crawler)
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Web Crawler==
 
==Web Crawler==
This page contains instructions for downloading and installing the Web Crawler created in the 2011 project, Code Cracking: Who murdered the Somerton Man? ([[Cipher Cracking 2011]]).
+
This page contains instructions for downloading and installing the Web Crawler created in the 2011 project, [[Cipher Cracking 2011| Code Cracking: Who murdered the Somerton Man?]]
 
===Instructions===
 
===Instructions===
# Download the Web Crawler Graphical User interface, found [[Media:Crawler.rar|here]].
+
# Download the Web Crawler Graphical User Interface, found [[Media:Crawler.rar|here]].
# Extract to your desired location. You should have a folder labelled Crawler, containing a java archive file, Crawler.jar, and a README.txt file (containing instructions for use of the crawler).
+
# Extract to your desired location. You should have a folder labelled ''Crawler'', containing a java archive file, ''Crawler.jar'', and a ''README.txt'' file (containing instructions for use of the crawler).
# This Crawler.jar file is an executable file so can be run through double click. However it requires some libraries. These libraries can be found on the [http://code.google.com/p/crawler4j/| crawler4j site] which should be the top link from Googling "crawler4j". Download the crawler4j-dependencies-lib.zip libraries as shown in the image below.
+
# This ''Crawler.jar'' file is an executable file so can be run through double click. However it requires some libraries. These libraries can be found on the [http://code.google.com/p/crawler4j/ crawler4j site] which should also be the top link from Googling "crawler4j". Download the '''''crawler4j-dependencies-lib.zip''''' libraries as shown in the image below.[[Image:Crawler4jwebsite.png|thumb|300px|center|crawler4j website with the dependencies library download (click to enlarge).]]
[[Image:Crawler4jwebsite.png|thumb|300px|center|crawler4j website with the dependencies library download (click to enlarge).]]
+
# Extract the downloaded libraries into your ''Crawler'' folder you have just formed in Step 2. It should appear as a folder titled "''lib''".
# Extract the downloaded libraries into your Crawler folder you have just formed in Step 2. It should appear as a folder titled "lib".
+
# Change the name of the folder from "''lib''" to "''Crawler_lib''".
# Change the name of the folder from "lib" to "Crawler_lib".
+
# You are now ready to run the Web Crawler! Simply double click the ''Crawler.jar'' file and providing the above steps have been followed correctly, the crawler should function. From this point on, for instructions, see the ''README.txt'' file.
# You are now ready to run the Web Crawler! Simply double click the Crawler.jar file and providing the above steps have been followed correctly, the crawler should function. From this point on, for instructions, see the README.txt file.
+
 
 +
==See also==
 +
* [[Cipher Cracking 2011]]
 +
* [[Final Report 2011]]
 +
* [[Stage 1 Design Document 2011]]
 +
* [[Stage 2 Progress Report 2011]]
 +
* [[Cipher Cross-off List]]
 +
* [[Media:Cipher GUI.rar|Cipher GUI]]
 +
* [http://www.youtube.com/watch?v=K0DEF-FDLso 2011 YouTube Project Video]
 +
 
 +
==Back==
 +
*[https://myuni.adelaide.edu.au/webapps/portal/frameset.jsp Back to MyUni]
 +
*[http://www.eleceng.adelaide.edu.au/personal/dabbott Back to Derek Abbott's homepage]
 +
*[http://www.eleceng.adelaide.edu.au Back to EEE Department page]
 +
*[http://www.adelaide.edu.au Back to the University of Adelaide homepage]

Latest revision as of 09:57, 9 November 2011

Web Crawler

This page contains instructions for downloading and installing the Web Crawler created in the 2011 project, Code Cracking: Who murdered the Somerton Man?

Instructions

  1. Download the Web Crawler Graphical User Interface, found here.
  2. Extract to your desired location. You should have a folder labelled Crawler, containing a java archive file, Crawler.jar, and a README.txt file (containing instructions for use of the crawler).
  3. This Crawler.jar file is an executable file so can be run through double click. However it requires some libraries. These libraries can be found on the crawler4j site which should also be the top link from Googling "crawler4j". Download the crawler4j-dependencies-lib.zip libraries as shown in the image below.
    crawler4j website with the dependencies library download (click to enlarge).
  4. Extract the downloaded libraries into your Crawler folder you have just formed in Step 2. It should appear as a folder titled "lib".
  5. Change the name of the folder from "lib" to "Crawler_lib".
  6. You are now ready to run the Web Crawler! Simply double click the Crawler.jar file and providing the above steps have been followed correctly, the crawler should function. From this point on, for instructions, see the README.txt file.

See also

Back