Cipher cracking 2011 weekly progress

From Derek
Revision as of 12:35, 29 July 2011 by A1162212 (Talk | contribs)

Jump to: navigation, search

Weekly progress and questions

This is where you record your progress and ask questions. Make sure you update this every week. The deadline is every Friday evening. However, if you sometimes slip a little into the weekend (so long as you don't do it too often) we won't be too hard on your marks.

Please remember that we make use of this progress section to give you your project mark. Your mark will suffer if you don't complete this section.

Semester 1 Week 1

Steven

  1. Week 1 work:
    • First meeting with Patrick and Derek
    • Introduced to Honours Project wiki page
      • Watched the 2010 project video
      • Watched the ABC documentary of the Somerton Man Case
      • Began brief review of 2009/2010 documentation
    • Patrick and I attended a Literature Search Training Session with Kay Leverett in the Barr Smith Library
      • Included a tutorial on how to use the engineering databases – very helpful.
  2. Goals for week 2:
    • Review previous years work in much greater detail
    • Clearly define the project scope in accordance with Derek’s suggestions in meeting
      • Generate a corresponding work breakdown structure
      • Summarise individual tasks and associated deliverables
    • Assist Patrick in preparing the Proposal Seminar ready for presenting in week 3.

Patrick

  1. Work Done this Week
    • Initial meeting with Steven and Derek
    • Had a brief read of 2009/10 Final Reports
    • Watched ABC Documentary of the Somerton Man case
    • Watched the 2010 group's YouTube video.
  2. Goals for Next Week
    • Detailed examination of Previous Years' work
    • Begin preparation of Proposal Seminar - to be presented in week 3.
    • Identify the Tasks and Paths of the project
      • Create Work Breakdown Structure
      • Divide up tasks between team members and assign deliverables to tasks

Semester 1 Week 2

Steven

  1. Week 2 work:
    • Attended meeting with Patrick and David Knight from the CS School
      • Discussed Web Crawler/Pattern Matcher implementation options and difficulties
      • Provided with additional resources for internet programming
    • Attended Occupational Health and Safety Lecture with Braden Phillips and Stephen Guest
      • Clarified requirements for project risk assessment and OH&S risk assessment for progress reports
    • Patrick and I planned the project approach
      • Established project work breakdown structure and proposed schedule
    • Analysed the Final Reports of the 2009 and 2010 projects, attention towards;
      • Understanding their procedures and results
      • Develop ideas for improvement or extension
    • Started work on Proposal Seminar
  2. Goals for week 3:
    • Prepare a gantt chart to represent proposed project schedule
    • Complete and present Proposal Seminar on Friday 18/03/11

Patrick

  1. Work Done this Week
    • Meeting with David Knight from the CS School
      • Discussed Web Crawler/Pattern Matcher implementation options and difficulties
    • Detailed analysis of 2009/10 Final Reports - Purpose to:
      • Summarise the main findings
      • Identify any areas missed in previous years.
    • Drew up Work Breakdown Structure and planned project approach
    • Started work on the Proposal Seminar.... Due to be presented next week
  2. Goals for Next Week
    • Complete and PRESENT Proposal Seminar
    • Begin work on verifying previous years' results


Semester 1 Week 3

Steven

  1. Week 3 work:
    • Work this week was devoted to the Proposal Seminar
    • Prepared gantt chart representing project schedule
    • Attended meeting with Patrick and Derek
      • Main focus on preparing Proposal Seminar
    • Completed and presented Proposal Seminar with Patrick – only one attendee, Derek
  2. Goals for week 4:
    • Establish software development environment on my laptop.
    • Begin review of 2009 and 2010 software development
    • Begin work on the Stage 1 Progress Report

Patrick

  1. Work Done this Week
    • Spent the majority of the week working on the Proposal Seminar
    • Had a meeting with Derek regarding Proposal Seminar
    • Downloaded and installed JDK and Java Eclipse on Laptop as a working/development environment for project work
    • Presented our Proposal Seminar! ... to one person, Derek. They don't know what they missed!
  2. Goals for Next Week
    • More work on Verifying previous results.
    • Begin code for text parser - the core of the pattern matcher
    • Start work on the Stage 1 Progress Report... does documentation ever end?

Semester 1 Week 4

Steven

  1. Week 4 work:
    • Began work on the Stage 1 Progress Report – due Friday Week 5
    • Established a SVN repository for the project
      • For use by Patrick and I as a code exchange point
    • Under Linux installed Java IDE for project use and establish a project working environment
    • Brief review of 2010 “web crawler” code
  2. Goals for week 5:
    • Requirements for another course will restrict my available time in Week 5
    • Complete Stage 1 Progress Report including integration onto wiki page
    • Continue with previous project software investigation if time permits

Patrick

  1. Work Done this Week
    • Began preparation of the Stage 1 Prog Report, due end of next week
    • Created simple text parser to work from.
      • Current ability:
        • removes punctuation
        • converts all letters to lowercase.
      • Successfully tested on a Rubaiyat text file!
  2. Goals for Next Week
    • Complete Stage 1 Progress Report and Submit/Put on wiki
    • Continue with text parser work

Semester 1 Week 5

Steven

  1. Week 5 work:
    • Limited availability this week due to requirements for another course
    • Worked heavily focused on the Stage 1 Progress Report
      • Integrated contributions from Patrick and myself and submitted to MyUni
  2. Goals for week 6:
    • Complete Stage 1 Progress Report
    • Integrate Stage 1 Progress Report onto the wiki page
    • Technical work:
      • Begin formulation of cipher scheme testing that will extend on results from 2009 and 2010
      • Begin exploration of additional cipher schemes that can be tested
        • Summarise methodology for testing validity

Patrick

  1. Work Done this Week
    • Lots of work on Stage 1 Progress Report
    • Submitted a semi complete copy to MyUni
    • Drew up design plans for pattern matcher and web crawler, and their integration
  2. Goals for Next Week
    • Finish Stage 1 Progress Report
    • Post up proper Stage 1 Progress Report onto the Wiki
    • Spotted a gap in Documentation - next one not due til week 12! Time for some proper work.
      • Look into statistically analysing some results gathered last year.
      • Continue work on text parser, start adding pattern matching features.

Semester 1 Week 6

Steven

  1. Week 6 work:
    • Completed and integrated the Stage 1 Progress Report to the project wiki page. See the link Patrick has provided below.
      • Learnt valuable wiki syntax and semantics
    • Formulated cipher scheme tests that will extend the results from 2009 and 2010
    • Identified possible additions to the cipher “cross-off list”
  2. Goals for week 7:
    • Meet with Derek and Patrick and plan availability and work for the mid-semester break
    • Begin implementation and testing of cipher schemes that will extend the results from 2009 and 2010
    • In collaboration with Patrick, begin implementation and testing additional cipher schemes for use in the “cross-off” list
    • Get a good result on my Engineering Management test.

Patrick

  1. Work Done this Week
    • Stage 1 Progress Report, Stage 1 Progress Report and more Stage 1 Progress Report. The completed report has been formatted for the Wiki site and is now available here.
    • Developed a plan to analyse the pattern matching results gathered in 2010. Unfortunately it relies on a working pattern matcher to gather more data, which leads to:
    • Further development of pattern matching software. An Initialise function has been added and pattern matching features are currently being designed.
  2. Goals for Next Week
    • Continue work on text parser/pattern matcher
    • Start testing Ciphers on the Cipher Cross-Off list
    • Set up a plan with Steven/Derek as to what we plan to achieve over the mid-semester break
    • Get a good result in my Financial Institutions Management test.

Semester 1 Week 7

Steven

  1. Week 7 work:
    • Attended a meeting with Derek and Patrick and summarised the work completed to date and intentions for the mid semester break
    • Patrick and I finalised use of the Cipher Cross-Off List as the means for presenting and centralising results of continued 2009 project cipher scheme testing. Specific page to be added to wiki by Patrick.
    • Investigated one cipher scheme from the “Cipher Cross-Off list”. Results provide more thorough proof of conclusions from 2009
  2. Goals for “break”:
    • Begin detailed research into web-crawler implementations – ensuring there is compatibility with Patrick’s pattern matcher software
    • Examine at least one more cipher on the Cipher Cross-Off list – results will be added to the page created by Patrick
    • Investigate possible additional university computer resources for use in developmental testing

Patrick

  1. Work Done this Week
    • Worked on text parser some more, developed a version that is capable of analysing the structural statistics of the Rubaiyat.
    • Used Text parser to gather statistics on the Rubaiyat. Results indicate that the code and the poems inside are NOT structurally related. See reports (to come) for further details.
    • Set up the wiki Cipher Cross-off List!
    • Had a meeting with Derek and Steven to go through our work done so far and to plan out work for the next period.
  2. Goals for Next Week
    • Test one cipher identified on the Cipher Cross-Off list
    • Further development of the Text Parser/Pattern Matcher
    • Look into creating a closed web environment in which our Web Crawler can be safely tested.
    • Enjoy my "holidays"

Semester 1 Mid-Semester Break

Steven

  1. Mid-semester break work:
    • Detailed examination of code used in cipher scheme testing for 2009 project
    • Completed testing of two more cipher schemes from the Cipher Cross-off List – results yet to be added to project wiki
    • Investigated potential web crawler implementations – research documentation needs further compilation
    • For the purposes of future testing contacted Braden Phillips and learnt how to apply for access to the university servers for additional computing power
  2. Goals for week 8:
    • Add results of cipher scheme testing to the project wiki
    • Test another cipher identified on the Cipher Cross-off list
    • Further investigation of web crawler implementations. In addition, update supporting documentation
    • Meet with Patrick and discuss compatibility of current web crawler options with regard to the pattern matcher software

Patrick

  1. Work Done this Fortnight
    • Tested and disproved a cipher on the Cipher Cross-off List - the Alphabet Reversal Cipher.
    • Started modifying text parsing code for html style web pages.
    • Researched web crawling requirements and created a broad web crawler/text parser concept document.
    • Looked into test environments for help in developing the web crawler and identified two possible options:
      • A closed environment in a local directory
      • Limit the crawling to only pages starting with the start URL. E.g. if the start URL is http://www.adelaide.edu.au, then it should only crawl websites starting with this address – no outside websites.
  2. Goals for Next Week
    • Test another cipher on the cross-off list.
    • Begin the development of a test environment for the web crawler.
    • More development on the text parser/pattern matcher.

Semester 1 Week 8

Steven

  1. Week 8 work:
    • Met with Patrick and concluded pattern matcher implementation can be adapted to any web crawler implementation
    • Tested another cipher on the Cipher Cross-off list – results yet to be added to wiki with Shift Cipher (Caesar Cipher) results and Auto-Key Cipher results.
    • Web crawler investigation postponed to week 9 pending limited availability.
  2. Goals for week 9:
    • Test another cipher on the cross-off list
    • Further web crawler investigation and supporting document development
    • Research HTML coding language for purpose of providing a personal web crawler testing environment
    • Complete a document summarising web crawler findings and development to week 10 – to be completed over week 9 and 10.


Patrick

  1. Work Done this Week
    • Disproved another cipher on the Cipher Cross-off List - the ADFGVX Cipher.
    • Began design and development of pattern-matching code and strategies.
    • Created a simple test environment for Web Crawl testing. It is a closed environment in a local directory containing multiple pages.
  2. Goals for Next Week
    • Test another cipher on the cross-off list.
    • Evaluate the pattern matching code developed by last year's group and produce a document summarising their efforts.
    • Continue the development of our own pattern-matching algorithms and code.

Semester 1 Week 9

Steven

  1. Week 9 work:
    • Tested and disproved another cipher scheme on the Cipher Cross-off List – the VIC Cipher
    • Began document summarising web crawler findings of 2010
    • Researched and implemented a small local HTML environment. Further expansion required for web crawler testing.
  2. Goals for week 10:
    • Begin Stage 2 Progress Report in accordance with planned schedule
    • Complete development of web crawler summarising document
    • Compile formal summarising document of the ciphers on Cipher Cross-off List tested thus far

Patrick

  1. Work Done this Week
    • Disproved another cipher on the Cipher Cross-off List - the Affine Cipher - Proof here. Resultant output of code has been uploaded here.
    • Examined and evaluated the 2010 pattern matching code - internal document produced.
    • Designed algorithm for Exact pattern matching function.
  2. Goals for Next Week
    • Test another cipher on the cross-off list.
    • Implement design of Exact pattern matching function.
    • Design 'wildcard' pattern matching function.
    • Begin work on the Stage 2 Progress Report as per Gantt Chart schedule.

Semester 1 Week 10

Steven

  1. Week 10 work:
    • In accordance with the planned schedule began compilation of the Stage 2 Progress Report
    • Compiled formal documentation of 2010 web crawler implementation
    • Worked on a document to summarise findings of cipher investigations for Cipher Cross-off List
  2. Goals for week 11:
    • Continue Stage 2 Progress Report as per the Gantt Chart
    • Prepare an updated Gantt Chart for use in the Stage 2 Progress Report
    • Get a copy of developmental software from Patrick – for use in document/presentation preparation
    • Test another cipher on the cross-off list
    • Continue development of the cipher investigation documentation
    • Update Cipher Cross-off List wiki page

Patrick

  1. Work Done this Week
    • Discounted another cipher on the Cipher Cross-off List - the Two-square Cipher.
    • Coded up and tested algorithm for Exact pattern matching function.
    • Began design of next pattern-matching algorithm, the 'wildcard' matcher.
    • Started documentation of Stage 2 Progress Report.
  2. Goals for Next Week
    • Identify and test another cipher for the cross-off list.
    • Complete design and begin implementation and test of wildcard pattern matching function.
    • Continue work on the Stage 2 Progress Report.

Semester 1 Week 11

Steven

  1. Week 11 work:
    • Investigated another cipher on the cipher cross-off list – the Bifid cipher
    • Continued Stage 2 Progress Report in accordance with planned schedule
    • Continued cipher investigation documentation
    • Prepared updated Gantt Chart for use in the Stage 2 Progress Report
  2. Goals for week 12:
    • Update cipher investigation documentation to include Bifid Cipher
    • Complete and submit Stage 2 Progress Report
    • Attend meeting with Derek and Patrick and summarise work completed to date and intentions for the mid-year break
    • Meet with Patrick and get a copy of developmental software

Patrick

  1. Work Done this Week
    • Disproved another cipher on the Cipher Cross-off List - the 4-rail Rail Fence Cipher.
    • Added and tested wildcard letter feature to Exact pattern matching function.
    • Stage 2 Progress Report reportedly progresses.
  2. Goals for Next Week
    • Identify and test another cipher for the cross-off list.
    • Design (and maybe begin implementation) of the next function for the pattern matching software - likely to be Generic Pattern Matcher - e.g. search for $%$% pattern returns ABAB, CDCD, GDGD etc.
    • Continue work on the Stage 2 Progress Report.
    • Complete and submit Stage 2 Progress Report.
    • Set up meeting with Steve and Derek to discuss progress and plans for the mid-year break.

Semester 1 Week 12

Steven

  1. Week 12 work:
    • Attended a meeting with Derek and Patrick, reviewed Stage 2 Progress Report and planned work for the Mid-year break.
    • Work heavily oriented towards Stage 2 Progress Report
      • Report should now be available on wiki
    • Completed analysis of another cipher - the Trifid Cipher
    • Obtained copy of developmental software from Patrick
      • Successfully installed!
    • Light beginning to flicker at the end of the tunnel...
  2. Goals for "break":
    • Test at least one cipher per week following exams
    • Adapt cipher analysis code for use with Cipher GUI
    • Implement Web Crawler prototype
    • Begin preparation of Poster and Final Seminar
    • Write up some ideas for the project video
    • Attend Somerton Man exhbition at the Bay Discovery Centre with Patrick

Patrick

  1. Work Done this Week
    • Met with Derek and Steven regarding Stage 2 Progress Report and work for the mid semester break.
    • Completed structural and statistical tests on the Rubaiyat.
    • Spent many an hour working on Stage 2 Progress Report
    • Handed up said report.
  2. Goals for ... Mid Semester Break
    • Identify and test multiple ciphers for the cross-off list.
    • Design, implement and test all of the remaining functions for the pattern matching software.
    • Work with Steven on the Web Crawler.
    • Implement Affine Cipher on Cipher GUI
    • Look at possibility of adding frequency plot graphs to the Cipher GUI.

Mid-Year Break

Steven

  1. Mid-year break work:
  2. Goals for week 1:

Patrick

  1. Work Done this Break
  2. Goals for Next Week

Semester 2 Week 1

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 2

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 3

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 4

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 5

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 6

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 7

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 8

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 9

Steven

  1. Week X work:
  2. Goals for "break":

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Mid-Semester Break

Steven

  1. Mid-semester break work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Fortnight
  2. Goals for Next Week

Semester 2 Week 10

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 11

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

Semester 2 Week 12

Steven

  1. Week X work:
  2. Goals for week X+1:

Patrick

  1. Work Done this Week
  2. Goals for Next Week

See also

Back