Difference between revisions of "Cipher cracking 2013 weekly progress"

Revision as of 12:54, 25 October 2013 (view source) A1176277 (Talk | contribs) (→‎Weekly progress and questions) ← Older edit		Latest revision as of 13:26, 25 October 2013 (view source) A1195007 (Talk | contribs) (→‎Lucy)
(8 intermediate revisions by the same user not shown)
Line 462:		Line 462:
	# Week 5 progress:		# Week 5 progress:
	#* Graphed Results and wrote up a doc for it pending adding to the wiki.		#* Graphed Results and wrote up a doc for it pending adding to the wiki.
−	#*	+
−	#*	+
−	#*	+
	# Goals for Week 6:		# Goals for Week 6:
−	#*	+	#* Sorting and conclusions from mas spec data.
	#*		#*
Line 481:		Line 479:
	====Peter====		====Peter====
	# Week 6 progress:		# Week 6 progress:
−	#*	+	#* Did a really cursory look at the mass spec results.
−	#*	+
−	#*	+
−	#*	+
	# Goals for Week 7:		# Goals for Week 7:
−	#*	+	#* Meet with Lucy, do data sorting and conclusions from mass spec data.
−	#*	+
	===Semester 2 Week 7===		===Semester 2 Week 7===
Line 503:		Line 497:
	====Peter====		====Peter====
	# Week 7 progress:		# Week 7 progress:
−	#*	+	#* Met with Lucy to discuss Mass spec results.
−	#*	+	#* Worked out how we want to sort the graphs (Lucy will do this).
−	#*	+	#* Thought about whether it was worth it to try eliminate outliers. Drew some conclusions without it in case we run out of time.
	#*		#*
	# Goals for Week 8:		# Goals for Week 8:
−	#*	+	#* Do further work on the mass spec results.
−	#*	+
	===Semester 2 Week 8===		===Semester 2 Week 8===
Line 525:		Line 518:
	====Peter====		====Peter====
	# Week 8 progress:		# Week 8 progress:
−	#*	+	#* Began collection of previous work for the seminar.
−	#*	+	#* Redid some of the GUI for the purposes of making it better to present an example at the seminar.
−	#*	+
−	#*	+
	# Goals for Mid-Semester Break:		# Goals for Mid-Semester Break:
−	#*	+	#* Write and present our seminar.
−	#*	+
	====Lucy====		====Lucy====
Line 544:		Line 535:
	#*====Peter====		#*====Peter====
	# Week Mid-Semester Break progress:		# Week Mid-Semester Break progress:
−	#*	+	#* Created the slides, and created some demonstrations for our code for the seminar.
−	#*	+	#* Wrote and presented the seminar.
−	#*	+
−	#*	+
	# Goals for week 9:		# Goals for week 9:
−	#*	+	#* Begin to tie-up the code.
−	#*	+	#* Add a screen to the toolkit - probably have to redo the entire gui with a new java layout manager.
	====Lucy====		====Lucy====
Line 565:		Line 554:
	#*====Peter====		#*====Peter====
	# Week 9 progress:		# Week 9 progress:
−	#*	+	#* Completely remade the final version of the toolkit GUI. Re factored some old code so it works with the new screen.
−	#*	+
−	#*	+
−	#*	+
	# Goals for week 10:		# Goals for week 10:
−	#*	+	#* Write up some readme files for the two pieces of software.
−	#*	+
	====Lucy====		====Lucy====
Line 587:		Line 573:
	#*====Peter====		#*====Peter====
	# Week 10 progress:		# Week 10 progress:
−	#*	+	#* Attended briefing.
−	#*	+	#* Began poster design and writing our pitch for exhibition.
−	#*	+	#* Tied up and uploaded .rar files for the code. Added readme files for them.
−	#*	+
	# Goals for week 11:		# Goals for week 11:
−	#*	+	#* Final meeting with Derek.
−	#*	+	#* Finish the Final Report and Poster.
	====Lucy====		====Lucy====
Line 611:		Line 597:
	#*====Peter====		#*====Peter====
	# Week 11 progress:		# Week 11 progress:
−	#*	+	#* Met with Derek and Peter
−	#*	+	#* Met with lucy again to discuss final touches to the wiki and final report, and work on additional frequency analysis Derek suggested at the meeting.
−	#*	+	#* Completed report.
−	#*	+
	# Goals for week 12:		# Goals for week 12:
−	#*	+	#* Exhibition.
−	#*	+	#* Project closeout!
	====Lucy====		====Lucy====

---

Latest revision as of 13:26, 25 October 2013

Weekly progress and questions

This is where you record your progress and ask questions. Make sure you update this every week. The deadline is every Friday evening. However, if you sometimes slip a little into the weekend (so long as you don't do it too often) we won't be too hard on your marks.

Please remember that we make use of this progress section to give you your project mark. Your mark will suffer if you don't complete this section.

Briefly record (i) progress, (ii) problems/questions, (iii) goals for following week.

Semester 1 Week 1

Lucy

1. Week 1 progress:
   • Met with Peter
   • Read and discussed background information on the case (from wikipedia, newspaper articles etc.)
   • Attended the literature training session with Kay Leverette
2. Goals for Week 2:
   • Meet with Prof. Derek Abbott
   • Begin preparation for Project Proposal Seminar in week 4.

Peter

1. Week 1 progress:
   • First meeting with Lucy.
   • Reviewed background info about the case, including videos and info from Derek Abbott's page.
   • Attended to the Literature Search Training Session with with Kay Leveret in the Barr Smith Library.
2. Goals for Week 2:
   • Meet Prof. Abbott.
   • Find out what tasks we will be perusing within the scope of the project.
   • Read through previous years work, including the documents on the wiki.

Semester 1 Week 2

Lucy

1. Week 2 progress:
   • Met with Derek Abbott
   • Discussed the many tasks for the project and the content for the proposal
   • Received a copy of the last year's honors students' work on CD (from Peter)
   • Attended the Risk Assessment Lecture by Danny Gibbins (Acting Honors/Design Project Coordinator)
2. Goals for Week 3:
   • Complete preparation for Proposal Seminar
   • Decide on scope for project (pick which tasks we will attempt)

Peter

1. Week 2 progress:
   • First proper meeting with Derek and Lucy.
   • Discussed the different possible directions we could go in the project with Derek.
   • Discussed with Lucy which of the above we would like to pursue this year.
   • Introduced to the wiki and previous year's work and files from the wiki and CD form.
2. Goals for Week 3:
   • Get last year's students code working and understand where they left of.
   • From there make a start redoing their tests and looking at them critically as a starting point for the project.
   • Finish the proposal seminar presentation.

Semester 1 Week 3

Lucy

1. Week 3 progress:
   • Worked on Proposal (first draft)
   • Sent Proposal to Derek and Matthew for feedback
2. Goals for Week 4:
   • Polish the proposal
   • Practice the Proposal
   • Give the Proposal Seminar

Peter

1. Week 3 progress:
   • Made a first draft of the proposal, begun to update it from feedback given.
   • Began writing and practising my proposal part.

1. Goals for Week 4:
   • Fine tune the proposal, practice my part.
   • Give the proposal seminar.

Semester 1 Week 4

Lucy

1. Week 4 progress:
   • Polished the proposal
   • Practiced the Proposal
   • Gave the Proposal Seminar on Wednesday at 2:30pm
2. Goals for Week 5:
   • Begin the letter statistical analysis tasks (review last years' stats)
   • Bring weekly progress up to date on wiki

Peter

1. Week 4 progress:
   • Practiced and then gave the proposal seminar.
   • Drew up some rough system sketches of the letter matcher program.

1. Goals for Week 5:
   • Begin implementing the Letter Matcher program functions and GUI

Semester 1 Week 5

Lucy

1. Week 5 progress:
   • Brought weekly progress up to date on wiki
2. Goals for Week 6:
   • Review 2012 frequency analysis
   • Write report on 2012 frequency analysis and 2013 possible extensions

Peter

1. Week 5 progress:
   • Finished drawing up system diagrams for the letter Matcher program.
   • Implemented a simple GUI (involving a lot of remembering how to use java)
   • Wrote up some some skeleton code for the driver program so that other method functionality can be added when complete.

1. Goals for Week 6:
   • Complete all buffer and string helper methods needed
   • Complete the first simple matching method.

Semester 1 Week 6

Lucy

1. Week 6 progress:
   • Reviewed and reported on 2012 frequency analysis and 2013 possible extension

1. Goals for Mid-Semester Break:
   • Begin Semester A Progress Report (Intro, background, project management etc)

Peter

1. Week 6 progress:
   • Got all of the helper methods working.
   • Quickly got a simple exact matching method working. Extended this to partial and wildcard matching algorithms for later use.

1. Goals for Week Mid-Semester Break:
   • Begin and basically complete the one time pad functionality. Extend the driver and GUI to work with it.

Semester 1 Mid-Semester Break

Lucy

1. Mid-Semester Break progress:
   • Researched into romanisation of Russian and Farsi (Persian)
   • Wrote short decript method for one time pad.

1. Goals for Week 7:
   • Find romanised Russian and Farsi Texts to analyse
   • Find 1940's neswpaper text to analyse

Peter

1. Mid-Semester Break progress:
   • Completed the functionality needed to 'get decrypts' and all relevant helper methods.
   • Completed a simple search function for the generated decryption to allow better testing.
   • Created a 'debug mode' functionality in the GUI and driver to allow easier debugging of these new functions.
   • Updated the GUI to represent the new functionality.

1. Goals for Week 7:
   • Debug the entire thing.
   • Implement a better search function, and a shortlist function to allow decrypts to be sorted nicely.

Semester 1 Week 7

Lucy

1. Week 7 progress:
   • Abandoned search for romanised Farsi and russian texts online. (this is addressed in report)
   • Found 1948 Advertiser with searchable text for analysis.

1. Goals for Week 8:
   • Analyse 1948 text and conclude on letter analysis.
   • Complete one time pad software and run (with Peter)

Peter

1. Week 7 progress:
   • Debugging still continues, the get decrypt method still gives unexpected outputs for some edge cases.
   • A shortlist /search function was added to allow the decrypts to be sorted.
   • The GUI was redesigned for ease of use.

1. Goals for Week 8:
   • Finish debugging the program so that it works in time for the meeting with supervisors!
   • Run as many variations of the decrypt as we can think of, using different keys, first letters etc.
   • Finalize the section, write up the report about it.
   • If everything is finished, begin working on the next section.

Semester 1 Week 8

Lucy

1. Week 8 progress:
   • Worked with Peter to assess where we are in the Schedule
   • Finished the Frequency Analysis Review and Extension
   • Wrote about the Frequency Analysis Review and Extension in the Semester A progress report
   • Met with Derek to discuss progress
2. Goals for Week 9:
   • Begin the Cipher Gui Extension (permitting we receive the original cipher gui code)
   • Discuss with Peter possible changes to the schedule if we don't get the code

Peter

1. Week 8 progress:
   • Finished debugging the Matcher software.
   • Wrote up a report about the results.
   • Met with Derek to show him the Matcher software and assess current progress.

1. Goals for Week 9:
   • Begin next segment - Probably cipher matcher if we can get the source code by next week.
   • Otherwise reassess timetable and move another segment to next week.

Semester 1 Week 9

Lucy

1. Week 9 progress:
   • Met with Peter to discuss options for timetable reshuffle
   • Received cipher gui code

1. Goals for Week 10:
   • Research ciphers not yet implemented in gui

Peter

1. Week 9 progress:
   • Begun researching ciphers to implement in GUI
   • Received code for cipher GIU, imported and resorted project to begin editing
   • Wrote report about discovered ciphers and which ones we will implement.

1. Goals for Week 10:
   • Read through and understand the previous years code.
   • Try small modules to test to try to work out how to add new ciphers to it.
   • Begin implementing new ciphers.

Semester 1 Week 10

Lucy

1. Week 10 progress:
   • Met Peter to discuss who will implement which kind of ciphers

1. Goals for Week 11:
   • Research and implement some WWII ciphers in the cipher gui
   • Meet Derek for progress update and discuss semester A report

Peter

1. Week 10 progress:
   • Spent some 20 hours over the week trying to understand the current Cipher GUI code.
   • Managed to get the GUI to accept new cipher modules, but not handle the encryption/decryption of them.
   • Wrote up a encrypt/decrypt method for two new types of cipher ready for when I understand the code.

1. Goals for Week 11:
   • Get both the new ciphers working.

Semester 1 Week 11

Lucy

1. Week 11 progress:
   • Researched WWII era ciphers

1. Goals for Week 12:
   • Prepare semester A progress report (DUE FRIDAY 07/06/2013)
   • Meet with Derek about progress report.

Peter

1. Week 11 progress:
   • Got one new cipher working. The other has two keys and therefore requires a different interaction with the Cipher interface that I haven't figured out yet.
   • Wrote up a design/implementation document for the semester progress report, both for this cipher GUI and for the OTP stuff.

1. Goals for Week 12:
   • Get the second cipher and possibly a couple more implemented now that I understand the previous year's code.

Semester 1 Week 12

Lucy

1. Week 12 progress:
   • Met With Derek RE Progress Report
   • Compiled and completed the joint progress report (available to view on the wiki)

1. Goals for Week 13:
   • Look at using Farsi and Russian version of declaration of human rights for analysis
   • Study For Exams (this will slow progress for the next month)

Peter

1. Week 12 progress:
   • Added all of the reports and updates to the semester progress report ready for this friday.
   • Finished Cipher GUI updating.
2. Goals for Week 13:

Semester 1 Week 13

Lucy

1. Week 13 progress:
   • None (studied for exams)

1. Goals for Exam Period:
   • Seems to be difficult for any progress during this time. The next few weeks (during exams) may not show any progress.
   • Expect next update during the mid year break.

Peter

1. Week 13 progress:
   • Exam study =(
2. Goals for Exam Period:

Mid Year Break Week 1

Lucy

1. Week 1 progress:
   • Went camping (No progress)

1. Goals for Week 2:
   • Catch up on: Research of additional suitable ciphers for implementation in cipher gui
   • Catch up on: Implement said ciphers in cipher gui
   • Catch up on: Locate, 'Romanise' and analyse Farsi and Russian versions of the declaration of human rights.
   • Report on cipher research, gui implementation and new letter analyses.

Peter

1. Week 1 progress:
   • Begin new methods to the (newly renamed!) Decoding toolkit
   • These functions will facilitate the new frequency analysis work Lucy is doing

1. Goals for Week 2:
   • Continue Working on the toolkit

Mid Year Break Week 2

Lucy

1. Week 2 progress:
   • Processed language text files from UDHR website (~250 translations)

1. Goals for Week 3:
   • Analyse language text files.

Peter

1. Week 2 progress:
   • Continued adding Match Frequency Method
   • Refactored some Old code to better work with buffers

1. Goals for Week 3:
2. * Finish the new functions

Mid Year Break Week 3

Lucy

1. Week 3 progress:
   • Analysed language files (counting only basic Latin alphabet) (Analysis 1)
   • Altered the analysis code to include extended ascii letters (Analysis 2)

1. Goals for Semester 2 week 1:
   • Present analyses in graph form
   • Begin Mass Spec data analysis
   • Meet and Derek and Update

Peter

1. Week 3 progress:
   • Finished debugging the match frequency method.
   • Graphed these frequencies using matlab, and then on the google version of exel
2. Goals for Semester 2 Week 1:
   • Discuss results with Lucy
   • Organise some graphs for this to show off.

Semester 2 Week 1

Lucy

1. Week 1 progress:
   • Graphed first results for the Frequency analysis
   • Met Derek and Peter

1. Goals for Week 2:
   • Present some different graphs e.g.
     • Graph European Languages
     • Analysis Including accented letters
     • Analysis using W instead of M (i.e M = 0, W = 6)
     • Analysis using code as written in original police report
   • Analyse English books by subject area

Peter

1. Week 1 progress:
   • Meeting with Derek + Lucy.
   • Got first graphs for Frequency Analysis.
2. Goals for Week 2:
   • Lucy will analyse these, write code to test Line Length Frequency

Semester 2 Week 2

Lucy

1. Week 2 progress:
   • Met with Derek and Peter
   • Presented Graphs of:
     • Top 20 European Languages
     • Analysis including accented letters
     • Analysis for different versions of the code (only M, only W, Original Police Ver.)
     • Analysis of English books by subject area.

1. Goals for Week 3:
   • Present Graphs of individual books (e.g. Sonnets, Rubaiyat etc.)
   • Graph some of the Mass. Spec. data. (Graph in Matlab)

Peter

1. Week 2 progress:
   • Talked with Lucy and discussed results. Graphed the preliminary frequency analysis results.
   • Began working on new toolkit module
   • Met with Lucy + Derek again.

1. Goals for Week 3:
   • Finish working functionality for Line Length Frequency

Semester 2 Week 3

Lucy

1. Week 3 progress:
   • Presented all results from Frequency Analysis as graphs
   • Completed the report on the Frequency Analysis Results
   • Graphed most of the Mass. Spec. data. (in Matlab)

1. Goals for Week 4:
   • Meet with Derek and Peter to discuss direction for mass spec data

Peter

1. Week 3 progress:
   • Wrote up a document with results for the match frequency stuff pending adding it to the Wiki,
   • Analysed and collected results from this.
   • Finished working on the line length Frequency Module.

1. Goals for Week 4:
   • Probably bugtest module
   • Get results + graph it.

Semester 2 Week 4

Lucy

1. Week 4 progress:
   • Met with Peter and Derek

1. Goals for Week 5:
   • Re graph mass spec results as scatter plots
   • Sort graphs (discard erroneous data)
   • Consider dealing with outliers

Peter

1. Week 4 progress:
   • Bug tested the Line length frequency module.
   • Took results from Lucy's genre books to create some results.

1. Goals for Week 5:
   • Graph the results + write up a section for it.

Semester 2 Week 5

Lucy

1. Week 5 progress:
   • Re-graphed mass spec data as scatter plots

1. Goals for Week 6:
   • Sort graphs (discard erroneous data)
   • Consider dealing with outliers

Peter

1. Week 5 progress:
   • Graphed Results and wrote up a doc for it pending adding to the wiki.

1. Goals for Week 6:
   • Sorting and conclusions from mas spec data.

Semester 2 Week 6

Lucy

1. Week 6 progress:
   • No progress

1. Goals for Week 7:
   • Sort graphs (discard erroneous data)
   • Consider dealing with outliers

Peter

1. Week 6 progress:
   • Did a really cursory look at the mass spec results.
2. Goals for Week 7:
   • Meet with Lucy, do data sorting and conclusions from mass spec data.

Semester 2 Week 7

Lucy

1. Week 7 progress:
   • Met with Peter, looked at outlier identification methods (Thompson Tau)
   • Began Sorting Graphs (mass spec. data)

1. Goals for Week 8:
   • Finish Sorting Data
   • Implement outlier detection and removal
   • Write Report on findings for mass spec data

Peter

1. Week 7 progress:
   • Met with Lucy to discuss Mass spec results.
   • Worked out how we want to sort the graphs (Lucy will do this).
   • Thought about whether it was worth it to try eliminate outliers. Drew some conclusions without it in case we run out of time.
2. Goals for Week 8:
   • Do further work on the mass spec results.

Semester 2 Week 8

Lucy

1. Week 8 progress:
   • Continued sorting graphs

1. Goals for Mid-Semester Break:
   • Write and present Final Seminar with Peter
   • Complete mass spec sorting
   • Implement outlier detection and removal
   • Write report on findings of mass spec analysis

Peter

1. Week 8 progress:
   • Began collection of previous work for the seminar.
   • Redid some of the GUI for the purposes of making it better to present an example at the seminar.

1. Goals for Mid-Semester Break:
   • Write and present our seminar.

Lucy

1. Week Mid-Semester Break progress:
   • Wrote and presented Final Seminar with Peter

1. Goals for week 9:
   • Complete mass spec sorting
   • Implement outlier detection and removal
   • Write report on findings of mass spec analysis

1. • ====Peter====
2. Week Mid-Semester Break progress:
   • Created the slides, and created some demonstrations for our code for the seminar.
   • Wrote and presented the seminar.
3. Goals for week 9:
   • Begin to tie-up the code.
   • Add a screen to the toolkit - probably have to redo the entire gui with a new java layout manager.

Lucy

1. Week 9 progress:
   • Completed sorting the graphs
   • Attempted to implement Thompson Tau method (wrote some matlab code)
   • My implementation was taking too long, downloaded some code from Matlab website

1. Goals for week 10:
   • Verify Thompson Outlier identification code
   • Attend Exhibition Briefing
   • Write report on mass spec analysis results

1. • ====Peter====
2. Week 9 progress:
   • Completely remade the final version of the toolkit GUI. Re factored some old code so it works with the new screen.

1. Goals for week 10:
   • Write up some readme files for the two pieces of software.

Lucy

1. Week 10 progress:
   • Attended exhibition briefing
   • Began to design poster
   • Wrote report on Mass spec analysis findings
   • Abandoned verification of Thompson tau outlier identification code.

1. Goals for week 11:
   • Meet with Derek
   • Complete Wiki Semester B Final Report
   • Complete Poster

1. • ====Peter====
2. Week 10 progress:
   • Attended briefing.
   • Began poster design and writing our pitch for exhibition.
   • Tied up and uploaded .rar files for the code. Added readme files for them.

1. Goals for week 11:
   • Final meeting with Derek.
   • Finish the Final Report and Poster.

Lucy

1. Week 11 progress:
   • Met with Derek and Peter
   • Completed Poster
   • Conducted additional frequency analysis (using English text as a control)
   • Wrote Matlab code for the additional analysis
   • Completed the wiki report (including new analysis and fixing up mass spec section as per Derek's instructions)

1. Goals for week 12:
   • Exhibit project at the exhibition
   • Record and edit video for project
   • Gather all project related files and burn dvd/cd or put onto flash drive
   • Conduct project closeout

1. • ====Peter====
2. Week 11 progress:
   • Met with Derek and Peter
   • Met with lucy again to discuss final touches to the wiki and final report, and work on additional frequency analysis Derek suggested at the meeting.
   • Completed report.
3. Goals for week 12:
   • Exhibition.
   • Project closeout!

Lucy

1. Week 12 progress:

1. • ====Peter====
2. Week 12 progress:

See also

• Cipher Cracking 2013
• Semester A Progress Report 2013 - Cipher cracking
• Semester B Final Report 2013
• Cipher Cross-off List

Back

• Back to MyUni
• Back to Derek Abbott's homepage
• Back to EEE Department page
• Back to the University of Adelaide homepage
• Back to Cipher Cracking 2013 homepage