|
|
| Line 1: |
Line 1: |
| − | == Weekly progress and questions ==
| + | Semester A |
| − | This is where you record your progress and ask questions. Make sure you update this every week. The deadline is every Friday evening. However, if you sometimes slip a little into the weekend (so long as you don't do it too often) we won't be too hard on your marks.
| + | |
| | | | |
| − | Please remember that we make use of this progress section to give you your project mark. Your mark will suffer if you don't complete this section.
| + | * Week 1 |
| | | | |
| − | Briefly record (i) progress, (ii) problems/questions, (iii) goals for following week.
| + | 1. Week 1 progress |
| | | | |
| − | === Semester 1 Week 1===
| + | • Contacted and met with Yifan |
| | | | |
| − | ====Nicholas====
| + | • Sent emails to supervisor to confirm the first meeting time |
| − | # Week 1 progress:
| + | |
| − | #* Contacted Jikai and had preliminary meeting
| + | |
| − | #* Contacted Professor Abbott and held first meeting
| + | |
| − | #* Meeting occurred on Wednesday 4th March from 11:00am to 12:10pm
| + | |
| − | #* Booked Research Seminar with Librarian for Week 4
| + | |
| − | #* Conducted Background research by reading about previous final year projects
| + | |
| | | | |
| − | # Goals for Week 2:
| + | • Attended the literature training session with Yifan at Bar Smith library |
| − | #* Research google n-gram
| + | |
| − | #* Find out how much space the database requires
| + | |
| − | #* Find out about applying to use some of the budget on the purchase of a hard drive to store the database
| + | |
| − | #* Find out the cost of a copy of the google n-gram database (if any)
| + | |
| | | | |
| − | ====Jikai====
| + | • Study the background of this project |
| − | # Week 1 progress:
| + | |
| − | #* Meet Prof. Abbott and Nicholas.
| + | |
| − | #* Read and understand the background of the project.
| + | |
| − | #* Analyse all the documents from previous groups.
| + | |
| | | | |
| − | # Goals for Week 2:
| + | 2. Goals for week 2 |
| − | #* Install some software given from Dr Matthew.
| + | |
| − | #* Prepare for Project Proposal Seminar in week 5.
| + | |
| | | | |
| − | === Semester 1 Week 2===
| + | • Group meeting with supervisor |
| | | | |
| − | ====Nicholas====
| + | • Understand the aims of this project |
| − | # Week 2 progress:
| + | |
| − | #* Researched Google n-gram, size, cost.
| + | |
| − | #* Discovered Microsoft Web N-Gram Services
| + | |
| − | #* Researched Microsoft Web N-Gram Services
| + | |
| | | | |
| − | # Goals for Week 3:
| + | * Week 2 |
| − | #* Read about Git Hub
| + | |
| − | #* Create Git Hub account
| + | |
| − | #* Clone repository and install GUI on my Mac and Windows systems
| + | |
| − | #* Send Matthew Berryman user info to be granted permissions to repository
| + | |
| − | #* Begin work on Proposal Seminar
| + | |
| − | #* Create project Gantt chart
| + | |
| − | #* Create project Work Breakdown Structure
| + | |
| − | #* Organise meeting with Professor Abbott
| + | |
| | | | |
| − | ====Jikai====
| + | 1. Week 2 progress |
| − | # Week 2 progress:
| + | |
| − | #* Finish Github installment and creat an account in Github.
| + | |
| − | #* Download and use Github to check the folders Cipher_GUI and Decoding Toolkit from 2013 to find some useful information to continue our work.
| + | |
| − | #* Prepare for Proposal Seminar.
| + | |
| | | | |
| − | # Goals for Week 3
| + | • Meeting with Professor Derek Abbott |
| − | #* Trying to do the P-value for all language.
| + | |
| − | #* Doing Proposal Seminar.
| + | |
| − | #* Meet Prof. Abbott.
| + | |
| | | | |
| − | === Semester 1 Week 3===
| + | • Received a series of data from Prof. Derek and Dr. James |
| | | | |
| − | ====Nicholas====
| + | • Read previous year’s project |
| − | # Week 3 progress:
| + | |
| − | #* Created Git Hub Account
| + | |
| − | #* Commenced work on Proposal Seminar
| + | |
| − | #* Created Work Breakdown Structure
| + | |
| − | #* Commenced work on project Gantt Chart
| + | |
| − | #* Organised meeting with Professor Abbott for Monday 23rd March (Week 4) at 3pm
| + | |
| − | #* Emailed Microsoft and applied for user token to be granted access to the Microsoft Web N-gram Services and received a reply
| + | |
| − | # Goals for Week 4:
| + | |
| − | #* Attend meeting with Professor Abbott on Monday 23rd March at 3pm
| + | |
| − | #* Send Matthew Berryman user info to be granted permissions to repository
| + | |
| − | #* Finish project Gantt Chart
| + | |
| − | #* Continue work on Proposal Seminar
| + | |
| − | #* Attend Literature Search Training Session on Tuesday 24th March at 10am
| + | |
| | | | |
| − | ====Jikai====
| + | • Search related materials |
| − | # Week 3 progress:
| + | |
| − | #* Begin calculate P-value of the code as some languages.
| + | |
| − | #* Worked on Proposal
| + | |
| − | # Goals for Week 4:
| + | |
| − | #* Have meeting with Prof. Abbott on Monday.
| + | |
| − | #* Finish Proposal draft and send to both Prof. Abbott and Dr. Mattew for feedback.
| + | |
| | | | |
| − | === Semester 1 Week 4===
| + | 2. Goals for week 3 |
| | | | |
| − | ====Nicholas====
| + | • Cope with data |
| − | # Week 4 progress:
| + | |
| − | #* Continued work on Proposal Seminar
| + | |
| − | #* Emailed Matthew Berryman GitHub user information
| + | |
| − | #* Attended Literature Search Training Session on Tuesday 24th March at 10am
| + | |
| − | #* Attended Professor Abbotts presentation on giving presentations
| + | |
| | | | |
| − | # Goals for Week 5:
| + | • Prepare for the project proposal |
| − | #* Work on Work Breakdown Structure, Gantt Chart, Task Allocation, Risk Assessment and Budgeting
| + | |
| − | #* Submit draft of PowerPoint presentation and talk for Proposal Seminar to Professor Abbott
| + | |
| − | #* Rehearse for Proposal Seminar
| + | |
| − | #* Present Proposal Seminar on Tuesday 31st March
| + | |
| | | | |
| − | ====Jikai====
| + | • Group meeting with Yifan |
| − | # Week 4 progress:
| + | |
| − | #* Finished draft of PPT presentation and met Prof Abbott on Monday.
| + | |
| − | #* Attended Literature Search Training Session on Tuesday.
| + | |
| | | | |
| − | # Goals for Week 5:
| + | * Week 3 |
| − | #* Present Proposal Seminar on Tuesday 31st March.
| + | |
| − | #* Continue doing P-value about the European language.
| + | |
| | | | |
| − | === Semester 1 Week 5===
| + | 1. Week 3 progress |
| | | | |
| − | ====Nicholas====
| + | • Study the data of glass test |
| − | # Week 5 progress:
| + | |
| − | #* Completed Work Breakdown Structure, Gantt Chart, Task Allocation, Risk Assessment and Budgeting
| + | |
| − | #* Submitted draft of PowerPoint presentation and talk for Proposal Seminar to Professor Abbott
| + | |
| − | #* Rehearsed for Proposal Seminar
| + | |
| − | #* Presented Proposal Seminar on Tuesday 31st March
| + | |
| | | | |
| − | # Goals for Week 6:
| + | • Meeting with James to know related information about hair data |
| − | #* Commence background research for draft research proposal
| + | |
| − | #* Obtain previous groups statistics code from Professor Abbott
| + | |
| | | | |
| − | ====Jikai====
| + | • Cope with data |
| − | # Week 5 progress:
| + | |
| − | #* Finish Seminar presentation
| + | |
| | | | |
| | + | 2. Goals for week 4 |
| | | | |
| − | # Goals for Week 6:
| + | • Using Excel to plot the comparison figures of different elements in hair |
| | | | |
| − | #* Continue doing task 1: P-value about languages
| + | • Prepare project seminar |
| | | | |
| − | === Semester 1 Week 6===
| + | * Week 4 |
| | | | |
| − | ====Nicholas====
| + | 1. Week 4 progress |
| − | # Week 6 progress:
| + | |
| − | #* Commenced background research for draft research proposal.
| + | |
| | | | |
| − | # Goals for Mid-Semester Break:
| + | • Prepare project seminar |
| − | #* Complete draft research proposal by due date on Friday 17th April.
| + | |
| − | #* Commence work on critical review of previous groups statistical analysis and begin to implement P-Value statistical testing.
| + | |
| − | #* Attend National Trust Somerton Man Tour on Tuesday 14th April.
| + | |
| | | | |
| − | ====Jikai====
| + | • Start with first draft of project proposal |
| − | # Week 6 progress:
| + | |
| − | #* Begin draft research proposal.
| + | |
| | | | |
| − | # Goals for Week Mid-Semester Break:
| + | 2. Goals for week 5 |
| − | #* Finish draft research proposal before Friday 17th April.
| + | |
| | | | |
| − | === Semester 1 Mid-Semester Break===
| + | • Prepare project seminar |
| | | | |
| − | ====Nicholas====
| + | • Study on Matlab |
| − | # Mid-Semester Break progress:
| + | |
| − | #* Completed draft research proposal by due date on Friday 17th April.
| + | |
| − | #* Commenced work on critical review of previous groups statistical analysis.
| + | |
| − | #* Attended National Trust Somerton Man Tour on Tuesday 14th April.
| + | |
| | | | |
| − | # Goals for Week 7:
| + | • Meeting with Prof. Derek |
| − | #* Background research on how compile and program in Java for potential use in extension of 2013 group’s statistical frequency analysis.
| + | |
| | | | |
| − | ====Jikai====
| + | * Week 5 |
| − | # Mid-Semester Break progress:
| + | |
| − | #* Finished draft research proposal
| + | |
| − | #* Have a trip to Somerton beach
| + | |
| | | | |
| − | # Goals for Week 7:
| + | 1. Week 5 progress |
| − | #* Based on 2013 group's work, continue doing P-Value test for Europen languages
| + | |
| | | | |
| − | === Semester 1 Week 7===
| + | • Received advices about seminar ppt from Prof. Derek |
| | | | |
| − | ====Nicholas====
| + | • Work on the first draft of proposal |
| − | # Week 7 progress:
| + | |
| − | #* Conducted background research on how compile and program in Java for potential use in extension of 2013 group’s statistical frequency analysis.
| + | |
| | | | |
| − | # Goals for Week 8:
| + | Goals for week 6 |
| − | #* Organise meeting with Professor Abbott.
| + | |
| − | #* Organise meeting with Jikai.
| + | |
| − | #* Evaluate usability of 2013 group’s statistical analysis for extension.
| + | |
| | | | |
| − | ====Jikai====
| + | • Present proposal on Monday 4th April |
| − | # Week 7 progress:
| + | |
| − | #* Used mathematic method to do the P-value test for Europen languages.
| + | |
| | | | |
| | + | • Plotting comparison figures by Matlab |
| | | | |
| − | # Goals for Week 8:
| + | * Week 6 |
| − | #* Considering to use java or matlab to do the P-value test.
| + | |
| − | #* Meeting prof. Abbott.
| + | |
| | | | |
| − | === Semester 1 Week 8===
| + | 1. Week 6 progress |
| | | | |
| − | ====Nicholas====
| + | • Finish seminar presentation |
| − | # Week 8 progress:
| + | |
| − | #* Met with Professor Abbott.
| + | |
| − | #* Met with Jikai to discuss progress.
| + | |
| − | #* Evaluated usability of 2013 group’s statistical analysis for extension: Decided to use a combination of Java and Excel. Java to be used for text processing, and outputting letter frequency results, and Excel to perform statistical analysis calculations and graph outputs.
| + | |
| | | | |
| − | # Goals for Week 9:
| + | • Plotting comparison figures by Matlab |
| − | #* Organise meeting with Jikai and Professor Abbott.
| + | |
| − | #* Contact Peter Varsos
| + | |
| − | #* Download programming resources
| + | |
| − | #* Begin compiling and formatting text resources for use in statistical frequency analysis.
| + | |
| | | | |
| − | ====Jikai====
| + | 2. Goals for Mid-break |
| − | # Week 8 progress:
| + | |
| − | #* Met with Nick to discuss P-value task progress.
| + | |
| − | #* Used excel to calculated P-value for English and Scots.
| + | |
| | | | |
| | + | • Finish first draft of proposal |
| | | | |
| − | # Goals for Week 9:
| + | • Finish glass data figures’ plotting |
| − | #* Making a meeting with Professor Abbott.
| + | |
| − | #* Wait for Peter's reply about statistic value for each language in text resources.
| + | |
| − | #* Finish the P-value test between English and Somerton code.
| + | |
| | | | |
| − | === Semester 1 Week 9===
| + | * Mid-break |
| | | | |
| − | ====Nicholas====
| + | 1. Mid-break progress |
| − | # Week 9 progress:
| + | |
| − | #* Organised and attended meeting with Professor Abbott for Friday 15th May
| + | |
| − | #* Researched how to create branches and commit to GitHub
| + | |
| − | #* Committed 2013 group's work to GitHub
| + | |
| − | #* Downloaded and installed Eclipse
| + | |
| − | #* Emailed Peter Varsos about obtaining frequency analysis text files
| + | |
| − |
| + | |
| − | # Goals for Week 10:
| + | |
| − | #* Hopefully obtain text files from 2013 group for use in frequency analysis
| + | |
| − | #* Prepare test text files to test statistical analysis P-value method
| + | |
| | | | |
| − | ====Jikai====
| + | • Submitted first draft of project proposal |
| − | # Week 9 progress:
| + | |
| − | #* Met with Professor Abbott and discuss our progress.
| + | |
| − | #* Complete the P-value test between English and Somerton code.
| + | |
| | | | |
| − | # Goals for Week 10:
| + | • Finish figures plotting |
| − | #* Begin the P-value test for English, French and German.
| + | |
| − | #* Compare the 44 letters in somerton code with letters in English, French and German by Declaration of the human rights.
| + | |
| | | | |
| − | === Semester 1 Week 10===
| + | 2. Goals for week 7 |
| | | | |
| − | ====Nicholas====
| + | • Email Prof. Derek to arrange a meeting |
| − | # Week 10 progress:
| + | |
| − | #* Received reply from Peter Varsos, directed me to contact Lucy Griffith
| + | |
| − | #* Emailed Lucy Griffith and received a reply, awaiting an additional reply to see whether or not she can find original text files for 2013 group’s statistical frequency analysis
| + | |
| − | #* Received reply from Lucy Griffith with zip file including all text files
| + | |
| − | #* Prepared test text files for English, German and French to test our p-value statistical frequency analysis code
| + | |
| − | #* Committed working version and modifications of 2013’s group to Git Hub for use with text processing
| + | |
| − | #* Organised and attended meeting with Professor Abbot for Friday 22nd May
| + | |
| − |
| + | |
| − | # Goals for Week 11:
| + | |
| − | #* Research how to create and edit wiki page
| + | |
| − | #* Create Research Project Proposal & Progress Report 2015 Wiki page
| + | |
| − | #* Download Anova package for Excel to test Jikai’s P-value method
| + | |
| − | #* Run test case for P-value in Matlab to check method against Excel and by hand
| + | |
| − | #* Commence writing progress report section of Research Project Proposal & Progress Report document
| + | |
| − | #* Organise meeting with Professor Abbott for Friday 29th May
| + | |
| | | | |
| − | ====Jikai====
| + | * Week 7 |
| − | # Week 10 progress:
| + | |
| − | #* Received test text files for English, German and French from Nick, and use excel to calculate the P-value for each language declaration against Code, other languages declaration against English statistics and English decalaration against itself.
| + | |
| − | #* Meet Nick and Professor Abbot for Friday 22nd May.
| + | |
| | | | |
| − | # Goals for Week 11:
| + | 1. Week 7 progress |
| − | #* Use mathmatic methed to manually calculate P-value to check the result from excel is correct or not.
| + | |
| − | #* Use Matlab methed to check the result from excel is correct or not.
| + | |
| | | | |
| − | === Semester 1 Week 11===
| + | • Meet Prof. Derek to check the first draft of project proposal |
| | | | |
| − | ====Nicholas====
| |
| − | # Week 11 progress:
| |
| − | #* Researched how to create and edit wiki page
| |
| − | #* Created Research Project Proposal & Progress Report 2015 Wiki page
| |
| − | #* Download Stat Plus for Mac to run Anova P-value test in Excel to test Jikai’s P-value method
| |
| − | #* Ran test case for P-value in Matlab to check method against Excel and by hand
| |
| − | #* Commenced writing progress report section of Research Project Proposal & Progress Report document
| |
| − | #* Attended meeting with Professor Abbott on Friday 29th May
| |
| − |
| |
| − | # Goals for Week 12:
| |
| − | #* Prepare text files for statistical analysis
| |
| − | #* Complete Task 1: Statistical Frequency Analysis of Letters
| |
| − | #* Complete and submit Research Project Proposal & Progress Report onto MyUni by Friday 5th June
| |
| | | | |
| − | ====Jikai====
| + | • Receive advices from Prof. Derek to process glass test data |
| − | # Week 11 progress:
| + | |
| − | #* Used mathmatic methed to manually calculated P-value, the result was same as excel did.
| + | |
| − | #* Use Matlab to calculated the P-value, the result was same as excel did.
| + | |
| − | #* Attended meeting with Professor Abbott and Nick on Friday 29th May.
| + | |
| − | # Goals for Week 12:
| + | |
| − | #* Calculate the P-value for European languages form Declaration against Somerton code and compare results with 2013 group's.
| + | |
| − | #* Finish Semester A proposal and progress report.
| + | |
| | | | |
| − | === Semester 1 Week 12===
| + | 2. Goals for week 8 |
| | | | |
| − | ====Nicholas====
| + | • Study on moving-average filter |
| − | # Week 12 progress:
| + | |
| − | #* Emailed Lucy Griffith for past code or excel spreadsheets used to perform the 2013 group's statistical analysis and received excel spreadsheets containing raw data and method
| + | |
| − | #* Emailed Matthew Berryman for assistance with statistical analysis
| + | |
| − | #* Prepared text files for statistical analysis
| + | |
| − | #* Carried out statistical analysis using Normal Distribution methods
| + | |
| − | #* Carried out statistical analysis using Non-Parametric methods
| + | |
| − | #* Modified statistical analysis method to obtain more accurate results
| + | |
| − | #* Completed Task 1: Statistical Frequency Analysis of Letters
| + | |
| − | #* Completed and submitted Research Project Proposal & Progress Report onto MyUni on Friday 5th June
| + | |
| | | | |
| − | # Goals for Week 13:
| + | * Week 8 |
| − | #* Upload content from Research Project Proposal & Progress Report onto 2015 group's Wiki page
| + | |
| | | | |
| − | ====Jikai====
| + | 1. Week 8 progress |
| − | # Week 12 progress:
| + | |
| − | #* Calculated the P-value for European languages form Declaration against Somerton code and compare results with 2013 group's.
| + | |
| − | #* Calculated chi-squared value between top 20 European languages from declaration against code and top 21 popular European language from Wikipedia against code.
| + | |
| − | #* Finishd and submited Semester A proposal and progress report on 5th June.
| + | |
| − | # Goals for Week 13:
| + | |
| − | #* Finish and upload gourp progress report to Wiki page.
| + | |
| − | #* Prepare begin task 3.
| + | |
| | | | |
| − | === Semester 1 Week 13===
| + | • Plotting after moving-average filter comparison figures |
| | | | |
| − | ====Nicholas====
| + | 2. Goals for week 9 |
| − | # Week 13 progress:
| + | |
| − | #* Uploaded content from Research Project Proposal & Progress Report onto 2015 group's Wiki page
| + | |
| | | | |
| − | # Goals for Exam Period:
| + | • Compare the original figures with after moving-average filter figures |
| − | #* Exam Revision
| + | |
| − | #* Commence Task 2
| + | |
| | | | |
| − | ====Jikai====
| + | • Start with the second draft of project proposal |
| − | # Week 13 progress:
| + | |
| − | #* Uploaded research project proposal & progress report onto 2015 group's Wiki page.
| + | |
| | | | |
| − | # Goals for Exam Period:
| + | * Week 9 |
| − | #* Review for exam.
| + | |
| | | | |
| − | ===Mid Year Break Week 1===
| + | 1. Week 9 progress |
| | | | |
| − | ====Nicholas====
| + | • Analysis of the after moving-average filter figures |
| − | # Week 1 progress:
| + | |
| − | #* Installed Microsoft Visual Studio.
| + | |
| − | #* Created and ran n-gram test code using quick start guide.
| + | |
| − |
| + | |
| − | # Goals for Week 2:
| + | |
| − | #* Re-evaluate the use of the Microsoft Database and perhaps consider the Google alternative.
| + | |
| | | | |
| − | ====Jikai====
| + | • Selected good comparison results |
| − | # Week 1 progress:
| + | |
| − | #* Finish Chi-squared tests update(If the letter appeared 0 time.
| + | |
| | | | |
| − | Use number 1 to instead of 0 for numbers)
| + | • Sent email to Prof. Derek to have a meeting at week 10 |
| | | | |
| − | # Goals for Week 2:
| + | 2. Goals for week 10 |
| | | | |
| − | #* Go to Gold Coast.
| + | • Meeting with Prof. Derek |
| | | | |
| − | ===Mid Year Break Week 2===
| + | • Further processing the moving-average filter figures |
| | | | |
| − | ====Nicholas====
| + | 3. Goals for week 11 |
| − | # Week 2 progress:
| + | |
| − | #* Upon further research, and consulting Dr Matthew Berryman and the Microsoft Web N-Gram Team, I found that the Microsoft database would require too many calls for use with our application and so the Google alternative must be considered.
| + | |
| − | #* Enquired about access to the collated database from the University of Pennsylvania Linguistic Data Consortium, was quoted a cost of 150 USD for the license, plus 50 USD postage of the physical DVDs upon which they are stored.
| + | |
| − |
| + | |
| − | # Goals for Week 3:
| + | |
| − | #* Begin writing search engine for use with Google corpus.
| + | |
| | | | |
| − | ====Jikai====
| + | • Continuing on second draft |
| − | # Week 2 progress:
| + | |
| − | #* Travel in Gold Coast.
| + | |
| | | | |
| − | # Goals for Week 3:
| + | * Week 11 |
| − | #* Review One-time pad work from 2013's group.
| + | |
| − | #* Search information about One-time pad.
| + | |
| | | | |
| − | ===Mid Year Break Week 3===
| + | 1. Week 11 progress |
| | | | |
| − | ====Nicholas====
| + | • Processing data and plotting without background comparison figures |
| − | # Week 3 progress:
| + | |
| − | #* Sought assistance from Dr Matthew Berryman, who wrote code to download the n-gram files from Google and collate them into a single file.
| + | |
| − | #* Dr Matthew Berryman advised me to use Python to write the database search engine
| + | |
| − | #* Began to learn python language
| + | |
| − | #* Began writing search engine
| + | |
| − | #* Had Skype conference with Dr Matthew Berryman
| + | |
| − | #* Organised meeting with Professor Abbott for next week
| + | |
| − |
| + | |
| − | # Goals for Semester 2 week 1:
| + | |
| − | #* Continue learning python and continue working on search engine
| + | |
| − | #* Meet with Professor Abbott
| + | |
| | | | |
| − | ====Jikai====
| + | 2. Goals for week 12 |
| − | # Week 3 progress:
| + | |
| − | #* Reviewed One-time pad work from 2013's group.
| + | |
| − | #* Searched information about One-time pad.
| + | |
| − | #* Organised meeting with Professor Abbott for next week.
| + | |
| − | # Goals for Semester 2 Week 1:
| + | |
| − | #* Met with Professor Abbott and Nick.
| + | |
| | | | |
| − | ===Semester 2 Week 1===
| + | • Finish second draft |
| | | | |
| − | ====Nicholas====
| + | * Week 12 |
| − | # Week 1 progress:
| + | |
| − | #* Met with Professor Abbott on Tuesday 28 July.
| + | |
| − | #* Continued working on search engine code in conjunction with Dr Matthew Berryman.
| + | |
| − | #* Ran code on database for first time.
| + | |
| − | #* Continued learning python functions used in code for use in thesis writeup.
| + | |
| | | | |
| − | # Goals for Week 2:
| + | 1. Week 12 progress |
| − | #* Assist Jikai with Task 3
| + | |
| − | #* Continue writing up elements for use in thesis.
| + | |
| | | | |
| − | ====Jikai====
| + | • Finish and submit second draft |
| − | # Week 1 progress:
| + | |
| | | | |
| − | #* Met with Professor Abbott and Nick on Tuesday 28 July.
| + | • Prepare final exam, no further works on project |
| − | #* Discussed task 3 with Nick.
| + | |
| − | # Goals for Week 2:
| + | |
| | | | |
| − | #* Started writing code for task 3 One-time pad.
| + | 2. Goals for week 13 |
| | | | |
| − | ===Semester 2 Week 2===
| + | • Meeting with Prof. Derek |
| | | | |
| − | ====Nicholas====
| + | • Arrange next semester’s tasks |
| − | # Week 2 progress:
| + | |
| − | #* Recieved results from first test from Matthew Berryman.
| + | |
| − | #* Commenced working on obtaining statistical data from results.
| + | |
| − | #* Continued writing up elements for thesis.
| + | |
| | | | |
| − | # Goals for Week 3:
| + | • Ask for quartz test data |
| − | #* Try to complete statistical results.
| + | |
| − | #* Email Dr Andrew Allison to book consulting time to discuss our task 1 statistical analysis results
| + | |
| | | | |
| − | ====Jikai====
| + | * Week 13 |
| − | # Week 2 progress:
| + | |
| − | #* Try to use Matlab to write code for task 3 One-time pad.
| + | |
| | | | |
| − | # Goals for Week 3:
| + | 1. Week 13 progress |
| − | #* Continue writing code for task 3.
| + | |
| | | | |
| − | ===Semester 2 Week 3===
| + | • Receive guidance from Prof. Derek to understand quartz test data |
| | | | |
| − | ====Nicholas====
| + | • Continuing on glass test data analysis |
| − | # Week 3 progress:
| + | |
| − | #* Emailed Dr Andrew Allison and received no reply.
| + | |
| − | #* Organised appointment with Professor Abbott for Friday 21st of August.
| + | |
| − | #* Emailed Dr Matthew Berryman about discrepancy between raw results and initial results using count column.
| + | |
| | | | |
| − | # Goals for Week 4:
| + | • Double check plotted figures |
| − | #* Meet with Professor Abbott on Friday.
| + | |
| − | #* Discuss n-gram search results with Dr Berryman and Professor Abbott to decide whether/what type of statistical analysis is to be conducted.
| + | |
| | | | |
| − | ====Jikai====
| + | 2. Goals for winter vacation. |
| − | # Week 3 progress:
| + | |
| − | #* Continued using Matlab to write code for task 3.
| + | |
| | | | |
| | + | • Meeting with James to check the figures |
| | | | |
| − | # Goals for Week 4:
| + | * Mid-break year |
| − | #* Use Matlab to write code for task 3.
| + | |
| − | #* Finish case(4M and 2W) Chi-squared value calculations.
| + | |
| | | | |
| − | ===Semester 2 Week 4===
| + | 1. Winter vacation progress |
| | | | |
| − | ====Nicholas====
| + | • Meet James and got advices form him |
| − | # Week 4 progress:
| + | |
| − | #* Met with Professor Abbott for Friday 21st of August.
| + | |
| − | #* Decided that we are unable to conduct statistical analysis from results of n-gram search, so results to be cleaned up and presented as part of final report.
| + | |
| | | | |
| − | # Goals for Week 5:
| + | • Log original data and plot figures |
| − | #* Clean up search results for presentation
| + | |
| − | #* Visit Dr Allison's office to organise a meeting
| + | |
| − | #* Conduct verification and testing of Jikai's one-time pad code.
| + | |
| | | | |
| − | ====Jikai====
| + | 2. Goals for semester B |
| − | # Week 4 progress:
| + | |
| − | #* Meet with Professor Abbott on Friday 21st of August.
| + | |
| − | #* Finish programming code for one time pad.
| + | |
| | | | |
| − | # Goals for Week 5:
| + | • Quartz test data analysis |
| − | #* Add last function to the code.
| + | |
| − | #* Review our task 1 statistical analysis.
| + | |
| | | | |
| − | ===Semester 2 Week 5===
| + | * Semester B |
| | | | |
| − | ====Nicholas====
| + | Week 1 |
| − | # Week 5 progress:
| + | |
| − | #* Emailed Hong Gunn Chew about University of Wollongong invoicing University of Adelaide for server and processing costs, using project budget.
| + | |
| − | #* Tried reaching Dr Andrew Allison via his office phone on multiple days but he was not in.
| + | |
| − | #* Spoke to Electrical Engineering office and was given an alternate email to try to reach him at.
| + | |
| − | #* Emailed Dr Allison to organise meeting.
| + | |
| − | #* Verified Jikai's One Time Pad code and suggested changes and improvements.
| + | |
| | | | |
| − | # Goals for Week 6:
| + | 1. Week 1 progress |
| − | #* Clean up search results for presentation.
| + | |
| − | #* Continue writing up n-gram search section of thesis.
| + | |
| − | #* Obtain mass spectrometer data from Professor Abbott to begin extension task (task 4).
| + | |
| | | | |
| − | ====Jikai====
| + | • Read quartz test data |
| − | # Week 5 progress:
| + | |
| − | #* Improve the matlab code and add last function in order to decipher the code by last character.
| + | |
| − | #* Review our chi-squared result.
| + | |
| − | #* Complete our group wiki page under IEEE home page.
| + | |
| − | # Goals for Week 6:
| + | |
| − | #* Continue improving code and add function.
| + | |
| − | #* Organise a meeting with Dr Allison to discusss our statistic result.
| + | |
| | | | |
| − | ===Semester 2 Week 6===
| + | • Cope with quartz test data |
| | | | |
| − | ====Nicholas====
| |
| − | # Week 6 progress:
| |
| − | #* Met with Dr Andrew Allison and discussed possibility of attempting statistical analysis from task 1 again using Bayes' theorem.
| |
| − | #* Continued writing code to clean up search results for presentation.
| |
| − | #* Continued writing up n-gram search section of thesis.
| |
| | | | |
| − | # Goals for Week 7:
| + | 2. Goals for week 2 |
| − | #* Arrange meeting with Professor Abbott
| + | |
| − | #* Send formal application for funding to Dr Hong-Gunn Chew including amended and forecasted budget.
| + | |
| − | #* Email Matthew Berryman for advice on proposed method.
| + | |
| − | #* Finish clean up code and excel import of data.
| + | |
| | | | |
| − | ====Jikai====
| + | • Matlab Programming |
| − | # Week 6 progress:
| + | |
| − | #* Continued improving code and add last function.
| + | |
| − | #* Met Dr Allison and get some useful suggetions to improve our statistic tests.
| + | |
| − | # Goals for Week 7:
| + | |
| − | #* Finished one time pad code improvement.
| + | |
| − | #* Organise a meeting with Prof Abbott and Dr Matthew to discuss our statistic results.
| + | |
| | | | |
| − | ===Semester 2 Week 7===
| + | * Week 2 |
| | | | |
| − | ====Nicholas====
| + | 1. Week 2 progress |
| − | # Week 7 progress:
| + | |
| − | #* Arranged to have meeting with Professor Abbott and Dr Berryman in week 8.
| + | |
| − | #* Created agenda of items of importance to discuss in meeting.
| + | |
| − | #* Had email discussion with Dr Berryman and Dr Allison about statistical analysis approach.
| + | |
| − | #* Completed cleanup code.
| + | |
| − | #* Ran completed cleanup code on search results.
| + | |
| − | #* Cleanup code produced repeated results, so commenced writing double remover code.
| + | |
| − | #* Completed application for funding to be sent to Dr Hong-Gunn Chew, waiting on invoices for proof of purchases from Dr Berryman.
| + | |
| | | | |
| − | # Goals for Week 8:
| + | • Matlab Programming |
| − | #* Complete and run doubles remover code and import outputs into excel document.
| + | |
| − | #* Email application for funding to Dr Hong-Gunn Chew.
| + | |
| − | #* Meet with Professor Abbott and Dr Berryman to discuss project progress so far and direction of further work.
| + | |
| | | | |
| − | ====Jikai====
| + | • Plot the change of Somerton man’s hair elements |
| − | # Week 7 progress:
| + | |
| − | #* Finished one time pad code improvement.
| + | |
| − | #* Organise a meeting with Prof Abbott and Dr Matthew to discuss our statistic results.
| + | |
| − | #* The matlab code was able to decode the Somerton code by using different letter locations and last letter as key.
| + | |
| | | | |
| − | # Goals for Week 8:
| + | • Plot the change of control samples’ hair elements |
| − | #* Meet both Professor Abbott and Dr Berryman to discuss project progress so far and we will start task 4 or update our task 1 results in the midbreak.
| + | |
| − | #* Use matlab code to output decoding messages and find some meaningful words.
| + | |
| | | | |
| − | ===Semester 2 Week 8===
| + | 2. Goals for week 3 |
| | | | |
| − | ====Nicholas====
| + | • Meeting with Prof. Derek and ask for advices |
| − | # Week 8 progress:
| + | |
| − | #* Created agenda for meeting with Professor Abbott, Dr Berryman and Jikai.
| + | |
| − | #* Met with Professor Abbott, Dr Berryman and Jikai on Friday 18 September.
| + | |
| − | #* In meeting, decided upon using texts from project Gutenberg to redo chi-squared statistical analysis on the language of origin of the code to overcome the issue of letters appearing 0 times in using the UN Declaration of Human Rights as the base text.
| + | |
| − | #* Received invoices from Dr Berryman and emailed completed application for funding to Dr Hong-Gunn Chew.
| + | |
| − | #* Completed doubles remover code.
| + | |
| | | | |
| − | # Goals for Mid-Semester Break:
| + | * Week 3 |
| − | #* Process results using doubles remover code and import into excel.
| + | |
| − | #* Obtain useful results from n-gram search for use in final report.
| + | |
| − | #* Submit exhibition requirements.
| + | |
| − | #* Fix up all original chi-squared test results.
| + | |
| − | #* Perform Chi-squared reanalysis using project Gutenberg texts.
| + | |
| | | | |
| − | ====Jikai====
| + | 1. Week 3 progress |
| − | # Week 8 progress:
| + | |
| − | #* Met Professor Abbott and Dr Berryman on Friday 18/09/2015.
| + | |
| − | #* In the meeting, decided we should redo our task 1 by using texts from project Gutenberg instead of using the UN Declaration of Human Rights as the base text.
| + | |
| − | #* Used matlab code to output decoding messages and try to find some meaningful words.
| + | |
| | | | |
| | + | • Meeting with Prof. Derek and get recommendations |
| | | | |
| − | # Goals for Mid-Semester Break:
| + | • Plot hold on figures |
| − | #* Redo our chi-squared test on task 1.
| + | |
| − | #* Search text files on project Gutenberg webpage and format them.
| + | |
| − | #* Analyse results in task 3.
| + | |
| | | | |
| − | ===Mid Semester Break===
| + | 2. Goals for week 4 |
| − | ====Nicholas====
| + | |
| − | # Week Mid-Semester Break progress:
| + | |
| − | #* Submitted Exhibition requirements and created shortened project title and project description for display.
| + | |
| − | #* Extended doubles remover code to work for results that appear more than twice.
| + | |
| − | #* Processed results and output final results in alphabetical order for comparison with raw results and cleaned up results.
| + | |
| − | #* Also processed results and output in order of highest number of year occurrence to lowest.
| + | |
| − | #* Tried importing results into Excel but ran out of rows, as data was too large, so instead exported full results for use in final dump of work, as well as top 20 results ranked in order of occurrence for each group of n-grams from 1-5 for inclusion in appendices of final report/thesis/wiki.
| + | |
| − | #* Discussed finding interesting/useful combinations of 5 grams for presenting in final report with Matthew Berryman
| + | |
| − | #* Received most popular interesting/useful 5 gram combinations from Dr. Berryman.
| + | |
| − | #* Fixed up task 1 initial results with count changed from 0 to 1, fixed up second refinement, for letters with 0 count, changing frequency to 0.001, and commenced re-analysis of some of the top 20 European languages with larger text files from project Gutenberg to allow no letters with count 0 to occur to verify our top 20 European results.
| + | |
| − | #* Wrote instructions on how to use initial and all letter counter java files from 2013 group’s work
| + | |
| | | | |
| − | # Goals for week 9:
| + | • Plot comparison figures of Somerton man hair and control hairs data |
| − | #* Organise meeting and meet with Professor Abbott
| + | |
| − | #* Visit Maths Learning Centre to see if there is any way to obtain a p-value from our new data sets.
| + | |
| − | #* Finalise all results, figures, graphs etc. for use in presentation and thesis/final report
| + | |
| − | #* Commence creating slideshow for final presentation
| + | |
| − | #* Commence writing thesis skeleton for use in final presentation
| + | |
| | | | |
| − | ====Jikai====
| + | * Week 4 |
| − | # Week Mid-Semester Break progress:
| + | |
| − | #* Redo our chi-squared test on task 1.
| + | |
| − | #* Searched text files on project Gutenberg webpage and format them. The new text files from project Gutenberg allows no letters with count 0 and we uesd them to verify our chi-squared test results.
| + | |
| − | #* Analyse results in task 3, pick some of them to used in our Final Seminar and Final Report.
| + | |
| | | | |
| − | # Goals for week 9:
| + | 1. Week 4 progress |
| − | #* Meet Professor Abbott and Dr Berryman to discuss our update results for task 1.
| + | |
| − | #* Start writing slides for our Final Seminar presentation.
| + | |
| − | #* Start writing our Final thesis.
| + | |
| | | | |
| − | ===Semester 2 Week 9===
| + | • Plot comparison figures of Somerton man hair and control hairs data |
| − | ====Nicholas====
| + | |
| − | # Week 9 progress:
| + | |
| − | #* Obtained promising results from re-analysis of a portion of the top 20 European languages using project Gutenberg text files and the chi-squared method.
| + | |
| − | #* Organised meeting and met with Professor Abbott and Dr. Berryman on Thursday 8 October at 11am.
| + | |
| − | #* Conclusions from meeting were to increase the sample size of the English portion of our Project Gutenberg corpus to 20 concatenated novels, and to take 100 44 letter samples from this to obtain our average chi-squared value for English to calculate our English p-value significance level.
| + | |
| − | #* Visited Maths Learning Centre and was given some useful advice on how to compare our control p-values vs code p-values.
| + | |
| − | #* Attempted normal distribution p-value analysis method on chi-squared value of code versus average chi-squared value of English samples but did not work since lower chi-squared values are better, not closer chi-squared values.
| + | |
| − | #* Finalised all results, figures, graphs etc. for use in presentation and thesis/final report.
| + | |
| − | #* Commenced creating slideshow for final presentation.
| + | |
| − | #* Continued writing thesis for inclusion of task 4: statistical frequency of letters reanalysis in final presentation.
| + | |
| | | | |
| − | # Goals for week 10:
| + | 2. Goals for week 5 |
| − | #* Complete slideshow and talk for final presentation.
| + | |
| − | #* Present final presentation on Tuesday 13 October at 5pm.
| + | |
| − | #* Write python code in order to increase the sample size of the English portion of our Project Gutenberg corpus to 20 concatenated novels, and to take 100 44 letter samples from this.
| + | |
| − | #* Obtain average chi-squared value for English to calculate our English p-value significance level.
| + | |
| − | #* Obtain chi-squared and p-value for new English base text vs Somerton Man code.
| + | |
| − | #* Continue writing thesis.
| + | |
| | | | |
| − | ====Jikai====
| + | • Continuing plot comparison figures of Somerton man hair and control hairs data |
| − | # Week 9 progress:
| + | |
| − | #* Meet Professor Abbott and Dr Berryman on Thursday 08/10/2015 and discuss our update results on task 1.
| + | |
| − | #* Discuss with Nick about the Final Seminar workplan and time.
| + | |
| − | #* Start writing slides for our Final Seminar presentation.
| + | |
| | | | |
| | + | * Week 5 |
| | | | |
| − | # Goals for week 10:
| + | 1. Week 5 progress |
| − | #* The final seminar will hold on Tuesday 13/10/2015.
| + | |
| − | #* Continue updating and improving our Chi-squared test for task 1.
| + | |
| − | #* Start writing our Final thesis.
| + | |
| | | | |
| − | ===Semester 2 Week 10===
| + | • Continuing plot comparison figures of Somerton man hair and control hairs data |
| − | ====Nicholas====
| + | |
| − | # Week 10 progress:
| + | |
| − | #* Completed slideshow and talk for final presentation.
| + | |
| − | #* Presented final presentation on Tuesday 13 October at 5pm.
| + | |
| − | #* Completed python codes for implementing increased sample size reanalysis for Task 4
| + | |
| − | #* Obtained average chi-squared value for English to calculate our English p-value significance level.
| + | |
| − | #* Obtained chi-squared and p-value for new English base text vs Somerton Man code.
| + | |
| − | #* Continued writing thesis.
| + | |
| | | | |
| − | # Goals for week 11:
| + | 2. Goals for week 6 |
| − | #* Complete and submit final report/honours thesis
| + | |
| − | #* Complete honours poster
| + | |
| | | | |
| − | ====Jikai====
| + | • Compare two tests’ data |
| − | # Week 10 progress:
| + | |
| − | #* Finished the PPT slides for final seminar.
| + | |
| − | #* Presented The final seminar on Tuesday 13/10/2015.
| + | |
| − | #* Downloaded and formatted English novels from Project Gutenberg, and sent results to Nick.
| + | |
| − | #* Started writing our Final thesis.
| + | |
| − | .
| + | |
| | | | |
| − | # Goals for week 11:
| + | * Week 6 |
| − | #* Finish our Final thesis in Wiki page.
| + | |
| | | | |
| − | ===Semester 2 Week 11===
| + | 1. Week 6 progress |
| − | ====Nicholas====
| + | |
| − | # Week 11 progress:
| + | |
| − | #* Completed and submitted Final Report/Honours Thesis
| + | |
| − | #* Designed and submitted project exhibition poster
| + | |
| − | #* Organised project exhibition resources
| + | |
| | | | |
| − | # Goals for week 12:
| + | • Compare two tests’ data |
| − | #* Present at project exhibition
| + | |
| | | | |
| − | ====Jikai====
| + | 2. Goals for week 7 |
| − | # Week 11 progress:
| + | |
| − | *# Finished final thesis before Wednesday 21/10/2015.
| + | |
| − | *# Prepared for exhibition next week.
| + | |
| | | | |
| | + | • Plot the comparison figures of two tests’ data |
| | | | |
| − | # Goals for week 12:
| + | * Week 7 |
| − | *# Exhibition will hold between Monday (26/10/2015) and Tuesday (27/10/2015). | + | |
| − | *#
| + | |
| | | | |
| − | ===Semester 2 Week 12===
| + | 1. Week 7 progress |
| − | ====Nicholas====
| + | |
| − | # Week 12 progress:
| + | |
| − | #* Presented at Ingenuity Exhibition
| + | |
| − | #* Collated work for final dump to be submitted Friday 6 November
| + | |
| − | #* Organised final meeting with Derek for Friday 6 November
| + | |
| | | | |
| − | ====Jikai====
| + | • Plot comparison figures of two tests’ data |
| − | # Week 12 progress:
| + | |
| − | #*
| + | |
| − | #*
| + | |
| − | #*
| + | |
| − | #*
| + | |
| | | | |
| − | ==See also==
| + | 2. Goals for week 8 |
| − | * [[Cipher Cracking 2013]]
| + | |
| − | * [[Semester A Progress Report 2013 - Cipher cracking]]
| + | |
| − | * [[Semester B Final Report 2013]]
| + | |
| − | * [[Cipher Cross-off List]]
| + | |
| | | | |
| − | ==Back==
| + | • Exhibition briefing |
| − | *[https://myuni.adelaide.edu.au/webapps/portal/frameset.jsp Back to MyUni] | + | |
| − | *[http://www.eleceng.adelaide.edu.au/personal/dabbott Back to Derek Abbott's homepage] | + | * Week 8 |
| − | *[http://www.eleceng.adelaide.edu.au Back to EEE Department page] | + | |
| − | *[http://www.adelaide.edu.au Back to the University of Adelaide homepage]
| + | 1. Week 8 progress |
| − | *[https://www.eleceng.adelaide.edu.au/personal/dabbott/wiki/index.php/Cipher_Cracking_2013 Back to Cipher Cracking 2013 homepage] | + | |
| | + | • Exhibition briefing |
| | + | |
| | + | • Read example posters |
| | + | |
| | + | • Prepare for the edition of project poster |
| | + | |
| | + | 2. Goals for week 9 |
| | + | |
| | + | • Edit exhibition poster |
| | + | |
| | + | * Week 9 |
| | + | |
| | + | 1. Week 9 progress |
| | + | |
| | + | • Edit exhibition poster |
| | + | |
| | + | • Work on final report |
| | + | |
| | + | 2. Goals for week 10 |
| | + | |
| | + | • Work on final report |
| | + | |
| | + | • Analysis of three groups’ figures |
| | + | |
| | + | * Week 10 |
| | + | |
| | + | 1. Week 10 progress |
| | + | |
| | + | • Work on final report |
| | + | |
| | + | 2. Goals for week 11 |
| | + | |
| | + | • Work on final report |
| | + | |
| | + | • Poster exhibition |
| | + | |
| | + | • Prepare project seminar |
| | + | |
| | + | * Week 11 |
| | + | |
| | + | 1. Week 11 progress |
| | + | |
| | + | • Work on final seminar |
| | + | |
| | + | • Work on final report |
| | + | |
| | + | 2. Goals for week 12 |
| | + | |
| | + | • Prepare poster exhibition |
| | + | |
| | + | • Poster exhibition |
| | + | |
| | + | * Week 12 |
| | + | |
| | + | 1. Week 12 progress |
| | + | |
| | + | • Poster exhibition |
| | + | |
| | + | • Edit Wiki page |
| | + | |
| | + | • Prepare final seminar |
| | + | |
| | + | 2. Goals for week 13 |
| | + | |
| | + | • Final seminar |
| | + | |
| | + | • Edit Wiki page |
| | + | |
| | + | * Week 13 |
| | + | |
| | + | 1. Week 13 progress |
| | + | |
| | + | • Finish wiki page editing |
| | + | |
| | + | • Record Youtube video |
• Received a series of data from Prof. Derek and Dr. James
• Meeting with Prof. Derek
• Received advices about seminar ppt from Prof. Derek
• Email Prof. Derek to arrange a meeting
• Meet Prof. Derek to check the first draft of project proposal
• Sent email to Prof. Derek to have a meeting at week 10
• Meeting with Prof. Derek
• Meeting with Prof. Derek
• Receive guidance from Prof. Derek to understand quartz test data
• Meeting with Prof. Derek and ask for advices
• Meeting with Prof. Derek and get recommendations
• Continuing plot comparison figures of Somerton man hair and control hairs data
• Continuing plot comparison figures of Somerton man hair and control hairs data
