ADVT Assessment

1. ADVT Assessment

2. Coinbox exercise

3. An apology • I am really sorry about the bug in the feedback web pages • Inexcusable • Your feedback is most valuable

4. Specification You are to write a paper according to the instructions below. The paper must be a literature review, informed by one or more of the classes in this module. The title of the paper will be of your choice, but will have to be approved by Alistair Edwards.

5. Four phases

6. Title The title must relate to one or more of the classes in this module. It should be sufficiently specific to be realistic to be addressed in a paper written under these constraints. The paper must be based on existing work – as presented in the classes and in the literature. It must not require any original research.

7. Extended abstract The purpose of the abstract is to set out the structure and outline content of the eventual paper. Feedback will be provided on the abstract. The Extended Abstract must be no more than 2 pages. It does not have to conform to any page formatting rules, but must be in PDF electronic format and must be submitted electronically.

8. Paper The paper must address the title. It is expected that it will follow the outline of the extended abstract, but it is permissible to introduce new material. In particular, there may be topics covered in greater depth towards the end of term, which you may wish to include. Your paper must be in PDF format, formatted according to the published specification requirements (http://www-course.cs.york.ac.uk/hcit/Sample.docx or http://www-course.cs.york.ac.uk/hcit/Sample.doctx) ) and must not exceed 8 A4 pages. You must use the IEEE style of referencing. (See http://www.ieee.org/documents/ieeecitationref.pdf).

9. Marking 1 Has the Extended Abstract been submitted and approved? (0.5) 2 Does the paper address the topic implied by its title? (0.5) 3 Does the paper show evidence of the author having read more widely around the topics? (1.0) 4 Does the paper show evidence of input from one or more of the ADVT classes? (0.5) 5 Does the author show original and critical thinking? (1.0) 6 Does the paper show awareness of the diversity of potential users of interactive technology? (1.0) 7 Are references used appropriately? (1.0) 8 Does the paper meet the formatting requirements? (0.5) 9 Is the abstract appropriate? (1.0) 10 Quality of the introduction. (1.0) 11 Does the paper present appropriate conclusions? (1.0) 12 Quality of presentation and writing. (2.0) This includes clarity of meaning, English style and grammar and formatting.

10. Questions? Any subsequent questions will be answered via the on-line forum: http://www.cs.york.ac.uk/forum/viewforum.php?f=63&sid=84ed8f0e3bbff1cdd17c37d67db26025

11. A gentle introduction to writing research papers …but drawing heavily on slides from Chris Power Alistair Edwards

12. Objectives • To give a brief introduction to scientific writing in general • To help you prepare for the specific writing task for the assessment of this module

13. Why do we publish? ‘Publish or perish’

14. Organizing your research (paper)

15. Organizing your research (paper) • Choosing a topic • Choosing your audience • What is your hypothesis? • What is your story? • Doing your literature review • Finding your evidence

16. Choosing a topic • One key to success is – What are you going to research? • …but in the context of this assessment • must be related to one or more of the classes • must have a significant literature • must be of the right size • must require no original research

17. Choosing your audience • After you have chosen your topic (and done the work!) you need to know how to target your paper • Again, for this assessment: • think of the second marker • is an HCI expert • but has not been to the classes

18. What is your hypothesis? • A hypothesis is a proposition • Your objective is to prove – or falsify – that hypothesis • (Remember QUAN?)

19. Example hypotheses • Animation makes web advertising more effective • Fast-tempo music increases game players’ sense of immersion • Perceived ease-of-use is positively related to flow experience of playing of an on-line game • Data entry by older users is easier when the pocket computer has a keyboard, albeit a small one

20. The null hypothesis • The negation of the hypothesis • Seek to prove it • Fail and you have proved the hypothesis e.g. Perceived ease-of-use is not positively related to flow experience of playing an on-line game

21. Even a review paper should have a hypothesis • Find a point to argue • and do so with reference to the literature

22. What is your story? • Every paper has a story • Finding it can be hard • but once you are clear you can write a clearer paper • ‘No tale is so good that it can’t be spoiled in the telling’ (Proverb)

23. Example stories • ‘This is my hypothesis and here is the evidence to prove or disprove it’ • A history • Selling • an idea • a product • Teach • start from what the reader knows • and lead them to new knowledge

24. Doing your literature review • There is always a literature review • Your assessment paper will be mostly a literature review

25. Doing your literature review

26. Doing your literature review • Look for those references that have titles and keywords that seem to match the problem you are solving • If available, read the abstract • Collect papers – either digital or go to *gasp* the library! • Do this early because if you need to see a paper and we don’t have it in the University you can order through inter-library loans (ILL)

27. Doing your literature survey • Read the abstract, introduction and conclusions • If they are well written these will tell you what the paper is about and whether it is useful • Discard those that are not useful – may want to keep a file of interesting things to look at for another time • Keep those that are applicable and read methods and results

28. Doing your literature survey • Read the abstract, introduction and conclusions • These will also be most important in the paper you write • and are often poor

29. Doing your literature review • Make notes as you go along • Organize the papers cleverly – use good tools to store and organize papers • Desktop – Bibtex, Endnote, RefMan • Cloud – Mendeley, Citeulike • Do not keep them in a word document or other basic file type – you will drown • With the above tools you can then generate bibliographies for your own paper in whatever format you want

30. Exercise: Doing a literature survey in 15 minutes

31. Exercise • Get into groups of 3 or 4 • Each group to have a computer with web access • Choose a topic that is interesting to you • Do a Google Scholar search on that topic • http://scholar.google.co.uk/ • Pick 1 paper that appears to be highly cited • Read the abstract and introduction • Pick out interesting references • After 10 minutes you will tell the other groups the ‘story’ of research you have found

32. Choose a topic What is Multimodality? Research in Practice Design for the web: Frameworks and Metaphors Cross-cultural design Can we do a better mail merge? Using dialogical methods to understanding experience Are we human or are we children? Research through Design The social experience of gaming Multimodality Forms Design: What really matters to users Access to the Web for disabled and older people

33. What’s your story?

34. Structuring your paper • You then have to communicate all of the above to your reader • Build constructs of language – sentence to paragraph, paragraphs to sections, sections to papers • All constructs of our paper will have the same structure: • Introduction – orienting the reader • Contribution – the point of the construct • Conclusion – sending the reader off

35. Structuring your paper • Introduction • Contribution • Generally • Method • Results • Discussion • Conclusion

36. Structuring your paper • Introduction • Contribution • For the assessment mainly discussion • Conclusion

37. Abstract • Abstract: • State the contribution you are making • State the motivation as to why it is interesting • State the methodology you followed • State the results • State the conclusions • You get about 1-2 sentences for each of these • The abstract will keep people reading your paper • Extended abstracts – short paper – you get 1 or 2 paragraphs for each of these

38. Abstract • Abstract: • State the contribution you are making • State the motivation as to why it is interesting • State the methodology you followed • State the results • State the conclusions • You get about 1-2 sentences for each of these • The abstract will keep people reading your paper • Extended abstracts – short paper – you get 1 or 2 paragraphs for each of these

39. Abstract • The abstract and paper should be capable of being read independently • Don’t assume that the reader reading one of them has read the other

40. Abstract Example This paper presents the design of a new web browser, the Tree Trailblazer, which allows users to browse the web while maintaining a visual record of their exploration path, or trail, through the information space. This design enhances the backtracking aspects of web browsing over current designs by providing visual cues regarding the pages related to the page being viewed, providing users with an understanding of their position in the trail. This design also helps users blaze new trails off a page by allowing them to open previews of pages off of the currently viewed page. The scenario based design process that was used to construct the browser is discussed in conjunction with the initial prototype implementation. A formative user evaluation of this prototype showed this browser design to be very easy to learn and highly usable, with particular attention being paid to aspects of the tree visualization. Power, C.; McQuillan, I.; Petrie, H.; Kennaugh, P.; Daley, M.; Wozniak, G.; , "No Going Back: An Interactive Visualization Application for Trailblazing on the Web," Information Visualisation, 2008. IV '08. 12th International Conference , vol., no., pp.133-142, 9-11 July 2008doi: 10.1109/IV.2008.64URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4577938&isnumber=4577908

41. Introduction • Introduce the topic • ‘This paper is about…’ very early on • ‘No one reads the second paragraph’ • Journalists’ dogma • Introduce the background • Introduce the paper

42. Literature review • In this section you will convince the reader that what you are doing is new and interesting • Hit on major themes within the research community • Look for problem areas such as common disagreements or ‘dogma’ that is in the field so that you reference them clearly • This is particularly important in your assessment • You have not simply read the literature, you have analysed it critically • Discussion section?

43. Conclusions Simple rule • Introduce nothing new in the conclusions • It is a distillation of what has gone before

44. Conclusions State – or re-iterate – succinctly: • The contribution you have made • The motivation as to why it is interesting to your audience and how it applies to them • The methodology you already described • The key results • What the findings mean to the field and how it is original and important

45. Scientific Writing Style

46. Scientific writing • Everything you say must be backed by evidence • From the literature • From your results • There is no place for opinion

47. Finding your scientific voice • It’s not a highly personal narrative “I studied different sources in the library. I attended the class on…” • It doesn’t have to be very convoluted, full of complex terms “If skin deformation is a critical factor for roughness perception (Taylor and Lederman, 1975), then it would seem reasonable to argue that roughness perception in virtual reality might be more similar to roughness perception in the physical world via a probe, than via a bare finger.” 46-word sentence - I have to draw breath, that’s not a good sign

48. Keep it as plain and simple as you can • Try to find a way of writing that is somewhere in the middle, that you are comfortable with • A certain amount of use of the first person is fine • Keep words short and simple as possible - except for technical terms • Keep sentences short always (break the argument down into its logical parts for the reader to understand)

49. Sentences building to paragraphs ‘Skin deformation may be a critical factor for roughness perception (Taylor and Lederman, 1975). Roughness perception in the physical world is usually undertaken with the bare fingers and thus involves skin deformation; sometimes it may be undertaken with a probe or other device, and no skin deformation is involved. Therefore it is reasonable to argue that roughness perception in virtual reality, which inevitably uses a probe, is more similar to roughness perception in the physical world via a probe than via a bare finger.’

50. Readability • Original sentence: Flesch Ease of Reading Index 13% • Chris’s (initial) re-write: Flesch 33.4% These reading indices are not very good, but can occasionally be a useful tool