1 / 13

The Loneliness of the Long-Distance Document Reviewer: E-discovery and Cognitive Ergonomics

The Loneliness of the Long-Distance Document Reviewer: E-discovery and Cognitive Ergonomics. Simon Attfield Stephen De Gabrielle Ann Blandford. The Making Sense of Information Project. The problem of manual review.

conan
Download Presentation

The Loneliness of the Long-Distance Document Reviewer: E-discovery and Cognitive Ergonomics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Loneliness of the Long-Distance Document Reviewer: E-discovery and Cognitive Ergonomics Simon Attfield Stephen De Gabrielle Ann Blandford The Making Sense of Information Project

  2. The problem of manual review • The problem of ‘information inflation’ – a ‘pulse’ in the history of information [Paul & Baron, 2007] • A challenge to effectively identifying the evidentiary record within reasonable constraints of time and cost.

  3. The problem of manual review • - Interest in search – TREC Legal Track • But what about the review process itself? • Document review is cognitively intense • Junior lawyers scanning document after document… • ……… for weeks • Its a jigsaw • It is the reviewers ability to understand that underpins the task • - We draw on examples from case-studies in large London law firm

  4. Case study data… • Identifying classes of irrelevant documents • Participants identified classes of irrelevant documents • Learning ‘signature cues’ improved speed • BUT temporal separation reduced priming • Identifying classes of relevant documents • Participants learned about the underlying narratives • This supported faster interpretation • BUT temporal separation reduced priming • Confounded by multiple threads

  5. Supporting the development of interests • Hypotheses: • Efficiency and effectiveness of reviewers’ relevance judgements are adversely affected by • Separation between similar irrelevant documents • Separation between related relevant documents • Relate to timing and order in which documents are encountered • Need to be tested • Draw attention to issues of cognitive ergonomics

  6. What does it mean for design? • Can system design help the user make strategically informed decisions about which document to look at next given the dynamic development of interests? • Relevance feedback • Is lexical analysis enough…

  7. Thumbnail arrays?

  8. Information visualisations Information Visualisations can help the user shape the flow of information they receive [McNee & Arnette, 2008] Attenex Patterns

  9. Information visualisations - ThreadsVI

  10. Information visualisations – Threads VI

  11. Information visualisations - EventsVI

  12. Information visualisations - EventsVI

  13. Conclusions • The review challenge • Hypotheses… • Efficiency and effectiveness of review is adversely affected by: • Separation between similar irrelevant documents • Separation between related relevant documents • Interface design - a potentially profitable area of research • We are planning some controlled evaluations

More Related