Lifelogging to Lifebraries (L2L)

1. Lifelogging to Lifebraries(L2L) Outline proposal for a Network of Excellence Objective ICT-2009.4.1 Digital Libraries and Digital PreservationTarget Outcome (e) Interdisciplinary Research Networks

2. What is Cultural Heritage Culture is based on what people do, on what everyone does Recording what everyone is doing will preserve a better cultural heritage Lifelogging – a term with baggage, Lifebraries is our new community Definition is recording, digitally, aspects of one's life. Captures one's life experiences and includes explicit User Generated Content (UGC) as well as ambient logging 1. Cultural Heritage

3. 2. Explicit Lifelogging There are several, and a growing number, of lifelogging projects in Europe and beyond MemoryLane, SenseCam, LiveMemories, LivingKnowledge, GLOCAL, COGNOW, Memories for Life Grand Challenge, HAPTIMAP, Oldenburg wellness trials Based on wearable cameras (SenseCam/Vicon), GPS recording tracks, accelerometers (independent/phones to record walk, sit, drive, etc.), Bluetooth sensing other BT devices (phones) we encounter, etc. 2. Lifelogging happens

4. 3. Implicit Lifelogging Record indirectly or infer activities – from FaceBook, Twitter, phone/Skype calls, SMS, email and web, IPTV, LinkedIn, Flickr (etc.) photos, YouTube videos, blogs, online calendars, financial transactions. Smart meters on domestic electricity, gas, water infer use of different appliances, infer domestic activities. Sousveillance vs. Surveillance 3. Lifelogging happens

5. Why ? Find incidents from our past Personal journal of one's history Discover deviations in our lifestyles, short term or longer Re-live the past as a memory prosthesis - Alzheimer's/dementia Share our past with others Build a community memory of some event ... all these are library uses 4. Why Lifelogging

6. Problem ? All happening with a technological drive, no information science, memory science, neurospychology, sociology, law, ethics,governance, social acceptance, curation Need for a new community, drawn from all of the above. Also, projects focus on lifelogging data no leverage of additional UGC to socially link different people's views/lives/experiences 5. What’s the Problem ?

7. Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech 6. CONSORTIUM

8. Alinari Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Guardian of a photographic ‘corpus’ of >5.5M pictures, historical and contemporary • Responsible for the management of an ongoing program of exhibitions and publishing • Expert areas:watermarking, digital rights management, content provider, preservation and image restoration, multimedia content supply • Relevant EU Projects: GLOCAL • People: Andrea de Polo CONSORTIUM

9. Dublin City University - CLARITY Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Harvesting & harnessing of large volumes of sensed information, from both the physical world in which we live, and the digital world of modern communications & computing • >50% of all SenseCam publications have CLARITY authors • Expert areas: Information Management in Ambient Lifelogs, human digital memories • People: Alan F. Smeaton, Cathal Gurrin, Aiden Doherty, Noel E. O’Connor CONSORTIUM

10. DCU - Institute of Ethics Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Studies in Ethics, Law and Technology • Play a leading role in raising public awareness of, and stimulating debate about, ethical issues • Expert areas: ethics of emerging technologies, ethical issues in life sciences, healthcare, technology and innovation, and business and society • People: Bert Gordijn CONSORTIUM

11. University of Glasgow Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • International reputation in research on information retrieval methods • Focus on Multimedia information management • Expert areas: Developing advanced retrieval models, studying the role of emotion in search, personalization and adaptive retrieval • People: Joemon M. Jose, C. J. (Keith) van Rijsbergen CONSORTIUM

12. University of Leeds Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • World-class reputation in memory science & neuropsychology, with links to local and national clinicians in the National Health Service • Memory impairment research at Leeds work includes some of the first work with the SenseCam wearable camera in memory impaired groups • Expert areas: Autobiographical memory, memory rehabilitation, memory dysfunction in dementia & healthy aging, the self & memory • People: Chris Moulin, Martin Conway CONSORTIUM

13. Luleå Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Past projects geared towards health-care (e.g. FP5 MobiHealth) and context aware social networking • Expert areas: advanced applications for eHealth, support for people with disabilities using enabling technologies, context discovery in social networks • Relevant EU Projects: COGKNOW • Relevant Regional Projects: MemoryLane • People: Arkady Zaslavsky, Kåre Synnes, Josef Hallberg, Johan Bengtsson CONSORTIUM

14. Namur Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Research in the field of new technologies with a special emphasis on privacy issues, individual and public freedom in the Information Society and Internet Governance • Member of the Belgian Commission on Data Protection • Expert areas: social science & philosophy, ethical, political and legal challenges raised by the new information, communication and surveillance technologies • People: Yves Poullet, Claire Lobet-Maris, Antoinette Rouvroy, Nathalie Grandjean CONSORTIUM

15. Oldenburg Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Identify, enhance, and evaluate new techniques of information and communication technology for design of environments for aging • Detection of daily activities by monitoring • Expert areas: Information summarisation, person activity classification • Relevant Industry Projects: CeWe Color • Relevant EU Projects: HaptiMap • People: Susanne Boll, Jochen Meyer, Wilko Heuten CONSORTIUM

16. Praeposit Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Provides services such as technology research, organisation of business and cooperation events, EU project proposal support and eLearning consultations • Expert areas: Project Administration & Management • People: Craig Stewart CONSORTIUM

17. Queen Mary University London Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Multimedia, especially visual, information analysis • Leveraging user generated content for enhancing representation • Expert areas: multimedia content analysis • People: Ebroul Izquierdo, Krishna Chandramouli CONSORTIUM

18. Royal School of Library and Information Science Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Experimental research on cognitive aspects of user-system interaction • Graduate school with focus on theoretical and practical information science • Expert areas: library science storage and retrieval • People: Peter Ingwersen, Pia Borlund, Birger Larsen CONSORTIUM

19. Swedish National Archives Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Maintains an archive of ????? • Member of QVIZ FP6, browsing of the archival resources through time and space using a dynamic map or contextual categories. • Expert areas: Curation of cultural content • Relevant EU Projects: ???? • Other Relevant Projects: ??? • People: Peder Andren, Borje Justrell CONSORTIUM

20. Trento Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Investigations into social structure; inequalities & collective actions; social norms, political & ethical values; social policies in EU • Social construction of technology; knowing and learning as a collective • Expert areas: management of cultural memories, shared cultural experiences, sociology • Relevant Regional Projects: LiveMemories • Relevant EU Projects: LivingKnowledge, GLOCAL • People: Fausto Giunchiglia, Silvia Gherardi, Pierre Andrews CONSORTIUM

21. VicomTech Alinari DCU/CLARITY DCU/Ethics Glasgow Leeds Luleå Namur Oldenburg Praeposit QMUL RSLIS Swedish Natl Archives Trento VicomTech • Develop advanced techniques to understand and manage multimedia assets • Expert areas: semantic enrichment of multimedia, ontology construction • People: Julián Flórez, Jorge Posada CONSORTIUM

22. CONSORTIUM

23. CONSORTIUM

24. LifeLog Interpretation Image Processing VicomTech QMUL Information Search Lulea Glasgow Social Interaction Library Science RSLIS Oldenburg Health & Wellness DCU-CLARITY LifeLog Technology Curation (Industry) Trento Alinari Shared Culture Namur Swedish National Archive Curation (Culture) Content Rights DCU-Ethics Praeposit Leeds Social Acceptance Memory Science Management CONSORTIUM

25. 7. The L2L Work Programme structure WP1- Management (Praeposit) WP2: Integration activities (Glasgow) WP3: Technological Challenges in Lifebraries (DCU) WP4: Cognition, Memory, Emotion in Lifebraries (Leeds) WP5: Societal issues in Lifebraries (Namur) WP6: Use cases and Demonstrators (QMUL) WP7: Dissemination, exploitation and standardisation activities (DCU) CONSORTIUM

26. 7. The L2L Work Programme structure WP1- Management (Praeposit) Activity 1.1: Network Administration Activity 1.2: Network Communications and Reporting to the Commission Activity 1.3: Financial Management Activity 1.4: Quality Control Activity 1.5: Risk Management Activity 1.6: Legal and Ethical Reporting Activity 1.7: Objective tree and assessment metrics WP2: Integration activities (Glasgow) Activity 2.1: Towards a Virtual Competence Centre Activity 2.2: Researcher Mobility Program Activity 2.3: Cooperation in Education, teaching materials and PhD formation Activity 2.4: Lifebrary Festival Summer Schools Cross-disciplinary exploration Activity 2.5: Pan-European Integration WP3: Technological Challenges in Lifebraries (DCU) Activity 3.1: Data Preparation and Pre-Processing Activity 3.2: Evidence by Combination Techniques Activity 3.3: Context Modeling and User/Community Profiling Activity 3.4: Event Detection & Summarisation Activity 3.5: Event Visualisation Schemes Activity 3.6: Semantic Modeling /Ontology Activity 3.7: Community Profiling using Social Networks WP4: Cognition, Memory, Emotion in Lifebraries (Leeds) Activity 4.1: Cognitive Issues in archiving and interacting with lifebraries Activity 4.2: Memory impairment and lifebraries Activity 4.3: Emotional issues in preserving lifebraries Activity 4.4: Lifebrary selection and preservation models Activity 4.5: Lifebrary curation model Activity 4.6: Browsing, search and retrieval models in lifebraries Activity 4.7: The self and other: What is remembered about who in lifebraries WP5: Societal issues in Lifebraries (Namur) Activity 5.1: Stakeholders cartography Activity 5.2: Case Studies Activity 5.3: Legal Issues in Lifebrary Construction and Archiving including Privacy & Security Issues in Lifebraries Activity 5.4: Social Impact and societal Issues Activity 5.5: Ethical Issues Activity 5.6: Dissemination WP6: Use cases and Demonstrators (QMUL) Activity 6.1: Virtual Laboratory Activity 6.2: Evaluation Methodology Activity 6.3: Data Set Creation and Ground Truth Generation Activity 6.4: Case Studies Autobiography-based Lifebraries Societal Biographies-based Lifebraries Preserving cultural heritage – Digital curation to Lifebrary Activity 6.5: Distributed research environment and L2L Integration Platform Activity 6.6: Lifebrary Archive WP7: Dissemination, exploitation and standardisation activities (DCU) Activity 7.1: Web portal & Promotional materials Activity 7.2: Joint Publications Activity 7.3: Standards and Technology Transfer Activity 7.4: Societal Impacts Activity 7.5: L2L Platform Challenge CONSORTIUM

27. External Advisory Chamber SCIENTIFIC ADVISORY BOARD INDUSTRIAL ADVISORY BOARD • Jim Gemmel (Microsoft) • Peter Scott (KMI, Open U) • Steve Mann (Toronto U) • Ramesh Jain (UC Irvine) • Hari Sundaram (ASU) • Gary Marchionini (UNC) • Nick Belkin (Rutgers) • Keith Oatley (Toronto U) • Eric Moore (FAST/Microsoft) • John Herlihy (Google) • Geoff Cross (Vicon) • Ron Yang (FaceBook) • Ricardo Baeza Yates (Yahoo! Research, Barcelona) • John Tait (IRF) 8. Advisors USER GROUP • Emma Berry, MSR (Co-chair) • Frank Nack, CWI (Co-chair)

28. Why is this a Digital Library, why this call ? L2L matches perfectly with the aims of the call - interdisciplinarity in composition. More than bridges, integrates technological, information and archival science & practice social and cognitive sciences law and ethics Creates a new research community where non-technological partners are more than just cheerleaders. Lifelogging is happening, building personal lifelogs, explicitly, or implicitly, and 5 years from now … These lifelogs are our personal Digital Libraries. As Libraries, they are in need of inputs from all the different L2Lcommunities. We need to move from Lifelogging to Lifebraries. 9. A DigitalLibrary ?

29. Questions: Collaborative research/integration vs. community building 13 partners belonging to 4 areas, 42 months duration, €5M Commission contribution CONSORTIUM