50 likes | 450 Views
Web Archiving in Norway. - Legal framework - Activities - Main challenges. Svein Arne Solbakk, IIPC Ottawa May 2009. Legal framework. Everything published for the general public is subject to legal deposit Legal Deposit Act from 1989 independent on distribution media and method
E N D
Web Archiving in Norway - Legal framework - Activities - Main challenges Svein Arne Solbakk, IIPC Ottawa May 2009
Legal framework • Everything published for the general public is subject to legal deposit • Legal Deposit Act from 1989 independent on distribution media and method • Includes Internet Svein Arne Solbakk, IIPC Ottawa May 2009
Activities • Full domain harvests (.no domain)-> so far six full harvests (and one running)-> a total of 1 800 000 000 files (and counting…) • Thematic and event-based harvests-> elections every second year-> royal weddings-> financial crisis • Newspapers-> 8 internet newspapers daily • E-books Svein Arne Solbakk, IIPC Ottawa May 2009
Infrastructure for current full domain harvest • Heritrix 1.14 • 8 parallel instances of the harvester • 1 Gbps connection to Internet • 15 TBytes disk buffer Svein Arne Solbakk, IIPC Ottawa May 2009
Main challenges • Privacy-> need license from Data inspectorate to collect and give access to sensitive information-> so far only temporary license to collect, and no license to give access… • Curator tool-> Web Curator Tool looks very promising, but still has some problems • Scaling up ambitions-> full domain every month?-> more ambitious thematic/event-based harvests?-> more daily newspaper harvests?-> streamed audio and video Svein Arne Solbakk, IIPC Ottawa May 2009