1 / 12

Dipping our toes in the Big Data Ocean

Dipping our toes in the Big Data Ocean. s teve.macfeely@cso.ie john.dunne@cso.ie andrew.murray@cso.ie. Outline. The Mystery The Plot The Cast The Data Flow Map The Legislation Putting CSO on the Map The Timeline Concluding remarks. The Mystery. The Plot.

pavel
Download Presentation

Dipping our toes in the Big Data Ocean

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dipping our toes in the Big Data Ocean steve.macfeely@cso.ie john.dunne@cso.ieandrew.murray@cso.ie

  2. Outline • The Mystery • The Plot • The Cast • The Data Flow Map • The Legislation • Putting CSO on the Map • The Timeline • Concluding remarks

  3. The Mystery

  4. The Plot “We know more about the travel patterns of the 6.8m cows on the island than we do about the 6.5m visitors to our shores each year. It is shocking how little we know about [tourism]” Michael Vaughan President - Irish Hotels Federation Learning Point 1 - Have a problem that requires a solution; this provides focus

  5. The Cast Learning Point 2 -Identify and build relationships with actors (stakeholders)

  6. The Legislation Key discussion point - relationship between both legislation in a modern state Learning Point 3 - Look to build consensus/clarity on understanding around legal basis

  7. The Data Flow Map Exchange of data for billing purposes Irish Mobile Network Operators MNOs Clearing Houses ROW Mobile Network Operators Learning Point 4 -Know the data topology and jargon of the industry Learning Point 5 -Be confident/sure of being able to process data volumes

  8. Putting CSO on the Map Clearing Houses CDR required fields (Inbound roamers) IMSI, IMEI, MSISDN – Identification Country of home network - Nationality Cell ID plus lookup – Location Date and time of communication - Time CSO Discussion points - Cost of compliance v Data Protection consideration - Required fields are a subset of the complete record - Easier/cheaper to provide full record/file Learning Point 6 - Seek to minimise burden/cost for data provider (MNOs)

  9. DPC Data Protection Commissioner tif Telecommunications Industry Federation AGO Attorney General Timeline Scoping Nature of Activity Legal Technical Technical Update on DPC position tif 1st meeting 1st draft of Statistics Order Under Stats Act PRISM in Media today 11/2011 11/2012 06/2013 08/2013 07/2011 12/2011 04/2012 03/2013 Regular meetings with tif Start Engage DPC AGO Key meeting with DPC Key meeting with DPC and tif Legal Technical Ready to go? Key events Learning Point 7 - Expect the unexpected

  10. Concluding remarks • Access (legislation – statistical & data protection) • Trust in official statistics • Governance (safeguards) • Resources (skill-sets, infrastructure etc.) • Cost • Burden • Methodological • First outputs defined by data sources • high correlation will provide statistical value • calibration?

  11. www.sendsteps.com Prepare to react; keep your phone ready! Internet Go tosendc.com 1 Log in withSession 2 Type WS10 <space> youranswer 3 TXT Textto+316 4250 0030 1 Type Session <space> WS10 <space> youranswer 2 Posting messages is anonymous No additional charge per message

  12. Having heard the challenges in Ireland, do you think we need a coordinated initiative to securing access 'big data' in order to compile official statistics?

More Related