1 / 20

EMOTIVE: Data Collection

EMOTIVE: Data Collection. 19 th July, Loughborough University, UK Dr. Tom Jackson, Dr. Ann O’Brien and Dr. Martin Sykora. EMOTIVE Work Packages and Milestones. Contents. Previous Work Technical Considerations Retrieval of Datasets Exploring Taxonomy / Ontology.

tirza
Download Presentation

EMOTIVE: Data Collection

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. EMOTIVE: Data Collection 19th July, Loughborough University, UK Dr. Tom Jackson, Dr. Ann O’Brien and Dr. Martin Sykora

  2. EMOTIVE Work Packages and Milestones

  3. Contents • Previous Work • Technical Considerations • Retrieval of Datasets • Exploring Taxonomy / Ontology

  4. Previous WorkTechnical Considerations Retrieval of Datasets - Guardian (with academic collaboration) work on London 2011 Riots - Crisees Demonstrator - Terrorism Informatics: Cheong and Lee (2011) • Cheong M. and Lee V. C. S., 2011. A microblogging-based approach to terrorism informatics: Exploration and chronicling civilian sentiment and response to terrorism events via Twitter, Journal of Information Systems Frontiers – Springer 13 (1), pp. 45-59

  5. Previous WorkTechnical Considerations Retrieval of Datasets - Crisees Demonstrator; Kingston Bridge (Glasgow) – Scottish storms Maxwell, D. and Raue, S. and Azzopardi, L. and Johnson, C. and Oates, S., 2012. Crisees: Real-time monitoring of social media streams to support crisis management, Advances in Information Retrieval – Springer, pp. 573-575

  6. Previous WorkTechnical Considerations Retrieval of Datasets - Terrorism Informatics: Cheong and Lee (2011) • Cheong M. and Lee V. C. S., 2011. A microblogging-based approach to terrorism informatics: Exploration and chronicling civilian sentiment and response to terrorism events via Twitter, Journal of Information Systems Frontiers – Springer 13 (1), pp. 45-59

  7. Previous Work Technical Considerations Retrieval of Datasets Brief overview of technical challenges: • Collecting and processing data in real-time • Filtering (spam detection / influential Tweets / Influential Twitter Accounts) and aggregating the datasets • Assessing the integrity of the datasets • Potential need to store massive datasets (MongoDB)

  8. Previous WorkTechnical ConsiderationsRetrieval of Datasets DATASETS based on UK REGIONS • Retrieve geo-tagged tweets only (small minority) • …other ways of restricting Tweet retrieval to UK based Tweets • Use look-up lists of entities / places / cities / main-roads / etc. in the UK (tricky; King’s Cross station vs. King’s Cross city in Sydney) • Complementary Approach; differences in dialects, e.g. Nottingham / Nottinghamshire, Newcastle, Manchester, London,… (identify heuristics & automated classification) • Location inferred from the event

  9. Previous WorkTechnical ConsiderationsRetrieval of Datasets DATASETS based on NATIONAL SECURITY RISKS • Hashtags # concerning national security • starting point; threats list compiled by Cheong and Lee (2011) • Tweet collection operating at all times, collect Tweets before events happen: preselect known events such as the G20 or G8 • Also collect datasets relating to emergencies; i.e. floods in UK • understanding the “lifecycle” of such an event on Twitter • Sentiment of Terse natural language…

  10. Previous WorkTechnical ConsiderationsRetrieval of Datasets Chris Halpin ‏@KatsJonouchi This M6toll thing... If you're going to try and blow up a coach, you wouldn't choose a Megabus, surely... Exploratory Data Collection: M6 Armani Music ‏@ArmaniBmusic Someone was seen pouring a liquid in something that made fumes on a Mega bus on the M6Toll. I will full on wee myself if it's a pot noodle. Johnny O'Grady ‏@Johnnnnyyyyyyyy Watching the news in Tescos, bit confused about what's happened on the M6toll road Ellie Henderson ‏@EllieH_86 Distracted at work watching the M6Toll footage on the news.#M6Toll ZoraSuleman ‏@ZoraSuleman Police confirm .. the closure of the M6 toll road was caused by an Electric cigarette Splashy♥❤ ‏@_Splashy_ 2001, terrorists hijack planes. 2012, terrorism alert on a Megabus on the M6toll. This recession has hit hard. Ian Watson ‏@IanWatoop M6Toll. "I picked the wrong day to give up smoking!". #Megabus

  11. Previous WorkTechnical ConsiderationsRetrieval of Datasets ‏@Pearcesport|17 days before Olympics, and Kings Cross station, one of main gateways to Olympic Park, has been closed this morning due to overcrowding Exploratory Data Collection: Kings Cross Station @thefashionturd Got evacuated from Kings cross stpancras! not half as scary as Boris' Olympic messages that are being played into tube stations though... @subhajitb Some pretty angry people outside Kings Cross tube station#fasterhigherstrongerhttp://twitter.com/subhaji tb/status/222599112976105472/photo/1 @MoniqueBabyx RIP to the 18 year old boy who died in kings cross. so sad, so young, so early. prayers go to the innocent family. @corrina_kylie Kings Cross is filled with scary characters, I'll say that much.

  12. Exploring Taxonomy / Ontology Taxonomy / Ontology 1 • Make a Taxonomy first • This establishes correct relationships • Then create ontology (OWL) • Scope • Civic unrest? UK? • Emotions • Range of Language for Ontology 1 • ‘normal’ English • Urban slang • Street talk • Text language

  13. Exploring Taxonomy / Ontology Vocabulary sources • Thorne, T. Dictionary of contemporary slang • www.urbandictionary.com • www.odps.org • www.chavscum.co.uk • etc. • and from Twitter feeds and archives

  14. Exploring Taxonomy / Ontology Taxonomy / Ontology 2 • A number of ‘lists’ of emotions exist: • Project Muse • Art and architecture thesaurus • Tate Gallery • Etc.

  15. Exploring Taxonomy / Ontology Tate galleries – emotion

  16. Exploring Taxonomy / Ontology Linguistic and semantic issues • At the extraction stage: • Single terms and noun phrases: ‘police car’, etc. • Barriers to understanding • Sarcasm and metaphor • Types of relationships between terms: • Synonyms • Broad to narrow (Classes and subclasses)

  17. Exploring Taxonomy / Ontology For example… etc.

  18. Exploring Taxonomy / Ontology ‘Guns’ is one subclass of ‘Weapons’

  19. Final Remarks… The issues and approaches discussed in the context of Twitter, also apply to public Facebook messages. Other considerations: - Age and Gender detection from Terse natural language - Scope of Communication (social network analysis) - Followers of certain bands / parties (maybe extreme; neo-nazi, leftist, etc.)

  20. Thanks

More Related