160 likes | 295 Views
Mashing Up Linked Open Government Data. Li Ding Tetherless World Constellation Rensselaer Polytechnic Institute Nov 8, 2010. LOGD Consumption Workflow. LOGD Application UI. Query Data. Integrate Data. Visualize Data. JSON. XML. CSV. SPARQL Query. Format Data. SPARQL Results.
E N D
Mashing Up Linked Open Government Data Li Ding Tetherless World Constellation Rensselaer Polytechnic Institute Nov 8, 2010
LOGD Consumption Workflow LOGD Application UI Query Data Integrate Data Visualize Data JSON XML CSV SPARQL Query Format Data SPARQL Results dbpedia data.gov.uk TWC LOGD W W W
Query Data: SPARQL-based Data Mashup SELECT ?x ?y WHERE { graph <RDF Dataset 1> { ?x <p1> ?obj } graph <RDF Dataset 2> { ?y <p2> ?obj } } query SPARQL Endpoint RDF Dataset 2 RDF Dataset 1 <record_y> <p2> obj <record_x> <p1> obj same value load load LOGD data dump file 1 LOGD data dump file 2
Format Data JSON (Google Viz) google.visualization.Query.setResponse({version:0.6,status:'ok',reqId:0,table:{cols:[{id:'g',label:'g',type:'string'},{id:'number_of_triples',label:'number_of_triples',type:'number'}],rows:[ {c:[{v:'http://data-gov.tw.rpi.edu/vocab/Dataset_353'},{v:23721}]}, {c:[{v:'http://data-gov.tw.rpi.edu/vocab/Dataset_1623'},{v:446}]}, {c:[{v:'http://data-gov.tw.rpi.edu/vocab/Dataset_1580'},{v:778}]}, …. <sparql xmlns="http://www.w3.org/2005/sparql-results#" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.w3.org/2001/sw/DataAccess/rf1/result2.xsd"> <head> <variable name="g"/> <variable name="number_of_triples"/> </head> <results distinct="false" ordered="true"> <result> <binding name="g"><uri>http://data-gov.tw.rpi.edu/vocab/Dataset_353</uri></binding> <binding name="number_of_triples"><literal>23721</literal></binding> </result> ….. HTML Table SPARQL/XML
Integrate & Visualize Data • Dynamic content generated by SPARQL query • Aggregate data from multiple sources • Visualize data using different technologies XSLT Javascript Google AJAX API Yahoo Pipes PHP + Java
Aspects Data Mashup Visualization Mashup Application Mashup Subject Temporal Mashup Spatial Mashup Entity Mashup … Other topics Semantic Search Social mashup Provenance Types of Mashups
US and UK Foreign AID FY2007:Integrating data from two countries Data Sources: [Spatial Mashup] Data.gov (USAID) + Data.gov.uk (DFID) Created by James Michaelis, RPI, http://data-gov.tw.rpi.edu/demo/linked/aidviz-1554-10030.html
Gov Data for Pop Science:Integrating different sources for discovery Gov data provides knowledge for poplation science study [Spatial Mashup] Data.gov (Population) + NIH (Tobacco Tax, Smoking rate) Created by Sarah Magidson, U. Chicago.http://data-gov.tw.rpi.edu/demo/stable/tobacco-smoker/demo-state-10026-smoke-rate-statevarsapi.html
Consume LOGD data in Semantic Search Data-gov Semantic Search Web Search Results http://data-gov.tw.rpi.edu/ HTML XHTML+RDFa RDFa RDF Annotation ARC2
Adding Social Factor to Mashups • Import socially contributed data, e.g. DBpedia • Let users contribute • links • feedbacks Other Social Web Apps Enhance* Import/export RDF Raw Data Publish* consume* User feedback
Social Mashup - US Wildland Fire:Linking to Wikipedia (socially contributed) Category:Wildfires In The United States Budget on wildfire “DOI” and “USDA”(OMB) Wildland fire (NIFC) [Temporal Mashup] Data.gov (statistics+ budget) + Wikipedia (famous fires) Created by Li Ding, RPI, http://data-gov.tw.rpi.edu/demo/stable/demo-1187-40x-wildfire-budget.html
Social Mashup - White House Visitor Search:Linking social network data using semantic wiki NYTimes Wikipedia dbpedia:Barack_Obama Semantic Wiki “POTUS” The White House [Person Mashup] Data.gov (statistics) + Wikipedia (personal profiles) Created by Dominic DiFranzo, Evan Patton, RPI, http://data-gov.tw.rpi.edu/demo/stable/white-house-visitor/top100-visitees.php
Social Mashup: USPS Spending and Newsgovernment data + User Feedbacks [Temporal Mashup] Data.gov (budget) + USPS + User Contributed News Created by Sarah Magidson, http://data-gov.tw.rpi.edu/demo/linked/demo-401-usps-news.html
Using Web Tools Information networks can be integrated via the Semantic Wiki and visualized a number of different ways: social networks, human-language technology, workflows, …
More Mashups (c) Agency Budget and NYTimes (a) white house visitor search (b) US-UK Foreign Aid Comparison (d) Wildland fire and DBpedia (d) Wildland fire and DBpedia (g) [Financial] Stock price and Twitter events (e) [Health] Tobacco Prevalence and Correlated Factors (f) [Policy] About Supreme Court Justices (j) [RDFa] semantic search (k) [RSS] data.gov updates (h) [Yahoo! Pipes] World Earthquake Map (i) [IBM ManyEyes] white house visitor network
Resources • Online Tutorials • Mashing up LOGD data with SPARQL • Retrieving SPARQL Results • Building LOGD Visualizations • Standards and Tools • SPARQL Endpoint • SparqlProxy • Visualization APIs • Google Visualization API • MIT SIMILE Exhibit • Language (name it): Javascript, PHP, Python,…