Foundations V: Infrastructure and Architecture, Middleware

1. Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Joanne Luciano With Peter Fox and Li Ding CSCI-6962-01 Week 10, November 8, 2010

2. Contents • Review of reading, questions, comments • Technology and how to use it • Summary • Next week

3. Reading from last week • Provenance - PML, Inference Web, • Implementation - IAAI VSTO, Semantic eScience Web Services, Computers and Geoscience

4. Semantic Web Methodology and Technology Development Process • Establish and improve a well-defined methodology vision for Semantic Technology based application development • Leverage controlled vocabularies, et c. Adopt Technology Approach Leverage Technology Infrastructure Science/Expert Review & Iteration Rapid Prototype Open World: Evolve, Iterate, Redesign, Redeploy Use Tools Evaluation Analysis Use Case Develop model/ ontology Small Team, mixed skills

5. Architecture • Importance of state • Grids • Web • Existing infrastructure • Catalogs • Data sources • User interfaces • Services • Wrapping these syntactic interface

6. Inventory • Refer to the Resources • Files • Databases • Catalogs • Existing UI • Services • User database/ security • Logging • Backup/ archive

7. Limited interoperability • WSCommon • Web Coverage Service • Web Feature Service • Web Mapping Service Geo App2 App3 Geo App1 DBn DB2 DB3 … … … … DB1

8. The Astronomy approach; data-types as a service Lightweight semantics Limited meaning, hard coded Limited extensibility Under review Limited interoperability • VOTable • Simple Image Access Protocol • Simple Spectrum Access Protocol • Simple Time Access Protocol VO App2 VO App3 VO App1 VO layer DBn DB2 DB3 … … … … DB1 Fox WHOI: Semantic Data Frameworks March 20, 2008

9. Education, clearinghouses, other services, disciplines, etc. Semantic mediation layer - mid-upper-level Semantic interoperability Semantic query, hypothesis and inference Web Serv. API Web Portal Query, access and use of data Semantic mediation layer:Ontology - capturing concepts of Parameters, Instruments, Date/Time, Space, Event, Feature, Data Product (and associated classes, properties) and Service Classes. Maps queries to underlying data. Generates access requests for metadata, data. Allows queries, reasoning, analysis, new hypothesis generation, testing, explanation, etc. Data as Service Metadata, schema, data DB… DB2 DB3 … … … … DB1

10. Implementing • Let’s take an example • VSTO • Representative but does not exercise all semantic web capabilities

11. Web Service Fox RPI: Semantic Data Frameworks May 14, 2008

17. 2

18. Additional Middleware • Web server, Tomcat are essential (Axis) • MySQL (or similar) is very handy to have • OPeNDAP – for data access and transport

19. Web Service Fox RPI: Semantic Data Frameworks May 14, 2008

21. Infrastructure • Protégé-OWL-API • http://protege.stanford.edu/plugins/owl/api/index.html • http://protege.stanford.edu/plugins/owl/api/guide.html • Jena (Java API for RDF and OWL) • http://protege.stanford.edu/plugins/owl/jena-integration.html • http://jena.sourceforge.net/ • Migrate to other triple stores when needed

22. Using Protégé • Load VSTO into Protégé 3.4 • Generate Java-OWL classes from Tool menu • Review other tools for generating code stubs • E.g. ELMO (http://www.openrdf.org/doc/elmo/1.3/user-guide/x463.html and http://www.openrdf.org/download.jsp )

23. Examine some of the code • Java Factory class • Code stubs and ‘myclass’ • VSTO code base can be made available for browsing

24. Jena

25. Infrastructure • Reasoner – DIG/Pellet • http://protegewiki.stanford.edu/index.php/ProtegeReasonerAPI • SPARQL • http://www.w3.org/2001/sw/DataAccess/tests/implementations • Spring (Application Framework - optional) • http://www.springframework.org/ • Eclipse (IDE) • http://www.eclipse.org/

26. Infrastructure • Rules • OWL-2 RL • SWRL – plug-in for Protégé • Jena rules • Jess rules • Jess rules engine - http://herzberg.ca.sandia.gov/jess/

27. Software development • Junit (generated in Eclipse) • http://smi-protege.stanford.edu/repos/protege/owl/trunk/junit.properties.template • Faceted browsing – mspace

28. Metadata • Migrate metadata into ontologies – instances, choose how you will populate them • Manual – okay to start with sufficient annotation • Scripted – preferred • rdfs_comment: essential • Choose what you will not, cannot move

29. Services • If you are going to put up services, include an end-point and a link to your WSDL (or SAWSDL) • At this point, developing a full services ontology, e.g. in OWL-S may be beyond the initial implementation

30. Semantic Web Services Fox RPI: Semantic Data Frameworks May 14, 2008

31. Semantic Web Services OWL document returned using VSTO ontology - can be used both syntactically or semantically Fox RPI: Semantic Data Frameworks May 14, 2008

32. Result/ outcome • Refer to the use case document • Check the expected outcome and see if the test (to verify outcome) is complete • Document all variations, note alternate flows • Document in sufficient detail that someone else could come along and re-produce your work • Include URLs for access, etc.

33. 2008 Assignments

36. Orchard Irrigation • External slides

37. Diet exchange • External slides

38. Metrics • Next week we will cover evaluation but already be thinking of things you can measure • Could not do before • Faster, more complete, less mistakes, etc. • Wider range of users • Estimate the baseline before you start

39. Summary • Architectural design needs to take into account existing resources that you will leverage • Keeping it simple is also very important as you begin to implement • Take time to learn the tools and the supporting APIs; look at existing examples and working code • Being prepared to iterate is really essential

40. Next week • This weeks assignment: • Reading: Evaluation • Next class (week 11 – November 15): • Application Project Evaluation • Office hours this week – • Questions?