Deep Web Technologies: Show and Tell Presentation (03 December 2012)

1. Deep Web Technologies Show and Tell Presentation to 03 December 2012 By Abe Lederman, CEO

2. Abe Lederman Deep Web Technologies was founded by Abe Lederman in 2002. • BS & MS Degrees in Computer Science from MIT • A co-founder of Verity, acquired by Autonomy (now HP) • Developed SciSearch@LANL (part of “Library without Walls”) • 25 years experience in Information Retrieval

3. About Deep Web Technologies... • 20 person company based in Santa Fe, New Mexico • Over $5M in DOE SBIR Grants (2003-2011) • Pioneer/trailblazer in federated search • 100+ solutions in production

4. Customers Include... Government: Defense Technical Info Center (DTIC) Office of Sci. & Tech. Info (DOE-OSTI) UN Economic Comm. for Africa (UNECA) European Space Agency Corporate: Boeing BASF Intel HP P&G • Academic: • Stanford University • George Mason University • Texas Medical Center • University College of Cork • Public Portals: • WorldWideScience.org • Science.gov • Biznar • Mednar • ScienceResearch.com

5. History of Partnership 2012 2011 2011 2010 2007

6. 2008 PR

10. What Is Federated Search? Federated Search allows users to submit a real-time search in parallel to multiple information sources and retrieve aggregated, ranked and de-duplicated results.

11. Begin Search In Other Words…One Search, Many Sources Subscription Sources News & Social Media Blogs & Wikis Reports Internal Sources Public Web Sources

12. xSearch Status • Upgraded early fall to v. 3.2.2 • GSB linked to xSearch • 200 collections in application • 30 new connectors in acceptance testing (roll-out imminent)

16. Explorit Release 3.2.3Starting customer upgrades • Visual clusters • Full-text filters • Content type/Media type • Integration with Zotero, Mendeley

21. Explorit Release 4.0Coming mid-2013 • Dynamic tab searching • Thesaurus-based searching (Do you also want to search for?) • Personal library • Big Data mashups (Enhanced content) • Faceted navigation

22. Big Data Mashups

23. Related Content • Major Science portals • Science News • Patent Databases • Scholar Networks • Subscription Sources • Public Databases • Open Access Journals

24. Article Grouping

25. Non-Invasive imaging

26. Linking Open Data Cloud Diagram by Richard Cyganiak and AnjaJentzsch. http://lod-cloud.net/

27. Nature has 297 million triples.

28. Journey to 10,000 sources

29. Scalability Challenges • Source selection • Ranking and organizing of results • Traffic management • System load management • Finding, building, and maintaining connectors

30. Scalability - Divide and Conquer ScienceResearch.com Other Federated Search Engines WorldWideScience.org Science.gov ScienceAccelerator

33. Multilingual WorldWideScience.org

34. How Multilingual Federated Search Works Results in source’s language Foreign language search engines German Chinese Russian Query in source’s language Results returned to user Ranking Microsoft Translator Query to be translated for each source Ranked results translated by Microsoft to user’s language EXPLORIT Ranked results in user’s language Query in user’s language

36. Translated Original

41. ESN – x2

44. UNECA ASKIA Portal (United Nations – Access Scientific Knowledge in Africa)

50. BASF