660 likes | 794 Views
Deep Web Technologies Show and Tell Presentation to. 03 December 2012 By Abe Lederman, CEO. Abe Lederman. Deep Web Technologies was founded by Abe Lederman in 2002. BS & MS Degrees in Computer Science from MIT A co-founder of Verity, acquired by Autonomy (now HP)
E N D
Deep Web Technologies Show and Tell Presentation to 03 December 2012 By Abe Lederman, CEO
Abe Lederman Deep Web Technologies was founded by Abe Lederman in 2002. • BS & MS Degrees in Computer Science from MIT • A co-founder of Verity, acquired by Autonomy (now HP) • Developed SciSearch@LANL (part of “Library without Walls”) • 25 years experience in Information Retrieval
About Deep Web Technologies... • 20 person company based in Santa Fe, New Mexico • Over $5M in DOE SBIR Grants (2003-2011) • Pioneer/trailblazer in federated search • 100+ solutions in production
Customers Include... Government: Defense Technical Info Center (DTIC) Office of Sci. & Tech. Info (DOE-OSTI) UN Economic Comm. for Africa (UNECA) European Space Agency Corporate: Boeing BASF Intel HP P&G • Academic: • Stanford University • George Mason University • Texas Medical Center • University College of Cork • Public Portals: • WorldWideScience.org • Science.gov • Biznar • Mednar • ScienceResearch.com
History of Partnership 2012 2011 2011 2010 2007
What Is Federated Search? Federated Search allows users to submit a real-time search in parallel to multiple information sources and retrieve aggregated, ranked and de-duplicated results.
Begin Search In Other Words…One Search, Many Sources Subscription Sources News & Social Media Blogs & Wikis Reports Internal Sources Public Web Sources
xSearch Status • Upgraded early fall to v. 3.2.2 • GSB linked to xSearch • 200 collections in application • 30 new connectors in acceptance testing (roll-out imminent)
Explorit Release 3.2.3Starting customer upgrades • Visual clusters • Full-text filters • Content type/Media type • Integration with Zotero, Mendeley
Explorit Release 4.0Coming mid-2013 • Dynamic tab searching • Thesaurus-based searching (Do you also want to search for?) • Personal library • Big Data mashups (Enhanced content) • Faceted navigation
Related Content • Major Science portals • Science News • Patent Databases • Scholar Networks • Subscription Sources • Public Databases • Open Access Journals
Linking Open Data Cloud Diagram by Richard Cyganiak and AnjaJentzsch. http://lod-cloud.net/
Scalability Challenges • Source selection • Ranking and organizing of results • Traffic management • System load management • Finding, building, and maintaining connectors
Scalability - Divide and Conquer ScienceResearch.com Other Federated Search Engines WorldWideScience.org Science.gov ScienceAccelerator
How Multilingual Federated Search Works Results in source’s language Foreign language search engines German Chinese Russian Query in source’s language Results returned to user Ranking Microsoft Translator Query to be translated for each source Ranked results translated by Microsoft to user’s language EXPLORIT Ranked results in user’s language Query in user’s language
Translated Original
UNECA ASKIA Portal (United Nations – Access Scientific Knowledge in Africa)