Massive Effective Search from the Web

1. Users Queries Metasearch Engine Results Queries Search Engine 1 Search Engine N ……… Massive Effective Search from the Web Investigator: Clement Yu, Department of Computer Science Primary Grant Support: NSF • Retrieve, on behalf of each user request, the most accurate and most up-to-date information from the Web. • The Web is estimated to contain 500 billion pages. Google indexed 8 billion pages. A search engine, based on crawling technology, cannot access the Deep Web and may not get most up-to-date information. • A metasearch engine connects to numerous search engines and can retrieve any information which is retrievable by any of these search engines. • On receiving a user request, automatically selects just a few search engines that are most suitable to answer the query. • Connects to search engines automatically and maintains the connections automatically. • Extracts results returned from search engines automatically. • Merges results from multiple search engines automatically. • Optimal selection of search engines to answer accurately a user’s request. • Automatic connection to search engines to reduce labor cost. • Automatic extraction of query results to reduce labor cost. • Has a prototype to retrieve news from 50 news search engines. • Has received 2 regular NSF grants and 1 phase 1 NSF SBIR grant. • Has just submitted a phase 2 NSF SBIR grant proposal to connect to at least 10,000 news search engines. • Plans to extend to do cross language (English-Chinese) retrieval.