110 likes | 285 Views
WEAvE : Web Exploration and Analytic Engine. Automation of Web Form Queries. Beth Watson Jared Coplin Mentor: Dr. Anne Ngu. Outline. Problem/Motivation Associated Works Automated URL Clustering – Jared Automated Query Submission – Beth Goals for Desired Endstate Questions/Comments.
E N D
WEAvE: Web Exploration and Analytic Engine Automation of Web Form Queries Beth Watson Jared Coplin Mentor: Dr. Anne Ngu
Outline • Problem/Motivation • Associated Works • Automated URL Clustering – Jared • Automated Query Submission – Beth • Goals for Desired Endstate • Questions/Comments
Motivation Current search engines cannot access the Deep Web Those that can do not submit queries for you Compile results pages into sortable, committable units Military: lack of efficient data mining methods on classified systems Easier to make small businesses and startups “searchable” URL database grows organically Potential for personalized URL caches Make what YOU search for easier for YOU Parental controls, preferences…. Employs crowd sourcing to learn as it grows Rapid, relevant information retrieval from ALL THE SOURCES
Associated Works • I am a placeholder
Jared Have done Will do before next presentation
Beth’s Part Identifying input fields Mapping input fields to query needs Submitting queries Cataloging query paths, successful/unsuccessful
Beth’s Part:Last Summer’s Work Finds textboxes No radio buttons, drop down Allows query input Checks validity of web source Catalogues web sources
Beth’s Part:Current Work Locate input fields with Selenium’s keyboard interface Captures text, radio, check and dropdown Object Oriented Easier to format, organize information
Beth’s Part:Goals Successfully query wide variety of sites within domain
Questions? Comments?