1 / 19

WEB MONITORING

WEB MONITORING. E6125 Web enHanced Information Management. Presentation on Design of Web Monitoring applications. By Satyajeet Shaligram Columbia University MS CS Fall-08. WEB MONITORING. You are here!!. Introduction The web monitoring task Architectural components How it all works?

orea
Download Presentation

WEB MONITORING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WEB MONITORING E6125 Web enHanced Information Management Presentation on Design of Web Monitoring applications. By Satyajeet Shaligram Columbia University MS CS Fall-08.

  2. WEB MONITORING You are here!! Introduction The web monitoring task Architectural components How it all works? Applying machine learning Difference generation User notification Some examples Future improvements Questions?

  3. What’s the task? “There could be countries out there giving away shit for free!!”

  4. It’s different! RSS feeds..!! User driven. Involves Analytics. Supports a wide range of tasks. Customization! Search Engines..!! Understanding what web monitoring deals with..

  5. How do I design one?? • Client Server model. • Scalable! Scalable! Scalable!! • Efficient & Accurate. • User friendly and non-obtrusive.

  6. WEB MONITORING Introduction The web monitoring task Architectural components How it all works? Applying machine learning Difference generation User notification Some examples Future improvements Questions? You are here!!

  7. Show me the design!! Change Detector - Whizbang! Labs.

  8. Detailed Design! WebCQ – developed at Georgia Tech

  9. WEB MONITORING Introduction The web monitoring task Architectural components How it all works? Applying machine learning Difference generation User notification Some examples Future improvements Questions? You are here!!

  10. Machine Learning! Taxonomy driven crawling Text classification Entity detection Identifying interesting changes Building smarter systems to do the job!!

  11. Difference Generation Developing algorithms with linear running time. Sub dividing the problem into many parts…

  12. Content based chunking

  13. Content based chunking… Smart techniques like Rabin’s fingerprinting algorithm make this possible.

  14. WEB MONITORING Introduction The web monitoring task Architectural components How it all works? Applying machine learning Difference generation User notification Some examples Future improvements Questions? You are here!!

  15. Notification Displaying relevant changes!

  16. Notification…

  17. Future trends… Improving feeds and updates currently provided… E.g. Facebook. Integrating with existing applications such as browsers Developing more intuitive user interfaces to web monitors

  18. Questions!? “Sometimes questions are more important than answers.” - Nancy Willard.

  19. Thank you! …and have a nice day!!

More Related