1 / 32

Deep Learning – With an Example Implementation

Deep Learning – With an Example Implementation. Krishna Bhavsar Vinayak Joglekar. Krishnakumar Bhavsar. More than 11 years working on natural language processing, social media analytics , text mining and machine learning in various industry domains

loch
Download Presentation

Deep Learning – With an Example Implementation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Deep Learning – With an Example Implementation Krishna Bhavsar VinayakJoglekar

  2. KrishnakumarBhavsar More than 11 years working on natural language processing, social media analytics, text mining and machine learning in various industry domains Worked on most of the Open Source NLP libraries related to computational linguistics. Published a paper on sentiment analysis augmentation techniques in 2010 NAACL. Created an NLP pipeline/toolset and open sourced it for public use. Authored “Natural Language Processing Cookbook Using Python”

  3. VinayakJoglekar Passionately building software products with Lean and Agile Teams Nurtured top notch software professionals and built several self organizing teams. Actively pursuing business opportunities in big data analytics, machine learning and natural language processing. Deep domain expertise in technical hiring including resume processing, technical assessment and interviews.

  4. AI vs ML vs Deep Learning

  5. Difference Between ML and Deep Learning • ML – the concept existed in the 70s and 80s with the old school statistical analysis, study of probabilities, regressions, • Concept of deep learning existed in the early 80s, only the invent of parallel computing and cheap processing power with commodity hardware has expedited the use of deep learning algorithms • Primary difference is the feedback mechanism involved with the Deep Learning algorithms that is absent in ML algorithms (it works in multiple passes)

  6. Neural Networks Brain Neurons and Synapses model Two layer Feed Forward ANN

  7. Example Problems that can be Solved • Speech Recognition • Natural Language Processing • Bioinformatics • Image Classification – classic cats and dogs classification problem • Edges • Shapes (circles, rectangles, squares, ellipses) • Whiskers, Ears, Eyes (definitive features) • Cat or Dog

  8. Preprocessing • Image • Size standardization/Scaling • Color standardization • Text • Sentence Segmentation • Tokenization • Stemming/Lemmatization • Standardizations (case, special characters) • Statistical • Normalization • Outliers • Missing values

  9. Identifying the Cat

  10. Convolution

  11. Convolution – Sliding Window

  12. Defining the Resume Classification Problem • Continuous Stream of incoming resumes • Heterogeneous formats • Practically Unaccountable number of buckets • Manual labor to classify is immense

  13. Any Typical Candidate Resume

  14. Solution Deep Learning GATE Jape CVs

  15. Modelling the Data • More than a thousand samples (CVs) • GATE(japes) gives all the pre-defined Entities and many more lower level feature details • Standardization of Resume Size • Working at offset level • Encoding 98 features per offset per CV

  16. Precision and Recall

  17. UnderfittingvsOverfitting

  18. Precision vs Recall Conundrum Output Second attempt Output First attempt . . . . . . . . . . . Project9 . . . . . Project11 Project10 Project1 Project1 Project2 Project2 Project3 Project3 Project4 Project4 Project5 Project5 Project6 Project6 Project7 Project7 Project8 Project8

  19. Results • 1st Pass • 90 features and 8 target variables • Smaller size target buckets were extremely accurate • Larger size target buckets had sprinkled outliers all over the place, unwarranted breaks and overlaps • 2nd Pass • Proximity, feature size in consecutive offsets and location as features and same 8 target variables • Outliers were largely gone, overlaps were completely eliminated • In terms of accuracy at the level of single offset the prediction error was only 12%

  20. First Pass vs Second Pass Output Output Second Pass Output First Pass . . . . . . . . . . . Project . . Project . . . Project . . Project Project

  21. Tools, Tech and Algorithms Used • Logistic Regression, Random Forest, Tensor MLP, Neural net Multinomial, SMOTE

  22. Final Outcome with an Error Rate of 12.4%

  23. Recent Book Authored by KrishnakumarBhavsar

  24. sales@synerzip.com

  25. Who is Synerzip Synerzip is your Agile software product co-development partner 2X accelerate product roadmap 110+ product success stories Inc. 5000 awarded Inc 5000 6 years in a row 500+ strong team DNA a truly agile product development partner 10+ years in business 50% savings from optimized delivery Dual-Shore matured delivery model

  26. Partner in Your Growth DevOps Proof of Concept In a few short weeks, we'll deliver a defined scope of work while you experience what it's like working with Lean / Startup MVP We bridge the gap from idea to MVP using our lean approach to agile product development Offshore-Outsource Hybrid Architects and product managers work with you on-site and fully manage the development effort Accelerate Product Roadmap Quickly scale your engineering capacity for ongoing software product development Migration / Upgrade Use Synerzip's skilled technologists to decrease the effort and risk of transitioning to a new technology or platform. QA Testing / Automation

  27. Leveraging Dual Shore Operations US Team: Customer + Architects India Team: Product Owner + Dev & QA • Local team of architects and business analysts coordinate with you to understand product requirements • Design a workable model for your requirement after consulting with the India team • Enable a handshake between Program Manager (client side) and Product Owner (India team) • Identify optimal setting for the project and set up a team / hire • Understand the product, market, users, requirements, etc. and train developers • Use best practices for developing the product in a dual-shore mode while adopting existing processes (client side) Operating As One Extended Team

  28. Clients… …100 more

  29. Next Webinar Is REACT the Best Thing Since Sliced Bread? Tuesday, May 15, 2018 at 10am CT presenter: Yogesh Patel, Author and Director of Engineering at Synerzip .

  30. Thank You

  31. Final outcome(use if required) • Full Name - 1st Pass, location check • Objective - 2nd Pass • Overview – 1st Pass • Education – 1st Pass, pure • Company Experience – 1st Pass • Skillset – 1st Pass, pure • Project – 2nd Pass, pure • Footnote – 2nd Pass, pure

More Related