180 likes | 273 Views
ToolKit for Large-SCAle studies of Web documents. SI4 June Project Imane BELLAT – Bastien BLANCHARD Clément TOCHE – Maurice YARED. Project Subject Initial WorkFlow Vision of Architecture Code Implementation WorkFlow Structure WorkFlow With Modularity Concept WorkFlow Structure
E N D
ToolKit for Large-SCAle studies of Web documents SI4 June Project Imane BELLAT – Bastien BLANCHARD Clément TOCHE – Maurice YARED
Project Subject • Initial WorkFlow • Vision of Architecture • Code Implementation • WorkFlow Structure • WorkFlow WithModularity • Concept • WorkFlow Structure • Final WorkFlow • Vision of Architecture • WorkFlow Structure • Some Tests • Problems • Outlooks Contents
Web documents evaluation process • Co-operating services • Evaluations and Requirements • Web Accessibility Initiative (WAI) • Checkpoints from the Web Content Accessibility Guidelines • Additional Services • Page Rank • W3C Validation • PrettyPrint of statistics Project Subject
Grid Workflow Efficient Enactment for Data Intensive Applications (Gwendia) • Workflow description framework • Grid Infrastructure • Optimizingdistributed computation • MOTEUR as WorkFlow Manager • Goal • Accessibility tests on elements in HTML, CSS, Script code ProjectSubject
Vision of Architecture Initial WorkFlow
Subdivision of WorkFlow in Processors • Encoding processors • BeanShell • Internal MOTEUR Java Code • Directlydeployed on the grid Code Implementation Initial WorkFlow
Common WebServices • Accessible through Web Service Description Language (WSDL) • Encoding processors • DIET and GASW • Service provider implemented on the grid • Services deployed and Accessible directlyfrom the grid. Code Implementation Initial WorkFlow
WorkFlow Structure Initial WorkFlow
Meeting the needs of developers wishing to expand treatments • Communication constraints • Modularity : • By Layers • By Processors Concept WorkFlow WithModularity Contract Models Implementation
WorkFlow WithModularity Concept Data flow Data contract
Structure WorkFlow WithModularity
Vision of Architecture Final WorkFlow
WorkFlow Structure Final WorkFlow
MOTEUR has no final release version • MOTEUR Simulation use Common JVM Allocated Memory • Insufficient for large scale data flows • WorkFlow GraphicModeling not Malleable • VeryUselessDebugging Platform Problems
Implementation of all WAI checkpoints tests • With CSS parsing • Dynamic scripts parsing • Implementation of GlassFish WebServices in JGASW provider • Implementation of Security Manager Modules to WorkFlow • Defining automation for new processors implementation • Conditioning every modification of the MOTEUR Workflow according to contracts Outlooks
What we have learnt : • WorkFlow modeling • Team working and project planning • Facing and resolving unplanned issues • Working on a research-oriented project • Getting along with additional requests from a client Conclusion