1 / 20

The EGRID project

The EGRID project. S.Cozzini www.egrid.it Athens, 21 rs April 2005. Agenda. The EGRID project (short overview) The new egrid community The added value for EGRID The added value for EGEE Our plans/commitments. The EGRID project. A FISR project funded by MIUR (2003) Original Aim:

chynna
Download Presentation

The EGRID project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The EGRID project S.Cozzini www.egrid.it Athens, 21rs April 2005

  2. Agenda • The EGRID project (short overview) • The new egrid community • The added value for EGRID • The added value for EGEE • Our plans/commitments

  3. The EGRID project • A FISR project funded by MIUR (2003) • Original Aim: • Use of grid paradigm for research on complex system in economics and finance • MIUR asked to similar FISR projects to coordinate together • ICTP new task: • Provide a National Italian Facility for economical and financial data using grid technology

  4. The EGRID community • Several different research groups in Italy • Palermo: dep of Physics; • Roma: dep. Of Physics; • Roma: IAC-CNR Istitute; • Ancona: Department of Economics; • Firenze: dep. of Statistics. • Alessandria: dep of Physics; • Trieste: • Dep of Economics • Dep of Engineering • Area Science Park • ICTP • 2 groups in USA: UCLA + Columbia • Grid research applied to finance They posed the user requirements to the Egrid team at ICTP

  5. User requirements in a nutshell • High Frequency Financial Data: raw data • Different Stocks Exchanges (NYSE/LSE/Paris/BorsaMilano) . • Restricted access to raw data acquired under legally binding disclosure policies (privacy and security) • Raw Data should be: • Safe kept/backed-up/shared on the GRID • Actions on the raw data: transformations • Filtering procedures (size reduced) • Building procedures (size increased) • Authorized and authenticated access to financial databases • Computational power • To transform data / To perform simulations

  6. EGRID infrastructure • Version 1.0 released: 8-9 october 2004 (meeting in Trieste) • Globus based EDG middleware. • Specific VO within Grid.it. ( our Grid provider..) • A star shaped topology for data management: • Central SE (large and backed up storage) hosted in grid.it • Local SE hosted in research centres acting as a temporary storage space. • Data management based on EDG Replica manager

  7. AN Roma PADOVA WN WN CE TS WN WN SuperNode: CE+SE+WN FI PA AL A graphical view (as 11/04) Main Storage

  8. EDG & Egrid • EDGLimits • Data privacy not guaranteed • EDG software installations: complex/invasive… • Other problems • Limited Bandwidth among different sites. • EGRID solutions • Temporary Work-around on privacy/security • Temporary cache system based on star-topology • Ad hoc procedures for installing (Live CD for UI and SuperNode)

  9. EGRID solution: UI • Egrid UI now also on Live CD: • Based on Knoppix • http://www.egrid.it/download/software/ui/

  10. EGRID enhancements (from 11/04) • Storm project (see later) • Filtering tools provided to users • EGRID software layer completed • Live CD's updated (2.4.0 EDG version) • An updated testbed with all the grid services

  11. StoRM: • SRM protocol: standard for accessing files in a GRID environment. • Storm: an implementation norn from a collaboration between INFN and ICTP EGRID project • Storm features: • Promiscuous access to files: GRID users and the computing farm's Local users, can access the same files. • Support for File protocol: direct Filesystem access for GRID users running jobs on the computing farm's Worker Nodes, by leveraging the farm's Distributed Parallel Filesystem. • security model for the our needs of privacy and security

  12. EGRID users’ s financial applications in production • Filtering/Building procedures • From Row data to ready to use data.. • Now inserted in a software layer built on the top of EDG commands and based on the EGRID architecture • Pricing financial derivatives • by means of MCS and genetic algorithms • USA partners + Trieste groups • Order Book reconstruction and analysis • Palermo Group • Volatility estimation via Hidden Markov models • Firenze Group GRID USAGE (as today) Jobs : 2961 WallTime: 42166285 sec. ~ 500 days !!! CPUTime: 38103152 sec.

  13. The European-EGRID community • European research groups interacting with us: • Giulia Iori (City College London) • MAS Laboratory (Ioane Muni Toke, Lionel Gabet) from the Ecole Centrale Paris, France. • European research groups ready to join: • Madrid • Budapest

  14. EGRID – City College London interaction • Giulia Iori’ s research Group • Currently using our local testbed to get acquainted and port applications • Ready to either to install a small local facility or to contribute to enlarge other sites

  15. EGRID – MAS interaction • Currently playing with our UI Live CD and with our testbed. • Ready to port their Grid-aware applications on our testbed and our production grid • Willing to enlarge the community with their commercial partners • Ready to merge local facilities within EGEE

  16. Other future partners: • Financial Institutions already working with MAS ready to support our community: • Société Générale and other • expression of interest from Avanade Italy (www.avanade.com) • Quite recent (last week meeting)

  17. EGRID added values in joining EGEE • EGEE middleware is addressing some of our requirements • Egrid needs to be aligned with major european grid research avoiding duplications • Egrid partners want to include European research group: infrastructure needs to be at European scale • EGRID is now addressing Banks and Financial Institutions interested in using a continental grid instead of a national one.

  18. EGEE added values in accepting EGRID • very important security/privacy issues addressed • A well trained and motivated group • Scientific & academic community with a large technological transfer • Financial & economical entities can play a determinant role in spreading grid technologies outside academic/scientific world

  19. EGRID future working plans • Applications: • Porting of Paris/London applications • Fine tuning of currently supported programs • Middleware: • Integration of our middleware within EGEE glite product (very much interested) • Release of version 2.0 of our facility (web portal) • Community: • Enlarge further the community • Go with its own proposal to the next European call

  20. Future EGRID event: “Finance in GRID” Palermo 14/15 october 2005 chair: Rosario Mantegna A international workshop where two communities (Grid and Finance) can meet and discuss and interact Call for papers will be out next week ! (Hopefully with the EGEE logo)

More Related