250 likes | 463 Views
BRGM : a WebCast Infrastructure. Olivier Pouvesle June 3, 2013. 03/06/2013 – BRGM WebCast Infrastructure. Some figures :. Main infrastructure 2 datacenters located on BRGM campus (Orléans City) BRGM internet network 2 Internet access points : Renater 1Gb/s and Oléane 400Mb/s Servers
E N D
BRGM : a WebCast Infrastructure Olivier Pouvesle June 3, 2013 03/06/2013 – BRGM WebCast Infrastructure
Some figures: • Main infrastructure • 2 datacenters located on BRGM campus (Orléans City) • BRGM internet network • 2 Internet access points : Renater 1Gb/s and Oléane 400Mb/s • Servers • 200 physical servers • 500 virtual servers (65 % of linux) • Storage, backup • 700To SAN and NAS Storage • Library 400 slots et 8 LTO5 tapes • Webcast • 500 hosted web sites (285 in production, 215 for testing or integration) • 12 Millions visits in 2012 03/06/2013 – BRGM WebCast Infrastructure
Technical infrastructure 03/06/2013 – BRGM WebCast Infrastructure
Storage infrastructure F5 appliance Webaccelerator Vmware ESX4 Vcenter 5.1 Netapp FAS 3240C Ex : Spatial data 03/06/2013 – BRGM WebCast Infrastructure
Monitoring • System monitoring • Microsoft System Center Operation Management • External web monitoring • Scenario test • www.netvigie.com • Inspire Analytic • Home made development 03/06/2013 – BRGM WebCast Infrastructure
BRGM technical team • Technical division : • Operating technicians • Operating engineers • Storage engineers • Network engineers • Security engineers • System administrators • Databaseadministrators • Software achitects • … • > 15 supporting staff Working in coordination with application devloppment team in the same information system division. 03/06/2013 – BRGM WebCast Infrastructure
How do we work together ? • Project management PROJECT Project manager / Developmentteam IT team 03/06/2013 – BRGM WebCast Infrastructure
Benefits • Better SLA • Better performances (optimized for the BRGM infrastructure and adaption of infrastructure according to application requirements) • Scalable, elastic architecture • Smoother management of evolution • Lessdeploymentproblems • Challenges • Needstaff with expertise • ComplexHumanResource Planning 03/06/2013 – BRGM WebCast Infrastructure
Support, Partner and training • Editors & constructors • Oracle • Microsoft • VMWare • NetApp • Exalead • … • Special attention of BRGM on training policy 03/06/2013 – BRGM WebCast Infrastructure
Software environment • Directory server • OpenLdap • Active Directory • Operating system • Linux (CentOS) • Windows 2003,2008 R2 and 2012 • WebServer • Apache • Tomcat / JBOSS • PHP • IIS / .Net framework • Python • Webmapping server • Mapserver, mapcache, phpmapscript • Database • Oracle, Postgres/Gis, SqlServer/ Mysql • WebAnalytics • Piwik 03/06/2013 – BRGM WebCast Infrastructure
Reference databases vs publishing environnements 03/06/2013 – BRGM WebCast Infrastructure
Serving geospatial data • Inspire standard requirements • Performance • GetMap < 5 seconds : image 800x600*8 • Caching system, F5 webaccelerator • Precise tuning of each components (OS, Apache.. • Capacity • 20 requests per second • Loadbalacing methode on multiple farm server • 2000 requests per second on BRGM spatial webservices architecture • Availability • 99% soit 1,7 hour per week or 7,27 hours per month or 3,63 days per year • Vmware HA system • BRGM webservices 99,9% (2013) 03/06/2013 – BRGM WebCast Infrastructure
Mapserver & Mapcache • Farm of VMWare Virtual server 03/06/2013 – BRGM WebCast Infrastructure
Tiles constraint • Storage: • fastreadaccess • Specific File system (hugenumber of files). • example: 2 basedmaplayers(7 and 4 zoom levels) 55 millions files generated • Updating data • Delete millions of files take time 03/06/2013 – BRGM WebCast Infrastructure
Web mapping architecture : - CARMEN (www.carmencarto.fr ) is a web tool allowing any contributor of a public authority to push geospatial data, create a map with a online GIS tool and to publish the information as a web page, download access or like a web service • 190 data producers • 8100 OGC webservices 03/06/2013 – BRGM WebCast Infrastructure
Carmen : 03/06/2013 – BRGM WebCast Infrastructure
Web mapping architecture : • Geofoncier Unique access point to land geographic information in France. GéoFoncierportal provides access to the database of all interventions by land surveyors since 1997 (boundary map). - BRGM operator for the national association of land surveyors - 2500 users/per day working on the backoffice 03/06/2013 – BRGM WebCast Infrastructure
Geofoncier architecture in 2008: 03/06/2013 – BRGM WebCast Infrastructure
What’s next ? • Oracle SuperCluster • consolidation of databases • high performance • Puppet • Single server configuration management • Automatic server deployment • Cloud approch • VMWarevCloudDirector • Privatecloud • Self service to automaticalydeliverytestingenvironnement • R&D : Cloud Computing • Geospatial services on the cloud • Europeanreseachproject : InGeoCloud 03/06/2013 – BRGM WebCast Infrastructure
Some conclusions 1/2 • We developed an « AGILE » infrastructure to serve BRGM requirements • Costs : • regular hardware / software investments • highly skilled and trained team of technicians and engineers • Benefits : • Provides a full control on the whole chain (application development – hosting) • Permits a cost efficient collaboration between developers and infrastructure experts • Allows an optimal use of the resources • Facilitates the smooth evolution according to the end user requirements 03/06/2013 – BRGM WebCast Infrastructure
Some conclusions 2/2 • The BRGM infrastructure is a key element of the components that are necessary for the objectives of BRGM which are to develop and to serve the best customised services for our users 03/06/2013 – BRGM WebCast Infrastructure
Thank you for your attention o.pouvesle@brgm.fr