150 likes | 347 Views
BID209 :Business Intelligence Anywhere with Sybase IQ. Sam Friedlander Sr. Mgr. Global Business Intelligence samf@sybase.com Carlos Martinez Enterprise Research Analyst cmartine@sybase.com August 15-19. Agenda. Who we are Legacy Architecture Challenges / Problems
E N D
BID209 :Business Intelligence Anywhere with Sybase IQ Sam Friedlander Sr. Mgr. Global Business Intelligence samf@sybase.com Carlos Martinez Enterprise Research Analyst cmartine@sybase.com August 15-19
Agenda • Who we are • Legacy Architecture Challenges / Problems • Large, Expanding Reporting Demand • GBI Solution Architecture • Sybase Products in BI Action • Product Role Summary • Sybase IQ – A Major Player • Beneficial Experiences • Lessons Learned • IWS Industry Warehouse Studio
Who we are • Sybase internal business intelligence / data warehousing group (GBI) • We collect, integrate, cleanse and optimize information from disparate systems for presentation and analytical analysis • Provide reports, ad hoc requests, data behind portals and custom presentation applications • A showcase for Sybase BI products
Who we are - Goals • Self-help analytics • Slicing/Dicing, Drilling Up/Down, Visual • Conformed Bus Architecture / Component Reuse and Consistency • Foundation for Performance Management, Metrics, Balanced Scorecarding • Data Integrity • Faster, Better Business Decisions
Legacy Architecture Challenges / Problems • Rapid Growth - Large Expanding Reporting Demand • Performance • Load Flexibility • Scalability
Large, Expanding Reporting Demand • GRW (Global Revenue Warehouse) • MAST (Mobile Accessible Sales Tool) • LDM (License Data Mart) • ORR (Order Rep Revenue) • ESA Reporting (Professional Services & IT) • PRT (Partner Royalty Transactions) • Customer View • Product View • CRM Analytics (proposed) • Product Support View (proposed) • Compensation (proposed) • Resource Management (proposed)
Legacy Architecture Challenges / Problems Staging/Reporting Zeus Sources Cosmos Staging Area Power User Power User ETL DBS Product View Data Warehouse ESA Customer View Support View End User End User End User End User
ASE ASE, Replication Server Informatica* Sybase IWS, PowerDesigner, Informatica* Sybase IQ Sybase EP, Business Objects* M-Business Server *Notes Partner Technology Sybase Products in BI Action Sources Replicated Databases Staging Area Data Warehouse Data Marts Desktop Handheld RepSrvr Source 1 Business Objects RepSrvr E T L E T L ASIQ Bulk Load Source 2 Star Schema WiFi GPRS 802.11B DW Staging Tables Business Objects WebI RepSrvr Source 3 M-Business Mobile Server RepSrvr Sybase Enterprise Portals Others Data Cleanse/ Transform Data Acquisition Data Transform Data Storage Presentation Presentation Sybase/Partner Technology
Product Role Summary Extraction Transformation Load Tool (ETL) Database/ Data Model/ Data Enrichment Reporting Tool/ User Interface Sybase Speedy Movers Sybase Products Enterprise Portal M-Business Server Sybase IQ • IWS • ASE* Sybase Replication Server (for Staging) Partner/Vendor Products Business Objects Data Enrichment: D&B & PostalSoft Informatica * Note – ASE is the source data base for legacy data
Sybase IQ – A Major Player • Designed specifically from the ground up for analytics • Compresses data anywhere from 30 to 60 percent • Current record holder for the largest data warehouse (48.2 TB input data compressed to 22 TB) • Highly Scalable – near-linear and data scalability to support 100s and 1000s of users and terabytes of data • Column-based • Patented Bit-wise indexing • 100 times faster than traditional RDBMs
Sybase IQ – A Major Player • Incredibly fast loads for scalability and load frequency (real-time) • Designed for large scope queries - for example trend analysis spanning many years and billions of facts • Easier to maintain - does not require time and resource-intensive tuning to obtain excellent performance • Facilitates more frequent analysis cycles, deeper more current understanding and a smarter business
Beneficial Experiences • ESA load time decreased from 5 hours to 20 minutes • Utilization report processing time decreased to 20 seconds from a previous 25+ minutes • Every query, report and stored procedure runs faster on Sybase IQ • With faster performance faster turn-around and more numerous queries for deeper analysis and a smarter business • Reduction in administration, maintenance & tuning • Index maintenance eliminated – “set it and forget it” • Very scalable solution
Lessons Learned The enterprise needs to move to an architecture standard where reports and queries run on IQ Database sparcity is a non-issue for data warehouse design – there is no degradation of performance for a sparse data warehouse, thus simplifying and reducing design and implementation costs Separating the staging of data on ASE and the presentation of data on IQ improved load and query performance and helped to stabilize our BI environment Indexing was very easy and involved virtually no maintenance – “set it and forget it” Administration cost decreased dramatically Tuning became a non-issue
IWS – Industry Warehouse Studio Jump-starts the design, development and implementation Sales analysis and design costs Key performance indicators designed specifically for the financial, media, insurance and communications industries