1 / 30

The Return of The DB2 Top Ten Lists

The Return of The DB2 Top Ten Lists. Craig S. Mullins craig.mullins@softwareonz.com craig@CraigSMullins.com. The Top Ten Lists. And now, from the home office in Sugar Land, Texas… a series of DB2 Top Ten lists about various topics ranging across the following subjects: Performance

clarke
Download Presentation

The Return of The DB2 Top Ten Lists

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Return of The DB2 Top Ten Lists Craig S. Mullins craig.mullins@softwareonz.com craig@CraigSMullins.com

  2. The Top Ten Lists • And now, from the home office in • Sugar Land, Texas… a series of • DB2 Top Ten lists about various • topics ranging across the • following subjects: • Performance • Coding • Design • Administration • Management • Features • Tools

  3. The Ten Database Management Commandments Thou shalt always design databases from a logical data model. Thou shalt always document thy database design. (There are many important aspects of database administration, but of them all,) data integrity shalt always remain the most important. Thou shalt encrypt personal and sensitive information, both at rest and in transit. Thou shalt implement appropriate security within thy database and between thy DBMS and thy operating systems. Thou shalt always maintain the recoverability of thy databases with sufficient backups to meet the availability requirements of the business supported by the data. Thou shalt implement a consistent and documented workflow process for implementing database change that assures data integrity while minimizing downtime. Thou shalt always consider transaction performance and data availability in thy database design. Thou shalt also work with application developers to ensure efficient code is written to access thy databases. Thou shalt not download thy database to thy laptop.

  4. Top Ten DB2 Database Design Guidelines Always start with a logical data model Follow relational database design rules - normalization Create and follow consistent naming standards for all DB2 objects (including columns) Favor declarative referential integrity (RI) Don’t forget the free space Always fully document the database design including all implementation decisions Plan for data purging and archiving Design for sharing data… instead of copying it all over the place! Plan for performance (or availability) at design time Plan for backup and recovery before implementation

  5. Top Ten Benefits of Using DB2 CDC for DW/ETL Why move all of your data every night when just a fraction of the data actually changed? Near-real-time data delivery vs. daily extracts - downstream users have access to most current information Significant reduction in CPU cycles by eliminating costly ETL processes Identify certain business events as soon as they occur(i.e. claim submitted over $1M) High availability with active/active replication between data centers Optimize existing ETL processes by supplying only the data that has changed Real-time integration with newer applications(i.e. send a text message if account balance goes negative) No need to modify existing applications to track data changes or publish specific business events Extend the life of your legacy DB2 applications by integrating data changes with newer applications Allows for auditing by tracking all data changes to important tables

  6. Top Ten Development Best Practices Minimize network calls Minimize passes through the data Put the work into the SQL, not the program Unlearn the “flat file” mentality Be sure data type and length match in predicates Know your Stage 1, Stage 2, and Indexable predicates Document your code Always check the SQLCODE or SQLSTATE Analyze your access paths (and tune your SQL in test) Avoid Bachelor Programming Syndrome

  7. Top Ten Common SQL Mistakes Assuming an ORDER BY is not necessary for ordered results Forgetting the NULL indicator Incorrect expectations when using the NOT IN predicate with NULLs* Coding predicates appropriately in Outer Joins Not coding a cursor for a multi-row result Recompiling but not rebinding Forgetting to use single quotes around strings (instead of double quotes) Trying to modify a Primary Key column Forcing dynamic SQL into static SQL (sometimes hundreds of static SQL statements) Asking for more data than you need (columns and/or rows) * SELECT C.color FROM Colors AS C WHERE C.color NOT IN (SELECT P.color                        FROM Products AS P); • Sometimes (erroneously) referred to as the SELECT * problem

  8. Top Ten Compliance Concerns Data Quality “Poor data quality costs the typical company at least ten percent (10%) of revenue; twenty percent (20%) is probably a better estimate.” Data Retention Database Security Authentication (Who is it?) Authorization (Who can do it?) Encryption (Who can see it?) Audit (Who did it?) Data Masking and Obfuscation Database and Data Access Auditing DBA Procedures (e.g. change management) “Unauthorized change is one of the best (and worst) ways to get your auditor’s attention.” Data Movement Tracking Master Data Management Data Definition and Categorization Metadata Management

  9. Top Ten Biggest Data Breaches Jan. 20, 2009 Heartland Payment Systems ~130 million Oct. 2, 2009 U.S. Military Veterans 76 million Jan. 17, 2007 TJ stores (TJX) 45.7 million June 16, 2005 CardSystems over 40 million Dec. 15, 2009 RockYou 32 million (SQL injection) May 22, 2006 U.S. Dept. of Veteran's Affairs 28.6 million Mar. 8, 2006 iBill 17,781,462 Mar. 26, 2008 Bank of New York Mellon 12.5 million July 3, 2007 Fidelity National Information Services (Certegy Check Services Inc.) 8.5 million Sept. 14, 2007 TD Ameritrade Holding Corp. 6.3 million http://www.privacyrights.org/ar/ChronDataBreaches.htm As of Feb 17, 2010, total records breached: 345,724,373 (since January 2005)

  10. Top Ten Non-Technical Security Steps Buy and use a good shredder Don’t wear your ID badge outside of the office Be vigilant when using your laptop in public Buy and use a screen “shade” Don’t put identification on your laptop (e.g. ID tags) Company should invest in an anonymous PO box Be careful about company logo clothing Don’t leave unencrypted disks/USB sticks/etc. laying around Invest in a laptop lock and use it whenever possible Never put any disk you do not know into your computer (salaries)

  11. Top Ten Under-Utilized Features Table Expressions CASE statements REOPT (other than NONE) Triggers Auto expand buffer pools Real Time Stats User-Defined Functions DISTINCT Types LOBs Date/Time Arithmetic XML?

  12. Top Ten Specialty Processor Workloads IFL: Linux “stuff” zIIP: distributed SQL requests zIIP: parallel SQL requests zIIP: data warehousing/star schema zIIP: native SQL stored procedures run via DDF (V9) zIIP: index maintenance during LOAD, REORG, and REBUILD zAAP: Java zAAP: XML (zAAP on) zIIP: Java and XML zIIP: non-DB2 stuff including: z/OS Communcation Server encryption, z/OS XML System Services, and System Data Mover processing associated with zGM/XRC (z/OS Global Mirror)

  13. Top Ten A-Ha! Moments Changing the SQL terminator for triggers Truly understanding locking When you can predict access paths by looking at SQL (and statistics) Being a human compiler (or JCL checker) When your first reaction is to look it up in the manual instead of asking the DBA When you take responsibility for your professional development When you start thinking about the business problems your programs and database solve before thinking about a “neat” technical issue When you stop thinking of fetching from a cursor like reading from a file When you stop blaming DB2 before your own code When you look at this list and say “that all makes sense”

  14. Top Ten DB2 Myths Use Views to Insulate Programs from Change Locking Problems Indicate a Database Problem Primary Key is Usually a Good Choice for Clustering Just Using the Defaults Should Work Out Well Programmers Don’t Need to Know How to Tune SQL Black Boxes Work Well for Performance Using NULLs Can Save Space RUNSTATS Aren’t That Important DB2 is a Hog It Depends!

  15. Top Ten Outdated Standards Limiting indexes per table to 3… or 5… or… Requring base table views Forbidding dynamic SQL Limiting number of tables per join (typically for online txns) Avoiding NULLs Arcane table naming standards (e.g. TXR0031) Just about any buffer pool standard (e.g. BP0 only) Almost any standard using the words “always” or “never” GRANT…WITH GRANT OPTION Putting standards in a binder instead of online

  16. Top Ten Things to Do Before You Visit the DBA Try to Figure It Out Yourself, Please RTFM Figure out what you are going to say to him/her Be sure it is the truth! Don’t assume you (or your code) are innocent Have a drink (coffee?) Bring the DBA a drink (your choice!) Never say “But IBM said it should work this way.” Never say “But it worked that way yesterday.” Always say “Thank you.”

  17. Ten Eleven Rules of the Road for DBAs Write Down Everything Keep Everything Automate Share Your Knowledge Focus Your Efforts Don’t Panic! Measure Twice, Cut Once Understand the Business Don’t Be a Hermit Use All of the Resources at Your Disposal Keep Up-to-Date From zJournal article available at: http://www.craigsmullins.com/zjdp_042.htm

  18. Top Ten Weasel-Speak Interpretations (Part 1) We will look into it(We will forget all about it the moment you leave) It is in process(The bureaucracy involved has rendered it hopeless) I didn’t get your e-mail(I was too busy updating my Facebook status to read your e-mail) The entire project is being abandoned [or reorganized](The only guy who understood it just left or retired) A number of different approaches are being tried(We are all just guessing at this point)

  19. Top Ten Weasel-Speak Interpretations (Part 2) 6.Preliminary tests were inconclusive(We can’t get the dang thing to run) 7.Test results are very promising(Amazing, it actually works) 8.What do you think about this…(I only want your opinion so you can share the blame later) 9.Robust(We want you to buy this thing but have no Earthly idea how to convince you, so we call it robust)* 10.Low maintenance(Almost impossible to fix) * See also, “Best of Breed”

  20. Top Ten, err, Twelve DB2-Related SG24-7330 DB2 9 for z/OS Technical Overview SG24-6763 The Business Value of DB2 SG24-6300 DB2 for z/OS Application Programming Topics SG24-6289 DB2 9 for z/OS: Using the Utilities Suite SG24-7322 DB2 for z/OS: Data Sharing in a Nutshell SG24-7720 Securing and Auditing Data on DB2 for z/OS SG24-7688 DB2 9 for z/OS: Packages Revisited SG24-7473 DB2 9 for z/OS Performance Topics SG24-7134 DB2 UDB for z/OS: Design Guidelines for High Performance and Availability SG24-7604 DB2 9 for z/OS Stored Procedures: Through the CALL and Beyond SG24-7663 DB2 9 for z/OS: Deploying SOA Solutions SG24-6319 DB2 for z/OS and WebSphere: The Perfect Couple http://www.redbooks.ibm.com/

  21. Top Ten DB2 Twitter-ers

  22. Top Ten LUW vs. z/OS Differences Memory: EDM Pool, RID Pool, Sort Pool, Buffer Pools versus Catalog Cache, Package Cache, Sort Heap, Buffer Pool, Locklist Table Spaces: Simple (obsolete), Segmented, Partitioned, Universal (V9), LOB versus Regular, Temporary, Large, Automatic (V9.5) Optimizer: 7 levels of optimization in LUW (0,1,2,3,5,7,8) Monitoring: Traces and Instrumentation Facility versus EventMonitor, Snapshot Monitor XML: XPath versus XPath, XQuery Index Compression: z/OS only Oracle syntax suport: LUW only Multi-row INSERT, FETCH & multi-row cursor UPDATE: z/OS only SET CURRENT ISOLATION: LUW only Bottom Line: amazingly similar but different enough to make transitioning from one to the other non-trivial z/OS LUW

  23. Top Ten DB2 9 for z/OS Application Developer Features Plan Management: Package Stability MERGE SELECT FROM UPDATE, DELETE, & MERGE Index on Expressions Native SQL Procedure Language FETCH FIRST and ORDER BY in subselect and fullselect INTERSECT and EXCEPT INSTEAD OF TRIGGER TRUNCATE LOB Improvements

  24. Top Ten DB2 9 for z/OS DBA Features Universal Table Spaces- PBG and range-partitioned Reordered Row Format Index Compression CLONE Tables BUILD2 Phase Eliminated in Online REORG APPEND YES– ignoring clustering during INSERT and LOAD The promise of REOPT(AUTO) IMPLICITLY HIDDEN columns New Data Types: BIGINT, DECFLOAT, BINARY/VARBINARY Database Definition on Demand- renaming a table’s column; renaming an index

  25. Top Ten DB2 10 Features “…best reduction in CPU for transactions, queries, and batch since V2.1… most customers to reduce CPU times between 5% and 10% as soon as DB2 10 is out of the box.” Improved Security (e.g. data masking, smaller granularity for admin privileges) Index Include Columns Temporal (Versioned) Data Hashing Buffer Pool Improvements(e.g.use of the System z10 1 megabyte, page size, buffer pools in memory) 80% to 90% of Virtual Storage Moved “Above the Bar” No More Links in the DB2 Catalog Efficient Caching of Dynamic SQL Statements That Use Literals LOB Improvements (e.g. inline LOBS, improved large object streaming)

  26. Top Ten Trends Industry Consolidation Cloud Computing SaaS Virtualization Server Consolidation Open Source Social Media Complexity Autonomic, Self-Managing Databases Commoditization

  27. Top Ten Best Practices for DB2 Professional Development Join your local DB2 user group (and participate!) Join IDUG and attend the annual conference in your geography Lobby for relevant annual training Purchase and read DB2 and database books Subscribe to relevant magazines and read them regularly (e.g. IBM Database Magazine, Database Trends & Applications, zJournal) Subscribe to RSS feeds for DB2-related blogs (mine [DB2 Portal and Data Technology Today], Willie Favero, Troy Coleman, Dave Beulke, Robert Catterall, etc.) Subscribe to the DB2 mailing list (daily DIGEST perhaps) Visit IBM DeveloperWorks frequently (http://www.ibm.com/developerworks/data/) Download the DB2 manuals in PDF form Be business savvy, not just tech savvy! Learn about your business.

  28. Top Ten DB2 Related Blogs Start with: Planet DB2 (DB2 blog aggregator) – http://www.planetdb2.com DB2 Portal Blog - http://www.db2portal.com/blog.html Getting the Most Out of DB2 for z/OS (Willie Favero) - http://it.toolbox.com/blogs/db2zos DB2 News & Tips - http://db2news.blogspot.com/ DB2 USA - http://db2usa.blogspot.com/ Dave Beulke’s Blog - http://davebeulke.com/ DB2utor (Troy Coleman) - http://ibmsystemsmag.blogs.com/db2utor/ Thoughts on DB2 (Triton) - http://www.triton.co.uk/blog/ SAP on DB2 for z/OS (Omer Brandeis) - http://it.toolbox.com/blogs/sap-on-db2 Robert Catterrall - http://catterallconsulting.blogspot.com/

  29. Top Ten Books for DB2 Professionals DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide DB2 Developer’s Guide

  30. The Return of the DB2 Top Ten Lists Craig S. Mullins craig@craigsmullins.comhttp://www.CraigSMullins.com craig.mullins@softwareonz.com http://www.softwareonz.com

More Related