Database Design: Normalization and SQL

1. Database Design: Normalization and SQL University of California, Berkeley School of Information Management and Systems SIMS 202: Information Organization and Retrieval Information Organization and Retrieval

2. Review • Database design Process • Entity-Relationship Diagrams • Designing a database Information Organization and Retrieval

3. Database Design Process Application 1 Application 2 Application 3 Application 4 External Model External Model External Model External Model Application 1 Conceptual requirements Application 2 Conceptual requirements Conceptual Model Logical Model Internal Model Application 3 Conceptual requirements Application 4 Conceptual requirements Information Organization and Retrieval

4. ER Diagrams: Entity • An Entity is an object in the real world (or even imaginary worlds) about which we want or need to maintain information • Persons (e.g.: customers in a business, employees, authors) • Things (e.g.: purchase orders, meetings, parts, companies) Employee Information Organization and Retrieval

5. Birthdate First Age Employee Middle Name SSN Last Projects ER Diagrams: Attributes • Attributes are the significant properties or characteristics of an entity that help identify it and provide the information needed to interact with it or use it. (This is the Metadata for the entities.) Information Organization and Retrieval

6. Project Attends Student Class Supplies project parts Supplier Part ER Diagrams: Relationships Information Organization and Retrieval

7. Customer Invoice Employee Inventory Supplier Account Sales Rep Parts ACME Widget Co. Entities • Timecard • Check Information Organization and Retrieval

8. ACME Widget Co. Functional areas • Ordering • Inventory • Supplies • Shipping • Personnel • Payroll • We will concentrate on Ordering and Inventory Information Organization and Retrieval

9. Sales-Rep Rep# Part# Writes Cust# Invoice# Quantity Orders Contains Customer Invoice Line-Item Invoice# Rep# Cust# ACME WidgetOrdering Normalization Information Organization and Retrieval

10. Emp# Employee Wage ISA Company# Hourly Company# Supplier Sales-Rep Sales Part# Quantity Part# Writes Cust# Invoice# Quantity Ordered Part Orders Contains Customer Invoice Line-Item Invoice# Rep# Contains Has Cust# On-Order Part Supplied Part Supplies Part# Count Part# Cost Price Company# ACME WidgetER Model Information Organization and Retrieval

11. Mapping to a Relational Model • Each entity in the ER Diagram becomes a relation. • A properly normalized ER diagram will indicate where intersection relations for many-to-many mappings are needed. • Relationships are indicated by common columns (or domains) in tables that are related. • We will examine the tables for the Acme Widget Company derived from the ER diagram Information Organization and Retrieval

12. Employee Information Organization and Retrieval

13. Sales-Rep Hourly Information Organization and Retrieval

14. Customer Information Organization and Retrieval

15. Invoice Information Organization and Retrieval

16. Line-Item Information Organization and Retrieval

17. Part Information Organization and Retrieval

18. Joins Information Organization and Retrieval

19. Today • Normalization • Relational Algebra and Calculus • SQL • Effectiveness and Efficiency criteria for database designs • Advantages and failings of DBMS technology Information Organization and Retrieval

20. Normalization • Normalization theory is based on the observation that relations with certain properties are more effective in inserting, updating and deleting data than other sets of relations containing the same data • Normalization is a multi-step process beginning with an “unnormalized” relation • Hospital example from Atre, S. Data Base: Structured Techniques for Design, Performance, and Management. Information Organization and Retrieval

21. Normal Forms • First Normal Form (1NF) • Second Normal Form (2NF) • Third Normal Form (3NF) • Boyce-Codd Normal Form (BCNF) • Fourth Normal Form (4NF) • Fifth Normal Form (5NF) Information Organization and Retrieval

22. Normalization Unnormalized Relations First normal form Functional dependencyof nonkey attributes on the primary key - Atomic values only Second normal form No transitive dependency between nonkey attributes Third normal form Boyce- Codd and Higher Full Functional dependencyof nonkey attributes on the primary key All determinants are candidate keys - Single multivalued dependency Information Organization and Retrieval

23. Unnormalized Relations • First step in normalization is to convert the data into a two-dimensional table • In unnormalized relations data can repeat within a column Information Organization and Retrieval

24. Unnormalized Relation Information Organization and Retrieval

25. First Normal Form • To move to First Normal Form a relation must contain only atomic values at each row and column. • No repeating groups • A column or set of columns is called a Candidate Key when its values can uniquely identify the row in the relation. Information Organization and Retrieval

26. First Normal Form Information Organization and Retrieval

27. 1NF Storage Anomalies • Insertion: A new patient has not yet undergone surgery -- hence no surgeon # -- Since surgeon # is part of the key we can’t insert. • Insertion: If a surgeon is newly hired and hasn’t operated yet -- there will be no way to include that person in the database. • Update: If a patient comes in for a new procedure, and has moved, we need to change multiple address entries. • Deletion (type 1): Deleting a patient record may also delete all info about a surgeon. • Deletion (type 2): When there are functional dependencies (like side effects and drug) changing one item eliminates other information. Information Organization and Retrieval

28. Second Normal Form • A relation is said to be in Second Normal Form when every nonkey attribute is fully functionally dependent on the primary key. • That is, every nonkey attribute needs the full primary key for unique identification Information Organization and Retrieval

29. Second Normal Form Information Organization and Retrieval

30. Second Normal Form Information Organization and Retrieval

31. Second Normal Form Information Organization and Retrieval

32. 1NF Storage Anomalies Removed • Insertion: Can now enter new patients without surgery. • Insertion: Can now enter Surgeons who haven’t operated. • Deletion (type 1): If Charles Brown dies the corresponding tuples from Patient and Surgery tables can be deleted without losing information on David Rosen. • Update: If John White comes in for third time, and has moved, we only need to change the Patient table Information Organization and Retrieval

33. 2NF Storage Anomalies • Insertion: Cannot enter the fact that a particular drug has a particular side effect unless it is given to a patient. • Deletion: If John White receives some other drug because of the penicillin rash, and a new drug and side effect are entered, we lose the information that penicillin can cause a rash • Update: If drug side effects change (a new formula) we have to update multiple occurrences of side effects. Information Organization and Retrieval

34. Third Normal Form • A relation is said to be in Third Normal Form if there is no transitive functional dependency between nonkey attributes • When one nonkey attribute can be determined with one or more nonkey attributes there is said to be a transitive functional dependency. • The side effect column in the Surgery table is determined by the drug administered • Side effect is transitively functionally dependent on drug so Surgery is not 3NF Information Organization and Retrieval

35. Third Normal Form Information Organization and Retrieval

36. Third Normal Form Information Organization and Retrieval

37. 2NF Storage Anomalies Removed • Insertion: We can now enter the fact that a particular drug has a particular side effect in the Drug relation. • Deletion: If John White recieves some other drug as a result of the rash from penicillin, but the information on penicillin and rash is maintained. • Update: The side effects for each drug appear only once. Information Organization and Retrieval

38. Boyce-Codd Normal Form • Most 3NF relations are also BCNF relations. • A 3NF relation is NOT in BCNF if: • Candidate keys in the relation are composite keys (they are not single attributes) • There is more than one candidate key in the relation, and • The keys are not disjoint, that is, some attributes in the keys are common Information Organization and Retrieval

39. Most 3NF Relations are also BCNF Information Organization and Retrieval

40. Fourth Normal Form • Any relation is in Fourth Normal Form if it is BCNF and any multivalued dependencies are trivial • Eliminate non-trivial multivalued dependencies by projecting into simpler tables Information Organization and Retrieval

41. Fifth Normal Form • A relation is in 5NF if every join dependency in the relation is implied by the keys of the relation • Implies that relations that have been decomposed in previous NF can be recombined via natural joins to recreate the original relation. Information Organization and Retrieval

42. Relational Calculus • Relational Algebra provides a set of explicit operations (select, project, join, etc) that can be used to build some desired relation from the database. • Relational Calculus provides a notation for formulating the definition of that desired relation in terms of the relations in the database without explicitly stating the operations to be performed • SQL is based on the relational calculus. Information Organization and Retrieval

43. Relational Algebra Operations • Select • Project • Product • Union • Intersect • Difference • Join • Divide Information Organization and Retrieval

44. Select • Extracts specified tuples (rows) from a specified relation (table). Information Organization and Retrieval

45. Project • Extracts specified attributes(columns) from a specified relation. Information Organization and Retrieval

46. A1 B1 A2 B1 A3 B2 B1 C1 B2 C2 B3 C3 A1 B1 C1 A2 B1 C1 A3 B2 C2 Join • Builds a relation from two specified relations consisting of all possible concatenated pairs of, one from each of the two relations, such that in each pair the two tuples satisfy some condition. (Natural or Inner) Join Information Organization and Retrieval

47. B1 C1 B2 C2 B3 C3 Outer Join A1 B1 C1 A2 B1 C1 A3 B2 C2 A4 * * A1 B1 A2 B1 A3 B2 A4 B7 Outer Join • Outer Joins are similar to PRODUCT -- but will leave NULLs for any row in the first table with no corresponding rows in the second. Information Organization and Retrieval

48. SQL • Structured Query Language • SEQUEL from IBM San Jose • ANSI 1992 Standard is the version used by most DBMS today (SQL92) • Basic language is standardized across relational DBMSs. Each system may have proprietary extensions to standard. Information Organization and Retrieval

49. SQL Uses • Database Definition and Querying • Can be used as an interactive query language • Can be imbedded in programs • Relational Calculus combines Select, Project and Join operations in a single command. SELECT. Information Organization and Retrieval

50. SELECT • Syntax: • SELECT [DISTINCT] attr1, attr2,…, attr3 FROM rel1 r1, rel2 r2,… rel3 r3 WHERE condition1 {AND | OR} condition2 ORDER BY attr1 [DESC], attr3 [DESC] Information Organization and Retrieval