390 likes | 592 Views
C20.0046: Database Management Systems Lecture #5. M.P. Johnson Stern School of Business, NYU Spring, 2008. Agenda. Last time: FDs This time: Anomalies Normalization: BCNF & 3NF Next time: SQL. then they must also agree on the attributes. B 1 , B 2 , …, B m. Review: FDs. Definition:
E N D
C20.0046: Database Management SystemsLecture #5 M.P. Johnson Stern School of Business, NYU Spring, 2008 M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Agenda • Last time: FDs • This time: • Anomalies • Normalization: BCNF & 3NF • Next time: SQL M.P. Johnson, DBMS, Stern/NYU, Spring 2008
then they must also agree on the attributes B1, B2, …, Bm Review: FDs • Definition: • Notation: • Read as: Ai functionally determines Bj If two tuples agree on the attributes A1, A2, …, An A1, A2, …, An B1, B2, …, Bm M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Review: Combining FDs If some FDs are satisfied, thenothers are satisfied too namecolor categorydepartment color, categoryprice If all these FDs are true: name, categoryprice Then this FD also holds: Why? M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Problem: find all FDs • Given a relation instance and set of given FDs • Find all FD’s satisfied by that instance • Useful if we don’t get enough information from our users: need to reverse engineer a data instance • Q: How long does this take? • A: Some time for each subset of atts • Q: How many subsets? • powerset • exponential time in worst-case • But can often be smarter… M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Closure Algorithm Example: Start with X={A1, …, An}. Repeat: if B1, …, Bn C is a FD and B1, …, Bn are all in X then add C to X. until X didn’t change namecolor categorydepartment color, categoryprice {name, category}+ = {name, category, color, department, price} M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Closure alg e.g. A, B CA, D B B D Example: Compute X+, for every set X (AB is shorthand for {A,B}): A+ = A, B+ = BD, C+ = C, D+ = D AB+ = ABCD, AC+ = AC, AD+ = ABCD, BC+ = BC, BD+ = BD, CD+ = CD ABC+ = ABD+ = ACD+ = ABCD (no need to compute–why?) BCD+ = BCD, ABCD+ = ABCD What are the keys? M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Closure alg e.g. In class: A, B C A, D E B D A, F B R(A,B,C,D,E,F) Compute {A,B}+ X = {A, B, } Compute {A, F}+ X = {A, F, } What are the keys? M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Closure alg e.g. • Product(name, price, category, color) name, category price category color FDs are: Keys are: {name, category} • Enrollment(student, address, course, room, time) student address room, time course student, course room, time FDs are: Keys are: M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Next topic: Anomalies • Identify anomalies in existing schemata • Decomposition by projection • BCNF • Lossy v. lossless • Third Normal Form M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Types of anomalies • Redundancy • Repeat info unnecessarily in several tuples • Update anomalies: • Change info in one tuple but not in another • Deletion anomalies: • Delete some values & lose other values too • Insert anomalies: • Inserting row means having to insert other, separate info / null-ing it out M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Examples of anomalies • Redundancy: name, maddress • Update anomaly: Bill moves • Delete anom.: Bill doesn’t pay bills, lose phones lose Bill! • Insert anom: can’t insert someone without a (non-null) phone • Underlying cause: SSN-phone is many-many • Effect: partial dependency ssn name, maddress, • Whereas key = {ssn,phone} SSN Name, Mailing-address SSN Phone M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Decomposition by projection • Soln: replace anomalous R with projections of R onto two subsets of attributes • Projection: an operation in Relational Algebra • Corresponds to SELECT command in SQL • Projecting R onto attributes (A1,…,An) means removing all other attributes • Result of projection is another relation • Yields tuples whose fields are A1,…,An • Resulting duplicates ignored M.P. Johnson, DBMS, Stern/NYU, Spring 2008
R1(A1, ..., An, B1, ..., Bm) R2(A1, ..., An, C1, ..., Cp) Projection for decomposition R(A1, ..., An, B1, ..., Bm, C1, ..., Cp) R1 = projection of R on A1, ..., An, B1, ..., Bm R2 = projection of R on A1, ..., An, C1, ..., Cp A1, ..., An B1, ..., Bm C1, ..., Cp= all attributes R1 and R2 may (/not) be reassembled to produce original R M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Name SSN Mailing-address SSN Phone Michael 123 NY 123 212-111-1111 Hilary 456 DC 123 917-111-1111 Bill 789 Chappaqua 456 202-222-2222 456 914-222-2222 789 914-222-2222 789 212-333-3333 Decomposition example Break the relation into two: • The anomalies are gone • No more redundant data • Easy to for Bill to move • Okay for Bill to lose all phones M.P. Johnson, DBMS, Stern/NYU, Spring 2008
name buys Person Product price name ssn Relational Model: plus FD’s Normalization: Eliminates anomalies Thus: high-level strategy E/R Model: M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Using FDs to produce good schemas • Start with set of relations • Define FDs (and keys) for them based on real world • Transform your relations to “normal form” (normalize them) • Do this using “decomposition” • Intuitively, good design means • No anomalies • Can reconstruct all (and only the) original information M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Decomposition terminology • Projection: eliminating certain atts from relation • Decomposition: separating a relation into two by projection • Join: (re)assembling two relations • Whenever a row from R1 and a row from R2 have the same value for some atts A, join together to form a row of R3 • If exactly the original rows are reproduced by joining the relations, then the decomposition was lossless • We join on the attributes R1 and R2 have in common (As) • If it can’t, the decomposition was lossy M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Lossless Decompositions Lossless Decompositions A decomposition is lossless if we can recover: R(A,B,C) R1(A,B) R2(A,C) R’(A,B,C) should be the same as R(A,B,C) Decompose Recover R’ is in general larger than R. Must ensure R’ = R M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Lossless decomposition • Sometimes the same set of data is reproduced: • (Word, 100) + (Word, WP) (Word, 100, WP) • (Oracle, 1000) + (Oracle, DB) (Oracle, 1000, DB) • (Access, 100) + (Access, DB) (Access, 100, DB) M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Lossy decomposition • Sometimes it’s not: • (Word, WP) + (100, WP) (Word, 100, WP) • (Oracle, DB) + (1000, DB) (Oracle, 1000, DB) • (Oracle, DB) + (100, DB) (Oracle, 100, DB) • (Access, DB) + (1000, DB) (Access, 1000, DB) • (Access, DB) + (100, DB) (Access, 100, DB) What’swrong? M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Ensuring lossless decomposition R(A1, ..., An, B1, ..., Bm, C1, ..., Cp) • Examples: • name price, so first decomposition was lossless • category name and category price, and so second decomposition was lossy R1(A1, ..., An, B1, ..., Bm) R2(A1, ..., An, C1, ..., Cp) If A1, ..., An B1, ..., Bmor A1, ..., An C1, ..., Cp Then the decomposition is lossless Note: don’t need both M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Quick lossless/lossy example • At a glance: can we decompose into R1(Y,X), R2(Y,Z)? • At a glance: can we decompose into R1(X,Y), R2(X,Z)? M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Next topic: Normal Forms • First Normal Form = all attributes are atomic • As opposed to set-valued • Assumed all along • Second Normal Form (2NF) • Third Normal Form (3NF) • Boyce Codd Normal Form (BCNF) • Fourth Normal Form (4NF) • Fifth Normal Form (5NF) M.P. Johnson, DBMS, Stern/NYU, Spring 2008
BCNF definition • A simple condition for removing anomalies from relations: • I.e.: The left side must always contain a key • I.e: If a set of attributes determines other attributes, it must determine all the attributes • Slogan: “In every FD, the left side is a superkey.” A relation R is in BCNF if: If As Bs is a non-trivial dependency in R , then As is a superkey for R M.P. Johnson, DBMS, Stern/NYU, Spring 2008
A’s B’s Others R1 R2 BCNF decomposition algorithm Repeat choose A1, …, Am B1, …, Bn that violates the BNCF condition split R into R1(A1, …, Am, B1, …, Bn) and R2(A1, …, Am, [others]) continue with both R1 and R2Until no more violations //Heuristic: choose Bs as large as possible M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Boyce-Codd Normal Form • Name/phone example is not BCNF: • {ssn,phone} is key • FD: ssn name,mailing-address holds • Violates BCNF: ssn is not a superkey • Its decomposition is BCNF • Only superkeys anything else M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Design/BCNF example • Consider situation: • Entities: Emp(ssn,name,lot), Dept(id,name,budg) • Relship: Works(E,D,since) • Draw E/R • New rule: in each dept, everyone parks in same lot • Translate to FD • Normalize M.P. Johnson, DBMS, Stern/NYU, Spring 2008
BCNF Decomposition • Larger example: multiple decompositions • {Title, Year, Studio, President, Pres-Address} • FDs: • Title Year Studio • Studio President • President Pres-Address • Studio President, Pres-Address • No many-many this time • Problem cause: transitive FDs: • Title,year studio president M.P. Johnson, DBMS, Stern/NYU, Spring 2008
BCNF Decomposition • Illegal: As Bs, where As not a superkey • Decompose: Studio President, Pres-Address • As = {studio} • Bs = {president, pres-address} • Cs = {title, year} • Result: • Studios(studio, president, pres-address) • Movies(studio, title, year) • Is (2) in BCNF? Is in (1) BCNF? • Key: Studio • FD: President Pres-Address • Q: Does president studio? If so, president is a key • But if not, it violates BCNF M.P. Johnson, DBMS, Stern/NYU, Spring 2008
BCNF Decomposition • Studios(studio, president, pres-address) • Illegal: As Bs, where As not a superkey • Decompose: President Pres-Address • As = {president} • Bs = {pres-address} • Cs = {studio} • {Studio, President, Pres-Address} becomes • {President, Pres-Address} • {Studio, President} M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Decomposition algorithm example • R(N,O,R,P) F = {N O, O R, R N} • Key: N,P • Violations of BCNF: N O, OR, N OR • Pick N OR (on board) • Can we rejoin? (on board) • What happens if we pick N O instead? • Can we rejoin? (on board) M.P. Johnson, DBMS, Stern/NYU, Spring 2008
An issue with BCNF • We could lose FDs • Relation: R(Title, Theater, Neighboorhood) • FDs: • Title,N’hood Theater • Assume a movie shouldn’t play twice in same n’hood • Theater N’hood • Keys: • {Title, N’hood} • {Theater, Title} M.P. Johnson, DBMS, Stern/NYU, Spring 2008
R1 R2 Theater N’hood Theater Title Angelica Village Angelica Aviator Angelica Life Aquatic Losing FDs • BCNF violation: Theater N’hood • Decompose: • {Theater, N’Hood} • {Theater, Title} • Resulting relations: M.P. Johnson, DBMS, Stern/NYU, Spring 2008
R’ Theater N’hood Title Angelica Village Life Aquatic Angelica Village Aviator Film Forum Village Life Aquatic Losing FDs • Suppose we add new rows to R1 and R2: • Neither R1 nor R2 enforces FD Title,N’hood Theater R2 R1 M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Third normal form: motivation • Sometimes • BCNF is not dependency-preserving, and • Efficient checking for FD violation on updates is important • In these cases BCNF is too severe a req. • “over-normalization” • Solution: define a weaker normal form, 3NF • FDs can be checked on individual relations without performing a join (no inter-relational FDs) • relations can be converted, preserving both data and FDs M.P. Johnson, DBMS, Stern/NYU, Spring 2008
BCNF lossiness • NB: BCNF decomp. is not data-lossy • Results can be rejoined to obtain the exact original • But: it canlose dependencies • After decomp, now legal to add rows whose corresponding rows would be illegal in (rejoined) original • Data-lossy v. FD-lossy M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Third Normal Form • Now define the (weaker) Third Normal Form • Turns out: this example was already in 3NF A relation R is in 3rd normal form if : For every nontrivial dependency A1, A2, ..., An Bfor R, {A1, A2, ..., An } is a super-key for R, or B is part of a key, i.e., B is prime Tradeoff: BCNF = no FD anomalies, but may lose some FDs 3NF = keeps all FDs, but may have some anomalies M.P. Johnson, DBMS, Stern/NYU, Spring 2008
Next week • For Monday: read ch.5.1-2 (SQL) • Proj1 due next Monday M.P. Johnson, DBMS, Stern/NYU, Spring 2008