110 likes | 224 Views
The Dawning of the Age of Infinite Storage. William Perrizo Dept of Computer Science North Dakota State Univ. Google 10 100 . . . Yotta 10 24 Zetta 10 21 Exa 10 18 Peta 10 15 Tera 10 12 Giga 10 9 Mega 10 6 Kilo 10 3. Tera Bytes are Here
E N D
The Dawning of the AgeofInfinite Storage William Perrizo Dept of Computer Science North Dakota State Univ.
Google 10100 . . . Yotta 1024 Zetta 1021 Exa 1018 Peta 1015 Tera 1012 Giga 109 Mega 106 Kilo 103 • Tera Bytes are Here • 1 TB costs 1k$ to buy • 1 TB costs 300k$/y to own • Management & curation are expensive • Searching 1TB takes hours • I’m Terrified byTeraBytes • I’m Petrified by PetaBytes We are here • I’ll soon be Exafied byExaBytes • I’m too old to ever be Zettafied by ZettaBytes • But you may be in your lifetime • You may even be Yottafied by YottaBytes • You probably won’t ever be Googified byGoogiBytes • But one should “never say never”.
How much information is there? Yotta Zetta Exa Peta Tera Giga Mega Kilo Everything! Recorded • Soon everything can be recorded and indexed. • Most bytes will never be seen by humans. • Data summarization, trend detection, anomaly detection, data mining, are key technologies All Books MultiMedia All books (words) .Movie A Photo A Book 10-24 Yocto, 10-21 zepto, 10-18 atto, 10-15 femto, 10-12 pico, 10-9 nano, 10-6 micro, 10-3 milli
First Disk 1956 Me, at13. • IBM 305 RAMAC • 4 MB • 50x24” disks • 1200 rpm • 100 ms access • 35k$/y rent • Included computer & accounting software(tubes not transistors)
10 years later 30 MB 1.6 meters
12/1/1999 9/1/2000 9/1/2001 4/1/2002 11/4/2003 The Cost of Storage about 1K$/TB
E.g., A recent Purchase Order Company: NDSU Date: 8/7/03 System Board: Intel D865 GBFL system board w/LAN 800mhz FSB Processor: Intel Pentium 4 2.6 GHz Hard Drives: 4 x 250 GB IDE (total = 1 TB) Controller: Onboard IDE Controller 2nd IDE Controller: Video: Integrated Diskette Drive: 1.44 MB Memory: 4 GB 400 mhz memory CD/DVD Drive: DVD/CDRW Sound: Integrated AC97 Audio w/Soundmax Case: Performance Minitower ATX w/300 Watt PS Keyboard: Microsoft 104 Internet keyboard Mouse: Microsoft Intellimouse Optical Operating System: none Network Cards: Integrated Intel 10/100 Ethernet w/D845GEBV2L board Price:$2,899.00 Main expense is here
Kilo Mega Giga Tera Peta Exa Zetta Yotta Disk Evolution
MemexAs We May Think, Vannevar Bush, 1945 “A memex is a device in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility” “yet if the user inserted 5000 pages of material a day it would take him hundreds of years to fill the repository, so that he can enter material freely”
The Personal TerabyteHow Will We Find Anything? • Need Queries, Indexing, Data Mining, Pivoting, Scalability, Backup, Replication, Online update, Set-oriented access. • If you don’t use a DBMS, you will implement one! • Need Data Mining, Machine Learning! • 80% of data is personal/individual • 20% is Corporate, Governmental SQL ++DBMS