80 likes | 194 Views
Performers : Yehuda Krief Assaf Cohen Etay Goldshtein. Storage Management Tools for a Storage System. Academic Advisor : Dr’ Eitan Bachmat. Problem definition. Companies that have a huge amount of data.
E N D
Performers : Yehuda Krief Assaf Cohen Etay Goldshtein Storage Management Tools for a Storage System Academic Advisor : Dr’ Eitan Bachmat
Problem definition • Companies that have a huge amount of data. • When a user wants to get data from the Storage System, he will wait a long amount of time to get the data that he desires, and it may cause him to lose money, deals, etc…: • - For example, in the NASDAQ stock market computers compete between themselves to buy and sell stocks. • The company which has a faster Storage System than their competitors can get the requested information first, and earn more money.
Storage System Structure Storage System Host A Host A Network
System Storage Structure Storage System Host A Read(..) Host A Is it in cache? NO data Network Read(..)
Current situation: • Storage Systems have a huge amount of data to store and manage (in many cases, more then 100 TB). • Storage Systems use DRAM memories as cache. • DRAM memories are very fast, but they are also very expensive. • Storage Systems have a small capacity of cache (usually 16 Giga Bytes). • Cache capacity is very small compared to the disk drive capacity that the storage system has. • Cache misses lead to poor performance.
Project Requirements Research on the extension of the Memory-Cache, of the Storage System, with flash disks (size of 150GB each ). Tracking the trace of the Storage System: - amount of hit ratio before and after adding the Flash memory as extension of the cache. - statistical measures :Kb read/write – in time intervals. Integrate a clustering algorithm with the trace: - cluster the Storage System : which will map the LUNs of the Storage System. - helps organize the caching algorithm. Develop a simulator which the IT manager will use to examine and organize his/her Storage System.
Method Of Solution We will implement the UPGMA clustering algorithm with the use of C++ with threads. Build a simulator that will predict and examine the benefits of adding Flash into the Memory-Cache. Investigate the behavior of “local”/”global” caching algorithms for the implementation of the Flash.
System Storage Structure Storage System Host A Host A Network