70 likes | 181 Views
A Filesystem for Lots Of Little Files (LOL FS). Allison Regier and Karen Hollingsworth University of Notre Dame. The Problem. Both of us use many small files in our research projects. 24 byte files composed of approximately 24 ascii characters:.
E N D
A Filesystem for Lots Of Little Files(LOL FS) Allison Regier and Karen HollingsworthUniversity of Notre Dame
The Problem • Both of us use many small files in our research projects. 24 byte files composed ofapproximately 24 ascii characters: Files that are 200 to 1000 bytes each, of ascii text: y1 x1 r1 y2 x2 r2 AAGTCACTCG…
The Problem Lots of little files require lots of overhead space and time!
The Solution • We use a single large file behind-the-scenes for many small files of data. Name size flags filedata Name size flags filedata Name … 20 4 1 variable 20 4 1 variable Number of bytes for each field
The Solution Characteristics our file system • Assumes files will be written once and not modified • Achieves excellent space performance! • Needs improvements in time performance
Initial Results • Writing 10,000 files, 10 bytes each
The Road Ahead Future Work • Improve the time performance of our filesystem • Fix memory errors that occur during large-scale testing • Perform more tests to compare our filesystem to a traditional file system