180 likes | 292 Views
ICOLC Use Data Webinar Episode 1. Tansy Matthews July 2010. Quick Change of Plan. I’d like to swap sessions two and three if there are no (not too many) objections. It’ll “follow” better. So.. July 15, 2010 2pm - 3pm (EST): Working with COUNTER Reports
E N D
ICOLC Use Data WebinarEpisode 1 Tansy Matthews July 2010
Quick Change of Plan I’d like to swap sessions two and three if there are no (not too many) objections. It’ll “follow” better. So.. July 15, 2010 2pm - 3pm (EST): Working with COUNTER Reports July 29, 2010 2pm - 3pm (EST): Retrieving COUNTER Reports for Consortia Using MISO, an Open Source SUSHI Client
A bit of background • VIVA comprises • 6 public doctoral institutions • 9 public 4-year comprehensive colleges and universities • 24 community and 2-year branch colleges (at 40 campuses) • 33 of Virginia's independent (private, not-for profit) colleges and universities • Selected other educational and research institutions
A bit of background Central statistics processing Institution level 34 products Three years ago, goal was to reduce processing time, facilitate storage over time, and provide means for easy retrieval of multi-year reports.
Key Elements Columnar data Columnar data Columnar data Standard formatting Standard formatting Standard formatting Did I mention that columnar data and standard formatting are really important?
Working backwards • What is the end result we’re looking for? • The ability to track use over time. • Tracking cost per use over time? • VIVA's Use Over Time
Source of the data • Table in a database • Excel • MySQL • We use a combination – MySQL storage with an Excel front-end • Let’s have a look…
Adding data to the database • This is where the standard formatting comes in… • We compile data monthly • Store in Excel spreadsheets • Import into database quarterly
Access is pretty smart Columns don’t have to be in the same order But they DO have to have the same headers And it all needs to be columnar data.
Columnar data? Columnar data is the type of data that spreadsheets and databases are designed for Every element appears on every line. Not columnar Columnar Columnar data can be concatenated over time.
How do we get to columnar? For Non COUNTER reports… it depends. Mostly, you have to be imaginative about it. For COUNTER reports… Aha! We have a system! Which we’ll talk about next session.
What needs to be included? • It depends on your requirements. We’ve added over time. • Certain fields need to be standardized in order to retrieve the data, for example: • Institution • Institution type • Vendors don’t provide these in a standard format.
Standardizing data using VLookup • Lookup tables can be used to standardize data. • So, what’s a lookup table? And what’s VLookup? • Vertical Lookup matches a cell’s value with a value in the lookup table and returns the value that from a specified column in the matching cell’s row.
Huh? For example: VIVA’s institution lookup table
Adding the data to a spreadsheet Once the data is in a columnar format, it is stored in a spreadsheet – one spreadsheet for each vendor. We make this available to our members monthly as PivotTables stored in a secure location. It’s imported into the database quarterly. Members can then download the raw data from our DIY Downloads site.
Getting it into the database • Spatial considerations • Store by product, not by title. • Use PivotTable to select data to be loaded. • Loading workbook • Import into Access
Homework • For the next session: • Download: http://www.vivalib.org/stats_training/counter_processing.xlsmhttp://www.vivalib.org/stats_training/counter_xml_loading.xlsx • Have available: • At least one COUNTER report in .xml format • At least one COUNTER report in .csv or .tsv format. Two or three would be better.
Questions? Comments? Questions about the session Tansy Matthews Associate Director Virtual Library of Virginia tmatthe6@gmu.edu Elluminate Technical Questions Lisa Tatum Alday, M.Ed., MLISFlorida Center for Library Automationlisatfl@ufl.edu