1 / 35

“I’m sorry, but we didn’t know we wanted to know that !”

“I’m sorry, but we didn’t know we wanted to know that !” Building Frameworks of Organizational Intelligence Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries NISO Usage Data Forum November 1-2, 2007 Dallas, TX.

idalia
Download Presentation

“I’m sorry, but we didn’t know we wanted to know that !”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “I’m sorry, but we didn’t know we wanted to know that!” • Building Frameworks of Organizational Intelligence • Joe Zucca • Director for Planning and Communication • University of Pennsylvania Libraries • NISO Usage Data Forum • November 1-2, 2007 • Dallas, TX

  2. Building Frameworks of Organizational Intelligence Home, May 2006

  3. Building Frameworks of Organizational Intelligence New Library Home Page:The “Hindrance” Effect Use of Electronic Resources, Spring 2005 and 2006 Comparison [local not vendor counts]

  4. Building Frameworks of Organizational Intelligence New Library Home Page: User Intolerance No. of clicks before visitor left new for old home Total clicks logged 12,827 sessions logged (this 24-hour snap shoot, minus ‘bots) 185 (1.4%) sessions opted for old home 20 sessions opting for old home involved Safari 135 old home sessions (1.1% of total) -- bookmarks or first clicks on new home: no tolerance

  5. Building Frameworks of Organizational Intelligence Data live all around us in structures. What are the properties of these structures? How versatile are they? Are we able to adapt or repurpose them to facilitate measurement? What resources (tools, dollars, staff) are required to harvest, transform, and manage the data that now live all around us?

  6. Service Environment Information Loop Inform ERED Catalog Data Farm Environment Funds SFX | ERM? Integrate Report Builder DYNIX BorrowDirect Circulation WEB Apache ezproxy Ref|Instruct Dashboard Data Streams Data Bureau Clean | Anonymize Normalize People and Network Data Building Frameworks of Organizational Intelligence Working with data structures

  7. E-Resource Use Resolve Resource Resolve People Resolve Places Digital Library Voyager-Supported Services Building Use Staff Census Reference & Instruction (dynamic) Resolution Services LDAP Administration Building Frameworks of Organizational Intelligence Data Farm Oracle Space-Overview 18+ gb, in 139 tables, for collecting and disseminating management info Circulation Reference Contact Web Analytics Acquisitions Funds Image Collection Use Holdings Consortia ILL/DocDel Tech Processing Workflow 70-Member ILL Coop. Copier | Printer Use Gate Swipes

  8. Building Frameworks of Organizational Intelligence Interacting with data: dashboard pages

  9. Building Frameworks of Organizational Intelligence Interacting with data: report builders

  10. Submit for asynchronous processing and delivery DATA FARM Building Frameworks of Organizational Intelligence Interacting with data: “data bureau” [e.g., record consultations, request ID resolution using the library intranet] Scheduled reports Research [rmediated] Auto-survey

  11. Building Frameworks of Organizational Intelligence bib_text invoice bib_ master Sample Data Structure I - Voyager invoice_ status Invoice_ line_item line_item purchase_ order fund invoice_ line_item _funds vendor

  12. Building Frameworks of Organizational Intelligence Sample Data Structure II - Data Farm Table

  13. Building Frameworks of Organizational Intelligence Sample Data Structure III – Data Farm Funds Report

  14. Building Frameworks of Organizational Intelligence “…but we didn’t know we wanted to know that!” Slide of report by fund and publisher (casalini) deleted

  15. Modules to Normalize, Resolve, Anonymize, and Format Data Self-Executing—Dashboards, Cron’d Processes Mediated Services: Report Builders, Resolvers, Research Synchronous & Asynchronous Processing Backup and Security Building Frameworks of Organizational Intelligence Data Farm: Operational Parameters Raw Data In | Minimally Processed Data Out Data Harvest, Retention, and Storage Policies

  16. Building Frameworks of Organizational Intelligence Data Farm: Example Applications • Reference & instruction measures: • assess “market penetration”, • track changes in the modality and focus of service • account for liaison activities in annual reviews • Web page analytics: navigation, use frequencies, browser functionality, search functionality • Fund tracking and collection metrics, current and historical, for: • annual budget allocation, • stacks management, • storage decisions • E-resource tracking: monitor customer interest, use analysis • ILL consortial traffic: facilitate local collection analysis • Proxy log analysis, current study of interdisciplinary research behavior

  17. Building Frameworks of Organizational Intelligence A different take on a management information framework

  18. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

  19. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]|GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F xxx.xx.xxx.xxx = .edu | on-campus | Van Pelt Library | staff office July 26, 2007: 3:41 p.m. Device= Mac | OSX Browser= Safari

  20. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer

  21. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]|GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F zucca [Penn authentication key] = Provost cntr | LIBRARY | staff

  22. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F SessionID 10335905=PsycInfo (resource identifier 7014)

  23. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F sfx_session_id=Journal of Experimental Child Psychology, “Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”

  24. Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F • TRANSLATION: • July 26, 2007 at 3:41 pm • A library staff (Provost’s center affiliate) • Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library and in the same session, • Logged into PsychInfo (CSA) • Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.

  25. Org|Program Staff Unrestricted Restricted Library Program Service Genre Fund Code Course Descriptor Level Budget Expnd Amt Client Program Dept Biblio- graphic Content Dept Reqmnt School URL Client Environment School IP-Domain Dept Rank Date|Time Campus Location Major Building Frameworks of Organizational Intelligence Events: aStructurefor Library DecisionMetrics EVENT

  26. ERED Catalog Funds SFX | ERM? DYNIX BorrowDirect Circulation Building Frameworks of Organizational Intelligence Service Environment Data Farm Silos WEB Apache ezproxy Ref|Instruct funds

  27. ERED Catalog Funds SFX | ERM? DYNIX BorrowDirect Circulation WEB Apache ezproxy Ref|Instruct Building Frameworks of Organizational Intelligence Data Farm Framework Service Environment Repository processes Sources Analysis DATA STORE query (xsql) parse, resolve, anonymize, secure! store as metridoc.xml XML oracle logs perl oracle XL

  28. Library Program Budget Client Program EVENT Content Environment Client Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema • <ENVIRONMENTAL> • <v.domain> • <p.domain> • <date> • <time> • <session> • <url> • </ENVIRONMENTAL> • <CLIENT> • <school> • <dept> • <rank> • </CLIENT> • <LIBRARY PRGRM> • <service genre> • <staff_name> • <staff_org> • <staff_prgm> • </LIBRARY PRGRM> • <CONTENT> • <title> • <author> • <holdings> • <call_no> • <isbn> • <issn> • <url> • <res_id> • <sfx_id> • </CONTENT>

  29. URL IP-Domain Environment Date|Time Campus Location Library Program Budget Client Program EVENT Content Environment Client Building Frameworks of Organizational Intelligence Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema • <ENVIRONMENTAL> • <v.domain> • <p.domain> • <date> • <time> • <session> • <url> • </ENVIRONMENTAL> • <CLIENT> • <school> • <dept> • <rank> • </CLIENT> • <LIBRARY PRGRM> • <service genre> • <staff_name> • <staff_org> • <staff_prgm> • </LIBRARY PRGRM> • <CONTENT> • <title> • <author> • <holdings> • <call_no> • <isbn> • <issn> • <url> • <res_id> • <sfx_id> • </CONTENT>

  30. School Dept Client Library Program Major Budget Rank Client Program EVENT Content Environment Client Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema • <ENVIRONMENTAL> • <v.domain> • <p.domain> • <date> • <time> • <session> • <url> • </ENVIRONMENTAL> • <CLIENT> • <school> • <dept> • <rank> • </CLIENT> • <LIBRARY PRGRM> • <service genre> • <staff_name> • <staff_org> • <staff_prgm> • </LIBRARY PRGRM> • <CONTENT> • <title> • <author> • <holdings> • <call_no> • <isbn> • <issn> • <url> • <res_id> • <sfx_id> • </CONTENT>

  31. Service Genre Library Program Budget Library Program Client Program EVENT Org|Program Content Staff Environment Client Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema • <ENVIRONMENTAL> • <v.domain> • <p.domain> • <date> • <time> • <session> • <url> • </ENVIRONMENTAL> • <CLIENT> • <school> • <dept> • <rank> • </CLIENT> • <LIBRARY PRGRM> • <service genre> • <staff_name> • <staff_org> • <staff_prgm> • </LIBRARY PRGRM> • <CONTENT> • <title> • <author> • <holdings> • <call_no> • <isbn> • <issn> • <url> • <res_id> • <sfx_id> • </CONTENT>

  32. Library Program Budget Client Program EVENT Content Environment Client Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema • <ENVIRONMENTAL> • <v.domain> • <p.domain> • <date> • <time> • <session> • <url> • </ENVIRONMENTAL> • <CLIENT> • <school> • <dept> • <rank> • </CLIENT> • <LIBRARY PRGRM> • <service genre> • <staff_name> • <staff_org> • <staff_prgm> • </LIBRARY PRGRM> • <CONTENT> • <title> • <author> • <holdings> • <call_no> • <isbn> • <issn> • <url> • <res_id> • <sfx_id> • </CONTENT> Biblio- graphic Content

  33. Building Frameworks of Organizational Intelligence Schematic Workflow • <ENVIRONMENTAL> • <van_pelt> • <p.location> • <26-jul-2007> • <15:41:01> • <10335905> • < http://www.csa… > • < http://www.library.upe..> • <macOSX> • <safari2.0.4> • </ENVIRONMENTAL> • <CLIENT> • <LIB> • <admin> • <staff> • </CLIENT> • <LIBRARY PRGRM> • <urs> • <olson> • <5035> • <colldev> • </LIBRARY PRGRM> • <CONTENT> • <psycinfo> • <CSA> • <1017-7041> • <1901-3425> • <1452845903> • < http://www.csa… > • <sfx_id> • </CONTENT> Event schema Data Source instructions Penn Community Java- based processes voyager Staff db metridoc.xml Data Store

  34. Building Frameworks of Organizational Intelligence Summary: Exploring new frameworks to achieve greater data integration. Taking advantage of xml extensibility to enrich the descriptive power of library data resources. Aligning management information technology with the broader direction in digital library design. Evaluating the potential for shared, open-source solutions that might promote collaborative data gathering and assessment.

  35. Building Frameworks of Organizational Intelligence Questions? Joe Zucca zucca@pobox.upenn.edu 215-573-4643 University of Pennsylvania Library Office of Planning and Communication

More Related