420 likes | 580 Views
EPIC Online Publishing Use and Costs Evaluation Program. Overview. Overview of Evaluation Program Research update. Purpose of EPIC Evaluation Program. To investigate how online electronic resources affect different aspects of the scholarly communication process. a) general perspective
E N D
Overview • Overview of Evaluation Program • Research update
Purpose of EPIC Evaluation Program • To investigate how online electronic resources affect different aspects of the scholarly communication process. • a) general perspective • b) through lens of EPIC projects
How Does the Shift to Electronic Resources Affect the Following Groups? • Publishers • Administrators/Information Technology • Librarians • Faculty • Students
Research Approach • Interviews • Focus Groups • Surveys • Weblog analysis Info gathering Survey development
Research Projects to Date • Librarian Focus Group • Librarian Online Survey • Faculty Interviews • Faculty Online Survey • Student Interviews • Student Online Survey • http://epic.columbia.edu/eval/
Methodology • a 15 minute online survey of librarians was conducted in Winter, 2002 • e-mail invitations were sent to librarians at higher education institutions across the country • All were librarians at institutions that are either CIAO or Earthscape subscribers, or have been identified as being potential subscribers • 1007 respondents (response rate: 32%)
Objectives • Learn what librarians perceive as the benefits and disadvantages of electronic resources. • Gain insights into how electronic resources affect the role of the librarian. • Gain insights into how electronic resources affect the role of print resources.
Conclusions from Librarian Survey • Electronic Resources: • Allow libraries to serve patrons more effectively • Put a strain on some libraries • Do not replace print resources
Methods • a 25 minute online survey of faculty and graduate students was conducted in Winter 2003 • e-mail invitations were sent to scholars at higher education institutions across the country • scholars were involved in the disciplines of International Affairs or Earth Sciences • 845 respondents (response rate 14%)
Objectives • Gain insights into how academics are using electronic resources in their academic work • Gain insights into the perceived benefits and disadvantages of electronic resources • Learn how academics perceive electronic resources as affecting undergraduate students’ scholarship • Examine differences based on stage of career, type of discipline, and type of institution
Perceived Benefits and Disadvantagesof UsingElectronic Resources
Benefits of Electronic Resources--ConvenienceN=845 Slide 1 of 2
Benefits of Electronic Resources—Improved Availability N=845 Slide 2 of 2
Benefits and Disadvantages by DisciplineN=845 All of the differences in means by discipline on this chart are statistically significant.
Benefits and Disadvantages by SeniorityN=845 All of the differences in means by seniority on this chart are statistically significant.
Use of Electronic Resources for Teaching by DisciplineN=419 All of the differences in means by discipline on this chart are statistically significant.
Electronic Resources & Students—BenefitsN=419 Slide 1 of 2
Electronic Resources & Students—ProblemsN=419 Slide 2 of 2
Class Time Spent Instructing Students How to Evaluate Online InformationN=419
Availability of Courses Instructing Students How to Evaluate Electronic ResourcesN=419
The Effect of Electronic Resources on Overall Quality of Students’ Learning ExperienceN=419 MEAN4.00
Ability to download Ability to print Currency of info Speed of sites Reputation of providers Text in PDF or other standard format Full text available Search capabilities Ease of Navigation Availability of older/archived information Ability to tell if peer reviewed Important and Satisfied Important and Not Satisfied
Other suggestions • Reduce price • Standardize navigation and search procedures across databases • Synthesize databases so that they are accessible through a single portal • Faster turn-around time/More frequent updates • Clearly identify or label sources
Conclusions • Electronic resources have become the main tool for scholars’ information gathering. • Electronic resources are seen as providing convenience more so than increased availability of information. • The main problem with electronic resources is having to separate out reliable from unreliable information. • Most faculty believe students have an enhanced learning experience because of the information available through electronic resources. • Future efforts could focus on providing increased access to older and full text material, and improving search and navigation capabilities.
Christina Norman, Ph.D. Research Director, EPIC Columbia University 211 International Affairs Building 420 West 118th Street, Mail Code 3301 New York, NY 10027 cn2005@columbia.edu EPIC evaluation web site: http://epic.columbia.edu/eval/