周文杰（ Cell:+86-13359483186 E-mail: wj_lp@sina） Jo Bell Whitlatch

中国乡村图书馆的评估--------测试青树图书馆评估体系User Focused Assessment for Rural Libraries in China: Testing the Evergreen Assessment Framework 周文杰（Cell:+86-13359483186 E-mail: wj_lp@sina.com） Jo Bell Whitlatch Carol Priestley 2010.06

本文是周文杰、Jo Bell Whitlatch和Carol Priestley合作撰写的论文--- User Focused Assessment for Rural Libraries in China: Testing the Evergreen Assessment Framework的中文稿, Pro. Jo Bell Whitlatch负责设计了本评估体系。 • This presentation is based on the paper authored by Wenjie Zhou, Jo Bell Whitlatch and Carol Priestley. Prof. Jo Bell Whitlatch designed the Evergreen Assessment Framework.

前言Introduction • 本研究的目的是讨论青树图书馆评估体系的成效和影响力。本演讲在介绍青树目前建立的评估指标体系和基础上，根据对评估指标体系的测试结果，从两个方面进行讨论：1）收集得到的评估数据反映了天祝青树图书馆何种价值？2）对评估指标体系中的指标在收集评估信息中的有效性进行研究。 • The main purpose of the paper is to discuss testing the Evergreen Assessment Framework for measuring the performance and impact of libraries. First, we provide background to programs in rural China. Next, we introduce the Assessment Framework. Finally, we discuss the results of testing the framework: (1) What does the data collected reveal about the value of libraries in Tianzhu? and (2) How effective are the instruments in collecting the information .

青树图书馆评估体系的构建Evergreen Library Assessment Framework(ELAF) • 青树图书馆评估指标体系体系建立的基本着眼点是评估图书馆对社区所产生的积极作用，基本立足点在于成效测评。本评估指标体系并不聚焦于诸如具体图书的借阅率、图书馆员的工作量等图书馆内员工的绩效或馆内效率等方面，而是评估图书馆的社会效益----即因图书馆而产生的社区价值及提升。本评估指标体系重点参照了联合国教科文组织编写的《发展中国家农村地区信息提供：成效和影响力评估》。 • The main focus of the assessment plan is on benefits to the community – on outcome measures. These measures are not focused upon the internal operations of the staff, or internal efficiency measures, such as the rate at which books are cataloged, or on staff workload, but rather on the value community libraries add to the community. The framework used for the plan is adapted from Rural information provision in developing countries: Measuring performance and impact. http://unesdoc.unesco.org/images/0011/001115/111532eo.pdf

青树图书馆评估指标体系指标设置Indicators of ELAF • 在目前所设立的青树图书馆评估指标体系中，设计了7个需求指标和2个可选指标，所有指标的目的是确认图书馆是如何有效地服务社区的。 • Evergreen has developed seven required indicators and two optional measures to determine how well libraries are serving their communities.

需求指标 Required Indicators • 用户满意度（Satisfaction of users needs） • 学生的学业成效（Academic performance of students） • 可获取性（Accessibility） • 基于图书馆的活动与项目（Activities and programs） • 信息资源（Information materials） • 信息咨询（Consultations） • 技术满足度（Technology）。

可选指标Optional Measures • 社区满意度（Satisfaction of community needs） • 外部信息资源（External information sources）。

青树图书馆评估框架(ELAF）The Evergreen Library Assessment Framework • 青树评估框架是一个综合评估指标、评估方法、数据需求、数据收集和计算方法的综合架构。本框架的目的是在数据收集完成后确定各项指标在最终结果中的权重和位置。 • The Evergreen Assessment Framework summarizes the indicator area, indicator measures, data required, data collection instruments and method of calculation after data has been collected to determine values for indicator measures.

ELAF数据收集的工具The data collection instruments • 主要包括：管理数据统计表，图书馆管理软件所提供的在线书目及服务信息综合统计，针对社区成员的调查，针对图书馆到访用户的调查，针对参与图书馆项目学生的项目调查，针对儿童文化教育项目的参与者的项目调查，针对基于图书馆的农业活动项目的参与者的项目调查，馆员访谈和核心组访谈。 • The data collection instruments have been in draft form: (1) Administrative Statistics form is completed by library or school administrative staff and includes information collected from a tally of annual library visits; (2) Summary of Statistics Desired from the Library Computer Database captures information generated by the online catalog system; (3) Community Survey completed by community members; (4) User Library Survey completed by visitors to the library; (5) Program Survey: Class Instruction completed by students; (6) Program Survey: Early Childhood Literacy completed by participants in literacy programs; (7) Program Survey: Agricultural Activity completed by participants in agricultural projects; (8) Librarian Interview form; and (9) Focus Group form.

对评估指标体系的测试----基于天祝青树图书馆Testing the Framework: What does the Data Collected Reveal about the Value of Libraries in Tianzhu? • 2010年2月，我们在天祝青树图书馆进行了调查并随机抽取了100份问卷进行分析，以揭示如何将收集到的信息应用到使用评估框架中的计算方法和确定图书馆成效的层次。本演讲中并不分析数据所反映的图书馆实际情况，只是将这些数据作为例子来测试如何应用评估指标体系。未来，在真正应用本评估体系进行图书馆评估时，需要至少400个调查样本以及全年的项目数据等。 • Using data collected at Tianzhu to test the framework, we will illustrate how the indictors and their associated measures are useful in assessing the value of libraries to the Tianzhu community. Under each indicator area below, the associated measures are provided illustrated with results from the data collected at Tianzhu. In this paper, we are using sample data from 100 responses to illustrate how the information collected is utilized in developing indicator measures and performance levels. For a true test, one needs at least 400 responses for each survey, a full year to collect program surveys, and so forth.

需求指标 Required Indicators （1） • 用户满意度 • ----服务质量的满意度，由两项指标组成： • 用户调查中“比较满意+十分满意”所占比率=68/99=68.7% • 社区用户调查中“好+非常好”所占比率=16/92=17.4% • Satisfaction of users needs • --Percentage of users satisfied with the quality of service process • User Survey results quite satisfied + very satisfied = 68/99 =68.7% • Community Survey results good + very good = 16/92 = 17.4%

需求指标 Required Indicators（2） • 用户在图书馆访问期间的信息需求的满足率：用户调查结果中的“满足+比较能够满足+比较有限”所占比率=31/80=38.8% • Percentage of users that found needed information on library visit：User Survey results yes, exactly + yes, with limitations= 31/80=38.8%

需求指标 Required Indicators（3） • 图书馆综合效益测试：读者方面--图书馆对用户而言提供的服务状况“非常好+好”的比率=34/100=34%，社区用户方面---最近3个月内平均每个受访用户从图书馆借书6.93册。估计可平均节约92元购书或租书费用。社区用户方面---用户认为图书馆对于个人的最大价值：促进健康：26/124=21%；学得新技能：22/124=17.7%；理解当地和民族的文化：19/124=15.3%。社区方面---图书馆对当地社区的主要贡献：丰富社区成员文化生活：51/115=43.2%；提升社区成员的教育水平：30/118=16.9%；获取与工作相关的知识和技能：20/118=16.9%；学习新知识：17/118=14.4%. • Summary of benefits received • User Survey – Value of library services to you very good + good=34/100=34.0% • Community Survey – On average 6.93 books borrowed from library in 3 months per person with an estimated savings of 92 RMB in purchase or rental costs. • Community Survey – Personal Benefits of the Library – top three listed：Improving health 26/124 = 21%，New skills 22/124 = 17.7%，Understanding local and national issues 19/124 = 15.3% • Community Survey – Major Benefits of Library to Local Community • Enrich cultural life 51/118 = 43.2% • Improve education of community members 30/118 = 25.4% • Acquire practical work related knowledge & skills 20/118 = 16.9% • Learn new knowledge 17/118 = 14.4%

需求指标 Required Indicators（4） • 青树项目学校学生学业成绩状况测试 • 考虑到在青树图书馆目前的模式中，学校图书馆居于一个相对重要位置，因此对青树图书馆的评估必须同时关注青树项目学校学生的学业表现。基于此，在本指标体系中，图书馆对学生学业成绩的影响也被纳入到了评估指标之中。具体的评估项目有高考上线率，大专院校的入学率，初中会考合格率等。 • Academic performance of students • Percentage pass rate for high school students in national examinations each year=33% • --College admission rates by category of college=18% • Tier 1 44/1290=3.4% • Tier 2 185/1290=14.3% • Tier 3 380/1290=29.5% • --Annual percentage of students graduating from middle school and enrolling in high school=Since Tianzhu No.1 high school has no middle school, so these data is not available now. But this indicator will be very useful in future assessment when more Evergreen Libraries are involved.

需求指标 Required Indicators（5） • 可获取性： • 图书馆用户覆盖社区居民状况及读者访问图书馆情况： • 2009年访问天祝一中青树图书馆用户数13000人/居于周边5公里范围内的总居民数60000=0.22，因此社区人均到馆率为22%. • 天祝一中青树图书馆平均开放时间=每周50小时。 • 天祝一中所在社区居民的平均休闲时间=72小时。 • Accessibility • --Visits per capita • For 2009 13000/60000 (population within 5KM) = 0.22 visits per capita • --Average total open hours per week=50 hours • --Average community leisure hours per week=72 hours

需求指标 Required Indicators（6） • 基于图书馆的社区活动和项目开展情况 • 每年每个项目的参加人数及比率（Program attendance per capita per year）：因为天祝青树图书馆的项目于2009年底才正式展开，本次测试未获得全年数据。 • 项目对参加者的实际影响力： • 受测100个样本中46个样本认为项目内容非常好，1个样本认为项目内容还需要完善。 • 受测100个样本中42个样本认为项目非常有用，1个样本认为认为比较有用。 • Activities and programs • --Program attendance per capita per year • Not calculated – two samples completed with 47 attendees • --Summary of value/benefits reported by program attendees • 46 rated program content very good and 1 needs improvement • 42 rated personal value as very useful and 1 as somewhat useful

需求指标 Required Indicators（7） • 馆藏信息资料流通情况评估指标 • 馆藏流通率：天祝一中青树图书馆2009年度馆藏流通率=17906次借阅/周边5公里范围内社区总人口60000人=0.30，图书册均使用率（volumes circulating per capita）为30%. • 新增馆藏率：2009年度天祝一中青树图书馆新增馆藏7230/本馆藏总馆藏数96257=7.5%. • Information materials • --Circulation per capita per year • For 2009 17906/60000 (population within 5KM) =0.30 volumes circulating per capita • --Percentage currency of collection • Not available, useful substitute is new annual acquisitions/total collection • 7230/96257 = 7.5% of total collection represents materials acquired in last year

需求指标 Required Indicators（8） • 参考咨询服务指标：本次测评中未获得此方面数据。 • 技术指标：每位图书馆用户每年使用图书馆公用计算机的上网率及使用率，本次测评未获得此方面数据。 • Consultations • --In building use per capita per year • Not available • Technology • --Public internet computer uses per capita per year • Not available

可选指标 Optional （1） • 社区需求统计指标，主要指社区领导者所关注和认为有重要价值的指标项。本次测评中未获得此关于社区的核心成员（主要指社区领导或者其他有影响力的社区成员）方面的数据，对于其他社区成员的统计结果已被包含在了上述需求指标测评的有关指标之中。 • Satisfaction of community needs • --Summary of major benefits and issues identified by community leaders • Not Collected via Focus Group form but Community Survey results are included above

可选指标 Optional （2） • 社区其他信息源测评 • 本次测评中发现图书馆以外的其他信息源还包括：老年人活动中心，农业技术服务中心，当地诊所以及当地学校。 • External information sources • --Number of information sources in the community • Senior people’s health care center; agriculture technology station; local clinic; local school

综合讨论 Discussion (1) • 过去几年中，天祝青树图书馆自行组织对馆员提供了培训服务。今后，天祝青树图书馆还须加强对馆员的培训工作，提高对馆员培训的水平，提供诸如在线远程培训的方式共享培训资源，建立在线培训论坛以相互交流经验等方面的服务。 • For the past few years, Tianzhu Evergreen Library has provided training sessions for its staff. Tianzhu Evergreen Library should continue to provide conference and training sessions and create more training avenues for its staff, such as online training sessions and materials and online discussion forums for exchanging expertise and ideas among Tianzhu Evergreen Library staff.

综合讨论 Discussion (2) • 天祝一中青树图书馆仅有17台计算机用于公用使用，但有20.2%有用户报告他们认为图书馆最有价值的资源应该是“网上可存取的电子资源”，显然反映了该馆设备的不足。未来，青树图书馆应该提供更多的硬件设备、服务软件、电子资源以及对图书使用计算机和网络的培训服务。 • Tianzhu No.1 High School libraries only can provide 17 computers for public use in the library. However, 20.2% reported that the service they valued in terms of materials most in a library was “electronic resources accessible on the Internet.” So the library should provide more hardware, software, electronic resources, and training sessions for readers to let them have more opportunities to use computer to access electronic resources on their visit.

结论Conclusion (1) • 通过对目前各项指标的重新审视，以及今后本评估体系在更多图书馆的应用和反思，一系列关于农村信息提供与服务的策略和问题就浮出了水面。例如： • 图书馆目前的目标符合社区的需求吗？这些图书馆需要反思吗？ • 何种类型的馆员在中心图书馆是称职的？他们需要什么样的训练？ • 什么样的馆藏是最需要的？何种形式最好？从哪里可以获得这些馆藏？ • 什么样的硬件设备是急需的？ • 何种信息服务活动对社区来说是最重要的？ • When the present indicators are reexamined, revised and applied to more libraries, they are likely to raise a number of issues and options for the development of strategies for rural information provision. • For example: • - Do the objectives of the library reflect community needs? Or do they need revision? • - What type of staff should be employed in the Centre? And what training do they need? • - What materials should be held, in which format and where should they come from? • - What physical facilities are required? • - What sorts of information activities have the most impact on the well-being of the community?

结论Conclusion (2) • 除非农村信息中心能够提供对社区有用的东西，否则实现这些机构未来可持续的发展是不可能的。诚然，完善评估体系和评估程序是重要的，因此通过评估过程和对评估结果的分析，可以明确地确定图书馆工作的实际绩效。但更重要的是通过评估促使图书馆主动适应社区的需要，这一价值事实上远远大于评估本身的价值。EEF和CERLS已经把评估放在了一个高度优先的位置上，并为此进行了大量探索，这种探索将通过青树的各种会议和培训继续下去，以期在未来更加完善。 • Unless a rural information centre can prove that it is ‘useful’ to its community, then the human and financial support necessary to sustain the service will not be forthcoming. • Development of a process for identifying indicators for assessment is important, however, thorough analysis and interpretation of the results, and then using the results to develop and strengthen libraries to meet community needs are even more important. Evergreen and CERLS have therefore given assessment a high priority and their work in this area, in this conference, in the Assessment workshop and in the coming years will continue to be valuable.

Thanks

周文杰（ Cell:+86-13359483186 E-mail: wj_lp@sina） Jo Bell Whitlatch