Web site evaluation and quality issues

1. Web site evaluation and quality issues The BIOME approach to quality issues and Web site evaluation

2. Quality overview • Many concerns about the quality of information on the Internet • End user evaluation of Internet resources • The BIOME approach to Web site evaluation • Health quackery and health fraud

3. Issues of quality on the Internet • Sheer volume of information • Ephemeral nature of much information • Ease of self-publishing • Lack of peer-review or editorial and refereeing processes • Possible serious consequences of inaccurate health information

4. Quality • Concerns and limitations associated with the use of popular search tools • Output lacks context • Large numbers of hits • No quality control • Easy to manipulate – word spamming

5. BIOME Evaluation Guidelines • http://biome.ac.uk/guidelines/eval/ • BIOME approach assesses the applicability of each information resource for its inclusion into BIOME • We are concerned with indirect indicators of quality • The onus will always lie with the individual BIOME user in deciding whether the resource is right for them

6. BIOME Evaluation Guidelines Three broad elements of a resource are examined: • Context • Content • Format

7. Evaluation criteria in detail I Context • Scope – what is the subject scope and is it relevant to the BIOME community • Audience – who is it intended for? • Authority – who has produced it? Are they medically qualified? • Provenance – how long has the resource been available? Is it stable?

8. Evaluation criteria in detail II Content • Coverage – what is the subject coverage of the resource? Is it at a suitable level for the BIOME user? • Accuracy – has there been an editing process? Is there any evidence that the source may be biased? • Currency – is the information up-to-date? How frequently is it updated?

9. Evaluation criteria in detail III Format • Accessibility – are there any access restrictions or special requirements? Is there authentication problems? Charging? • Design and layout – is the site functional? Well designed? Images used appropriately? Choice of display formats? • Ease of use – Is it easy to use? Online help provided?

10. Alternative and Complementary Medicine • BIOME Guidelines developed for complementary and alternative medicine • Evolving document available at http://biome.ac.uk/guidelines/eval/cam.html • Due to the ‘controversial’ nature of this topic, separate guidelines had to be developed

11. Conducting your own evaluation of a resource Step 1: follow links to find out about the resource Step 2: analyse the URL Step 3: examine the information within the resource Step 4: consider the accessibility, design and layout, also the ease of use Step 5: obtain any additional information about the resource Full-text version of this document is available at http://biome.ac.uk/text/guidelines/eval/howto.html

12. Useful resources on Web site evaluation issues • MedlinePlus –Evaluating Health Information http://www.nlm.nih.gov/medlineplus/evaluatinghealthinformation.html • Centre for Health Information Quality (CHIQ) Hi Quality guidelines • eHealth Code of Ethics http://www.ihealthcoalition.org/ethics/code0524.pdf • National Center for Complementary and Alternative Medicine http://nccam.nih.gov/health/webresources/