1 / 20

Bibliometric Analysis in Social Sciences and Humanities: paradigm shift and mutual challenges

Bibliometric Analysis in Social Sciences and Humanities: paradigm shift and mutual challenges. João Costa Investigação e Ensino na NOVA June 29, 2012. OUTLINE. Bibliometrics in SSH: a paradigm shift and the response of the area .

giulia
Download Presentation

Bibliometric Analysis in Social Sciences and Humanities: paradigm shift and mutual challenges

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Bibliometric Analysis in Social Sciences and Humanities:paradigm shift and mutual challenges João CostaInvestigação e Ensino na NOVA June 29, 2012

  2. OUTLINE Bibliometrics in SSH: a paradigmshiftandthe response ofthearea. Thechallengetakenbyinstitutionsandindividuals (the case of FCSH). Theshortcomingsofbibliometrics. Thechallenge for SSH. Thechallenge for bibliometrics.

  3. A Paradigm Shift Common (andold) assumptions for evaluatingscience in SSH: (Double-blinded) peerreview as a standard; Booksandbookchapters are as important as journalarticles; Major journalseditmonograph series for longerarticles; Major conferenceseditbookswithselectedpapers; Citation in anytypeofformatsignalsimpact; Impactcomparedwithinareasanddomains. BOOKS are a major signalofacademicachievement. CITATIONsignalsimpact.

  4. A Paradigm Shift New assumptions/concepts: Impactfactors; Journalswithhigherrelevancethanbooksorbookchapters; No clear place for “cultural” products; Comparabilityacrossdifferentareas. BOOKSlostrelevance. MARKERS OF IMPACT suddenlychanged. SSH suddenlyperceived as areaswithlittleimpact.

  5. The SSH response Perceptionthatadherence to paradigmshiftiscondition for access to funding; Investmentondiversificationofpublicationtypes. LEIDEN STUDY witnessesthegrowthof SSH in therelevantpublicationtypes.

  6. The SSH response – the case of FCSH Rapidincreaseandinvestment in publicationsindexed in CI (source: Converis)

  7. The SSH response – the case of FCSH Institutionalstimulus for investment in indexedpublications: Individual productivityprizes; Productivityprizes to I&D centers; Membershipassessmentbasedon CI publications in certain I&D centers. Clear assumptionofchallenge.

  8. The shortcoming of bibliometrics Leiden Study:

  9. The shortcoming of bibliometrics Coverage: FCSH productivity in 2011 (including: articles in peer-reviewedjournals, books as author/editor, bookchapters, peerreviewedconferenceproceedings, journalissue) Total: 1170 Indexed: 55 (4,7%)

  10. The shortcoming of bibliometrics Coverage and weakness in assessing impact (R. Santos): Quadro 1. Numbers of cited references and proportion indexed in WoK. Source: Random sample of articles in WoS published in 2011.

  11. The shortcoming of bibliometrics Hiding relevant work: Three examples: INET-ID: production of materials supporting the promotion of FADO to World Intangible Heritage by UNESCO.

  12. The shortcoming of bibliometrics Hiding relevant work: Three examples: IELT: Collection of oral patrimony.

  13. The shortcoming of bibliometrics Hiding relevant work: Three examples: CHAM: Underwater Archaeology

  14. The shortcoming of bibliometrics Coverage: highly cited authors Book citations in 2007 (source: Times Higher Education with Thomson) Anthony Giddens (sociology) 1303 Noam Chomsky (linguistics) 812 Judith Butler (philosophy) 960 Ulrich Beck (sociology) 733 Jurgen Habermas (philosophy) 1049

  15. The shortcoming of bibliometrics Coverage: highly cited authors Occurrences and citations in WoS Anthony Giddens (sociology) 3 / 1 Noam Chomsky (linguistics) 19 /79 Judith Butler (philosophy) 21 / 57 Ulrich Beck (sociology) 0 / 0 Jurgen Habermas (philosophy) 3/0

  16. The challenge for SSH Precise identificationofmarkersof research performance. Clear adherence to evaluationof research (peer-reviewing, etc.) Ranking ofscientificproducts.

  17. The challenge for bibliometry Developmentofspecifictools for different research areas; Identificationofcorrespondencesacrossareas(e.g. what’sthe SSH correspondentof a short article in Chemistry in termsofimpact/work volume?)

  18. The challenge for bibliometry Inclusionofdomain-specificproducts (e.g. patrimonycollections, materials for languagepolicy, educationmaterials, research-based cultural products, etc.)

  19. The challenge for evaluation Makesurethatevaluation takes intoaccounttheactualproductivityinsteadoffocusingonimposing a newtypologyof research products.

  20. Conclusion: mutual challenges More impact, widercoverageandstrongerinternationalprofile for the SSH will come aboutifbibliometricsistakenseriously, andifthespecificityof SSH istakenseriouslybybibliometrics.

More Related