1 / 33

CSCD555 Research Methods

CSCD555 Research Methods. Lecture 4 CS Body of Literature Winter 2011. Managing CS Literature. There are too many conferences, workshops, symposia one has to keep track of (at least in most areas) ‏ Same for journals, newsletters, bulletins etc.

ellard
Download Presentation

CSCD555 Research Methods

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CSCD555 Research Methods Lecture 4 CS Body of Literature Winter 2011

  2. Managing CS Literature • There are too many conferences, workshops, symposia one has to keep track of (at least in most areas)‏ • Same for journals, newsletters, bulletins etc. • There is a huge amount of CS literature on the Web, including theses, online books, technical reports...

  3. Managing CS Literature • Solution • Make extensive use of existing literature search tools • Assuming that you know what your research focus is...

  4. More CS Collections • Computer Science Bibliography Server (DBLP)‏ • We didn't talk about this one, next slides • ACM Portal • IEEE Xplore • Google Scholar • Science Direct • CiteSeer • Networked Computer Science Technical Reference Library (NCSTRL)‏ • Collection of Computer Science Bibliographies, next slides

  5. http://dblp.uni-trier.de

  6. Computer Science Bibliographies • http://liinwww.ira.uka.de/bibliography/

  7. Microsoft Libra • http://academic.research.microsoft.com/ • Help explanation page: http://academic.research.microsoft.com/About/Help.htm

  8. Citeseer http://citeseer.ist.psu.edu/

  9. Literature Searches • Useful one is an entire journal of Surveys • Survey/Review Papers • ACM Computing Surveys Journal

  10. Impact Factor • The impact factor, IF, a measure reflecting the average number of citations to articles published in science and social science journals • Frequently used as a proxy for the relative importance of a journal within its field, • Journals with higher impact factors deemed more important than those with lower ones • Impact factor was devised by Eugene Garfield, the founder of the Institute for Scientific Information (ISI), now part of Thomson Reuters. • Impact factors calculated yearly for those journals that are indexed in Thomson Reuter's Journal Citation Reports

  11. Calculating Impact Factor Calculating Impact Factor Calculating Impact Factor • WHAT IS AN IMPACT FACTOR? • The journal impact factor is a measure of the frequency with which the average article in a journal has been cited in a particular year. The impact factor helps you evaluate a journal's relative importance, especially when you compare it to others in the same field. The impact factor is calculated by dividing the number of citations in the current year to articles published in the two previous years by the total number of articles published in the two previous years. Using Journal X as an example: Cites in 2007 to articles published in: 2006 1266 2005 1643 sum 290 Number of articles published in: 2006 352 2005 364 Sum 716 Calculation: Total cites to articles published in 2005 and 2006 2909 = 4.063 Number of articles 716 published in 2005 and 2006 The 2007 Impact Factor for Journal X is 4.063

  12. Some Impact Factors • Elsevier CS Journals cite impact factor http://about.elsevier.com/impactfactor/author-reports-19634/webpage/author-webpage-19634.html • Another Ranking Website for Journals http://www.scimagojr.com/journalrank.php

  13. Identifying Notable Authors • Not as easy as a journal citation index • Would look at the number of times author cited • Also, the quality of conferences • Body of work from this author • His graduate students • His institution, prestigious or not • All of the above will provide some clues as to the importance of the author in his/her field • Also something called h-index and g-index • Microsoft explains this: http://academic.research.microsoft.com/About/Help.htm Barbara Liskov of MIT

  14. Conferences vs. Journals

  15. Conferences vs. Journals • Why to prefer a conference • Conferences have higher status • Part this is historical artifact of field of computer science, but it is self-perpetuating since best researchers want to send their papers to conferences rather than journals • Conferences provide higher visibility and greater impact • Many people will attend your talk, you will have the opportunity to answer questions, and people will talk to both you and to one another in the hallways • Even disregarding the event itself, more non-attendees read conference proceedings than read journals

  16. Conferences vs. Journals • Conferences have higher quality • Acceptance rates to good conferences are often around 10%, at least in software engineering .. whereas even the best journals are less selective • Naturally, there exist low-quality conferences (and journals), but if your c.v. is cluttered with them, then you will appear to be incapable of good work (even if the work you published in those venues really is good!), and your good publications will not stand out • A good rule of thumb is that the best conferences are sponsored by ACM or IEEE

  17. Conferences vs. Journals • Conferences are more timely • It can take years for a journal publication to appear (or even for reviews to come back), • Whereas the turnaround time for conference reviews is a few months, and the proceedings also appear quickly • Conferences have higher standards of novelty • Journals often only require 20-30% of the material to be new, compared to an earlier conference version

  18. Conferences vs. Journals • Why to prefer a journal • Journals may have longer page limits. • If you have too many experimental results to fit in a conference publication, then a journal affords an opportunity to include them • You can also include proofs that are too long (or boring) for a shorter publication. • Journal reviews tend to be more detailed. A journal reviewer may spend days on a paper, whereas a conference reviewer cannot afford to do so for each of the many papers he or she is assigned

  19. The Case for Journals • Journals have higher acceptance rates • More chance to get your research published • Same is true of workshops • Good venues for people who are just starting their research careers • Some lesser-ranked universities evaluate faculty on basis of journal publications • Because Dean of Engineering is unable or unwilling to understand computer science • A top-ranked CS department can convince the dean to use the proper evaluation metric

  20. Case for Journals • Best papers at a conference are often solicited for expedited journal publication • I sometimes decline these opportunities, but your circumstances may be different • Whether you accept this invitation should be based on the factors above, such as whether there is value to the community of an expanded version of the paper, and how much more work it is to prepare the journal version http://www.cs.washington.edu/homes/mernst/advice/ conferences-vs-journals.html

  21. A Study that Confirms This • One commonly considered indicator of quality of a journal is its impact factor • As stated previously • Published yearly by Thomson ISI in the Journal Citation Report (JCR) by counts of the citations from articles of thousands of journals • Research results in computer science are often published in high-quality conferences which are not covered by the JCR citation databases

  22. Conferences Rule • Several recent system developments capture citation numbers for both journal and conference publications especially in computer science, • Citeseer, the ACM Digital Library, Microsoft Libra (Libra) and Google Scholar (GS)‏ • For example, Libra holds more than 900,000 computer science publications and more than 3.5 million citations to them as of December 2007

  23. Conferences Rule • The majority of papers appeared in conferences and workshops, not in journals. Furthermore, the total number of citations is higher for conferences and workshops than for journals

  24. Conferences Rule • Authors used cleaned citation data from GS for an in-depth citation analysis for database research, a subfield of computer science research • Analyzed all publications over a period of 10 years (1994–2003) which appeared in top database conferences and top database journals • Two top conferences (ACM Sigmod, VLDB) not only publish many more papers than the top journals (ACM TODS, VLDB Journal) but that they receive many more citations in total and per paper

  25. Conferences Rule

  26. Citation • Comparing the scientific impact of conference and journal publications in computer science • By Erhard Rahm http://iospress.metapress.com/content/v3343450241483q7/

  27. How to find Conferences and Journals for your Specialty • ACM http://www.acm.org/conferences • IEEE - Communications Society http://www.comsoc.org/conferences/conferencesearch • IEEE Computer Society http://www.computer.org/portal/web/conferences/calendar • Networks http://www.eet.unsw.edu.au/~timm/netconf/

  28. Journals and Magazines • IEEE Computer Society Publications • http://www.computer.org/portal/web/csdl/home • ACM Digital Libaray • http://portal.acm.org/

  29. End • New Assignment • See the Assignments page • On trying out the cool new Databases of articles

  30. Summary Conferences vs. Journals • Conferences • More impact in the CS field • Many more conferences than journals • More current results, more papers • Journals • Longer time to publication • More thorough review process • Longer, more thorough papers (in general)‏

More Related