PaperLens Understanding Research Trends in Conferences using PaperLens

1. PaperLensUnderstanding Research Trends in Conferences using PaperLens Work by Bongshin Lee, Mary Czerwinski, George Robertson, and Benjamin Bederson Presented by Jerry Alan Fails

2. Outline • Problem • Definition • PaperLens Overview • Previous Work • Demo • User Study • Questions

3. Problem PaperLens O(100-1000) O(100) O(10) O(10) O(1) O(1)

4. InfoVis 155 Papers 315 Authors 8 Years of Data 1995 – 2002 Attributes — author name(s), paper title, year of publication, list of references, links to original papers CHI 4073 Papers 6309 Authors 23 Years of Data 1982 – 2004 Had some missing reference data Did some cleanup to identify paper source, year of publication, title, and authors Data Sets Correlations • Year • Topic • Papers/Authors • Co-authors • Cited Papers/Authors

5. Interesting Questions • Which topics have come and gone over the last 23 years in CHI? • Which topics are currently hot in CHI? • Which papers/authors are most frequently referenced by CHI publications? • How has the most frequently referenced papers/authors changed over time? • What is the relationship between researchers?

6. Digital Libraries • ACM Digital Libraries • Additional Info – bibliographic data, references, citings, index terms, collaborative colleagues, peer-to-peer • Tools – discussions, similar articles, review article, save • CiteSeer • Bibliographic data, cited by, active bibliography, similar documents, related by co-citation • Histogram showing distribution of citations • IEEE Explore • HCI Bibliography

7. Galaxy http://in-spire.pnl.gov/2shots/in-spire_tools.jpg

8. ThemeView http://picturethis.pnl.gov/picturet.nsf/All/4J5Q3E?opendocument

9. Envision Query History Graphic View Window Query Window Item Summary Window http://www.dlib.vt.edu/Papers/SIGIR96.Env.html http://www.dlib.vt.edu/projects/Envision/

10. What is PaperLens?

11. InfoVis 155 Papers 315 Authors 8 Years of Data 1995 – 2002 Attributes — author name(s), paper title, year of publication, list of references, links to original papers CHI 4073 Papers 6309 Authors 23 Years of Data 1982 – 2004 Had some missing reference data Did some cleanup to identify paper source, year of publication, title, and authors Data Sets Correlations • Year • Topic • Papers/Authors • Co-authors • Cited Papers/Authors Implications • Viewing a graph!!! • Tight Coupling • Data & UI • Different Views

12. Clustering • Used standard clustering • Criteria • Titles • Weighted more for InfoVis clusters • References • Keywords • Minus • Stop words • Months of the year • Journal and proceeding titles • Version and page numbers • Final Clusters • InfoVis – 5 • CHI – 15 • Joined to create 15 from 22 Table 1. 15 Clusters of CHI papers by topic.

13. InfoVis PaperLens http://www.cs.umd.edu/hcil/InfovisRepository/contest-2004/16/video/PaperLens.html

14. CHI PaperLens http://www.cs.umd.edu/~bongshin/projects/PaperLens/sp275-lee.mov

15. User Study • 8 Users (including 1 pilot) • 4 computer science grad students • 4 full-time researchers in HCI • Age ranges 24-42 • Study • 20 minute tutorial, with think-aloud observations • 16 tasks completed sequentially

16. Tasks • Who published the only paper on Graph Visualization in 1998? • How many papers did S. K. Card publish at InfoVis over the 8 years in our database? • Who were George Robertson’s coauthors on his only paper in the database? • How many degrees of separation exist between S. F. Roth and S. G. Eick? • Which topic area has enjoyed gradual growth over the last 8 years? • Which topic area has all but died out in terms of papers published on that topic over the last 8 years? • Which topic area has had many more papers published on that topic during the last 2 years in our database? • Which authors are in the top 10 most frequently cited list but have not published at InfoVis? • How many papers of the top 10 most frequently cited papers are from InfoVis? • How many papers in the top 10 most frequently cited list are from CHI? • Which topic area references the most frequently cited paper most often? • Go to the most frequently cited InfoVis paper and read it’s abstract. • In the Dynamic Queries topic area, which author is the most frequently cited? • What was the last year that S. K. Card published in this database? • Who was the most frequently cited author in 2001? • How many papers did J. Mackinlay and S. K. Card publish together at InfoVis over the 8 years in our database?

17. Lessons Learned • Simple is Good • An abstract overview • Multiple small, simple components showing different aspects of the data • Relationships shown through interactivity and tightly coupled components • Visual elements laid out along axes with well defined metrics • Scaling Issues • Info Vis • Square paper representation • Fisheye technique to reveal individual paper details • Too many colors (max was 8 colors, indicating 8 co-authors) • CHI • Context menu for details since papers less than one pixel in size • Eliminate fisheye technique • Papers with >5 authors color-coded with a single color

18. User Satisfaction

19. Questions • How does PaperLens allow visualization of a graph, without showing a node-link diagram? • How generalizable is this work? • What design principles may transfer? • Can a general architecture from this UI?