50 likes | 56 Views
Explore the intricacies of the conference paper reviewing process, selection models, criteria, and the importance of providing constructive feedback to authors for scientific advancement. Learn the best practices to ensure fair and impactful reviews.
E N D
The Reviewing ProcessMarie desJardinsAAAI-13 PanelConference Reviewing Best Practices
Conference Reviewing • Program committees • Selection process • Different models/roles: • Senior vs. area chair vs. regular members • Paper assignments • Keyword-based • Similarity-based (compare to reviewer’s published papers) • Self-selection (bidding) • Discussion and author response • Decisions Review Process and Quality
Purpose of a Review • Evaluate the paper’s scientific merit • Check the validity of the paper’s claims and evidence • Judge the paper’s relevance and significance • Provide constructive feedback to the author Review Process and Quality
AAAI-13 Review Criteria • Goal: identify “interesting but flawed” papers and make sure they are reviewed fairly • Different ways in which a paper can make a contribution • Avoid a conference full of “technically acceptable but uninteresting and incremental” papers • Quality criteria: • Technical quality • Experimental analysis • Formal analysis • Clarity/presentation • Innovation criteria: • Novelty/innovation of question / solution • Impact criteria: • Breadth of interest • Potential for impact Review Process and Quality
Good Reviews Are... • Polite • Fair • Concise • Clear • Constructive • Specific • Well documented • Represent the scientific community Review Process and Quality