80 likes | 258 Views
A good paper. Prof. Bennett Math Model of Learning and Discovery Based on web page by Pat Langley. Outline. What’s in a good paper Design and Evaluation. Well Crafted Paper Contains. State the goals of the research and the criteria by which readers should evaluate the approach.
E N D
A good paper Prof. Bennett Math Model of Learning and Discovery Based on web page by Pat Langley
Outline • What’s in a good paper • Design and Evaluation
Well Crafted Paper Contains • State the goals of the research and the criteria by which readers should evaluate the approach. • Specify the performance and learning tasks • Describe the representation and organization of the system's knowledge, along with the representation of training data. Examples are good. • Explain both the performance and learning components of the system in enough detail that readers can reimplement them.
Well Crafted Paper Contains • Evaluate the approach to learning, computationally or theoretically. • Relate the approach to other methods, • State the limitations of the approach and suggest directions for future research. Go beyond a list of problems to propose tentative solutions.
Experimental Design • Discussion based on Moore’s notes www.cs.cmu.edu/~awm/tutorials/overfit.html • Note two issues: • How to tune your method. • How to compare methods.
Salzberg suggests • Compare with other algorithms – include one that is most similar • Choose benchmark illustrating strengths of proposed method • Do K-fold CV • tuning set must be picked from training fold • Note people now do K-fold many times and report average but Salzberg says this is bad • Use statistical test for significance (more on another day)
Title and Abstract • 4.1 Title and Abstract • Title informative but not overly long. • Brief abstract that let’s readers scan it quickly for an overview of the paper's content.
Good paper style • Partition parts and give subheadings • General Principle Tell what you are going to tell them. Tell them Tell them what you told them. • Use good grammar. Full sentences. • Include Bibliography • Figures, Graphs, Tables, Pseudocode can help a lot. Make sure to provide appropriate captions.