120 likes | 235 Views
NLSCY – Suggestions for papers. NLSCY - National Longitudinal Survey of Children and Youth. Objectives of the Presentation. Emphasize proper ways to use the NLSCY data Identify the key factors we are looking at when reviewing a paper. NLSCY.
E N D
NLSCY – Suggestions for papers NLSCY - National Longitudinal Survey of Children and Youth
Objectives of the Presentation • Emphasize proper ways to use the NLSCY data • Identify the key factors we are looking at when reviewing a paper
NLSCY • NLSCY is a longitudinal survey with a complex sample design • As a result, the data must be used properly: • Data limitations must be known • Weights, variance, valid statistical tests must be used
The factors – What are we looking for when reviewing a paper? • 1 - Data sources, domain of study • 2 - Type of study • 3 - Use of the design weights • 4 - Proper variance calculation • 5 - Statistical tests and analytical methods
The factors – 1 - Data sources • Are the data sources clearly identified? • Cycle(s) used? • Which subgroups or domains? • Which variables are used? • NLSCY target population well defined? • Are the NLSCY data limitations clearly identified?
The factors – 1 - Data sources (cont’d) • Responses rates to the key variables stated? • How is the partial non-response handled? • Sample sizes provided? Are the sample sizes sufficient? Confidentiality issues?
The factors – 2 - Type of study • What type of study is done? • Longitudinal? • Cross-sectional • NLSCY used as a repeated survey? • Mix of the above?
The factors – 3 - Design weights • Are the design weights used? • Appropriate weights (cross-sectional, longitudinal) used? • Revised weights or the original weights? • Re-weighting done to account for the partial non-response? • If the weights are not used, why?
The factors – 4 - Variance • How is the variance calculated for all the estimates? • CV look-up tables? • Excel spreadsheet with CVs for proportions? • Using the Bootstrap weights? • Using a SAS or SPSS procedure, without taking into account the design? : a big DON’T. • No variance? Another big DON’T
The factors – 5 - Statistical tests • Were statistical tests used? • If so, are they clearly identified? • Are they appropriate for what you are doing?
The factors – In brief • Would a reviewer be able to reproduce your results and reach the same conclusions, given you have used all the appropriate methods (weights, variance, statistical tests)?