130 likes | 174 Views
SAS/INSIGHT Demonstration - Exploratory Data Analysis (EDA) techniques. David Lassman Office of the Actuary X7933 David.Lassman@cms.hhs.gov. Introduction. Apply exploratory data analysis techniques (using SAS/INSIGHT) to improve outlier detection Demonstration Datasets Census Bureau
E N D
SAS/INSIGHT Demonstration - Exploratory Data Analysis (EDA) techniques David Lassman Office of the Actuary X7933 David.Lassman@cms.hhs.gov
Introduction • Apply exploratory data analysis techniques (using SAS/INSIGHT) to improve outlier detection • Demonstration • Datasets • Census Bureau • Service Annual Survey • Industry estimates • American Hospital Association • Annual hospital data • Baseball data – 1986 statistics • Hitters
Exploratory Data Analysis(EDA) • “A set of tools for finding what we might have otherwise missed” in a set of data (Tukey, 1977) • Determine which cases are unusual with respect to the bulk of the cases and to follow-up those cases. • Limited time frame
Data Review using Graphical Data Analysis-Benefits • Allows you to see the “big picture” • Research/explain data trends • Find patterns in your data
Techniques • Box plot • Location, spread, and shape of a distribution • Scatter plot • Fitting • Ordinary least squares regression • Transformations • Log • Square root • Other
Demonstration datasets - Service Annual Survey • Collect financial data • Revenue • Expenses • Service Industries include: • Personal Services • Business Services • *Health Care and Social Assistance • Trucking and Warehousing
Health Care and Social Assistance (NAICS 62) • Physicians - NAICS 6211 • Dentists - NAICS 6212 • Other health care practitioners - NAICS 6213 • Chiropractors – NAICS 62131 • Optometrists – NAICS 62132 • Outpatient Care Centers – NAICS 6214 • Home Health Care – NAICS 6216 • Other Ambulatory Services – NAICS 6219 – examples: blood/organ banks, health screening services, hearing services • Hospitals – NAICS 622 • Nursing and Residential Care Facilities – NAICS 623
Health Care and Social Assistance (NAICS 62) con’t • Data items • Total Revenue • Source of payment • Medicare • Medicaid • Other Government • Patient (out-of-pocket) • Patient from family – NAICS 623 only • Patient from social security benefits – NAICS 623 only • Private insurance • All other patient care • All other services • Total Expenses
SAS/INSIGHT • Interactive tool for exploring and analyzing data. • Graphs include box plots, histograms, and scatter plots • Dynamic - Click on points to identify • All graphs and analyses are linked. • Brush observations in one window and they are highlighted in all windows. • Color a point in one graph and it receives the same color in all displays. • Exclude an observation from calculations, and all analyses recalculate automatically.
Demonstration Invoke insight • Type insight in the command box • P-menu – solutions-analysis –interactive data analysis • PROC insight