• 270 likes • 283 Views
This chapter explores the KDD process model, scientific method application, and various tools for knowledge discovery in databases. Topics covered include goal identification, creating target datasets, data preprocessing, data transformation, data mining, interpretation and evaluation, and taking action.
E N D
Part II Tools for Knowledge Discovery
Knowledge Discovery in Databases Chapter 5
Step 1: Goal Identification Define the Problem. Choose a Data Mining Tool. Estimate Project Cost. Estimate Project Completion Time. Address Legal Issues. Develop a Maintenance Plan.
Step 3: Data Preprocessing Noisy Data Missing Data
Noisy Data Locate Duplicate Records. Locate Incorrect Attribute Values. Smooth Data.
Preprocessing Missing Data Discard Records With Missing Values. Replace Missing Real-valued Items With the Class Mean. Replace Missing Values With Values Found Within Highly Similar Instances.
Processing Missing Data While Learning Ignore Missing Values. Treat Missing Values As Equal Compares. Treat Missing values As Unequal Compares.
Step 4: Data Transformation Data Normalization Data Type Conversion Attribute and Instance Selection
Data Normalization Decimal Scaling Min-Max Normalization Normalization using Z-scores Logarithmic Normalization
Attribute and Instance Selection Eliminating Attributes Creating Attributes Instance Selection
Step 5: Data Mining Choose training and test data. Designate a set of input attributes. If learning is supervised, choose one or more output attributes. Select learning parameter values. Invoke the data mining tool.
Step 6: Interpretation and Evaluation Statistical analysis. Heuristic analysis. Experimental analysis. Human analysis.
Step 7: Taking Action Create a report. Relocate retail items. Mail promotional information. Detect fraud. Fund new research.
5.9 The Crisp-DM Process Model Business understanding Data understanding Data preparation Modeling Evaluation Deployment
A Four-Step Model for Knowledge Discovery Identify the goal. Prepare the data. Apply data mining. Interpret and evaluate the results.
Experiment 1: Attribute Evaluation *Applying the Four-Step Process Model to the Credit Screening Dataset*
Experiment 2: Parameter Evaluation *Applying the Four-Step Process Model to the Satellite Image Dataset*