240 likes | 370 Views
Use of scanning technology for data capture. ICR System (Intelligent Character Recognition). Information and Communication Technology Center National Statistical Office (NSO) Thailand. ICR SYSTEM. It is an automatically Data Entry by Scanning questionnaires which can be evaluated
E N D
Use of scanning technology for data capture ICR System (Intelligent Character Recognition) Information and Communication Technology Center National Statistical Office (NSO) Thailand
ICR SYSTEM It is an automatically Data Entry by Scanning questionnaires which can be evaluated handwritten numeric / alphanumeric characters (ICR) or handwritten optic marks (OMR) and conduce to Digital Data before processing on others Computer System.
ICR System ICR System in NSO (Thailand) can be divided into 2 parts : • TELEform Software System. • ABBYY Software System.
ICR for The Population Census 2000 NSO provided ICR System to process the first Project of Population Census in 2000. By scanning the 16 million households (16 million Forms) which spent only 8 months to process the raw data instead of more than 1 year by using Key in Data System.
ICR for The Agricultural Census 2003 NSO hired ABBYY Software to process about 25% of The Agricultural Census 2003 that has totally 5.7 million households (24 million forms).
Other Survey Projects After processing The Population Census 2000,some survey projects have been used ICR System such as The Labour Force Survey (monthly report), The Household Manufacturing Survey etc.
TELEform Hardware System • NetServer for TELEform Server 1 Unit • NetServer for Database Server 1 Unit • Reader Modules Workstations 21 Unit • Verifier Modules Workstations 30 Unit • Scanner Control Workstations 6 Unit • Scanner Fujitsu M4099D 6 Unit
TELEform Software System TELEform Software is selected for ICR System whichis used for Forms and Documents Processing. It is the product of TELEform Cardiff Software , Inc. USA. • TELEform 6.2Elite Enterprise Edition • Components: • TELEform Designer. • TELEform Reader. • TELEform Verifier.
ABBYY Hardware System • IBM Server X Series 225 1 Unit • Correction Station 1 Unit • Verifier Modules Workstations 25 Unit • Scanner Control Workstations 4 Unit • Scanner Fujitsu M4099D 4 Unit • Storageflex LT707 1 Unit
ABBYY Software System NSO provided ABBYY Software whichis the product of Russia. ABBYY FormReader 6.0 Enterprise Edition Components: ❑ Form Design ❑ Administration Station ❑ Recognition Station ❑ Correction Station
TELEform / ABBYY Designer Function • To create template form. • Fix value of data type properties in each field of template form on questionnaire.
Template Questionnaire
TELEform Reader / ABBYY Administration Function • To evaluate the questionnaires . • Export the corrected questionnaires to a data file. • Send the unclear questionnaires to TELEform / ABBYY Verifier Function for correcting and transferring the corrected questionnaires to a data file. • Store scanned images.
TELEform / ABBYY Verifier Function • To correct questionnaires that contain mismarked or illegible fields. • The corrected questionnaires are automatically exported to a data file.
BasicScript Programming Language Script Language use to add extensive features similar to Visual Basic. • To develop Form Script during Evaluation and Correction. • To develop Export Script during Data Export.
Step of ICR System in NSO Scan and Forms Distribution : The questionnaires are scanned in each Block / Village and created Multi Page Image Files in local hard disk. Forms Evaluation : The questionnaires images are evaluated. The corrected questionnaires which skipped Verifier Workstation and directly exported to Database server.
Scan and Forms Distribution Questionnaires Scanned Image files
Step of ICR System in NSO (cont.) Forms Verification : The unclear questionnaires are needed review and corrected it in Verifier Workstations before transferring to Database server. Data Export : - Link a data file from Database server to IBM Mainframe System. - Store Scanned image files to CD.
Unrecognized fields must be corrected at Verifier Workstations.
Forms Verification and Data Export Export data for processing Database Server Storage (Images files) Verify CD
ICR Link System PC6unit PC4 unit controller S controller Verifications 25unit TELEform Software ABBYY Software Scanners 4 unit Scanners Questionnaires 6 unit Questionnaires Storage (HD 880 GB) CD CD Verifications HP Server IBM 30unit Server Transfers COMPAQ Server Mainframe Readers station • - Software Correction 21unit -Administration -Export -Recognition • - Database - Backup Data 1unit Processing (Editing & Reporting)
Specific Questionnaire for ICR System • The questionnaires must be professionally printed in a specific colour field boxes (blue,green,red). • The scanners are recognized the questionnaires characters / numerics and drop out field boxes colour. • Test questionnaires to make sure that can process it with speed and accuracy.
ICR Benefits Reduce Cost. Reduce Time. Efficient Data Capture. Increase Data Accuracy.