350 likes | 365 Views
Explore the impact of quantizing errors on positional accuracy in computer vision systems, with a focus on false alarms, misdetection rates, and automated position inspection.
E N D
Computer Vision IIChapter 20 Accuracy Presented by: 王夏果 and Dr. Fuh r94922103@ntu.edu.tw 0937384214 Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
Introduction • Expect of positional inaccuracy due to quantizing error • Estimate false alarm and misdetection rate • Experimental protocols for describing the experiments and analysis • Determine the repeatability and positional accuracy • Assess the performance of a near-perfect vision system DC & CV Lab. NTU CSIE
Mensuration Quantizing Error • Position on digital grid has inherent quantizing error due to discreteness DC & CV Lab. NTU CSIE
Definition • B: coordinate of line’s right endpoint • Δc: spacing between pixel centers • q: uniform random variable, 0≦q≦1 • B = Δc ( B* - + q) • B* = Ceiling( ) DC & CV Lab. NTU CSIE
DC & CV Lab. NTU CSIE
Quantizing Model • β*: digital coordinate of the line’s right most pixel • Natural quantizing model: letting x be a random variable where DC & CV Lab. NTU CSIE
Quantizing Model (cont.) • Thus, we can restate the quantizing model: note that E(x) = q and E(x2) = q DC & CV Lab. NTU CSIE
Quantizing Model (cont.) DC & CV Lab. NTU CSIE
Automated Position Inspection • In industrial position inspection, an automated mechanism machines a part to given specifications • Ensures machining or part placement is correct • Automated inspector: consists of machine identifying critical object points DC & CV Lab. NTU CSIE
Ideal Condition DC & CV Lab. NTU CSIE
Real Condition • Actual position x is not known DC & CV Lab. NTU CSIE
False Alarm and Misdetection DC & CV Lab. NTU CSIE
False Alarm and Misdetection (cont.) • The entire probability model is characterized by five parameters: t, σx, σy, α, β • Problem: how to compute false-alarm and misdetection probabilities DC & CV Lab. NTU CSIE
Analysis DC & CV Lab. NTU CSIE
Analysis (cont.) ≦ ≦ ≦ ≦ DC & CV Lab. NTU CSIE
Take a Break DC & CV Lab. NTU CSIE
Discussion • Failure probability: • Relative precision: DC & CV Lab. NTU CSIE
Discussion (cont.) DC & CV Lab. NTU CSIE
DC & CV Lab. NTU CSIE
Discussion (cont.) DC & CV Lab. NTU CSIE
DC & CV Lab. NTU CSIE
Discussion (cont.) DC & CV Lab. NTU CSIE
DC & CV Lab. NTU CSIE
Discussion (cont.) DC & CV Lab. NTU CSIE
Experiment Protocol • Make experiment repeated and evidence verified by another researcher • Protocol: gives experimental design and data analysis plan • Experiment protocol states: • Quantity (or quantities) to be measured • Accuracy of measurement • Population of scenes/images or artificially generated data DC & CV Lab. NTU CSIE
Experiment Protocol (cont.) • Experimental design: how a suitably random, independent, and representative set of images from the specified population is to be sampled, generated, or acquired • Experimental data analysis plan: • How hypothesis meets specified requirement • How observed data analyzed • Detailed enough for another researcher DC & CV Lab. NTU CSIE
Experiment Protocol (cont.) • Accuracy criterion: how comparison between true, measured values evaluated • Analysis plan: supported by theoretically developed statistical analysis DC & CV Lab. NTU CSIE
Determining the Repeatability of Vision Sensor Measuring Positions • Vision sensors measure position or location in 1D, 2D, 3D • Some number of points are exposed to the sensor, each some number of times • Repeatability is computed in terms of the degree to which the measured position for each point agrees with the corresponding mean measured position for each point DC & CV Lab. NTU CSIE
The Model DC & CV Lab. NTU CSIE
Derivation DC & CV Lab. NTU CSIE
Performance Assessment of Near-Perfect Machines • Machines in recognition and defect inspection required to be nearly flawless • Error rate: • Fraction of time that machine’s judgment incorrect • Contains false detection and misdetection error • False-detection rate (false-alarm rate): unflawed part judged flawed • Misdetection rate: flaw part judged unflawed DC & CV Lab. NTU CSIE
Derivation DC & CV Lab. NTU CSIE
Balancing the Acceptance Test • If the buyer and seller balance their own self-interests exactly in a middle compromise, the operating chosen for the acceptance test will be the one for which the false-acceptance rate (which the buyer wants to be small) equals the missed-acceptance rate (which the seller wants to be small) DC & CV Lab. NTU CSIE
Lot Assessment • In the usual lot inspection approach, a quality control inspector makes a complete inspection on a randomly chosen small sample from each lot • For cost reason, we cannot inspect all of the lot • If more than specified number of defective products fount, the entire lot will be rejected DC & CV Lab. NTU CSIE
Summary • Mensuration quantizing error model computes variance due to random error DC & CV Lab. NTU CSIE