100 likes | 186 Views
REU Summer 2002 Weekly Report 3. Lorraine Harrington University of Nevada, Reno. Research Goals. Develop a medication monitoring program for the elderly Have patient/medical staff build a database of medications (times & descriptions)
E N D
REU Summer 2002Weekly Report 3 Lorraine Harrington University of Nevada, Reno
Research Goals • Develop a medication monitoring program for the elderly • Have patient/medical staff build a database of medications (times & descriptions) • Use a two-camera system hooked into a personal computer to monitor the medication consumption • Check the meds taken against the database – set off alarm if a medication is missed or the wrong medication is taken
Overview • Focus on medication consumption • Currently, assume that if: • Pill bottle is picked up and opened • Mouth opens • The hand occludes the mouth while it is open • Swallowing • Then the pill was taken
Pill Bottle Identification • Background subtraction • Connected components • Double size thresholding • If pixel remains on, look at orig. image (image addition)
Problems • Salt shaker is identified as a bottle • The three pill bottles have heads, necks, and trunks. The shaker tapers from the head. Do edge detection to find the shape of the head – if cylinder or has neck, is a pill bottle.
When arm moves, bottle & arm are seen as one component and deleted by threshold • Initialize the pill bottles with a stationary person, then track the pill bottles to maintain definition even when in contact/occluded with another object.
Differentiate between prescription bottles and OTC bottles • Currently, just identifies bottles • After running ConnectedComponents to identify bottles, use the linked list of each pixel in the object to check the color of the original pixel • If the color is within a preset range (yellow-orange values) increment a counter • If the final counter value for the object is above a threshold (50 pixels), mark the object as a prescription – if not, as an OTC drug.
Next Week • Implement problem solutions • Use skin detection to find user’s head and arms • Use component tracking to follow bottle when picked up by user • Detect twisting of hand as unscrewing the cap on a pill bottle
Research • Methods of mouth detection • Need to track mouth opening/closing • Handling mouth/hand occlusion – measure distance between hand and mouth • Detecting swallowing in females