400 likes | 499 Views
High 6 CDR. Group Members. Kirk Chan Brian Troili Ali Mizan Laura Rubio-Perez. Project Introduction. Motivation. Fresh idea to the UCF community This project has the potential to help the speech impaired Based on the research, technologies necessary were interesting Machine learning
E N D
Group Members • Kirk Chan • Brian Troili • Ali Mizan • Laura Rubio-Perez
Motivation • Fresh idea to the UCF community • This project has the potential to help the speech impaired • Based on the research, technologies necessary were interesting • Machine learning • Personal taste
Goals We want the following key factors:
Hardware Components • Flex Sensors • Able to detect changes in bend/flex • Changes its resistance at several points along the device • When a current is applied, it creates a voltage divider
Hardware Components • Pressure Sensors • Acts as a force sensing resistor • When the sensor is unloaded, its resistance is very high • When pressure is applied, its resistance decreases
Hardware Components Analog/Digital Converter (ADC) • Serial communication preferred. • Large number of input channels. • Avoid serial address conflict. - ADS7828 • I2C compatible • 8 Channel ADC • variable I2C address
Hardware Components Analog/Digital Converter (ADC) • Serial communication preferred. • Large number of input channels. • Avoid serial address conflict. - ADS7828 • I2C compatible • 8 Channel ADC • variable I2C address
Hardware Components Accelerometer and Gyroscope • Inertial Measurement Unit (IMU) • Speed demand allow for serial buses. - ITG3200/ADXL345 combo board • 3.3V input • I2C compatible • 3 axis each • calibrate to 2, 4, 8, and 16g
Hardware Components Wireless Communication
Hardware Components Bluetooth Low Energy (BLE) • Low power consumption • Approx. 50m range Wireless Communication
Hardware Components BLE TTL Transceiver • Bluetooth v4.0 • 3.3V input voltage • Approximately $6 • Customizable Baud Rate
Hardware Components • Microcontroller
Hardware Components • Microcontroller
Hardware Components • Development Environment
Hardware Components • Development Environment
Hardware components • Li-ion Batteries • Small size and lightweight • High energy density • Capacity gradually declines • Can drop below regulated voltage
Hardware components • Disadvantages: • Voltage ripple • Complexity of external passive • components on board • Switching Regulator Advantages: • Efficiency • Minimal power dissipated • Minimal switch duty-cycle
Hardware components • Step down switching regulator • Vin range: 4V - 40V • Vout range: 3.3V - 37V • LM2576 Switching Regulator:
Android vs iPhone • Android • Can be developed on Windows, Mac, and Linux • Apps written in Java • iPhone • Can only be developed in Mac • Apps written in objective C • Apple development software only works with other apple development software
Android IDEs IntelliJ (free version) • Advantages: • Less buggy • More intuitive • Faster • Better GUI • Disadvantages: • Java, Groovy, or Scala are only 3 languages supported in free version Eclipse • Advantages: • More plug-ins available • More commonly used • Disadvantages: • Has bugs and crashes a lot
Software Components • Two main components: • Android Application • is the interface between the user and the machine learning algorithm • Takes in raw data from glove • Displays letter on screen • Translator • There is no way to learn every single sign language gesture with 100% accuracy. • Machine learning gives ~95% accuracy. • Uses learning algorithm to learn from examples
Machine Learning • General Overview • Uses data in order to approximate target function • Uses examples to determine which hypothesis is closest approximation of unknown target function • 3 popular types • Regression • Classification • Clustering
Machine Learning Algorithm chosen Facts and image taken from IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 20, NO. 12, DECEMBER 1998 • Advantage of Hidden Markov Model • No need for segmentation • Very robust towards small changes in motion • History of being used for language recognition
Financing up to date • Boeing Sponsorship
Issues • The Hidden Markov Model is very complicated to both understand and implement • Training the algorithm • Varying hand sizes • BLE is relatively new and requires more research
Approaching the issues • Implementation of Hidden Markov • Reading and researching • Varying Hand size issue • Smooth the trajectory, hand shape, and orientation • Creating tolerances for hand gestures (for flexion) • BLE • Research or switching to classic Bluetooth (version 3.0)