400 likes | 547 Views
Java-Based In-Car Cell Phone Integration. By: Chris Keller Greg Nehus Matt Odille. High-Level View. Project Summary. Project Summary. There continues to be many accidents attributed to cell phone use while driving Text messaging is perhaps the most dangerous
E N D
Java-Based In-Car Cell Phone Integration By: Chris Keller Greg Nehus Matt Odille
Project Summary • There continues to be many accidents attributed to cell phone use while driving • Text messaging is perhaps the most dangerous • Our project improves safety of communication while driving • Streams phone conversations • Accepts commands via voice • Dictates text messages • We will implement the software and a GUI
Project Summary • Primary Research: • Bluetooth in Java • Bluetooth Protocol • AT Commands • Java Speech API • Why we chose this: • To learn how Bluetooth is implemented • To deepen our Java knowledge • To build something tangible that works
Specific Aims • Four main goals of the project • To learn how Bluetooth communications are implemented • To investigate how Bluetooth is already being used in automobiles • Implement and improve the preexisting uses (via text message dictation and synthesizing) • Improve safety of driving while using cell phones
Background and Motivation • All group members are Computer Engineering majors with focus on software • Relevant Courses: • COE 401, Intermediate Programming using Java • COE 445, Data Structures • COE 1501, Algorithm Implementation • COE 1186, Software Engineering • COE 1185, Computer Systems Interfacing
Background & Motivation • We’re motivated to do more than small Java applications • Co-op experience • Greg - ANSYS • Matt - Vocollect • Chris – ANSYS • We’re interested in cell phone, Bluetooth, and automobile technology
Preliminary Work/Design Possibilities • Combine our code with preexisting technologies • BlueCove Java Bluetooth Libraries • CloudGarden TalkingJava SDK • Broadcom’s Widcomm Bluetooth Software
Design Approach • Java Setup • Java is a general-purpose, class-based, object-oriented language • Must install the following on all development computers: • Java Runtime Environment • Java Development Kit • This gives us the software to develop and run Java applications
Design Approach • Integrated Development Environment (IDE) • Using the same IDE will make combining individual code easier • We will be using NetBeans 6.5 • Editor • Version Control integration • Syntax highlighting • Etc.
Design Approach • Version Control
Design Approach • Bluetooth Communication • Prerequisite: BlueCove Java Bluetooth Library • Java does not come packaged with any libraries that allow interfacing with the computer’s Bluetooth stack. The BlueCove library will give us that capability.
Design Approach • Bluetooth Communication • Five parts to the anatomy of a Bluetooth application • Stack Initialization • Device Discovery • Device Management • Service Discovery • Communication
Design Approach • Stack Initialization • Must be done prior to any attempts at Bluetooth communication • Initializes • Port • Baud Rate • Bluetooth mode
Design Approach • Device Discovery • Allows the computer to get a list of nearby Bluetooth devices (our phone). • Example code:
Design Approach • Device Management • Allows the computer to access properties of the phone • This piece of code obtains the MAC Address a BT device • Example code:
Design Approach • Service Discovery • Determine what services and protocols are available on the phone • Communication • At this point, a Bluetooth connection is established and communication can begin. • To control the cell phone, we will use AT Commands
Design Approach • Example dialogue of communication via AT commands • Phone: • +CMTI: <mem>,<index> • “I have a new text message” • PC: • AT+CMGR=<index> • “Give me it!” • Phone would then return the text message in a PDU encoded form. We must decode this in our application
Design Approach • Speech-to-Text (STT) • Improved safety with hands-free control over cell phone • Interprets voice commands • Whole companies exist based on writing STT algorithms (Vocollect) • We will utilize the Java-based CloudGarden software development kit
Design Approach • Text-to-Speech (TTS) • This will also be accomplished by utilizing the CloudGarden software
Management Plan • Week 1 • Chris: Finish preliminary research and project proposal • Matt: Finish preliminary research and project proposal • Greg: Finish preliminary research and project proposal • Week 2 • Chris: Progress report on non-technical issues • Matt: Create use case diagrams • Greg: Begin rudimentary communication between computer and phone
Management Plan • Week 3 • Chris: Testing of established communication between computer and phone • Matt: Install and learn basics of CloudGarden voice software • Greg: Finish communication between computer and phone
Management Plan • Week 4 • Chris: Utilize CloudGarden to begin implementing voice commands, progress report technical issues • Matt: Begin GUI design and coding, progress report technical issues • Greg: Utilize CloudGarden to begin implementing voice commands, progress report technical issues
Management Plan • Week 5 • Chris: Finish implementation of voice commands • Matt: Finish GUI • Greg: Begin incorporation of Broadcom • Week 6 • Chris: Begin final report • Matt: Test design at this stage • Greg: Finish Broadcom incorporation
Management Plan • Week 7 • Chris: Finish final report • Matt: Any remaining technical tasks • Greg: Begin final presentation • Week 8 • Chris: Final Presentation • Matt: Final Presentation • Greg: Final Presentation
Expected Problems & Solutions • Voice Recognition Accuracy • Problem: Speech dictations are not always 100% accurate. • Solution: Use Levenshtein Distance Algorithm for string similarity calculations. • Example code:
Expected Problems & Solutions • Software Compatibility Issues with CloudGarden • Problem: The CloudGarden TalkingJava SDK installation requires a specific outdated version of the Java Runtime Environment (JRE). • Solution: Uninstall any existing versions of Java and temporarily install JRE 1.4.2.
Expected Problems & Solutions • Incorporating Broadcom software • Problem: Streaming phone calls or stereo audio over Bluetooth is an extremely difficult task. Solutions exist, by companies such as Broadcom, but even their development kit fails to state how this is accomplished. • Solution: We will utilize Broadcom’s existing application to accomplish the task of passing audio from a phone call to the computer’s speakers.
Estimated Costs • Software: • TalkingJava SDK License (academic) = $14 per license • Hardware: • Microphone - $10 • Bluetooth adapter - $12 • Computer for developing and testing – N/A • Bluetooth-enabled cell phone – N/A • Total Estimated Cost = $64
Thank you for your time. - Chris Keller Greg Nehus Matt Odille