120 likes | 247 Views
Edward Rafaelov & Vladimir Postel. Saya Web Interface Project. Advisors: Prof. Shlomi Dolev & Michael Orlov. DEC. 2007. Introduction. The goals of our project are: Remote control some of Saya’s features and devices. Remote communication with Saya:
E N D
Edward Rafaelov & Vladimir Postel Saya Web Interface Project Advisors: Prof. Shlomi Dolev & Michael Orlov DEC. 2007
Introduction The goals of our project are: • Remote control some of Saya’s features and devices. • Remote communication with Saya: Present video and audio captured from the camera that is located inside the left eye and microphone that connected to Saya. Provide possibility to send messages to Saya • Increase popularity of Saya project by: Providing information about the Saya project. Make some of the features accessible to everyone.
Implementation The site was created by using several development tools: • Html / DhtmlandCSS for creation and design of web pages. • Javascript • PHPwas used for ssh2 and socket TCP/IP connections, some of the functions were implemented inPHP. • Java– JMF and RTP: audio and video transmission servers, capturing and transferring media streams to users. TCP/IP servers on the computers of Saya that communicate with theweb site. RxTx java library - Connection to neck and eyes DC motors via RS232 • Java Applet - receiving and presenting video and audio streams from camera and microphone in real time.
Architecture of Audio And Video transmission processes. 5) Audio is transmitted to clients IP. Video Audio 4) Gets message with client’s IP, creates connection & start transmitting. When client exits closes the connection. Saya1 Saya2 3) Client’s IP is sent to the transmitting computers. RTP 1) Client enters the site that is on the server. 2) The Applet is downloaded to client’s host. server RTP 6) The applet runs, and presentsthe streams, (audio and video), from both transmitters. user
Com2 Rx-Tx Eyes Compressor Architecture of connection to Sentry, Execution of commands and eyes initialization Video 2) Commands that client chooses are executed on sentry Sentry Saya1 3) Server that runs on Saya1 gets eyes initialization request, connects to eyes via com2 port and runs initialization commands. 1) Client enters the site that is on the server, Opens a page that provides control over Sentry. status Site on apache User
Architecture of 'Communication' with Saya Audio & speech recognition 2) Message is received by the server on Saya2 and processed by Saya2 Saya 2 Messageto Saya 1) Client enters the site, Opens a page that provide ability to send messages to Saya. Site on apache Answer user
Conclusion • Humanoid robots are very attractive. Most people are excited by communicating with the robots. • Making Saya more realistic and practical will receive more attention and interest, so many additional helpful features could be developed. • For future development of the project, additional options can be added: • Ability to recognize people who have Bluetooth technology cell phones, by managing a database of people with cell phone numbers. • When a person with Bluetooth passes near Saya, his name can be found in the data base and he will be greeted by Saya. • The site can grow to a portal. • Links to other projects about Saya can be added. • Control and Configuration of Saya’s features can be done via the web.
ScreenShots Sentry– power controller of eyes and compressor. Functions: turning on & off, rebooting, status.
Media gallery - containing pictures, Press releases and TV videos about Saya.