210 likes | 332 Views
Interactive Fieldtrip Experiences: Pilot Study Results. Dr. Becky Sue Parton bparton@twu.edu. ACE-D/HH Pittsburgh Feb 2007. “Merging Realties”. Hybrid fieldtrips Authentic on-site component using mobile technology Web-based distance component with virtual reality & 3D avatars.
E N D
Interactive Fieldtrip Experiences: Pilot Study Results Dr. Becky Sue Parton bparton@twu.edu ACE-D/HH Pittsburgh Feb 2007
“Merging Realties” • Hybrid fieldtrips • Authentic on-site component using mobile technology • Web-based distance component with virtual reality & 3D avatars. • Partnerships • Tiger Creek (Tyler) • JMA – Jean Massieu Academy for the Deaf • Lamar University • Lister-Mair School for the Deaf in Jamaica (Summer) • Join Together “Choice” Grant ACE-D/HH 2007 Painting by Chuck Baird, Deaf artist
Mobile Technology Innovative technology ensures that Pal Mickey knows where he is while exploring the four Theme Parks, and he will share information with you at just the right time and place. (using infrared technology) Same concept – but we used GPS location to trigger videos instead of audio files. Also see (Tech Trends article on “MUSEpad”, V49(3).) ACE-D/HH 2007
By clicking on the “flag”, you automatically jump to the signed interpretation & extra videos of that exhibit. ACE-D/HH 2007
If available photo will launch a video. ACE-D/HH 2007
Alternate way to access info: Look up by the exhibit’s name. (Doesn’t require GPS – you can use a cell phone or PDA for example.) ACE-D/HH 2007
For the pilot, we created: • 35 interpreted tiger stories / interviews • 46 avatar clips • 8 panoramic virtual exhibits • A Google earth / GPS map • The website ACE-D/HH 2007 If available photo will launch a video.
Mobile Tech Research Topics • How did the students use the micro laptop? i.e sequence & duration of multimedia inquiries (Video screen captured data) • Were the avatars understandable? (Survey data) • Was the equipment a good “match”? (Observation – battery life, screen size, photo & GPS capability) • To what extend did the students contribute new material for the website (counted photos/videos) ACE-D/HH 2007
Virtual Reality – Distance Ed(Focus of the next pilot study.) Integrate Google Earth! ACE-D/HH 2007
If available “Puppy/Tara” area will launch a panoramic video.
Distance Research Topics • How do the teachers implement the virtual fieldtrip (time allotted, presentation style) • What quality of video or animation is needed to understand & download easily? • After a “fieldtrip exchange”, how do the two groups collaborate? ACE-D/HH 2007
On-site Pilot Study Results • Subjects = 7 students (4 deaf, 3 hearing) from JMA. (grades 8th-12th; 5 females & 2 males) • Brian (Tiger Creek director) gave a Tiger Fact presentation. • Dr. John Dawson & I did a 3 hour training session w/ the micro laptop at JMA. • Dr. Andrew’s doctoral students from Lamar University evaluated the avatars. ACE-D/HH 2007 Project Team Dr. Becky Sue Parton Dr. John Dawson Dr. Beverly Rodgers
Pilot Study Results Cont • Observations: • Students enjoyed & learned from the “treasure hunting” activity (geo cache) Exhibits were too close together during the main trail though. • Since I was interpreting they watched me instead of relying on the laptop. So couldn’t compare time spent on human vs avatar video… • Students needed more time for training & follow-up. (JMA does not have computers.) • They spent most of the time taking photos rather than viewing the videos. Many forgot to save their photos. If available photo will launch a video. We wanted the students to learn about geography (map reading), science (the Tiger facts), & technology (digital photography, file management). ACE-D/HH 2007
Pilot Study Results Cont • Sequence & Duration of Multimedia Inquiries (Screen Video Capture) • Subject 1 – 7:55 • Subject 2 – 7:39 • Subject 3 – 7:04 • Subject 4 – 15:54 • Subject 5 – 9:16 • Subject 6 – 19:40 • Subject 7 – 16:41 19 Images & 3 Videos Captured by Students ACE-D/HH 2007 If available photo will launch a video.
Pilot Study Results Cont • Subject 6 took most of the viable photos & videos. • The times are in minutes & are estimates. • To the right => an example of a unique photo taken by a student (prints). ACE-D/HH 2007
Pilot Study – Written Remarks • Pre-Survey • Can you find a website if I give you the address? (7 yes) • Can you create a file folder? (7 yes) • Can you take a digital photo? (6 yes; 1 no) • Can you use a GPS receiver to locate something? (1 yes; 6 no) • “That’s so awesome – just to have fun with the computer, & I enjoyed seeing the real tigers, lions, …” • “See the tigers & use the GPS to find things” • “Learning about the tigers … the hunt was fun.” • “Stories about the tigers.” ACE-D/HH 2007
Pilot Study Results Cont.Signing Avatars: Background • An avatar is a virtual (i.e. 'synthetic') human which can be displayed on a computer screen. 3D animation is used to render the sign language. • Developed for a wide range of uses including television sets and to help to make the web more accessible to Deaf &/or hard of hearing users • http://www.vcom3d.com/ (VCom – Sign Smith Studio) ACE-D/HH 2007
Pilot Study Results contSigning Avatars: Evaluation • Avatars were difficult to understand – recommend adding more facial expressions & slowing the speed down. • 14 students wrote the translation from the avatars to English (2-3 tries per clip) • Overall, students would have preferred ASL clips instead of Signed English. • The translations were not understandable in most cases. The fingerspelling was especially difficult. • Students did correctly translate the sentences better with each viewing in general. • The avatar translations need to be changed significantly. Students expressed frustration in watching & trying to understand. “ugh” • Adults tended not to like the lizard avatar, but the kids did. ACE-D/HH 2007
Steps to create a virtual fieldtrip • To create the 360 degree views: • Take still, overlapping photos • Use Panorama Studio to stitch them together & create a QTVR file • Take video of the site along with interviews. Interpret & edit them. • Get the GPS readings. We then put “flags” in Microsoft Streets and Trips software. Then, link a particular file or website to that flag. • The website was built in FrontPage. • To create a custom Google Earth map: • Put your photos into Flickr and then geotag them with the longitude & latitude. • Then open a Tripper Map account which will locate all your tagged Flickr photos. It will automatically generate a Google Earth map and give you the html to insert into any web page. ACE-D/HH 2007
Future Plans & Ideas • Fieldtrip Exchange • Distance Collaboration • Dynamic, multi-perspective website • Teacher workshops • National Network • Student-created trips • Alternate mobile tech • Simulations/Gaming • Translations in other sign languages & cultural exchanges Possible link to battery-free mobile technology … ACE-D/HH 2007 www.geewhizcommunity.com