180 likes | 250 Views
Dive into the development of a computer vision-based game where players, acting as magicians in a factory, battle using spells. Learn about spell detection, operation detection, rendering effects, challenges, and problems faced during the project. Get insights into tools like Microsoft Kinect, OpenGL, nVidia CUDA, and Autodesk Maya used for this innovative game development. Discover the thrill of detecting basic interactions, spells, and rendering effects such as particle systems, shadows, and motion blur. Uncover the challenges of PhysX integration, effects implementation, and CUDA utilization on various graphics hardware. Explore the current project status, identify what is working well, what's missing, and the solutions and algorithms required to complete the game next week.
E N D
Computer VisionSystems Programming Caroline Steiner & Michael Beham
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Task – Game Overview • Players aremagicians • In factory • Want to kill eachother • Noweapons, but spells • Andobjects in factory
Task – Detectionof • Basic Interaction • Walking, Turning, Jumping, Cower • Spells • Balls • Wind • Tornado • Explosion • Throwobject • Earthquake
Task - Tools • Microsoft Kinect and Kinect SDK • OpenGL and GLSL • nVidiaCuda • Autodesk Maya + FBX • nVidiaPhysX
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Detecting Basic Operation • Walking: • RightFeet in height • TurningShoulderstogoleft/right • KinectrecognizeGround Plane: • Jump • Cower • Viewdirection • Turn Shoulderstolookleft/right
DetectingSpeels • HandTracking • Detecting Hands movementsfor • Righthand • Lefthand • Bothhands • DetectedMoves • Push forward • Whip totheside
Rendering effects • Particle System • Depthoffield • Shadows • Motionblur • Parallax Mapping • Transparency
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Challanges • PhysX • Effects • Integration into thescene • Modelling thescene • CUDA on different graphicshardware
Problems • Calculating Joints Orientation • Lot to do • „Easy“ problems got hard • Using too much time with effects
Project standing: What‘sworking? What‘smissing? • Rendering • Detecting • Animation • Rigid bodyanimation • Makegameready • Solvingsome Problems Will finish itnextweek(s)
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Overview Task Solution andAlgorithms Challanges & Problems Live Demo Summary
Summary • Integration to game is missing • Lot effects and spells