CSE 60641 – Microsoft Kinect Performance Slide 1/26

1. Microsoft Kinect Performance Metrics CSE 60641 – Graduate Operating Systems Final Presentation 12/13/2011 Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 1/26

2. Project Overview • Problem • Viability for WiiHabilitaiton • Hardware Requirements • FPS fast enough not to lose data • Write to disk speed based on OS • If there is a bottleneck, where does it exist? • Libraries and drivers from PrimeSense • OpenNI • NITE • PrimeSensor • Operating Systems • Windows 7 • Ubuntu 11.10 • Mac OS X 10.6 Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 2/26

3. Demo Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 3/26

4. Experimental Methodology • Two User Testing: • User A enters at 5 • User B enters at 10 • User A assumes pose at 20 • User A begins movement at 30 • User A returns to pose at 40 • User B leaves at 45 • User A leaves at 50 • Stop at 55 • One User Testing: • User enters at 5 • User assumes pose at 15 • User begins movement at 25 • User returns to pose at 35 • User leaves at 45 • Stop at 50 • Movement Phase • Turn full circle • Drop arms to side, then back to pose • Push out with right hand, return • Push out with left hand, return Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 4/26

5. Predicted Results User Enters Skeleton Found Movement User Leaves Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 5/26

6. Windows 7 Professional SP 1 x64 • CPU: Intel Core 2 Duo P8400 2.26 GHz • RAM: 4 GB • Graphics Card: Mobile Intel GMA 4500MHD • 32 MB • Ubuntu 11.10 x86 • CPU: AMD Athlon 5200 Dual Core 2.70 GHz • RAM: 2GB • Graphics Card: NVidia GeForce 8400gs •  512 MB • Mac OS X 10.6 x64 • CPU: Intel Core 2 Duo 2.4 GHz • RAM: 4 GB • Graphics Card: ATI Radeon HD 2400 • 128 MB Workstations Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 6/26

7. Write to Disk Speed Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 7/26

8. Windows 7 One User • Reason for Trial 1 reduced performance possibly result of other processes running at same time. • Dip at 53000 likely due to system looking for user and realizing the user has left • Initial dip at 1000 to 3000 present across all trials. Likely a result of opening excel file and writing data. Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 8/26

9. Windows 7 One User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 9/26

10. Windows 7 Two User • Initial dip at 1000 to 3000 present across all trials. Likely a result of opening excel file and writing data. • Dips starting at 52500 across all trials likely a result of the system losing track of User B then User A and removing them from list of users. Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 10/26

11. Windows 7 Two User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 11/26

12. Windows 7 Users Comparisons Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 12/26

13. Ubuntu 11.10 One User • Spontaneous decreases in FPS • Decreases at 45000 may be due to system searching for user Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 13/26

14. Ubuntu 11.10 One User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 14/26

15. Ubuntu 11.10 Two User • Spontaneous decreases in FPS • Decreases at 45000 may be due to system searching for user Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 15/26

16. Ubuntu 11.10 Two User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 16/26

17. Ubuntu Users Comparisons Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 17/26

18. Mac OS X One User • Noisy • Spontaneous increases in FPS • Possibly unstable SDK or general issues with mac Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 18/26

19. Mac OS X One User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 19/26

20. Mac OS X Two User • Noisy • Spontaneous increases in FPS • Possibly unstable SDK or general issues with mac Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 20/26

21. Mac OS X Two User Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 21/26

22. Mac OS X Users Comparisons Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 22/26

23. Operating Systems Comparison Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 23/26

24. Windows lower FPS  • Poor graphics memory • Write to disk speed • OpenNI vs Microsoft SDK • Ubuntu had the best overall results • Easiest to implement • Comparable write to disk speed • Good recovery to original steady state • Mac OS X and OpenNI are not fully compatible yet • Only unstable release • Has a lot of dependent components • Previous Kinect development makes it difficult Conclusions Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 24/26

25. Conclusions • Need a decent video card (~128 MB) • FPS performance equal if no display • Lower FPS may result due to slow write to disk speed • 30 FPS bottleneck at Kinect Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 25/26

26. Questions? Aaron Huus Ben Bockstege CSE 60641 – Microsoft Kinect Performance Slide 26/26