250 likes | 330 Views
Lunabotics Navigation Package. Team May14-20 Advisor: Dr. Koray Celik Clients: ISU Lunabotics Club, Vermeer Company. Project Scope. NASA Lunabotics Mining Competition For university-level students to design and build a mining robot that can traverse the simulated Martian chaotic terrain
E N D
Lunabotics Navigation Package Team May14-20 Advisor: Dr. Koray Celik Clients: ISU Lunabotics Club, Vermeer Company
Project Scope NASA Lunabotics Mining Competition • For university-level students to design and build a mining robot that can traverse the simulated Martian chaotic terrain • Points are awarded for autonomy • Landmarks allowed for navigation
Project Scope Our Clients • Lunabotics Club • Vermeer Company • Large industrial and agricultural equipment
Project Scope ISU Lunabotics Club • Bump detectors • Laser detector for orientation • No obstacle detection • LabView
Project Scope Our Solution • Create prototype navigation system using computer vision techniques for navigation and object detection • Microsoft Kinect for prototype hardware solution • Open-source software
Design Platform • Laptop Computer • 2.26 GHz Dual Core Processor • 4 GB RAM • Microsoft Kinect • RGB Camera • Infrared Optics • Robot ‘Virgil’
Design Virgil • Built by Dr. Koray Celik • Representative of Lunabotics robot • Modified Kinect • Motor Controller • 4 Motors • Encoder Controller • 6 Encoders • Li-Ion Battery Powered
Design Software • Ubuntu Linux 12.04 LTS • OpenCV 2.4.8 • OpenNI 1.5.7.10 • PropulsionClass
Design Landmark Detection • Acquisition Module • Color Threshold • Canny Convolution Operator • Boundary Tracing • Rectilinear Object Recognition
Landmark Detection Canny Threshold
Landmark Detection Contour All Poly Filter
Landmark Detection • Unobtrusive landmark, not likely to be found naturally • Searching for rectilinear shapes with overlapping midpoints • State-space reduction to reduce noise
Design Obstacle Detection • Acquire depth map • Smoothing • Regression • Least Squares Plane Fitting
Obstacle Detection • Plane Fitting • Least Squares Regression Normal Floor Plane Blue - Object Orange - Floor Smoothed Depth Mat
Obstacle Detection • Threshold regression values • Contour Filter • Area of bounding rectangle
Path Generation • Finite State Machine • Landmark must be in sight upon start • Drives towards landmark, avoids obstacles that appear in its path • Maintains spacial awareness to landmark in case it loses sight
Path Gen • Find landmark • Move towards the landmark • Obstacle detected • Proceed on alternate path • Turn back to relocate landmark • Head to landmark
Accomplishments Core Requirements • Robot Movement • Smooth Acceleration and turning • Position and heading • Landmark detection • Recognize and distinguish between our two landmarks • Obstacle detection • Recognise obstacles above 4 cm tall • Recognize Landmarks as not obstacles • Navigation • Obstacle avoidance
Challenges • Landmark Detection • Noise reduction • Obstacle Detection • Uneven terrain issues • Encoder • Set back by hardware (group is more software oriented • OpenNI Bug • Appears around 3 minute mark • Prevents code from scalability in terms of computational complexity • Caused by XnSensorServer
Testing Simulated Arena • 3 m X 2 m area • Virgil is representative of Lunabotics Club’s Robot Method • Test movement • Test landmark detection, eliminate false-positives • Test object detection • Test obstacle avoidance
Demonstration https://www.youtube.com/watch?v=WRIJiebZkOs
What’s Next? • Introduce Improved Hardware • 2.5-D Lidar • High Definition RGB Camera • Integrate Encoder Support • Improve Navigation Algorithm