Apparatus, system, and method of using depth assessment for autonomous robot navigation
An apparatus, system and method of operating an autonomous mobile robot having a height of at least one meter. The robot body; at least two three-dimensional depth camera sensors affixed to the robot body proximate to the height, wherein the sensors are directed toward a floor surface and, in combination, comprise a substantially 360 degree field of view of the floor surface around the robot body; and a processing system for receiving pixel data within the field of view of the sensors; obtaining missing or erroneous pixels from the pixel data; comparing the missing or erroneous pixels to a template, wherein the template comprises at least an indication of ones of the missing or erroneous pixels indicative of the robot body and a shadow of the robot body; and outputting an indication of obstacles in or near the field of view based on the comparing.
1. An autonomous mobile robot, comprising:
a robot body;
a first three-dimensional depth camera sensor and a second three-dimensional depth camera sensor affixed on opposing sides of the robot body, each having an equal angle of incidence relative to a major floor surface directed along a first forward motion axis and a second backward motion axis, respectively, of the robot body, providing a 360-degree field of view of the major floor surface proximate to the robot body; and
a processing system communicative with the first and second three-dimensional depth camera sensors and comprising non-transitory computing code which, when executed by at least one processor associated with the processing system, causes to be executed the steps of:
receiving pixel data of the field of view;
obtaining missing or erroneous pixels from the pixel data;
comparing the missing or erroneous pixels to at least one template; and
outputting an indication of obstacles in or near the field of view based on the comparing.
2. The robot of claim 1 , wherein the angle of incidence relative to the major floor surface comprises a predetermined angle related to the field of view.
3. The robot of claim 1 , wherein the field of view comprises at least two meters in radius.
4. The robot of claim 1 , wherein the first and second three-dimensional depth camera sensors are configured to rotate to provide the 360-degree field of view.
5. The robot of claim 1 , wherein the obstacles are at least 2 cm in height.
6. The robot of claim 1 , wherein the obstacles are selected from the group consisting of a step, slope, cliff, hole, and a shadow.
7. The robot of claim 1 , wherein the first and second three-dimensional depth cameras have a frame rate of between about 15 and 90 fps.
8. The robot of claim 1 , wherein the processing system further comprises communication capabilities for transceiving at least part of the comparing.
9. The robot of claim 1 , wherein the processing system further comprises communication capabilities for transceiving at least the indication of obstacles.
10. The robot of claim 1 , wherein the templates comprises an average of a plurality of sample depth images taken by the first and second three-dimensional depth camera sensors when the robot is in an open space with no obstacles in the field of view.
11. The robot of claim 1 , wherein the missing or erroneous pixels are compared to a plurality of templates.
12. The robot of claim 1 , wherein the processing system further comprises a second non-transitory computing code for governing operation of the robot based on the obstacle indication.
13. The robot of claim 12 , wherein the governed operation is selected from the group consisting of a full stop of motion, planning, environment mapping, and safety monitoring.
14. The robot of claim 12 , wherein the governed operation comprises a maneuver precise to +/−0.5 cm.
15. An autonomous mobile robot, comprising:
a robot body;
a first three-dimensional depth camera sensor and a second three-dimensional depth camera sensor affixed on opposing sides of the robot body, each having an equal angle of incidence relative to a major floor surface directed along a first forward motion axis and a second backward motion axis, respectively, of the robot body; and
wherein a lateral outward reach of a field of view has a starting point on the robot body.
16. An autonomous mobile robot, comprising:
a robot body having a height of at least one meter;
a first three-dimensional depth camera sensor and a second three-dimensional depth camera sensor affixed on opposing sides of the robot body, each having an equal angle of incidence relative to a major floor surface directed along a first forward motion axis and a second backward motion axis, respectively, of the robot body; and
a 360-degree field of view of the major floor surface proximate to the robot body based on at least the equal angle of incidence being directed along a first forward motion axis and the second backward motion axis of each of the first and second three-dimensional depth camera sensors.