IP Library Patent Application 18799658
Patent Application
App. No. 18/799,658

SYSTEMS AND METHODS FOR OPERATING A MOBILE ROBOT WITH STEREO IMAGING DEVICES MOUNTED THEREON

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/799,658
Abstract

Systems and methods for operating a mobile robot is disclosed. The system can include a pair of stereo imaging devices mounted on the mobile robot, a memory storing a current baseline, and a processor. The pair of stereo imaging devices include a first and a second imaging device. The current baseline is representative of a distance between the first and the second imaging devices. The processor is operable to: autonomously navigate the mobile robot to a visual target; while the visual target is within viewing range, capture an image of the visual target; generate a plurality of depth measurements from the image; compare the plurality of depth measurements with corresponding depth estimates; and update the current baseline based on the comparisons. The mobile robot is operable to autonomously execute a mission within an environment; and while executing the mission, use the current baseline for sensing the environment.

Claims (45)

1 . A method of operating a mobile robot, the method comprising:

operating the mobile robot to autonomously navigate to a visual target, the mobile robot comprising at least one processor, at least one pair of stereo imaging devices mounted thereon, and a memory storing a current baseline for each pair of stereo imaging devices, each pair of stereo imaging devices comprising a first imaging device and a second imaging device, the current baseline for each pair of stereo imaging devices being representative of a distance between the first imaging device and the second imaging device of that pair of stereo imaging devices;

while the visual target is within a viewing range of a first pair of stereo imaging devices of the at least one pair of stereo imaging devices, operating the first pair of stereo imaging devices to capture an image of the visual target, the image comprising a plurality of sample points generated based on the visual target;

operating the at least one processor to:

generate a plurality of depth measurements for the plurality of sample points of the image;

compare the plurality of depth measurements with corresponding depth estimates for the plurality of sample points, the depth measurements being based on the current baseline of the first pair of stereo imaging devices; and

update the current baseline of the first pair of stereo imaging devices based on the comparisons of the plurality of depth measurements with the corresponding depth estimates;

operating the mobile robot to autonomously execute a mission within an environment; and

while executing the mission, operating the at least one processor to use the current baseline for sensing the environment.

2 . The method of claim 1 , comprises operating the at least one processor to:

estimate a pose of the visual target shown i n the image based on the known dimensions of the visual target; and

generate the plurality of depth estimates for the plurality of sample points based on the estimated pose of the visual target shown i n the image.

3 . The method of claim 1 , comprises operating the at least one processor to, for each sample point of the plurality of sample points, determine a point difference between the depth measurement for that sample point and the depth estimate for that sample point.

4 . The method of claim 3 , comprises operating the at least one processor to, compare the plurality of point differences between the depth measurements and the depth estimates for the plurality of sample points with a Gaussian distribution; and

i n response to determining that the plurality of point differences is similar to a Gaussian distribution, update the current baseline to a value that minimizes an average of the point differences.

5 . The method of claim 4 , wherein the average of the point differences comprises a mean of the point differences.

6 . The method of claim 1 , comprises operating the at least one processor to update the current baseline of the first pair of stereo imaging devices based on a first imaging device of the first pair of stereo imaging devices having a same pose before and after the update.

7 . The method of claim 1 , comprises operating the first pair of stereo imaging devices to capture the image of the visual target while a longitudinal axis defined by the first pair of stereo imaging devices is non-parallel to a plane defined by the visual target.

8 . The method of claim 1 , wherein the first pair of stereo imaging devices mounted thereon the mobile robot have a lower height than the visual target.

9 . The method of claim 1 , comprise operating the mobile robot to remain stationary while the first pair of stereo imaging devices capture the image of the visual target.

10 . The method of claim 1 , comprises operating the mobile robot to autonomously navigate to a pre-determined proximity of less than 4.5 meters from the visual target.

11 . A system for operating a mobile robot, the system comprising:

at least one pair of stereo imaging devices mounted on the mobile robot, each pair of stereo imaging devices comprising a first imaging device and a second imaging device;

a memory storing a current baseline for each pair of stereo imaging devices, the current baseline for each pair of stereo imaging devices being representative of a distance between the first imaging device and the second imaging device of that pair of stereo imaging devices; and

at least one processor operable to:

autonomously navigate the mobile robot to a visual target;

while the visual target is within viewing range of a first pair of stereo imaging devices of the at least one pair of stereo imaging devices, operating the first pair of stereo imaging devices to capture an image of the visual target, the image comprising a plurality of sample points generated based on the visual target;

generate a plurality of depth measurements for the plurality of sample points of the image;

compare the plurality of depth measurements with corresponding depth estimates for the plurality of sample points, the depth measurements being based on the current baseline of the first pair of stereo imaging devices;

update the current baseline of the first pair of stereo imaging devices based on the comparisons of the plurality of depth measurements with the corresponding depth estimates;

operate the mobile robot to autonomously execute a mission within an environment; and

while executing the mission, use the current baseline for sensing the environment.

12 . The system of claim 11 , wherein the at least one processor is operable to:

estimate a pose of the visual target shown i n the image based on the known dimensions of the visual target; and

generate the plurality of depth estimates for the plurality of sample points based on the estimated pose of the visual target shown i n the image.

13 . The system of claim 11 , wherein the at least one processor is operable to, for each sample point of the plurality of sample points, determine a point difference between the depth measurement for that sample point and the depth estimate for that sample point.

14 . The system of claim 13 , wherein the at least one processor is operable to:

compare the plurality of point differences between the depth measurements and the depth estimates for the plurality of sample points with a Gaussian distribution; and

i n response to determining that the plurality of point differences is similar to a Gaussian distribution, update the current baseline to a value that minimizes an average of the point differences.

15 . The system of claim 14 , wherein the average of the point differences comprises a mean of the point differences.

16 . The system of claim 11 , wherein the at least one processor is operable to update the current baseline of the first pair of stereo imaging devices based on a first imaging device of the first pair of stereo imaging devices having a same pose before and after the update.

17 . The system of claim 11 , wherein the pair of stereo imaging devices are operable to capture the image of the visual target while a longitudinal axis defined by the first pair of stereo imaging devices is non-parallel to a plane defined by the visual target.

18 . The system of claim 11 , wherein the first pair of stereo imaging devices mounted thereon the mobile robot have a lower height than the visual target.

19 . The system of claim 11 , wherein the at least one processor is operable to maintain the mobile robot i n a stationary position while the first pair of stereo imaging devices capture the image of the visual target.

20 . The system of claim 11 , wherein the at least one processor is operable to autonomously navigate the mobile robot to a pre determined proximity of less than 4.5 meters from the visual target.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 17, 2025
From: CLEARPATH ROBOTICS INC.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 069918/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2024
From: LUNSCHER, NOLAN; MCLAUGHLIN, JAKE
To: CLEARPATH ROBOTICS INC.
Reel/Frame 068564/0303 →