IP Library Granted Patent US 11,123,865
Granted Patent B2
US 11,123,865 · App. 16/228,423 · Granted Sep 21, 2021

Using object observations of mobile robots to generate a spatio-temporal object inventory, and using the inventory to determine monitoring parameters for the mobile robots

Inventor: Peter Elving Anderson-Sprecher (Mountain View, CA)
Assignee: Boston Dynamics, Inc.
B25J9/1664B25J5/00B25J9/1694G01B11/14G01C21/00G05D1/0274G05D1/0297G06K9/00664G05D2201/0216G06K7/10376G06Q10/06315G06Q10/087Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,123,865
App. No.
16/228,423
Granted
Sep 21, 2021
Kind
B2
Abstract

Methods, apparatus, systems, and computer-readable media are provided for generating a spatio-temporal object inventory based on object observations from mobile robots and determining, based on the spatio-temporal object inventory, monitoring parameters for the mobile robots for one or more future time periods. Some implementations relate to using the spatio-temporal object inventory to determine a quantity of movements of objects that occur in one or more areas of the environment when one or more particular criteria are satisfied—and using that determination to determine monitoring parameters that can be utilized to provide commands to one or more of the mobile robots that influence one or more aspects of movements of the mobile robots at future time periods when the one or more particular criteria are also satisfied.

Claims (34)

1. A computer-implemented method, comprising:

determining based on a spatio-temporal object inventory, a quantity of movements of objects that occurred in at least one area of a warehouse during a particular temporal period, wherein the spatio-temporal object inventory defines, for each of the objects, measurement information including a first pose for the object, a first measurement time at which the first pose was measured, a second pose for the object, and a second measurement time at which the second pose was measured, wherein a movement of the object is determined based, at least in part, on the measurement information for the object included in the spatio-temporal object inventory;

determining, by one or more computing systems, based on the quantity of movements that occurred during the particular temporal period, one or more monitoring parameters for mobile robots for one or more future time periods, the one or more monitoring parameters defining, for the one or more future time periods, a number of the mobile robots that should be deployed to the at least one area of the warehouse and/or how often the mobile robots should be deployed to the at least one area of the warehouse; and

providing, to one or more of the mobile robots, commands based on the one or more monitoring parameters, wherein the commands influence one or more aspects of movements of the mobile robots at the one or more future time periods.

2. The computer-implemented method of claim 1 , wherein the particular temporal period is one of: one or more particular days of a week, one or more particular days of a year, or one or more time periods during one or more of the particular days of the week or one or more of the particular days of the year.

3. The computer-implemented method of claim 1 , wherein the commands that influence one or more aspects of movements of the mobile robots at the one or more future time periods based on the monitoring parameters include commands that direct the mobile robots to the at least one area during the one or more future time periods.

4. The computer-implemented method of claim 1 , wherein the commands that influence one or more aspects of movements of the mobile robots at the one or more future time periods based on the monitoring parameters include commands that increase a likelihood that the mobile robots will select a path that diverts from an optimal path and encounters the at least one area during the one or more future time periods.

5. The computer-implemented method of claim 1 , wherein determining a quantity of movements of objects that occurred in at least one area of the warehouse during the particular temporal period comprises determining a quantity of movements of objects into the at least one area and/or out of the least one area during the particular temporal period.

6. The computer-implemented method of claim 5 , wherein determining a quantity of movements of the objects into the at least one area during the particular temporal period is based on:

determining that the first pose for a selected object of the objects, is outside of the at least one area and the first corresponding measurement time is temporally before the particular temporal period; and

determining that the second pose for the selected object, is within the at least one area and the second corresponding measurement time is temporally within the particular temporal period.

7. The computer-implemented method of claim 5 , wherein determining a quantity of movements of the objects into the at least one area during the particular temporal period is based on:

determining that no pose that is temporally before the particular temporal period is defined for a selected object of the objects in the spatio-temporal object inventory; and

determining that the first pose or the second pose for the selected object is within the at least one area and has a corresponding first measurement time or second measurement time temporally within the particular temporal period.

8. The computer-implemented method of claim 5 , wherein determining a quantity of movements of the objects out of the at least one area during the particular temporal period is based on:

determining that the first pose for a selected object of the objects, is inside the at least one area and the first corresponding measurement time is temporally before the particular temporal period; and

determining that the second pose for the selected object is outside of the at least one area and the second corresponding measurement time is temporally within the particular temporal period.

9. A system comprising:

a plurality of mobile robots configured to travel within a warehouse; and

one or more computing systems comprising instructions that, when executed by the one or more computing systems, cause the one or more computing systems to:

determine, based on a spatio-temporal object inventory, a quantity of movements of objects that occurred in at least one area of the warehouse during a particular temporal period, wherein the spatio-temporal object inventory defines, for each of the objects, measurement information including a first pose for the object, a first measurement time at which the first pose was measured, a second pose for the object, and a second measurement time at which the second pose was measured, wherein a movement of the object is determined based, at least in part, on the measurement information for the object included in the spatio-temporal object inventory;

determine, based on the quantity of the movements that occurred during the particular temporal period, one or more monitoring parameters for one or more of the plurality of mobile robots for one or more future time periods, the one or more monitoring parameters defining, for the one or more future time periods, a number of the mobile robots that should be deployed to the at least one area of the warehouse and/or how often the mobile robots should be deployed to the at least one area of the warehouse; and

provide, to the one or more of the mobile robots, commands based on the one or more monitoring parameters, wherein the commands influence one or more aspects of movements of the one or more mobile robots at the one or more future time periods.

10. The system of claim 9 , wherein the particular temporal period is one of: one or more particular days of a week, one or more particular days of a year, or one or more time periods during one or more of the particular days of the week or one or more of the particular days of the year.

11. The system of claim 9 , wherein determining a quantity of movements of objects that occurred in at least one area of the warehouse during the particular temporal period comprises determining a quantity of movements of objects into the at least one area and/or out of the least one area during the particular temporal period.

12. The system of claim 11 , wherein determining a quantity of movements of the objects into the at least one area during the particular temporal period is based on:

determining that the first pose for a selected object of the objects, is outside of the at least one area and the first corresponding measurement time is temporally before the particular temporal period; and

determining that the second pose for the selected object, is within the at least one area and the second corresponding measurement time is temporally within the particular temporal period.

13. The system of claim 11 , wherein determining a quantity of movements of the objects into the at least one area during the particular temporal period is based on:

determining that no pose that is temporally before the particular temporal period is defined for a selected object of the objects in the spatio-temporal object inventory; and

determining that the first pose and/or the second pose for the selected object is within the at least one area and has a corresponding first and/or second measurement time temporally within the particular temporal period.

14. The system of claim 11 , wherein determining a quantity of movements of the objects out of the at least one area during the particular temporal period is based on:

determining that the first pose for a selected object of the objects, is inside the at least one area and the first corresponding measurement time is temporally before the particular temporal period; and

determining that the second pose for the selected object is outside of the at least one area and the second corresponding measurement time is temporally within the particular temporal period.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2020
From: X DEVELOPMENT LLC
To: BOSTON DYNAMICS, INC.
Reel/Frame 052790/0062 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2019
From: GOOGLE INC.
To: X DEVELOPMENT LLC
Reel/Frame 049589/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2019
From: ANDERSON-SPRECHER, PETER ELVING
To: GOOGLE INC.
Reel/Frame 049570/0446 →