IP Library Granted Patent US 11,288,693
Granted Patent B2
US 11,288,693 · App. 17/372,715 · Granted Mar 29, 2022

Navigating cleaning robots in retail stores

Inventor: Youval Bronicki (Los Altos, CA)
Assignee: Trax Technology Solutions Pte Ltd.
G06Q30/0208A47L11/4011G01C21/206G01G19/52G05D1/0219G05D1/0246G06K9/628G06K9/629G06K9/6227G06N5/04G06N20/00G06Q10/0639G06Q10/06311G06Q10/06315G06Q10/06375G06Q10/06395G06Q30/018G06Q30/0201G06Q30/0281G06Q30/0601G06Q30/0609G06Q30/0623G06Q30/0639G06Q30/0643G06T7/0002G06T7/50G06T7/70G06T7/73G06T7/80G06T7/97G06V10/225G06V10/40G06V20/00G06V20/10G06V20/20G06V20/52H04L67/303H04W4/024H04W4/029A47L2201/04G01G19/14G01G23/18G01J1/4204G01L1/00G05D2201/0203G06Q10/087G06Q30/0633G06T2207/30242G06V2201/09H04N7/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,288,693
App. No.
17/372,715
Granted
Mar 29, 2022
Kind
B2
Abstract

A method for routing a cleaning robot may include receiving an indication of a store shelf of a retail store and causing a first adjustment to a cleaning robot route of a cleaning robot within the retail store based on a location within the retail store corresponding to the store shelf. The first adjustment may be configured to enable an image sensor associated with the cleaning robot to capture images of at least one portion of the store shelf. The method may also include receiving a first image of the store shelf and analyzing the first image to determine a need for a second image of the store shelf. The method may further include, in response to the determined need, causing a second adjustment to the cleaning robot route within the retail store, which may enable the image sensor to capture the second image of the store shelf.

Claims (54)

1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for routing a cleaning robot, the method comprising:

receiving an indication of at least one store shelf of a retail store;

causing a first adjustment to a cleaning robot route of the cleaning robot within the retail store based on at least one location within the retail store corresponding to the at least one store shelf, wherein the first adjustment is configured to enable an image sensor associated with the cleaning robot to capture one or more images of at least one portion of the at least one store shelf;

receiving a first image acquired by the image sensor associated with the cleaning robot, the first image including a representation of the at least one portion of the at least one store shelf;

analyzing the first image to determine a need for a second image of the at least one portion of the at least one store shelf; and

in response to the determined need, causing a second adjustment to the cleaning robot route within the retail store, the second adjustment being configured to enable the image sensor to capture the second image of the at least one portion of the at least one store shelf.

2. The non-transitory computer-readable medium of claim 1 , wherein:

the at least one store shelf includes a first store shelf and a second store shelf; and

the at least one location includes a first location corresponding to the first store shelf and a second location corresponding to the second store shelf.

3. The non-transitory computer-readable medium of claim 1 , wherein the at least one location within the retail store comprises a location of the at least one store shelf.

4. The non-transitory computer-readable medium of claim 1 , wherein the at least one location within the retail store comprises a location from which the image sensor is configured to capture the one or more images of the at least one portion of the at least one store shelf.

5. The non-transitory computer-readable medium of claim 1 , wherein analyzing the first image to determine the need for the second image of the at least one portion of the at least one store shelf comprises:

analyzing the first image to determine an occlusion of at least a part of the at least one store shelf; and

in response to the determined occlusion, determining the need for the second image of the at least one portion of the at least one store shelf.

6. The non-transitory computer-readable medium of claim 1 , wherein analyzing the first image to determine the need for the second image of the at least one portion of the at least one store shelf comprises:

analyzing the first image to attempt to recognize a product; and

in response to a failure to recognize the product, determining the need to capture second image of the at least one portion of the at least one store shelf.

7. The non-transitory computer-readable medium of claim 1 , wherein analyzing the first image to determine the need for the second image of the at least one portion of the at least one store shelf comprises:

analyzing the first image to determine a quantity of one or more products of a product type on the at least one store shelf; and

determining, based on the determined quantity, the need for the second image of the at least one portion of the at least one store shelf.

8. The non-transitory computer-readable medium of claim 7 , wherein the need for the second image of the at least one portion of the at least one store shelf comprises a need for capturing the second image at a time within a predetermined time period after a capture time of the first image.

9. The non-transitory computer-readable medium of claim 8 , wherein the method further comprises determining the predetermined time period based on the product type and the determined quantity.

10. The non-transitory computer-readable medium of claim 1 , wherein the cleaning robot is configured to clean a first area of the retail store before capturing of the first image and to clean a second area of the retail store after the capturing of the second image.

11. The non-transitory computer-readable medium of claim 1 , wherein the determined need for the second image of the at least one portion of the at least one store shelf comprises a need for an image of the at least one portion of the at least one store shelf at a resolution higher than a resolution of the first image.

12. The non-transitory computer-readable medium of claim 1 , wherein the determined need for the second image of the at least one portion of the at least one store shelf comprises a need for an image of the at least one portion of the at least one store shelf captured by the image sensor from a different position.

13. The non-transitory computer-readable medium of claim 1 , wherein:

the cleaning robot comprises a first cleaning robot;

the cleaning robot route comprises a first cleaning robot route; and

the method further comprises causing, based on at least one of the first adjustment and the second adjustment, an adjustment to a second cleaning robot route of a second cleaning robot within the retail store.

14. The non-transitory computer-readable medium of claim 13 , wherein:

the second cleaning robot route prior to the adjustment includes a path passing the at least one store shelf; and

the second cleaning robot route after the adjustment does not include a path passing the at least one store shelf.

15. The non-transitory computer-readable medium of claim 1 , wherein:

the cleaning robot route prior to the first adjustment does not include a path passing the at least one store shelf; and

the cleaning robot route after the first adjustment includes a path passing the at least one store shelf.

16. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

transmitting an instruction to the cleaning robot to clean an area associated with the at least one store shelf.

17. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving the second image of the at least one portion of the at least one store shelf; and

analyzing the second image to determine an action associated with the at least one portion of the at least one store shelf to be performed, wherein the determined action comprises at least one of restocking one or more products of a particular product type, re-arranging one or more items on the at least one store shelf, or removing one or more items on the at least one store shelf.

18. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises selecting the cleaning robot of a plurality of alternative cleaning robots within the retail store based on planned routes associated with the plurality of alternative cleaning robots.

19. A system for routing a cleaning robot, the system comprising:

at least one processor configured to:

receive an indication of at least one store shelf of a retail store;

cause a first adjustment to a cleaning robot route of a cleaning robot within the retail store based on at least one location within the retail store corresponding to the at least one store shelf, wherein the first adjustment is configured to enable an image sensor associated with the cleaning robot to capture one or more images of at least one portion of the at least one store shelf;

receive a first image acquired by the image sensor associated with the cleaning robot, the first image including a representation of the at least one portion of the at least one store shelf;

analyze the first image to determine a need for a second image of the at least one portion of the at least one store shelf; and

in response to the determined need, cause a second adjustment to the cleaning robot route within the retail store, the second adjustment being configured to enable the image sensor to capture the second image of the at least one portion of the at least one store shelf.

20. A method for routing a cleaning robot, comprising:

receiving an indication of at least one store shelf of a retail store;

causing a first adjustment to a cleaning robot route of a cleaning robot within the retail store based on at least one location within the retail store corresponding to the at least one store shelf, wherein the first adjustment is configured to enable an image sensor associated with the cleaning robot to capture one or more images of at least one portion of the at least one store shelf;

receiving a first image acquired by the image sensor associated with the cleaning robot, the first image including a representation a first image of the at least one portion of the at least one store shelf;

analyzing the first image to determine a need for a second image of the at least one portion of the at least one store shelf; and

in response to the determined need, causing a second adjustment to the cleaning robot route within the retail store, the second adjustment being configured to enable the image sensor to capture the second image of the at least one portion of the at least one store shelf.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
RELEASE OF SECURITY INTEREST Recorded Sep 26, 2023
From: ALTER DOMUS (US) LLC
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK INC.
Reel/Frame 065028/0871 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2022
From: BRONICKI, YOUVAL
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 058890/0905 →
SECURITY INTEREST Recorded Oct 15, 2021
From: TRAX TECHNOLOGY PTE. LTD.; SHOPKICK, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 058184/0438 →
Continuity (6)
Continuation PCTUS2021034885 · May 28, 2021
Provisional Application 63113490 · Nov 13, 2020
Provisional Application 63091009 · Oct 13, 2020
Provisional Application 63084086 · Sep 28, 2020
Provisional Application 63033055 · Jun 1, 2020
Related Publication 20210369071A1 · Dec 2, 2021
Cited By (1)
US 12,322,155