IP Library Granted Patent US 11,328,311
Granted Patent B2
US 11,328,311 · App. 17/360,543 · Granted May 10, 2022

Gradual adjustments to planograms

Inventors: Youval Bronicki (Los Altos, CA); Ido Merkado (Tel Aviv, IL); Antonin Bertin (Maisons Laffitte, FR)
Assignee: Trax Technology Solutions Pte Ltd.
G06Q30/0208A47L11/4011G01C21/206G01G19/52G05D1/0219G05D1/0246G06K9/628G06K9/629G06K9/6227G06N5/04G06N20/00G06Q10/0639G06Q10/06311G06Q10/06315G06Q10/06375G06Q10/06395G06Q30/018G06Q30/0201G06Q30/0281G06Q30/0601G06Q30/0609G06Q30/0623G06Q30/0639G06Q30/0643G06T7/0002G06T7/50G06T7/70G06T7/73G06T7/80G06T7/97G06V10/225G06V10/40G06V20/00G06V20/10G06V20/20G06V20/52H04L67/303H04W4/024H04W4/029A47L2201/04G01G19/14G01G23/18G01J1/4204G01L1/00G05D2201/0203G06Q10/087G06Q30/0633G06T2207/30242G06V2201/09H04N7/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,328,311
App. No.
17/360,543
Granted
May 10, 2022
Kind
B2
Abstract

A system for making gradual adjustments to planograms may include at least one processor. The processor may be programmed to receive a first image of a shelf; analyze the first image to determine a first placement of products on the shelf; determine a planned first adjustment to the first placement of products; and provide first information configured to cause the planned first adjustment. The processor may then receive a second image of the shelf captured after the first information was provided; analyze the second image to determine a second placement of products on the shelf; determine a planned second adjustment to the second placement of products; and provide second information configured to cause the planned second adjustment to the determined second placement of products.

Claims (66)

1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for making gradual adjustments to planograms, the method comprising:

receiving a target planogram;

determining a plurality of adjustments to a placement of products on at least part of a shelf, the plurality of adjustments corresponding to a series of steps that, if carried out correctly, would result in compliance with the target planogram; and

providing information configured to cause the adjustments to be implemented;

wherein determining the plurality of adjustments to the placement of products on the at least part of the shelf and providing the information include:

receiving a first image of the at least part of the shelf;

analyzing the first image to determine a first placement of products on the at least part of the shelf;

based on the target planogram and the determined first placement of products, determining a planned first adjustment to the determined first placement of products on the at least part of the shelf, the planned first adjustment corresponding to a step in the series of steps;

based on the planned first adjustment to the determined first placement of products, providing first information, the first information being configured to cause the planned first adjustment to the determined first placement of products to be implemented, wherein providing the first information includes generating a first intermediate target planogram based on the planned first adjustment;

receiving a second image of the at least part of the shelf captured after the first information was provided;

analyzing the second image to determine a second placement of products on the at least part of the shelf;

identifying, based on the second placement of products on the at least part of the shelf, a failed execution of the planned first adjustment;

based on the target planogram, the failed execution of the planned first adjustment, and the determined second placement of products, determining a planned second adjustment to the determined second placement of products on the at least part of the shelf, the planned second adjustment corresponding to an additional step in the series of steps and representing a smaller adjustment than the planned first adjustment based on the failed execution of the planned first adjustment; and

based on the planned second adjustment to the determined second placement of products, providing second information, the second information being configured to cause the planned second adjustment to the determined second placement of products to be implemented, wherein providing the second information includes generating a second intermediate target planogram based on the planned second adjustment.

2. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving a third image of the at least part of the shelf captured after the second information was provided; and

analyzing the third image to determine compliance with the target planogram.

3. The non-transitory computer-readable medium of claim 1 , wherein identifying the failed execution of the planned first adjustment comprises analyzing the second image to determine a status of an execution of the planned first adjustment.

4. The non-transitory computer-readable medium of claim 1 , wherein the determined failure is based on an incorrect product placement detected in the second image.

5. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

in response to the identification of the failed execution of the planned first adjustment, determining the planned second adjustment to the determined second placement of products on the at least part of the shelf to correct the determined failure.

6. The non-transitory computer-readable medium of claim 1 , wherein at least one of the first image and the second image is acquired by at least one image sensor mounted adjacent to the shelf on an additional shelf.

7. The non-transitory computer-readable medium of claim 1 , wherein at least one of the first image and the second image is acquired by at least one image sensor of a personal mobile device.

8. The non-transitory computer-readable medium of claim 1 , wherein at least one of the first image and the second image is acquired by at least one image sensor of a robotic device.

9. The non-transitory computer-readable medium of claim 1 , wherein at least one of the planned first adjustment and the planned second adjustment includes removing a particular product type from the shelf.

10. The non-transitory computer-readable medium of claim 1 , wherein at least one of the planned first adjustment and the planned second adjustment includes adding a new product type to the shelf.

11. The non-transitory computer-readable medium of claim 1 , wherein at least one of the planned first adjustment and the planned second adjustment includes changing a placement location of a particular product type on the shelf.

12. The non-transitory computer-readable medium of claim 1 , wherein at least one of the planned first adjustment and the planned second adjustment includes changing a size of a portion of the shelf dedicated to a particular product type.

13. The non-transitory computer-readable medium of claim 1 , wherein at least one of the planned first adjustment and the planned second adjustment is configured to be performed as part of a restocking task.

14. The non-transitory computer-readable medium of claim 1 , wherein providing at least one of the first information and the second information includes transmitting instructions to a store associate of a retail store in which the shelf is included.

15. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

determining that the first image is insufficient to determine the first placement;

in response to the determination that the first image is insufficient to determine the first placement, causing at least one of a store associate and a robot to capture an additional image of at least a portion of the at least part of the shelf; and

analyzing the additional image to determine the first placement.

16. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving an indication of an impact of the planned first adjustment to the determined first placement of products; and

determining the planned second adjustment to the determined second placement of products on the at least part of the shelf based on the determined second placement of products and the indication of the impact of the planned first adjustment.

17. A system for making gradual adjustments to planograms, the system comprising:

at least one processor programmed to:

receive a target planogram;

determine a plurality of adjustments to a placement of products on at least part of a shelf, the plurality of adjustments corresponding to a series of steps that, if carried out correctly, would result in compliance with the target planogram; and

provide information configured to cause the adjustments to be implemented;

wherein determining the plurality of adjustments to the placement of products on the at least part of the shelf and providing the information include:

receiving a first image of the at least part of the shelf;

analyzing the first image to determine a first placement of products on the at least part of the shelf;

based on the target planogram and the determined first placement of products, determining a planned first adjustment to a determined first placement of products on the at least part of the shelf, the planned first adjustment corresponding to a step in the series of steps;

based on the planned first adjustment to the determined first placement of products, providing first information, the first information being configured to cause the planned first adjustment to the determined first placement of products to be implemented, wherein providing the first information includes generating a first intermediate target planogram based on the planned first adjustment;

receiving a second image of the at least part of the shelf captured after the first information was provided;

analyzing the second image to determine a second placement of products on the at least part of the shelf;

identifying, based on the second placement of products on the at least part of the shelf, a failed execution of the planned first adjustment;

based on the target planogram, the failed execution of the planned first adjustment, and the determined second placement of products, determining a planned second adjustment to the determined second placement of products on the at least part of the shelf, the planned second adjustment corresponding to an additional step in the series of steps and representing a smaller adjustment than the planned first adjustment based on the failed execution of the planned first adjustment; and

based on the planned second adjustment to the determined second placement of products, providing second information, the second information being configured to cause the planned second adjustment to the determined second placement of products to be implemented, wherein providing the second information includes generating a second intermediate target planogram based on the planned second adjustment.

18. A method for making gradual adjustments to planograms, the method comprising:

receiving a target planogram;

determining a plurality of adjustments to a placement of products on at least part of a shelf, the plurality of adjustments corresponding to a series of steps that, if carried out correctly, would result in compliance with the target planogram; and

providing information configured to cause the adjustments to be implemented;

wherein determining the plurality of adjustments to the placement of products on the at least part of the shelf and providing the information include:

receiving a first image of the at least part of the shelf;

analyzing the first image to determine a first placement of products on the at least part of the shelf;

based on the target planogram and the determined first placement of products, determining a planned first adjustment to a determined first placement of products on the at least part of the shelf, the planned first adjustment corresponding to a step in the series of steps;

based on the determined first adjustment to the determined first placement of products, providing first information, the first information being configured to cause the first adjustment to the determined first placement of products to be implemented, wherein providing the first information includes generating a first intermediate target planogram based on the planned first adjustment;

receiving a second image of the at least part of the shelf captured after the first information was provided;

analyzing the second image to determine a second placement of products on the at least part of the shelf;

identifying, based on the second placement of products on the at least part of the shelf, a failed execution of the planned first adjustment;

based on the target planogram, the failed execution of the planned first adjustment, and the second placement of products, determining a planned second adjustment to the determined second placement of products on the at least part of the shelf, the planned second adjustment corresponding to an additional step in the series of steps and representing a smaller adjustment than the planned first adjustment based on the failed execution of the planned first adjustment; and

based on the planned second adjustment to the determined second placement of products, providing second information, the second information being configured to cause the planned second adjustment to the determined second placement of products to be implemented, wherein providing the second information includes generating a second intermediate target planogram based on the planned second adjustment.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
RELEASE OF SECURITY INTEREST Recorded Sep 26, 2023
From: ALTER DOMUS (US) LLC
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK INC.
Reel/Frame 065028/0871 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2022
From: BRONICKI, YOUVAL; MERKADO, IDO; BERTIN, ANTONIN
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 058893/0381 →
Continuity (6)
Continuation PCTUS2021034885 · May 28, 2021
Provisional Application 63113490 · Nov 13, 2020
Provisional Application 63091009 · Oct 13, 2020
Provisional Application 63084086 · Sep 28, 2020
Provisional Application 63033055 · Jun 1, 2020
Related Publication 20210374642A1 · Dec 2, 2021