IP Library Granted Patent US 11,354,916
Granted Patent B2
US 11,354,916 · App. 17/082,938 · Granted Jun 7, 2022

Prioritizing shelf-oriented tasks

Inventors: Yair Adato (Kfar Shmuel, IL); Youval Bronicki (Los Altos, CA); Shlomi Dayan (Raanana, IL); Galit Peled (Ramat Hasharon, IL); David M. Gottlieb (Denver, CO); Alon Grubshtein (Lehavim, IL); Daniel Shimon Cohen (Hoboken, NJ)
Assignee: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
G06V20/64G06F16/23G06F16/235G06F16/288G06F16/55G06F16/583G06F16/5846G06F16/90335G06F17/18G06K9/6231G06Q10/06311G06Q10/06316G06Q10/063112G06Q10/087G06Q10/0875G06Q20/203G06Q30/0629G06Q30/0639G06Q30/0643G06Q50/28G06T7/0002G06T7/13G06T7/20G06T7/521G06T7/55G06T7/70G06T7/75G06V20/00G06V20/20G06V20/52G06V20/62G06V40/10G08B21/18G08B21/182H04N5/2252H04N5/2253H04N5/23203H04N5/23219H04N5/23229H04N5/247G06T2207/30196G06T2207/30232G06T2207/30242G06V20/68G06V30/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,916
App. No.
17/082,938
Granted
Jun 7, 2022
Kind
B2
Abstract

A system for automatically addressing detected conditions within the retail store is provided. The system may include at least one processor configured to receive a plurality of images depicting a plurality of products displayed on a plurality of store shelves; retrieve reference data specifying a desired state of the retail store; use the reference data to detect an indicator of a first service-improvement condition; use the reference data to detect an indicator of a second service-improvement; determine a first product-related task for addressing the first service-improvement condition; determine a second product-related task for addressing the second service-improvement condition; access a database storing information indicative of a first employee and a second employee on duty during a time interval over which the plurality of images was received; and assign the first product-related task to the first employee and assign the second product-related task to the second employee.

Claims (66)

1. A system for processing images captured in a retail store and automatically addressing detected conditions within the retail store, the system comprising:

at least one processor configured to:

receive a plurality of images depicting a plurality of products displayed on a plurality of store shelves;

retrieve reference data specifying a desired state of the retail store;

use the reference data to detect in the plurality of images an indicator of a first service-improvement condition relating to the plurality of products;

use the reference data to detect in the plurality of images an indicator of a second service-improvement condition relating to the plurality of products;

determine a first product-related task for addressing the first service-improvement condition;

determine a second product-related task for addressing the second service-improvement condition;

access a database storing information indicative of a first employee and a second employee on duty during a time interval over which the plurality of images was received; and

assign the first product-related task to the first employee and assign the second product-related task to the second employee.

2. The system of claim 1 , wherein the first service-improvement condition and the second service-improvement condition each include at least one of: a need for cleaning, a need for product restocking, a need for product rearrangement, a need for product re-orienting, a need for product recall, a need for labeling, a need for updated pricing, a promotion-related need, an identified misplaced product, and an occlusion event.

3. The system of claim 2 , wherein, when the first service-improvement condition and the second service-improvement condition include identified misplaced products, the at least one processor is configured to assign the first product-related task to the first employee and the second product-related task to the second employee based on product categories associated with the identified misplaced products.

4. The system of claim 2 , wherein, when the first service-improvement condition and the second service-improvement condition are occlusion events, the at least one processor is configured to assign the first product-related task to the first employee and the second product-related task to the second employee based on occlusion categories associated with the occlusion events.

5. The system of claim 2 , wherein, when the first service-improvement condition is a need for cleaning, and the second service-improvement condition is a need for product rearrangement, the at least one processor is configured to assign the first product-related task to a robot employee and assign the second product-related task to a human employee.

6. The system of claim 1 , wherein, when the first employee is a robot employee, the at least one processor is further configured to determine that the first service-improvement condition can be resolved by the robot employee, before assigning the first product-related task to the first employee.

7. The system of claim 6 , wherein the at least one processor is further configured to: obtain data indicative of a current physical condition of the robot employee for determining that the first service-improvement condition can be resolved by the robot employee.

8. The system of claim 1 , wherein the at least one processor is further configured to: receive location data indicative of current locations of the first employee and the second employee within the retail store; and

assign the first product-related task to the first employee and the second product-related task to the second employee based on the received location data and identified locations of the first service-improvement condition and the second service-improvement condition.

9. The system of claim 1 , wherein the at least one processor is further configured to access pending assignment data indicative of product-related tasks assigned to the first employee and the second employee; and

assign the first product-related task to the first employee and the second product-related task to the second employee based on at least one pending product-related task previously assigned to the first employee and at least one pending product-related task previously assigned to the second employee.

10. The system of claim 1 , wherein the at least one processor is further configured to access employment data indicative of skill sets associated with each of the first and second employees; and

assign the first product-related task to the first employee and the second product-related task to the second employee based on the skill sets of the first employee and the second employee and a type of the first service-improvement condition and a type of the second service-improvement condition.

11. The system of claim 1 , wherein the at least one processor is further configured to access employment ranking data associated with past performances of the first employee and the second employee; and

assign the first product-related task to the first employee and the second product-related task to the second employee based on the employment ranking data.

12. The system of claim 1 , wherein the at least one processor is further configured to:

determine prioritization of the first product-related task and the second product-related task based on urgency of the first service-improvement condition and the second service-improvement condition; and

assign the first product-related task to the first employee and the second product-related task to the second employee based on the determined prioritization of the first product-related task and the second product-related task.

13. The system of claim 1 , wherein the at least one processor is further configured to:

after assigning the first product-related task to the first employee first, analyze the plurality of images to determine that there is a need for a third product-related task to resolve a third service-improvement condition;

based on the plurality of images, determine that the third service-improvement condition is more urgent than the first service-improvement condition;

assign the third product-related task to the first employee; and

inform the first employee that the third product-related task has priority over the first product-related task.

14. The system of claim 1 , wherein the at least one processor is further configured to:

analyze the plurality of images to determine that the first service-improvement condition had been resolved prior to the arrival of the first employee; and

inform the first employee that the first product-related task has been cancelled.

15. The system of claim 1 , wherein the at least one processor is further configured to:

analyze the plurality of images to identify that the first product-related task has been completed by the first employee; and

update a repository of product-related tasks associated with the first employee based on the identification of the completion of the first product-related task.

16. The system of claim 15 , wherein the at least one processor is further configured to:

analyze the plurality of images to determine a performance quality level associated with the completion of the first product-related task; and

update a performance record associated with the first employee based on the determined performance quality level.

17. A method for processing images captured in a retail store and for automatically addressing detected conditions within the retail store, the method comprising:

receiving a plurality of images depicting a plurality of products displayed on a plurality of store shelves;

retrieving reference data specifying a desired state of the retail store;

using the reference data to detect in the plurality of images an indicator of a first service-improvement condition relating to the plurality of products;

using the reference data to detect in the plurality of images an indicator of a second service-improvement condition relating to the plurality of products;

determining a first product-related task for addressing the first service-improvement condition;

determining a second product-related task for addressing the second service-improvement condition;

accessing a database storing information indicative of a first employee and a second employee on duty during a time interval over which the plurality of images was received; and

assigning the first product-related task to the first employee and assign the second product-related task to the second employee.

18. The method of claim 17 , wherein:

when the first service-improvement condition and the second service-improvement condition include identified misplaced product, the method further comprises: assigning the first product-related task to the first employee and the second product-related task to the second employee based on product categories associated with the identified misplaced products;

when the first service-improvement condition and the second service-improvement condition are occlusion events, the method further comprises: assigning the first product-related task to the first employee and the second product-related task to the second employee based on occlusion categories associated with the occlusion events; and

when the first service-improvement condition is a need for cleaning and the second service-improvement condition is a need for rearrangement, the method further comprises: assigning the first product-related task to a robot employee and assigning the second product-related task to a human employee.

19. The method of claim 17 , wherein, when the first employee is a robot employee, the method further comprises:

obtaining data indicative of a current status of the robot employee for determining that the first service-improvement condition can be resolved by the robot employee; and

based on the obtained data, determining that the first service-improvement condition can be resolved by the robot employee, before assigning the first product-related task to the first employee.

20. A computer program product for processing images captured in a retail store and for automatically addressing detected conditions within the retail store, the computer program product being embodied in a non-transitory computer-readable medium and being executable by at least one processor, the computer program product including instructions for causing the at least one processor to execute a method comprising:

receiving a plurality of images depicting a plurality of products displayed on a plurality of store shelves;

retrieving reference data specifying a desired state of the retail store;

using the reference data to detect in the plurality of images an indicator of a first service-improvement condition relating to the plurality of products;

using the reference data to detect in the plurality of images an indicator of a second service-improvement condition relating to the plurality of products;

determining a first product-related task for addressing the first service-improvement condition;

determining a second product-related task for addressing the second service-improvement condition;

accessing a database storing information indicative of a first employee and a second employee on duty during a time interval over which the plurality of images was received; and

assigning the first product-related task to the first employee and assign the second product-related task to the second employee.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
RELEASE OF SECURITY INTEREST Recorded Sep 26, 2023
From: ALTER DOMUS (US) LLC
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK INC.
Reel/Frame 065028/0871 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
SECURITY INTEREST Recorded Oct 15, 2021
From: TRAX TECHNOLOGY PTE. LTD.; SHOPKICK, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 058184/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: ADATO, YAIR; BRONICKI, YOUVAL; DAYAN, SHLOMI; PELED, GALIT; GOTTLIEB, DAVID M; GRUBSHTEIN, ALON; COHEN, DANIEL SHIMON
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 054200/0662 →
Continuity (7)
Continuation 16578595 · Sep 23, 2019
Continuation 16353499 · Mar 14, 2019
Continuation PCTUS2019013054 · Jan 10, 2019
Provisional Application 62695469 · Jul 9, 2018
Provisional Application 62681718 · Jun 7, 2018
Provisional Application 62615512 · Jan 10, 2018
Related Publication 20210042502A1 · Feb 11, 2021
Cited By (1)
US 12,646,347