IP Library Granted Patent US 11,443,337
Granted Patent B2
US 11,443,337 · App. 17/372,162 · Granted Sep 13, 2022

Method, medium, and system for planning image sensor deployment

Inventors: Youval Bronicki (Los Altos, CA); David Dedi Arev (Bat Yam, IL); Odi Paneth (Givatayim, IL); Ido Merkado (Tel Aviv, IL); May Masha Mordechay (Pardes Hanna, IL)
Assignee: Trax Technology Solutions Pte Ltd.
G06Q30/0208G01G19/52G06K9/628G06K9/629G06K9/6227G06N5/04G06Q10/0639G06Q10/06311G06Q10/06315G06Q10/06375G06Q10/06395G06Q30/018G06Q30/0201G06Q30/0281G06Q30/0601G06Q30/0609G06Q30/0623G06Q30/0639G06Q30/0643G06T7/0002G06T7/50G06T7/70G06T7/73G06T7/97G06V10/225G06V10/40G06V20/00G06V20/10G06V20/20G06V20/52H04L67/303H04W4/029A47L11/4011A47L2201/04G01G19/14G06Q10/087G06Q30/0633G06T2207/30242G06V2201/09H04N7/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,337
App. No.
17/372,162
Granted
Sep 13, 2022
Kind
B2
Abstract

A method for planning deployment of image sensors may include determining a location of a store shelf within a retail store and obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type. The method may also include accessing a database to determine a first height of products of the first product type and a second height of products of the second product type, and determining a position for placing a camera configured to capture images of at least a portion of the store shelf by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height. The method may further include providing, to a user interface of a user device, information relating to the determined position of the camera.

Claims (56)

1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for planning deployment of image sensors, the method comprising:

determining a location of a store shelf within a retail store;

obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;

accessing a database to determine a first height of products of the first product type and a second height of products of the second product type;

determining, by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height, a position for placing a camera that enables image recognition of products represented in an image captured by the camera, the determined position being expressed relative to a coordinate system or an object in the retail store; and

providing, to a user interface of a user device, information relating to the determined position for placing the camera, the provided information including an indication of a particular store shelf to mount the camera to.

2. The non-transitory computer-readable medium of claim 1 , wherein determining the location of the store shelf comprises:

obtaining a store plan; and

determining a location of store shelf based on the store plan.

3. The non-transitory computer-readable medium of claim 2 , wherein the store plan includes a three-dimensional (3D) model of the retail store.

4. The non-transitory computer-readable medium of claim 2 , wherein the store plan is determined based on an analysis of images captured from the retail store to identify store shelves and products placed on the store shelves.

5. The non-transitory computer-readable medium of claim 1 , wherein the first coverage parameter corresponding to the first product type comprises at least one of a depth within a shelf on which a plurality of products of the first product type are planned to be placed, a percent of the plurality of products of the first product type that have been to be captured in an image to enable recognition, a capturing resolution, or a capturing frequency.

6. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining the first product type and the second product type based on a planogram.

7. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining an orientation of the camera.

8. The non-transitory computer-readable medium of claim 7 , wherein the method further comprises:

receiving updated information relating to a product type associated with products placed on the store shelf;

determining an updated orientation of the camera based on the updated information; and

providing, to the user interface of the user device, the updated orientation of the camera.

9. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining a capturing frequency for a usage of the camera.

10. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises generating a simulated image corresponding to a field of view of the camera.

11. The non-transitory computer-readable medium of claim 1 , wherein the information relating to the determined position for placing the camera is provided through an augmented reality (AR) system.

12. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving updated information relating to a product type associated with products placed on the store shelf;

determining an updated position for placing the camera based on the updated information; and

providing, to the user interface of the user device, the updated position for placing the camera.

13. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving updated information relating to the store shelf;

determining an update to at least one of a position for placing the camera and an orientation of the camera based on the updated information; and

providing, to the user interface of the user device, information relating to the update to at least one of the position for placing the camera and the orientation of the camera.

14. The non-transitory computer-readable medium of claim 1 , wherein:

the store shelf comprises a first store shelf; and

the method further comprises:

determining a location of a second store shelf within a retail store; and

determining the position for placing the camera by analyzing the location of the store shelf, the location of the second store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

15. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

determining at least one dimension of the store shelf within a retail store; and

determining the position for placing the camera analyzing the location of the store shelf, the at least one dimension of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

16. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

receiving at least one property of the camera; and

determining the position for placing the camera by analyzing the at least one property of the camera, the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

17. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

selecting a camera among a plurality of cameras as the camera based on properties of each one of the plurality of cameras, the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height; and

providing an indication of the selected camera to the user.

18. A system for planning deployment of image sensors, the system comprising:

at least one processor programmed to:

determine a location of a store shelf within a retail store;

obtain a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;

access a database to determine a first height of products of the first product type and a second height of products of the second product type;

determine, by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height, a position for placing a camera that enables image recognition of products represented in an image captured by the camera, the determined position being expressed relative to a coordinate system or an object in the retail store; and

provide, to a user interface of a user device, information relating to the determined position for placing the camera, the provided information including an indication of a particular store shelf to mount the camera to.

19. A method for planning deployment of image sensors, the method comprising:

determining a location of a store shelf within a retail store;

obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;

accessing a database to determine a first height of products of the first product type and a second height of products of the second product type;

determining, by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height, a position for placing a camera that enables image recognition of products represented in an image captured by the camera, the determined position being expressed relative to a coordinate system or an object in the retail store; and

providing, to a user interface of a user device, information relating to the determined position for placing the camera, the provided information including an indication of a particular store shelf to mount the camera to.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
RELEASE OF SECURITY INTEREST Recorded Sep 26, 2023
From: ALTER DOMUS (US) LLC
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK INC.
Reel/Frame 065028/0871 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2022
From: MERKADO, IDO; PANETH, ODI; AREV, DAVID DEDI; MORDECHAY, MAY MASHA; BRONICKI, YOUVAL
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 058890/0780 →
SECURITY INTEREST Recorded Oct 15, 2021
From: TRAX TECHNOLOGY PTE. LTD.; SHOPKICK, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 058184/0438 →
Continuity (6)
Continuation PCTUS2021034885 · May 28, 2021
Provisional Application 63113490 · Nov 13, 2020
Provisional Application 63091009 · Oct 13, 2020
Provisional Application 63084086 · Sep 28, 2020
Provisional Application 63033055 · Jun 1, 2020
Related Publication 20210374823A1 · Dec 2, 2021
Cited By (1)
US 12,322,155