IP Library Patent Application 17555628
Patent Application
App. No. 17/555,628

TRIGGERING IMAGE PROCESSING BASED ON INFRARED DATA ANALYSIS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/555,628
Abstract

A method for triggering image processing based on infrared data analysis may include receiving first infrared input data captured using a first group of infrared sensors; analyzing the first infrared input data to detect an engagement of a person with a retail shelf; receiving second infrared input data captured using a second group of infrared sensors after the capturing of the first infrared input data; analyzing the second infrared input data to determine a completion of the engagement of the person with the retail shelf; in response to the determined completion of the engagement of the person with the retail shelf, analyzing an image of the retail shelf captured using an image sensor after the completion of the engagement of the person with the retail shelf; and using the analysis of the image to determine a state of the retail shelf.

Claims (49)

1 . A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for triggering image processing based on infrared data analysis, the method comprising:

receiving first infrared input data captured using a first group of one or more infrared sensors;

analyzing the first infrared input data to detect an engagement of a person with a retail shelf;

receiving second infrared input data captured using a second group of one or more infrared sensors after the capturing of the first infrared input data;

analyzing the second infrared input data to determine a completion of the engagement of the person with the retail shelf;

in response to the determined completion of the engagement of the person with the retail shelf, analyzing at least one image of the retail shelf captured using at least one image sensor after the completion of the engagement of the person with the retail shelf; and

using the analysis of the at least one image to determine a state of the retail shelf.

2 . The non-transitory computer-readable medium of claim 1 , wherein the first group of one or more infrared sensors is a group of one or more passive infrared sensors.

3 . The non-transitory computer-readable medium of claim 1 , wherein the first group of one or more infrared sensors is identical to the second group of one or more infrared sensors.

4 . The non-transitory computer-readable medium of claim 1 , wherein the first group of one or more infrared sensors is a group of one or more infrared sensors positioned below a second retail shelf, the second retail shelf is positioned above the retail shelf.

5 . The non-transitory computer-readable medium of claim 1 , wherein the determined state of the retail shelf includes an inventory data associated with products on the retail shelf after the engagement of the person with the retail shelf.

6 . The non-transitory computer-readable medium of claim 1 , wherein the determined state of the retail shelf includes facings data associated with products on the retail shelf after the engagement of the person with the retail shelf.

7 . The non-transitory computer-readable medium of claim 1 , wherein the determined state of the retail shelf includes planogram compliance status associated with the retail shelf after the engagement of the person with the retail shelf.

8 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises using the analysis of the at least one image and an analysis of one or more images of the retail shelf captured using the at least one image sensor before the engagement of the person with the retail shelf to determine a change associated with the retail shelf during the engagement of the person with the retail shelf.

9 . The non-transitory computer-readable medium of claim 1 , wherein the at least one image sensor is at least one image sensor mounted to a second retail shelf.

10 . The non-transitory computer-readable medium of claim 1 , wherein the at least one image sensor is at least one image sensor mounted to an image capturing robot.

11 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises, in response to the determined completion of the engagement of the person with the retail shelf, triggering the capturing of the at least one image of the retail shelf using the at least one image sensor.

12 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

analyzing the first infrared input data to determine a type of the engagement of the person with the retail shelf;

in response to a first determined type of the engagement, triggering the analyzing the at least one image of the retail shelf; and

in response to a second determined type of the engagement, forgoing analyzing the at least one image of the retail shelf.

13 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

analyzing the first infrared input data to determine a type of the engagement of the person with the retail shelf;

in response to a first determined type of the engagement, including a first analysis step in the analysis of the at least one image of the retail shelf; and

in response to a second determined type of the engagement, including a second analysis step in the analysis of the at least one image of the retail shelf, the second analysis step differs from the first analysis step.

14 . The non-transitory computer-readable medium of claim 1 , wherein the determination of the completion of the engagement of the person with the retail shelf is a determination that the person cleared an environment of the retail shelf.

15 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

calculating a convolution of at least part of the first infrared input data;

in response to a first value of the calculated convolution of the at least part of the first infrared input data, detecting the engagement of a person with a retail shelf; and

in response to a second value of the calculated convolution of the at least part of the first infrared input data, forgoing detecting the engagement of a person with a retail shelf.

16 . The non-transitory computer-readable medium of claim 1 , wherein the method further comprises, in response to the detected engagement of a person with a retail shelf, analyzing one or more images of the retail shelf captured before the completion of the engagement of the person with the retail shelf to determine at least one aspect of the engagement.

17 . The non-transitory computer-readable medium of claim 16 , wherein the method further comprises updating a virtual shopping cart associated with the person based on the determined at least one aspect of the engagement.

18 . The non-transitory computer-readable medium of claim 16 , wherein the method further comprises using the analysis of the at least one image of the retail shelf captured after the completion of the engagement of the person with the retail shelf and the determined at least one aspect of the engagement to determine the state of the retail shelf.

19 . A method for triggering image processing based on infrared data analysis, the method comprising:

receiving first infrared input data captured using a first group of one or more infrared sensors;

analyzing the first infrared input data to detect an engagement of a person with a retail shelf;

receiving second infrared input data captured using a second group of one or more infrared sensors after the capturing of the first infrared input data;

analyzing the second infrared input data to determine a completion of the engagement of the person with the retail shelf;

in response to the determined completion of the engagement of the person with the retail shelf, analyzing at least one image of the retail shelf captured using at least one image sensor after the completion of the engagement of the person with the retail shelf; and

using the analysis of the at least one image to determine a state of the retail shelf.

20 . A system for triggering image processing based on infrared data analysis, the system comprising:

at least one processing unit configured to:

receive first infrared input data captured using a first group of one or more infrared sensors;

analyze the first infrared input data to detect an engagement of a person with a retail shelf;

receive second infrared input data captured using a second group of one or more infrared sensors after the capturing of the first infrared input data;

analyze the second infrared input data to determine a completion of the engagement of the person with the retail shelf;

in response to the determined completion of the engagement of the person with the retail shelf, analyze at least one image of the retail shelf captured using at least one image sensor after the completion of the engagement of the person with the retail shelf; and

use the analysis of the at least one image to determine a state of the retail shelf.

21 .- 100 . (canceled)

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2021
From: BRONICKI, YOUVAL
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD
Reel/Frame 058430/0667 →