IP Library › Granted Patent US 12,437,530
Granted Patent B2
US 12,437,530 · App. 18/040,735 · Granted Oct 7, 2025

Method, system and computer program product for correlating objects of interest based on difference and similarities analysis

Inventors: Grzegorz Gustof (Myslenice, PL); Pawel Niemiec (Rzeszow, PL); Pawel Wilkosz (Wisniowa, PL)
Assignee: MOTOROLA SOLUTIONS, INC.
G06V10/945G06F3/013G06V10/761G06V20/52G06V20/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,437,530
App. No.
18/040,735
Granted
Oct 7, 2025
Kind
B2
Abstract

A method, system and computer program product for correlating objects of interest based on difference and similarities analysis is disclosed. The method includes receiving input that a human user is focused on a portion of a first image during a first period of time, and also focused on a portion of a second image during a second period of time. In response to the input being received, a first analytics-based action may be initiated when certain similarity/difference conditions are met, or a second analytics-based action may be initiated when certain other similarity/difference conditions are met.

Claims (44)

1. A method comprising:

storing first and second images within at least one storage;

displaying the first image during a first period of time;

displaying the second image during a second period of time;

receiving input that a human user is focused on:

a portion of the first image during the first period of time, and

a portion of the second image during the second period of time;

determining a first similarity score between a first object of interest in the portion of the first image and a second object of interest in the portion of the second image;

determining a second similarity score between a first background portion of the first image and a second background portion of the second image;

in response to the input being received:

initiating a first analytics-based action when the first similarity score exceeds a first upper threshold and the second similarity score falls below a second lower threshold; or

initiating a second analytics-based action when the first similarity score falls below a first lower threshold and the second similarity score exceeds a second upper threshold; and

employing a gaze determination device to determine that the human user is focused on the portion of the first image during the first period of time, and the portion of the second image during the second period of time,

wherein the gaze determination device is configured to be worn on a head or face of the human user, and is positionable to rest proximate to an eye region of the human user.

2. The method of claim 1 wherein at least one of the portion of the first image and the portion of the second image are less than an entirety of the first image.

3. The method of claim 1 wherein the first period of time and the second period of time at least partly overlap.

4. The method of claim 1 wherein an end of the first period of time and a beginning of the second period in time differ by less than a contemporaneity threshold required for the input to be received.

5. The method of claim 1 wherein the first similarity score falls within a percentage range, the percentage range having a lower percentage bound above 50% and an upper percentage bound below 100%.

6. The method of claim 1 wherein the first similarity score falls within a percentage range, the percentage range having a lower percentage bound above 0% and an upper percentage bound below 50%.

7. The method of claim 1 wherein the at least one storage includes cloud storage at a location remote from the human user.

8. The method of claim 1 wherein the first analytics-based action is providing a notification to the human user that includes similarity particulars in relation to the first and second objects of interest.

9. The method of claim 1 wherein the second analytics-based action is providing a notification to the human user that includes difference particulars in relation to the first and second objects of interest.

10. A system comprising:

at least one display apparatus configured to:

display a first image during a first period of time; and

display a second image during a second period of time;

at least one storage configured to store the first and second images;

at least one processor in communication with the storage and the display apparatus, the at least one processor configured to:

receive input that a human user of the system is focused on:

a portion of the first image during the first period of time, and

a portion of the second image during the second period of time;

determining a first similarity score between a first object of interest in the portion of the first image and a second object of interest in the portion of the second image;

determining a second similarity score between a first background portion of the first image and a second background portion of the second image; and

in response to the input being received:

initiate a first analytics-based action when the first similarity score exceeds a first upper threshold and the second similarity score falls below a second lower threshold; or

initiate a second analytics-based action when the first similarity score falls below a first lower threshold and the second similarity score exceeds a second upper threshold; and

a gaze determination device configured to determine that the human user is focused on the portion of the first image during the first period of time, and the portion of the second image during the second period of time,

wherein the gaze determination device is configured to be worn on a head or face of the human user, and is positionable to rest proximate to an eye region of the human user.

11. The system as claimed in claim 10 wherein the at least one storage includes cloud storage at a location remote from the human user.

12. The system as claimed in claim 10 wherein the first analytics-based action is providing a notification to the human user that includes similarity particulars in relation to the first and second objects of interest.

13. The system as claimed in claim 10 wherein the second analytics-based action is providing a notification to the human user that includes difference particulars in relation to the first and second objects of interest.

14. The system as claimed in claim 10 wherein at least one of the portion of the first image and the portion of the second image are less than an entirety of the first image.

15. The system as claimed in claim 10 wherein the first period of time and the second period of time at least partly overlap.

16. The system as claimed in claim 10 wherein an end of the first period of time and a beginning of the second period in time differ by less than a contemporaneity threshold required for the input to be received.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: GUSTOF, GRZEGORZ; NIEMIEC, PAWEL; WILKOSZ, PAWEL
To: MOTOROLA SOLUTIONS INC.
Reel/Frame 062603/0110 →
Continuity (1)
Related Publication 20230281984A1 · Sep 7, 2023
References Cited (19)
US 9202117B2 · Kundu et al. · 2015 [cited by applicant]
US 9317113B1 · Karakotsios et al. · 2016 [cited by applicant]
US 9571797B2 · Kanehira · 2017 [cited by examiner]
US 10528794B2 · Koskan et al. · 2020 [cited by applicant]
US 20060056733A1 · Minakuti · 2006 [cited by examiner]
US 20120243796A1 · Saito · 2012 [cited by examiner]
US 20120274777A1 · Saptharishi · 2012 [cited by examiner]
US 20160086342A1 · Yamaji · 2016 [cited by examiner]
US 20170109601A1 · Gurwicz et al. · 2017 [cited by applicant]
US 20170318019A1 · Gordon · 2017 [cited by examiner]
US 20180189600A1 · Astrom · 2018 [cited by examiner]
US 20190180456A1 · Razumkov · 2019 [cited by examiner]
US 20200074210A1 · Beach · 2020 [cited by examiner]
US 20210125639A1 · Cai · 2021 [cited by examiner]
EP 3015952B1 · 2019 [cited by applicant]
H. R. Tavakoli, A. Borji, R. M. Anwer, E. Rahtu and J. Kannala, “Bottom-Up Attention Guidance for Recurrent Image Recognition,” 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 2018, p… [cited by applicant]
X. Xu, T. M. Hospedales and S. Gong, “Discovery of Shared Semantic Spaces for Multiscene Video Query and Summarization,” in IEEE Transactions on Circuits and Systems for Video Technology, vol. 27, No. 6, pp. 1353-1367, … [cited by applicant]
P. Napoletano, G. Boccignone and F. Tisato, “Attentive Monitoring of Multiple Video Streams Driven by a Bayesian Foraging Strategy,” in IEEE Transactions on Image Processing, vol. 24, No. 11, pp. 3266-3281, Nov. 2015, d… [cited by applicant]
The International Search Report and the Written Opinion corresponding patent application No. PCT/PL2020/050082 filed: Nov. 10, 2020, all pages. [cited by applicant]