IP Library Granted Patent US 10,121,515
Granted Patent B2
US 10,121,515 · App. 15/368,357 · Granted Nov 6, 2018

Method, system and computer program product for interactively identifying same individuals or objects present in video recordings

Inventors: Moussa Doumbouya (Melrose, MA); Mahesh Saptharishi (Sudbury, MA); Eric Sjue (Vancouver, CA); Hannah Valbonesi (Burnaby, CA)
Assignee: Avigilon Corporation
G11B27/22G06F3/0482G06F3/04847G11B27/102G11B27/309G11B27/3081G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,121,515
App. No.
15/368,357
Granted
Nov 6, 2018
Kind
B2
Abstract

A method, system and computer program product for interactively identifying same individuals or objects present in video recordings is disclosed. When a thumbnail in a set of thumbnails is selected, new information is obtained. The new information may be that an individual or object is present in the portion of the video recording associated with the thumbnail. A search can be carried out for the individual or object based on the new information. The search generates new match likelihoods for each of displayed thumbnails within a user interface page. The displayed thumbnails are re-ordered based on the new match likelihoods.

Claims (18)

1. A method comprising:

displaying a plurality of sets of thumbnails, each set of thumbnails including one or more thumbnails positioned in a respective row or column which, along with the set of thumbnails, are defined by a unique time interval of a plurality of time intervals, and each thumbnail of each set of thumbnails being visually representative of an associated portion of a video recording taken at the defined time interval for the thumbnail, and the one or more thumbnails in each set of thumbnails being organized in a descending order arrangement starting at one end of the respective row or column with a thumbnail corresponding to a highest likelihood, as compared to any other thumbnails of the set, of appearance of an individual or object having been identified as being of interest, and any remaining thumbnails in the set are displayed, in descending order, extending away from the thumbnail corresponding to the highest likelihood;

allowing selection of a first thumbnail in one of the sets of thumbnails to obtain new information that the individual or object is present in the portion of the video recording associated with the first thumbnail;

carrying out a search for the individual or object based on the new information, wherein the search generates new match likelihoods for each of the displayed thumbnails;

re-ordering the displayed thumbnails based on the new match likelihoods so as to maintain the descending order arrangement in each of the sets of thumbnails.

2. The method as claimed in claim 1 further comprising displaying new thumbnails interspersed with remaining pre-search thumbnails.

3. The method as claimed in claim 1 wherein the re-ordering the displayed thumbnails includes re-ordering only a sub-set of pre-search thumbnails with other pre-search thumbnails being no longer displayed due to respectively lowered match likelihoods.

4. The method as claimed in claim 1 wherein, after the selection of the first thumbnail, the first thumbnail is moved to a user interface space separate from another user interface space within which the plurality of sets of thumbnails are displayed.

5. The method as claimed in claim 1 wherein the plurality of sets of thumbnails are displayed within a user interface page, and the user interface page includes an interactive tool for changing the plurality of time intervals.

6. A tangible, non-transitory, computer-readable storage medium having instructions encoded therein, wherein the instructions, when executed by at least one processor, cause a carrying out of a method comprising:

displaying a plurality of sets of thumbnails, each set of thumbnails including one or more thumbnails positioned in a respective row or column which, along with the set of thumbnails, are defined by a unique time interval of a plurality of time intervals, and each thumbnail of each set of thumbnails being visually representative of an associated portion of a video recording taken at the defined time interval for the thumbnail, and the one or more thumbnails in each set of thumbnails being organized in a descending order arrangement starting at one end of the respective row or column with a thumbnail corresponding to a highest likelihood, as compared to any other thumbnails of the set, of appearance of an individual or object having been identified as being of interest, and any remaining thumbnails in the set are displayed, in descending order, extending away from the thumbnail corresponding to the highest likelihood;

allowing selection of a first thumbnail in one of the sets of thumbnails to obtain new information that the individual or object is present in the portion of the video recording associated with the first thumbnail;

sending a request to a server to search for the individual or object based on the new information, wherein the search generates new match likelihoods for each of the displayed thumbnails;

re-ordering the displayed thumbnails based on the new match likelihoods so as to maintain the descending order arrangement in each of the sets of thumbnails.

7. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the method further comprises displaying new thumbnails interspersed with remaining pre-search thumbnails.

8. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the re-ordering the displayed thumbnails includes re-ordering only a sub-set of pre-search thumbnails with other pre-search thumbnails being no longer displayed due to respectively lowered match likelihoods.

9. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein, after the selection of the first thumbnail, the first thumbnail is moved to a user interface space separate from another user interface space within which the plurality of sets of thumbnails are displayed.

10. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the plurality of sets of thumbnails are displayed within a user interface page, and the user interface page includes an interactive tool for changing the plurality of time intervals.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 31, 2022
From: AVIGILON CORPORATION
To: MOTOROLA SOLUTIONS, INC.
Reel/Frame 061361/0905 →
MERGER Recorded Nov 21, 2018
From: MOTOROLA SOLUTIONS CANADA HOLDINGS INC.; AVIGILON CORPORATION
To: AVIGILON CORPORATION
Reel/Frame 048407/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2018
From: SJUE, ERIC; VALBONESI, HANNAH
To: AVIGILON CORPORATION
Reel/Frame 045757/0290 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2018
From: DOUMBOUYA, MOUSSA; SAPTHARISHI, MAHESH; SJUE, ERIC; VALBONESI, HANNAH
To: AVIGILON CORPORATION
Reel/Frame 045757/0303 →
Continuity (3)
Provisional Application 62346240 · Jun 6, 2016
Provisional Application 62351806 · Jun 17, 2016
Related Publication 20170352380A1 · Dec 7, 2017
Cited By (1)
US 12,288,400