IP Library › Granted Patent US 12,657,911
Granted Patent B2
US 12,657,911 · App. 17/944,132 · Granted Jun 16, 2026

Using user-triggered video recordings and/or user-exported video recordings as a basis to identify future videos of interest

Inventor: Abhisekh Jain (Madurai, IN)
Assignee: HONEYWELL INTERNATIONAL INC.
G06V20/41G06V10/945G06V20/47G06V20/48H04N5/77G06V10/70G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,657,911
App. No.
17/944,132
Filed
Sep 13, 2022
Granted
Jun 16, 2026
Kind
B2
Art Unit
2676
USPC
382/159
Abstract

Video analytics may be performed on user-triggered video recording to generate metadata that describes what was found in the user-triggered video recording. A subsequent video stream may be analyzed, thereby generating metadata associated with the subsequent video stream. The metadata associated with the subsequent video stream may be compared with the metadata associated with the user-triggered recording. When the metadata associated with the subsequent video stream matches the metadata associated one or more of the user-triggered video recordings in accordance with one or more matching criteria, an inquiry is outputted to an operator soliciting whether a user-triggered video recording should be initiated for the subsequent video stream. The method includes receiving from the operator a response to the inquiry indicating whether to initiate a user-triggered video recording of the subsequent video stream, and if so, initiating a user-triggered video recording of the subsequent video stream.

Claims (62)

1 . A method for using user-triggered video recordings to find subsequent video streams of interest, the method comprising:

for at least some of the user-triggered video recordings:

performing video analytics on the corresponding user-triggered video recording to find one or more events, objects and/or characteristics within the corresponding user-triggered video recording;

generating metadata that corresponds to the one or more events, objects and/or characteristics found within the corresponding user-triggered video recording, including a time of day that the corresponding event, object and/or characteristic was captured in the respective video recording;

associating the metadata with the corresponding user-triggered video recording;

receiving a subsequent video stream, wherein for the subsequent video stream:

performing video analytics on the subsequent video stream to find one or more events, objects and/or characteristics within the subsequent video stream;

generating metadata that describes the one or more events, objects and/or characteristics found within the subsequent video stream, including a time of day that the corresponding event, object and/or characteristic was captured in the subsequent video stream;

compare the metadata associated with the subsequent video stream to the metadata associated one or more of the user-triggered video recordings;

when the metadata associated with the subsequent video stream matches the metadata associated one or more of the user-triggered video recordings in accordance with one or more matching criteria, outputting an inquiry to an operator soliciting from the operator whether a user-triggered video recording should be initiated for the subsequent video stream, wherein the one or more matching criteria comprise a matching time of day that the respective one or more events, objects and/or characteristics were captured; and

receiving from the operator a response to the inquiry indicating whether to initiate a user-triggered video recording of the subsequent video stream, and if so, initiating a user-triggered video recording of the subsequent video stream, and if not, not initiating a user-triggered video recording of the subsequent video stream.

2 . The method of claim 1 , wherein the subsequent video stream comprises a live-video stream.

3 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise one or more of:

one or more facial characteristics of a detected person suitable for facial recognition;

one or more clothing characteristics of a detected person;

a gender;

an estimated age;

an overall number of people;

a crowd density;

an interaction between two or more inanimate objects;

an interaction between a person and an inanimate object;

a presence of smoke;

a presence of flame;

a noise;

a noise level;

a scream; and

a video characteristic of being blurry, at least partially blocked, too dark, too light, or not stable.

4 . The method of claim 3 , wherein the one or more matching criteria comprise one or more matching events, objects and/or characteristics.

5 . The method of claim 3 , wherein the one or more matching criteria comprise a combination of two or more matching events, objects and/or characteristics.

6 . The method of claim 1 , wherein one or more of the matching criteria are learned over time using machine learning.

7 . The method of claim 1 , wherein the metadata associated with the subsequent video stream is compared to the metadata associated one or more of the user-triggered video recordings using a crawler.

8 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise an overall number of people.

9 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise an interaction between a person and an inanimate object.

10 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise a presence of smoke or a presence of flame.

11 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise a noise level.

12 . The method of claim 1 , wherein the one or more events, objects and/or characteristics comprise a video characteristic of being blurry, at least partially blocked, too dark, too light, or not stable.

13 . A method for using stored video recordings, at least some of the stored video recordings including user-triggered video recordings and/or user-exported video recordings, to find other videos of interest, the method comprising:

for each of the user-triggered video recordings and/or user-exported video recordings:

performing video analytics on the corresponding user-triggered video recording and/or the corresponding user-exported video recording to find one or more events, objects and/or characteristics within the corresponding user-triggered video recording and/or the corresponding user-exported video recording;

generating metadata that describes the one or more found events, objects and/or characteristics, including a time of day that the corresponding event, object and/or characteristic was captured in the respective video recording;

associating the metadata with the corresponding user-triggered video recording and/or the corresponding user-exported video recording;

receiving a subsequent video stream, wherein for the subsequent video stream:

performing video analytics on the subsequent video stream to find one or more events, objects and/or characteristics within the subsequent video stream;

generating metadata that describes the one or more events, objects and/or characteristics found within the subsequent video stream, including a time of day that the corresponding event, object and/or characteristic was captured in the subsequent video stream;

compare the metadata associated with the subsequent video stream to the metadata associated one or more of the user-triggered video recordings and/or one or more user-exported video recordings;

when the metadata associated with the subsequent video stream matches the metadata associated one or more of the user-triggered video recordings and/or one or more user-exported video recordings in accordance with one or more matching criteria, outputting an inquiry to an operator soliciting from the operator whether a user-triggered video recording should be initiated for the subsequent video stream, wherein the one or more matching criteria include a matching time of day that the respective one or more events, objects and/or characteristics were captured; and

receiving from the operator a response to the inquiry indicating whether to initiate a user-triggered video recording of the subsequent video stream, and if so, initiating a user-triggered video recording of the subsequent video stream, and if not, not initiating a user-triggered video recording of the subsequent video stream.

14 . The method of claim 13 , wherein at least one of the other videos comprise a live-streaming video.

15 . The method of claim 13 , wherein at least one of the other videos comprise a previously recorded video.

16 . The method of claim 13 , further comprising displaying at least part of the videos of interest for review by an operator.

17 . The method of claim 13 , wherein performing video analytics comprises identifying one or more objects and classifying one or more of the identified objects into one of a plurality of object classifications.

18 . A method for using user-triggered video recordings to find subsequent video streams of interest, the method comprising:

for at least some of the user-triggered video recordings:

performing video analytics on the corresponding user-triggered video recording to find one or more events, objects and/or characteristics within the corresponding user-triggered video recording;

generating metadata that corresponds to the one or more events, objects and/or characteristics found within the corresponding user-triggered video recording;

associating the metadata with the corresponding user-triggered video recording;

receiving a subsequent video stream, wherein for the subsequent video stream:

performing video analytics on the subsequent video stream to find one or more events, objects and/or characteristics within the subsequent video stream;

generating metadata that describes the one or more events, objects and/or characteristics found within the subsequent video stream;

compare the metadata associated with the subsequent video stream to the metadata associated one or more of the user-triggered video recordings;

when the metadata associated with the subsequent video stream matches the metadata associated one or more of the user-triggered video recordings in accordance with one or more matching criteria, outputting an inquiry to an operator soliciting from the operator whether a user-triggered video recording should be initiated for the subsequent video stream, wherein the one or more matching criteria comprise a crowd density; and

receiving from the operator a response to the inquiry indicating whether to initiate a user-triggered video recording of the subsequent video stream, and if so, initiating a user-triggered video recording of the subsequent video stream, and if not, not initiating a user-triggered video recording of the subsequent video stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2022
From: JAIN, ABHISEKH
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 061083/0068 →
Continuity (1)
Related Publication 20240087315A1 · Mar 14, 2024
References Cited (25)
US 9348909B1 · Goikhman · 2016 [cited by examiner]
US 9900632B1 · Flores Guerra · 2018 [cited by examiner]
US 10038872B2 · Worrill · 2018 [cited by examiner]
US 10271111B2 · Stieglitz · 2019 [cited by applicant]
US 10412346B1 · Yu · 2019 [cited by examiner]
US 10438465B1 · Bart · 2019 [cited by examiner]
US 10750209B1 · Edwards · 2020 [cited by examiner]
US 10868672B1 · Farrugia · 2020 [cited by examiner]
US 10911725B2 · Ross · 2021 [cited by examiner]
US 10997423B1 · Borras · 2021 [cited by examiner]
US 11776271B2 · Janakiraman · 2023 [cited by examiner]
US 20040218904A1 · Yoon et al. · 2004 [cited by applicant]
US 20160286156A1 · Kovac · 2016 [cited by examiner]
US 20170148488A1 · Li et al. · 2017 [cited by applicant]
US 20170213086A1 · Cao · 2017 [cited by examiner]
US 20180012078A1 · Pournaghi · 2018 [cited by examiner]
US 20200327313A1 · Kedarisetti · 2020 [cited by examiner]
US 20200364468A1 · Sulzer et al. · 2020 [cited by applicant]
US 20210158048A1 · Lee · 2021 [cited by examiner]
US 20220222943A1 · Loeshelle · 2022 [cited by applicant]
CA 2588219C · 2014 [cited by applicant]
P. V. V. Kishore, R. Rahul, K. Sravya and A. S. C. S. Sastry, “Crowd Density Analysis and tracking,” 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Kochi, India, 2015, p… [cited by examiner]
Extended European Search Report, EP Application No. 23193130.4; European Patent Office, Dec. 4, 2023 (9 pages). [cited by applicant]
Ma, et al; “A Retrieval Optimized Surveillance Video Storage System for Campus Application,” vol. 2018, Article ID 3839104, 10 pages, 2018. [cited by applicant]
Mei, et al; “Near-Lossless Semantic Video Summarization and Its Applications to Video Analyses,” 2012.ACM Trans. Mulitmedia Comput. Commun. Appl. 2,3 Article 1, 23 pages, 2010. [cited by applicant]