IP Library Granted Patent US 10,963,701
Granted Patent B2
US 10,963,701 · App. 15/889,020 · Granted Mar 30, 2021

Techniques for identifying and indexing distinguishing features in a video feed

Inventors: Rongbin Lanny Lin (Orem, UT); Brandon Bunker (Highland, UT); Aaron Davis (Pleasant Grove, UT); Shiwei Liu (Draper, UT); Matthew Mahar (Salt Lake City, UT); Matthew J. Eyring (Provo, UT); Clint Gordon-Carroll (Orem, UT); Jeremy B. Warren (Draper, UT); James Ellis Nye (Alpine, UT); Jefferson Lyman (Alpine, UT)
Assignee: Vivint, Inc.
G06K9/00751G11B27/028G11B27/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,963,701
App. No.
15/889,020
Granted
Mar 30, 2021
Kind
B2
Abstract

A method for security and/or automation systems is described. In one embodiment, the method may include receiving a plurality of video footage at a home automation system from at least one video monitor. The method may further include reviewing the plurality of video footage recorded over a predetermined period of time. The method may further include automatically identifying at least one distinguishing feature in the video footage over the predetermined period of time, and automatically indexing the video footage based, at least in part, on identifying the at least one distinguishing feature in the video footage.

Claims (48)

1. A method for security and/or automation systems at a computing device, comprising:

receiving, at the computing device, a plurality of video footage at a premises and at least one user preference at the premises;

reviewing, by the computing device, the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;

automatically detecting, by the computing device, a pattern in the received at least one user preference at the premises;

determining, by the computing device, a second user preference based at least in part on the detected pattern in the received at least one user preference;

automatically identifying, by the computing device, a first distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and

automatically indexing, by the computing device, the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

2. The method of claim 1 , further comprises:

automatically indexing, by the computing device, at least one extended clip of video footage based at least in part on the received at least one user preference, or the detected pattern, or a combination thereof.

3. The method of claim 1 , wherein receiving the plurality of video footage at the premises and the at least one user preference at the premises comprises:

receiving, at the computing device, the at least one user preference associated with one or more distinguishing features comprising at least the first distinguishing feature, the one or more distinguishing features to be identified in the video footage.

4. The method of claim 3 , wherein the received at least one user preference comprises one or more of an identified animate object, an audio feature, a visual feature, a time, a location, a detected increased occupancy, a detected motion, or an expression.

5. The method of claim 4 , wherein indexing the video footage comprises:

identifying, by the computing device, the plurality of individual clips of the video footage that comprise an identified common distinguishing feature corresponding to the first distinguishing feature.

6. The method of claim 1 , further comprises:

reviewing, by the computing device, the plurality of video footage recorded over the predetermined period of time based at least in part on the received at least one user preference.

7. The method of claim 1 , wherein receiving the at least one user preference comprises:

receiving, via one or more sensors coupled to the computing device, an auditory or a gestural command, or a combination thereof, from a user, wherein automatically indexing the video footage is based at least in part on the received auditory or gestural command from the user.

8. The method of claim 1 , further comprising:

monitoring, by the computing device, a currently recording video footage at the premises;

identifying, by the computing device, at least one emergency event in the currently recording video footage based at least in part on a facial recognition, a motion, a vibration, a vital sign, or a combination thereof; and

communicating an emergency alert to a third party.

9. The method of claim 1 , wherein the video footage is assembled into any of at least one thumbnail, clip, a condensed video clip, a single-cut video, a still photograph, or a combination thereof.

10. The method of claim 9 , further comprising:

displaying, at an interface of the computing device, the condensed video clip to a user of the premises; and

extending, by the computing device, the condensed video clip based at least in part on a selection received from the user.

11. An apparatus for security and/or automation systems, comprising:

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to:

receive a plurality of video footage at a premises and at least one user preference at the premises;

review the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;

automatically detect a pattern in the received at least one user preference at the premises;

determine a second user preference based at least in part on the detected pattern in the received at least one user preference;

automatically identify a first at least one distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and

automatically index the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

12. The apparatus of claim 11 , wherein the processor is further configured to:

index at least one extended clip of video footage based at least in part on the received at least one user preference, or the detected pattern, or a combination thereof.

13. The apparatus of claim 11 , wherein the processor is further configured to:

receive the at least one user preference associated with one or more distinguishing features comprising at least the first distinguishing feature, the one or more distinguishing features to be identified in the video footage.

14. The apparatus of claim 13 , wherein the received at least one user preference comprises one or more of an identified animate object, an audio feature, a visual feature, a time, a location, a detected increased occupancy, a detected motion, or an expression.

15. A non-transitory computer-readable medium storing computer-executable code, the code executable by a processor to:

receive a plurality of video footage at a premises and at least one user preference at the premises;

review the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;

automatically detect a pattern in the received at least one user preference at the premises;

determine a second user preference based at least in part on the detected pattern in the received at least one user preference;

automatically identify a first distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and

automatically index the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

Assignments (9)
AFTER-ACQUIRED INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 27, 2025
From: VIVINT LLC; SMART HOME PROS, INC.; VIVINT AMIGO, INC.
To: DEUTSCHE BANK TRUST COMPANY AMERICAS, AS PRIORITY COLLATERAL TRUSTEE
Reel/Frame 070349/0816 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2025
From: VIVINT, INC.
To: VIVINT LLC
Reel/Frame 069767/0257 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 049283, FRAME 0566 Recorded Nov 11, 2024
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: VIVINT, INC.
Reel/Frame 069334/0137 →
RELEASE (REEL 047029/ FRAME 0304) Recorded Nov 1, 2024
From: BANK OF AMERICA, N.A.
To: VIVINT LLC (F/K/A VIVINT, INC.)
Reel/Frame 069289/0468 →
RELEASE OF SECURITY INTEREST Recorded Jul 12, 2021
From: BANK OF AMERICA, N.A.
To: VIVINT, INC.
Reel/Frame 056832/0824 →
SECURITY AGREEMENT Recorded May 23, 2019
From: VIVINT, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 049283/0566 →
SUPPL. NO. 2 SECURITY AGREEMENT Recorded Sep 6, 2018
From: VIVINT, INC.
To: BANK OF AMERICA N.A.
Reel/Frame 047024/0048 →
SECURITY AGREEMENT Recorded Sep 6, 2018
From: VIVINT, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 047029/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2018
From: LIN, RONGBIN LANNY; BUNKER, BRANDON; DAVIS, AARON; LIU, SHIWEI; EYRING, MATTHEW J.; GORDON-CARROLL, CLINT; WARREN, JEREMY B.; MAHAR, MATTHEW; NYE, JAMES ELLIS; LYMAN, JEFFERSON
To: VIVINT, INC.
Reel/Frame 044836/0087 →
Continuity (2)
Continuation 14629207 · Feb 23, 2015
Related Publication 20180225520A1 · Aug 9, 2018