IP Library Granted Patent US 11,947,780
Granted Patent B2
US 11,947,780 · App. 18/184,088 · Granted Apr 2, 2024

Timeline-video relationship processing for alert events

Inventors: Christopher Charles Burns (Santa Clara, CA); George Alban Heitz, III (Mountain View, CA); James Edward Stewart (Mountain View, CA); Cameron Hill (San Francisco, CA); Seungho Yang (Mountain View, CA); Joe Delone Venters (Alameda, CA); William Alex Finlayson (San Francisco, CA); Carsten Hinz (Sunnyvale, CA); Timothy Samuel Psiaki (Duvall, WA); Nathan Scott Klee (Kirkland, WA); Gregory Rourk Nelson (San Bruno, CA); Kevin James Avery (San Francisco, CA); Lawrence W. Neal (Oakland, CA); Martin Davidsson (Redwood City, CA)
Assignee: Google LLC
G06F3/0482G06F3/04817G06F16/739G11B27/3081H04L65/61H04N21/2387H04N21/4223H04N21/47217H04N21/488H04N21/8456H04N21/8549H04N21/858G05B15/02G06F40/35H04L65/403H04N7/186H04N21/4312H04N21/632
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,947,780
App. No.
18/184,088
Granted
Apr 2, 2024
Kind
B2
Abstract

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

Claims (71)

1. A method comprising:

detecting one or more alert events associated with a video feed;

assigning one or more alert event indicators to at least portions of the video feed for each of the detected one or more alert events;

displaying, via a display of an electronic device, a user interface having a first region and a second region, the first region of the user interface comprising the video feed, the second region of the user interface comprising:

a timeline having time increment markers and at least one alert event indicator of the one or more alert event indicators, a size of a respective alert event indicator of the one or more alert event indicators based on a temporal length of a respective portion of the video feed to which the respective alert event indicator is assigned, and a spacing between the time increment markers based on a presence and the size of one or more alert event indicators; and

a time position marker that marks a time in the timeline to which the video feed corresponds;

transitioning (i) the timeline with respect to the time position marker or (ii) the time position marker with respect to the timeline; and

displaying, in response to the transitioning, one or more portions of the video feed in the second region of the user interface corresponding to the time in the timeline indicated by time position marker.

2. The method of claim 1 , wherein:

the timeline comprises a first time increment marker, a second time increment marker, and a third time increment marker; and

the timeline comprises a first alert event indicator of the one or more alert event indicators assigned to a first portion of the video feed.

3. The method of claim 2 , wherein:

the first alert event indicator is positioned between the first time increment marker and the second time increment marker; and

a spacing between the first time increment marker and the second time increment marker is greater than a spacing between the second time increment marker and the third time increment marker.

4. The method of claim 2 , wherein:

the first alert event indicator overlaps the second time increment marker such that the first alert event indicator is positioned between the first time increment marker and the third time increment marker; and

a spacing between the first time increment marker and the second time increment marker is equal to a spacing between the second time increment marker and the third time increment marker.

5. The method of claim 2 , wherein:

the timeline comprises a second alert event indicator of the one or more alert event indicators assigned to a second portion of the video feed, the second portion of the video feed being longer than the first portion of the video feed and the second alert event indicator being greater in size than the first alert event indicator;

the first alert event indicator is positioned between the first time increment marker and the second time increment marker;

the second alert event indicator is positioned between the second time increment marker and the third time increment marker; and

a spacing between the first time increment marker and the second time increment marker is less than a spacing between the second time increment marker and the third time increment marker.

6. The method of claim 5 , wherein:

the timelines comprises a fourth time increment marker;

a spacing between the third time increment marker and the fourth time increment marker is less than a spacing between the first time increment marker and the second time increment marker.

7. The method of claim 1 , wherein the transitioning is based on user input, the user input comprising a touch input sliding gesture or scrolling gesture.

8. The method of claim 1 , wherein:

wherein the alert events include alert events of one or more alert event types, the types including one or more of the group consisting of: motion events in a defined zone, motion events not in a defined zone, hazard events, sound events, thermostat events, and door events; and

the size of the respective alert event indicator of the one or more alert event indicators is further based on a type of alert event.

9. The method of claim 8 , wherein an alert event indicator for an alert event of a first type of the alert event types differs from an alert event indicator for an alert event of a second type of the alert event types in at least one visual characteristic.

10. The method of claim 8 , wherein:

alert event indicators for alert events of a first type of the alert event types are arranged along a first linear path, parallel to the timeline, in the second region;

alert event indicators for alert events of a second type of the alert event types are arranged along a second linear path, parallel to the first linear path and to the timeline, in the second region; and

the first linear path and the second linear path are parallel to each other and to the timeline.

11. An electronic device comprising:

a display;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

detecting one or more alert events associated with a video feed;

assigning one or more alert event indicators to at least portions of the video feed for each of the detected one or more alert events;

displaying, via the display, a user interface having a first region and a second region, the first region of the user interface comprising the video feed, the second region of the user interface comprising:

a timeline having time increment markers and at least one alert event indicator of the one or more alert event indicators, a size of a respective alert event indicator of the one or more alert event indicators based on a temporal length of a respective portion of the video feed to which the respective alert event indicator is assigned, and a spacing between the time increment markers based on a presence and the size of one or more alert event indicators; and

a time position marker that marks a time in the timeline to which the video feed corresponds;

transitioning (i) the timeline with respect to the time position marker or (ii) the time position marker with respect to the timeline; and

displaying, in response to the transitioning, one or more portions of the video feed in the second region of the user interface corresponding to the time in the timeline indicated by time position marker.

12. The electronic device of claim 11 , wherein:

the timeline comprises a first time increment marker, a second time increment marker, and a third time increment marker; and

the timeline comprises a first alert event indicator of the one or more alert event indicators assigned to a first portion of the video feed.

13. The electronic device of claim 12 , wherein:

the first alert event indicator is positioned between the first time increment marker and the second time increment marker; and

a spacing between the first time increment marker and the second time increment marker is greater than a spacing between the second time increment marker and the third time increment marker.

14. The electronic device of claim 12 , wherein:

the first alert event indicator overlaps the second time increment marker such that the first alert event indicator is positioned between the first time increment marker and the third time increment marker; and

a spacing between the first time increment marker and the second time increment marker is equal to a spacing between the second time increment marker and the third time increment marker.

15. The electronic device of claim 12 , wherein:

the timelines comprises a second alert event indicator of the one or more alert event indicators assigned to a second portion of the video feed, the second portion of the video feed being longer than the first portion of the video feed and the second alert event indicator being greater in size than the first alert event indicator;

the first alert event indicator is positioned between the first time increment marker and the second time increment marker;

the second alert event indicator is positioned between the second time increment marker and the third time increment marker; and

a spacing between the first time increment marker and the second time increment marker is less than a spacing between the second time increment marker and the third time increment marker.

16. The electronic device of claim 15 , wherein:

the timelines comprises a fourth time increment marker;

a spacing between the third time increment marker and the fourth time increment marker is less than a spacing between the first time increment marker and the second time increment marker.

17. The electronic device of claim 11 , wherein the transitioning is based on user input, the user input comprising a touch input sliding gesture or scrolling gesture.

18. The electronic device of claim 11 , wherein:

wherein the alert events include alert events of one or more alert event types, the types including one or more of the group consisting of: motion events in a defined zone, motion events not in a defined zone, hazard events, sound events, thermostat events, and door events; and

the size of the respective alert event indicator of the one or more alert event indicators is further based on a type of alert event.

19. The electronic device of claim 18 , wherein an alert event indicator for an alert event of a first type of the alert event types differs from an alert event indicator for an alert event of a second type of the alert event types in at least one visual characteristic.

20. The electronic device of claim 18 , wherein:

alert event indicators for alert events of a first type of the alert event types are arranged along a first linear path, parallel to the timeline, in the second region;

alert event indicators for alert events of a second type of the alert event types are arranged along a second linear path, parallel to the first linear path and to the timeline, in the second region; and

the first linear path and the second linear path are parallel to each other and to the timeline.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: BURNS, CHRISTOPHER CHARLES; HEITZ, GEORGE ALBAN, III; STEWART, JAMES EDWARD; HILL, CAMERON; YANG, SEUNGHO; VENTERS, JOE DELONE; FINLAYSON, WILLIAM ALEX; HINZ, CARSTEN; PSIAKI, TIMOTHY SAMUEL; KLEE, NATHAN SCOTT; NELSON, GREGORY ROURK; AVERY, KEVIN JAMES; NEAL, LAWRENCE W.; DAVIDSSON, MARTIN
To: GOOGLE INC.
Reel/Frame 063948/0950 →
CHANGE OF NAME Recorded Jun 14, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 063992/0096 →
Continuity (4)
Continuation 17346622 · Jun 14, 2021
Continuation 16536255 · Aug 8, 2019
Continuation 15335399 · Oct 26, 2016
Related Publication 20230214092A1 · Jul 6, 2023
Cited By (1)
US 12,271,576