IP Library › Granted Patent US 11,158,177
Granted Patent B1
US 11,158,177 · App. 17/175,522 · Granted Oct 26, 2021

Video streaming user interface with data from multiple sources

Inventors: Saleh ElHattab (San Francisco, CA); Kathryn Siegel (San Francisco, CA); Noah Paul Gonzales (Sebastopol, CA); Etienne Jean-Claude Dejoie (San Francisco, CA); Maxwell Coleman Goldberg (San Francisco, CA); Joyce Tian Chen (San Francisco, CA); Kelsey Michelle Lam (Fremont, CA); Adam Eric Funkenbusch (Saint Paul, MN); Karthikram Rajadurai (San Leando, CA); Rhea Lin (San Francisco, CA); Sebastian Richard Sangervasi (San Anselmo, CA); Aidan Siobhan Madigan-Curtis (Las Vegas, NV); William Arthur Hughes (San Francisco, CA)
Assignee: SAMSARA INC.
G08B13/19682G06K9/00718G08B13/19641G08B13/19669G08B13/19691G06K2009/00738
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,158,177
App. No.
17/175,522
Filed
Feb 12, 2021
Granted
Oct 26, 2021
Kind
B1
Art Unit
2481
USPC
386/230
Abstract

A management server receives a request to view video content; access a stream of video content corresponding to the request; access and store, in one or more databases, metadata associated with the video content, wherein the metadata includes a plurality of detections and was generated by the video gateway device based on an analysis of the video content and previously uploaded to a remote computing device; generating and causing display of a user interface that includes: the stream of the video content, a seek bar configured to be manipulated by a user so that the user can navigate through the video content, and the metadata overlaid on the seek bar such that the plurality of detections are overlaid at locations on the seek bar corresponding to when the plurality of detections were detected.

Claims (60)

1. A computer-implemented method comprising:

receiving, from a computing device, a request to view video content associated with an earlier point in time;

determining, from a video gateway device, a stream of video content corresponding to the request, wherein the video content was captured by cameras configured to capture video of areas of a manufacturing facility and stored on the video gateway device;

accessing, from one or more databases, previously stored metadata associated with the video content, wherein the previously stored metadata includes a plurality of detections and was generated by the video gateway device based on an analysis of the video content, and wherein the previously stored metadata includes, for each detection:

a classification of the detection,

a beginning time of the detection, and

an ending time of the detection; and

generating instructions to cause display of a user interface on the computing device, wherein the user interface includes:

the determined stream,

an interactive seek bar configured to be manipulated by a user so that the user can navigate through the video content associated with the determined stream, and

the previously stored metadata overlaid on the interactive seek bar such that the plurality of detections are overlaid at locations on the interactive seek bar corresponding to when the plurality of detections were detected, wherein the detections overlaid at locations on the interactive seek bar comprise indications of detection types from a plurality of detection types.

2. The computer-implemented method of claim 1 , wherein the determined stream is received from a video gateway device.

3. The computer-implemented method of claim 1 , wherein the determined stream is received from a management server.

4. The computer-implemented method of claim 3 , further comprising:

storing, in the one or more databases, the determined stream.

5. The computer-implemented method of claim 4 , further comprising:

receiving, from a second computing device, a second request to view video content associated with the earlier point in time; and

generating instructions to cause display of a user interface on the second computing device, wherein the user interface includes:

the determined stream pulled from the one or more databases,

the interactive seek bar, and

the previously stored metadata overlaid on the interactive seek bar.

6. The computer-implemented method of claim 1 , further comprising:

accessing pre-configured video recording criteria configured to be used to determine types of detection to monitor.

7. The computer-implemented method of claim 6 , wherein the pre-configured video recording criteria includes information designating at least a portion of a camera feed, a particular machine, type of motion detected, or a combination.

8. The computer-implemented method of claim 1 , wherein each of the plurality of detections that are overlaid at locations on the seek bar also includes an indication of each respective detection's classification.

9. The computer-implemented method of claim 1 , wherein the previously stored metadata includes one or more screenshots associated with the stream of the video content.

10. The computer-implemented method of claim 9 , further comprising:

receiving input data indicating a manipulation of the interactive seek bar by a user associated with the computing device; and

based on the received input data, generating instructions to cause display of one or more screenshots associated with the determined stream while the interactive seek bar is being manipulated by the user.

11. A management server system comprising:

a computer readable storage medium comprising program instructions; and

one or more processors configured to execute the program instructions to cause the management server system to:

receive, from a computing device, a request to view video content associated with an earlier point in time;

determine, from a video gateway device, a stream of video content corresponding to the request, wherein the video content was captured by cameras configured to capture video of areas of a manufacturing facility and stored on the video gateway device;

access previously stored metadata associated with the video content, wherein the previously stored metadata includes a plurality of detections and was generated by the video gateway device based on an analysis of the video content, and wherein the previously stored metadata includes, for each detection:

a classification of the detection,

a beginning time of the detection, and

an ending time of the detection; and

generate instructions to cause display of a user interface on the computing device, wherein the user interface includes:

the determined stream,

an interactive seek bar configured to be manipulated by a user so that the user can navigate through the video content associated with the determined stream, and

the previously stored metadata overlaid on the interactive seek bar such that the plurality of detections are overlaid at locations on the interactive seek bar corresponding to when the plurality of detections were detected, wherein the detections overlaid at locations on the interactive seek bar comprise indications of detection types from a plurality of detection types.

12. The management server system of claim 11 , wherein the determined stream is received from a video gateway device.

13. The management server system of claim 11 , wherein the determined stream is received from a management server.

14. The management server system of claim 13 , wherein the one or more processors are configured to execute the program instructions to further cause the management server system to:

store, in one or more databases, the determined stream.

15. The management server system of claim 14 , wherein the one or more processors are configured to execute the program instructions to further cause the management server system to:

receive, from a second computing device, a second request to view video content associated with the earlier point in time; and

generate instructions to cause display of a user interface on the second computing device, wherein the user interface includes:

the determined stream pulled from the one or more databases,

the interactive seek bar, and

the previously stored metadata overlaid on the interactive seek bar.

16. The management server system of claim 11 , wherein the one or more processors are configured to execute the program instructions to further cause the management server system to:

access pre-configured video recording criteria configured to be used to determine types of detection to monitor.

17. The management server system of claim 16 , wherein the pre-configured video recording criteria includes information designating at least a portion of a camera feed, a particular machine, type of motion detected, or a combination.

18. The management server system of claim 11 , wherein each of the plurality of detections that are overlaid at locations on the seek bar also includes an indication of each respective detection's classification.

19. The management server system of claim 11 , wherein the previously stored metadata includes one or more screenshots associated with the stream of the video content.

20. The management server system of claim 19 , wherein the one or more processors are configured to execute the program instructions to further cause the management server system to:

receive input data indicating a manipulation of the interactive seek bar by a user associated with the computing device; and

based on the received input data, generating instructions to cause display of one or more screenshots associated with the determined stream while the interactive seek bar is being manipulated by the user.

Assignments (2)
CHANGE OF NAME Recorded Mar 19, 2021
From: SAMSARA NETWORKS INC.
To: SAMSARA INC.
Reel/Frame 055665/0121 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2021
From: ELHATTAB, SALEH; SIEGEL, KATHRYN; GONZALES, NOAH PAUL; DEJOIE, ETIENNE JEAN-CLAUDE; GOLDBERG, MAXWELL COLEMAN; CHEN, JOYCE TIAN; LAM, KELSEY MICHELLE; FUNKENBUSCH, ADAM ERIC; RAJADURAI, KARTHIKRAM; LIN, RHEA; SANGERVASI, SEBASTIAN RICHARD; MADIGAN-CURTIS, AIDAN SIOBHAN; HUGHES, WILLIAM ARTHUR
To: SAMSARA NETWORKS INC.
Reel/Frame 055667/0465 →
Continuity (2)
Provisional Application 63109257 · Nov 3, 2020
Provisional Application 63109272 · Nov 3, 2020
Cited By (47)
US 12,197,610 US 12,200,046 US 12,213,090 US 12,228,944 US 12,253,617 US 12,256,021 US 12,260,616 US 12,269,498 US 12,289,181 US 12,294,809 US 12,306,010 US 12,307,878 US 12,323,744 US 12,327,445 US 12,328,639 US 12,344,168 US 12,346,712 US 12,361,805 US 12,367,718 US 12,368,903 US 12,426,007 US 12,445,285 US 12,450,329 US 12,479,446 US 12,501,178 US 12,511,947 US 12,524,314 US 12,534,097 US 12,561,624 US 12,565,143 US 12,626,200 US 12,630,050 US 12,639,950 US 12,646,402 US 12,651,529 US 12,662,152 US 12,665,989 US 12,671,464 US 12,675,419 US 12,693,653 US 12,701,004 US 12,720,162 US 12,726,671 US 12,730,425 US 12,739,298 US 12,742,846 US 12,748,942