IP Library Granted Patent US 11,895,346
Granted Patent B2
US 11,895,346 · App. 17/953,258 · Granted Feb 6, 2024

Techniques for secure video frame management

Inventors: Anush G. Nadathur (San Jose, CA); Keith W. Rauenbuehler (San Francisco, CA); Kenneth A. York (San Jose, CA); Varinder Singh (Mountain View, CA); Nicholas M. Fraioli (Mountain View, CA)
Assignee: APPLE INC.
H04N21/2347G06V10/44G06V10/764G06V10/82G06V20/46G06V20/52G06V20/64H04L9/0822H04N5/144H04N23/61G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,895,346
App. No.
17/953,258
Granted
Feb 6, 2024
Kind
B2
Abstract

Disclosure provides devices, methods, and computer-readable medium for secure frame management. Techniques disclosed herein provide an intelligent method for detecting triggering items in one or more frames of streaming video from an Internet Protocol camera. Upon detection, the camera transmits one or more frames of the video over a network to a computing device. Upon detecting a triggering item in a frame of the video stream, the computing device begins a streaming session with a server and stream the one or more frames of video and accompanying metadata to the server. The frames, metadata, and associated keys can all be encrypted prior to streaming to the server. For each subsequent segment of video frames that includes the triggering item, the server can append the frames of that segment to the video clip in an encrypted container. Once the triggering item is no longer detected, the streaming session can be closed.

Claims (49)

1. A method, comprising:

receiving, by a computing device, one or more frames of a video stream and accompanying metadata from a camera;

reviewing, by the computing device, each frame of the one or more frames of the video stream for a triggering item;

in accordance with detection of the triggering item in at least one frame of the one or more frames of the video stream:

encrypting, by the computing device, a portion of the one or more frames of the video stream and a portion of the accompanying metadata;

transmitting, to a storage device via a connection between the computing device and the network storage device, the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata;

encrypting, by the computing device, one or more subsequent frames of the video stream and subsequent metadata;

transmitting, to the storage device, the encrypted one or more subsequent frames of the video stream and the encrypted subsequent metadata; and

in accordance with detection of an absence of the triggering item in at least one subsequent frame of the one or more subsequent frames of the video stream:

terminating the connection between the computing device and the storage device.

2. The method of claim 1 , wherein the storage device is configured to store the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata in a container, and wherein the storage device is configured to append the encrypted one or more subsequent frames of the video stream onto the encrypted portion of the one or more frames of the video stream and to store the encrypted subsequent metadata in the container to enable the one or more frames of the video stream and the subsequent frames of the video stream to be played as a single video file.

3. The method of claim 1 , wherein the triggering item comprises at least one of a person, a vehicle, or an animal.

4. The method of claim 1 , further comprising establishing the connection between the computing device and the storage device in accordance with the detection of the triggering item in at least one frame of the one or more frames of the video stream.

5. The method of claim 1 , further comprising classifying, by the computing device, the one or more frames of the video stream by at least comparing one or more aspects of the one or more frames of the video stream from the camera against one or more criteria.

6. The method of claim 5 , wherein the classifying comprises utilizing an image recognition technique to determine a classification of the one or more frames of the video stream.

7. The method of claim 1 , further comprising decrypting the one or more frames of the video stream from the camera.

8. The method of claim 1 , wherein the accompanying metadata identifies a start time and an end time of the one or more frames of the video stream.

9. One or more non-transitory computer-readable media having instructions stored thereon, wherein the instructions, when executed by one or more processors, cause the one or more processors to:

receive one or more frames of a video stream and accompanying metadata from a camera;

review each frame of the one or more frames of the video stream for a triggering item;

in accordance with detection of the triggering item in at least one frame of the one or more frames of the video stream:

encrypt a portion of the one or more frames of the video stream and a portion of the accompanying metadata;

transmit, to a storage device via a connection between the computing device and the storage device, the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata;

encrypt one or more subsequent frames of the video stream and subsequent metadata; and

transmit, to the storage device, the encrypted one or more subsequent frames of the video stream and the encrypted subsequent metadata; and

in accordance with detection of an absence of the triggering item in at least one subsequent frame of the one or more subsequent frames of the video stream:

terminate the connection between the computing device and the storage device.

10. The one or more non-transitory computer-readable media of claim 9 , wherein the storage device is configured to store the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata in a container, and wherein the storage device is configured to append the encrypted one or more subsequent frames of the video stream onto the encrypted portion of the one or more frames of the video stream and to store the encrypted subsequent metadata in the container to enable the one or more frames of the video stream and the subsequent frames of the video stream to be played as a single video file.

11. The one or more non-transitory computer-readable media of claim 9 , wherein the triggering item comprises at least one of a person, a vehicle, or an animal.

12. The one or more non-transitory computer-readable media of claim 9 , wherein the instructions, when executed by the one or more processors, further cause the computing device to establish the connection between the computing device and the storage device in accordance with the detection of the triggering item in at least one frame of the one or more frames of the video stream.

13. The one or more non-transitory computer-readable media of claim 9 , wherein the instructions, when executed by the one or more processors, further cause the computing device to classify the one or more frames of the video stream by at least comparing one or more aspects of the one or more frames of the video stream from the camera against one or more criteria.

14. The one or more non-transitory computer-readable media of claim 13 , wherein to classify the one or more frames of the video stream comprises to utilize an image recognition technique to determine a classification of the one or more frames of the video stream.

15. The one or more non-transitory computer-readable media of claim 9 , wherein the instructions, when executed by the one or more processors, further cause the computing device to decrypt the one or more frames of the video stream from the camera.

16. A computing device, comprising:

memory to store frames of a video stream; and

one or more processors coupled to the memory, the one or more processors to:

receive one or more frames of a video stream and accompanying metadata from a camera;

review each frame of the one or more frames of the video stream for a triggering item;

in accordance with detection of the triggering item in at least one frame of the one or more frames of the video stream:

encrypt a portion of the one or more frames of the video stream and a portion of the accompanying metadata;

transmit, to a storage device via a connection between the computing device and the storage device, the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata;

encrypt one or more subsequent frames of the video stream and subsequent metadata; and

transmit, to the storage device, the encrypted one or more subsequent frames of the video stream and the encrypted subsequent metadata; and

in accordance with detection of an absence of the triggering item in at least one subsequent frame of the one or more subsequent frames of the video stream:

terminate the connection between the computing device and the storage device.

17. The computing device of claim 16 , wherein the storage device is configured to store the encrypted portion of the one or more frames of the video stream and the encrypted portion of the accompanying metadata in a container, and wherein the storage device is configured to append the encrypted one or more subsequent frames of the video stream onto the encrypted portion of the one or more frames of the video stream and to store the encrypted subsequent metadata in the container to enable the one or more frames of the video stream and the subsequent frames of the video stream to be played as a single video file.

18. The computing device of claim 16 , wherein the triggering item comprises at least one of a person, a vehicle, or an animal.

19. The computing device of claim 16 , wherein the one or more processors are further to establish the connection between the computing device and the storage device in accordance with the detection of the triggering item in at least one frame of the one or more frames of the video stream.

20. The computing device of claim 16 , wherein the one or more processors are further to classify the one or more frames of the video stream by at least comparing one or more aspects of the one or more frames of the video stream from the camera against one or more criteria.

Continuity (3)
Continuation 16560678 · Sep 4, 2019
Provisional Application 62853408 · May 28, 2019
Related Publication 20230088057A1 · Mar 23, 2023
Cited By (1)
US 12,604,049