IP Library Granted Patent US 12,604,049
Granted Patent B2
US 12,604,049 · App. 18/393,552 · Granted Apr 14, 2026

Techniques for secure video frame management

Inventors: Anush G Nadathur (San Jose, CA); Keith W. Rauenbuehler (San Francisco, CA); Kenneth A. York (San Jose, CA); Varinder Singh (Mountain View, CA); Nicholas M. Fraioli (Mountain View, CA)
Assignee: Apple Inc.
H04N21/2347G06V10/44G06V10/764G06V10/82G06V20/46G06V20/52G06V20/64H04L9/0822H04N5/144H04N23/61G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,604,049
App. No.
18/393,552
Granted
Apr 14, 2026
Kind
B2
Abstract

The present disclosure can provide devices, methods, and computer-readable medium for secure frame management. The techniques disclosed herein provide detection of triggering items in one or more frames of streaming video. The camera transmits one or more frames of the video over a network to a computing device. The computing device can begin a streaming session with a server and stream the one or more frames of video and accompanying metadata to the server. The frames, metadata, and associated keys can all be encrypted prior to streaming to the server. For each subsequent segment of video frames that includes the triggering item, the server can append the frames of that segment to the video clip in an encrypted container.

Claims (46)

1 . A method of storing a video frame, the method comprising:

receiving, by a storage device, one or more first encrypted frames of a video stream associated with a triggering item from a computing device, wherein the triggering item is within the video stream;

storing, by the storage device, the one or more first encrypted frames in a container;

receiving, by the storage device, one or more subsequent encrypted frames of the video stream associated with the triggering item from the computing device; and

appending, by the storage device, the one or more subsequent encrypted frames after the one or more first encrypted frames within the container to enable the one or more first encrypted frames and the one or more subsequent encrypted frames to be displayed as a single video file.

2 . The method of claim 1 , wherein the one or more first encrypted frames are received in a first wireless transfer, and wherein the one or more subsequent encrypted frames are received in a second wireless transfer.

3 . The method of claim 1 , further comprising:

receiving, from the computing device, first encrypted metadata that accompanies the one or more first encrypted frames;

storing, by the storage device, the first encrypted metadata with the one or more first encrypted frames within the container;

receiving, from the computing device, subsequent encrypted metadata that accompanies the one or more subsequent encrypted frames; and

storing, by the storage device, the subsequent encrypted metadata with the one or more subsequent encrypted frames within the container.

4 . The method of claim 3 , wherein the first encrypted metadata includes a first start position and a first end position for the one or more first encrypted frames, and wherein the subsequent encrypted metadata includes a second start position and a second end position for the one or more subsequent encrypted frames.

5 . The method of claim 3 , wherein the first encrypted metadata indicates a first duration of the one or more first encrypted frames, and wherein the subsequent encrypted metadata indicates a second duration of the one or more subsequent encrypted frames.

6 . The method of claim 1 , wherein the one or more first encrypted frames are received in a first fragmented MPEG-4 (fmp4) media segment, and wherein the one or more subsequent encrypted frames are received in a second fmp4 media segment.

7 . The method of claim 1 , wherein a connection between the computing device and the storage device is established based at least in part on a presence of the triggering item within the video stream, and wherein the connection is terminated based at least in part on an absence of the triggering item within the video stream.

8 . The method of claim 1 , wherein the storage device lacks access to one or more keys for decrypting the one or more first encrypted frames and the one or more subsequent encrypted frames.

9 . A storage device, comprising:

one or more memories to store instructions; and

one or more processors coupled to the one or more memories and configured to execute the instructions to:

receive, from a computing device, one or more first encrypted frames of a video stream associated with a triggering item, wherein the triggering item is within the video stream;

store the one or more first encrypted frames in a container;

receive, from the computing device, one or more subsequent encrypted frames of the video stream associated with the triggering item; and

append the one or more subsequent encrypted frames after the one or more first encrypted frames within the container to enable the one or more first encrypted frames and the one or more subsequent encrypted frames to be displayed as a single video file.

10 . The storage device of claim 9 , wherein the one or more first encrypted frames are received in a first wireless transfer, and wherein the one or more encrypted subsequent frames are received in a second wireless transfer.

11 . The storage device of claim 9 , wherein the one or more processors, via execution of the instructions, are further configured to:

receive, from the computing device, first encrypted metadata that accompanies the one or more first encrypted frames;

store the first encrypted metadata with the one or more first encrypted frames within the container;

receive, from the computing device, subsequent encrypted metadata that accompanies the one or more subsequent encrypted frames; and

store the subsequent encrypted metadata with the one or more subsequent encrypted frames within the container.

12 . The storage device of claim 11 , wherein the first encrypted metadata includes a first start position and a first end position for the one or more first encrypted frames, and wherein the subsequent encrypted metadata includes a second start position and a second end position for the one or more subsequent encrypted frames.

13 . The storage device of claim 11 , wherein the first encrypted metadata indicates a first duration of the one or more first encrypted frames, and wherein the subsequent encrypted metadata indicates a second duration of the one or more subsequent encrypted frames.

14 . The storage device of claim 9 , wherein the storage device lacks access to one or more keys for decrypting the one or more first encrypted frames and the one or more subsequent encrypted frames.

15 . The storage device of claim 9 , wherein the storage device includes a cloud storage system.

16 . A non-transitory, computer-readable medium storing a plurality of instructions that, when executed by one or more processors of a storage device, cause the one or more processors to perform operations comprising:

receiving one or more first encrypted frames of a video stream associated with a triggering item from a computing device, wherein the triggering item is within the video stream;

storing, by the storage device, the one or more first encrypted frames in a container;

receiving one or more subsequent encrypted frames of the video stream associated with the triggering item from the computing device; and

appending the one or more subsequent encrypted frames after the one or more first encrypted frames within the container to enable the one or more first encrypted frames and the one or more subsequent encrypted frames to be displayed as a single video file.

17 . The non-transitory, computer-readable medium of claim 16 , wherein the one or more first encrypted frames are received in a first wireless transfer, and wherein the one or more subsequent encrypted frames are received in a second wireless transfer.

18 . The non-transitory, computer-readable medium of claim 16 , wherein the operations further comprise:

receiving, from the computing device, first encrypted metadata that accompanies the one or more first encrypted frames from the computing device;

storing the first encrypted metadata with the one or more first encrypted frames within the container;

receiving, from the computing device, subsequent encrypted metadata that accompanies the one or more subsequent encrypted frames; and

storing, by the storage device, the subsequent encrypted metadata with the one or more subsequent encrypted frames within the container.

19 . The non-transitory, computer-readable medium of claim 16 , wherein a connection between the computing device and the storage device is established based at least in part on a presence of the triggering item within the video stream, and wherein the connection is terminated based at least in part on an absence of the triggering item within the video stream.

20 . The method according to claim 1 , wherein the one of more first encrypted frames of the video stream received by the storage device are accompanied by metadata.

Continuity (4)
Continuation 17953258 · Sep 26, 2022
Continuation 16560678 · Sep 4, 2019
Provisional Application 62853408 · May 28, 2019
Related Publication 20240129563A1 · Apr 18, 2024
References Cited (67)
US 7508941B1 · O'Toole, Jr. et al. · 2009 [cited by applicant]
US 9412268B2 · Saptharishi et al. · 2016 [cited by applicant]
US 9590958B1 · Howell · 2017 [cited by examiner]
US 9635317B1 · Ludwig et al. · 2017 [cited by applicant]
US 10862940B1 · Jones · 2020 [cited by examiner]
US 11482005B2 · Nadathur et al. · 2022 [cited by applicant]
US 11895346B2 · Nadathur et al. · 2024 [cited by applicant]
US 20020059144A1 · Meffert et al. · 2002 [cited by applicant]
US 20020151992A1 · Hoffberg et al. · 2002 [cited by applicant]
US 20040093419A1 · Weihl et al. · 2004 [cited by applicant]
US 20040174998A1 · Youatt · 2004 [cited by examiner]
US 20050207569A1 · Zhang · 2005 [cited by examiner]
US 20050262258A1 · Kohno · 2005 [cited by examiner]
US 20080198159A1 · Liu et al. · 2008 [cited by applicant]
US 20100189256A1 · Doehla · 2010 [cited by examiner]
US 20110096922A1 · Oya · 2011 [cited by applicant]
US 20110173235A1 · Aman et al. · 2011 [cited by applicant]
US 20120002809A1 · Candelore · 2012 [cited by examiner]
US 20130047264A1 · Bjorkengren · 2013 [cited by examiner]
US 20130307942A1 · Dini et al. · 2013 [cited by applicant]
US 20140063247A1 · Bernal et al. · 2014 [cited by applicant]
US 20140223475A1 · Mcintire et al. · 2014 [cited by applicant]
US 20140245400A1 · Chen · 2014 [cited by examiner]
US 20140247887A1 · Brueck · 2014 [cited by examiner]
US 20150043733A1 · Swaminathan · 2015 [cited by examiner]
US 20150113290A1 · Auradkar · 2015 [cited by examiner]
US 20160182952A1 · Wu · 2016 [cited by examiner]
US 20160358017A1 · Guzik · 2016 [cited by applicant]
US 20170064408A1 · Ketola · 2017 [cited by examiner]
US 20170208349A1 · Saptharishi · 2017 [cited by examiner]
US 20170214947A1 · Kiefer · 2017 [cited by examiner]
US 20170359423A1 · Nadathur et al. · 2017 [cited by applicant]
US 20170359555A1 · Irani · 2017 [cited by examiner]
US 20180034786A1 · Srinivasan · 2018 [cited by examiner]
US 20180061064A1 · Schwartz et al. · 2018 [cited by applicant]
US 20180167686A1 · James · 2018 [cited by examiner]
US 20180176112A1 · McLaughlin et al. · 2018 [cited by applicant]
US 20180189505A1 · Ghafourifar · 2018 [cited by examiner]
US 20180220189A1 · Hodge · 2018 [cited by examiner]
US 20180225230A1 · Litichever et al. · 2018 [cited by applicant]
US 20180331824A1 · Racz · 2018 [cited by examiner]
US 20180352022A1 · Hornquist Astrand · 2018 [cited by examiner]
US 20190027111A1 · Wilde · 2019 [cited by examiner]
US 20190109713A1 · Clark · 2019 [cited by examiner]
US 20190129888A1 · Bowman · 2019 [cited by examiner]
US 20190141368A1 · Loheide · 2019 [cited by examiner]
US 20200106990A1 · Farzone · 2020 [cited by examiner]
CN 109565605A · 2019 [cited by applicant]
CN 109690607A · 2019 [cited by applicant]
EP 2835978A2 · 2015 [cited by applicant]
WO 2011144510A1 · 2011 [cited by applicant]
WO 2015153723A1 · 2015 [cited by applicant]
The Indian Application No. IN202318010497, “First Examination Report,” mailed May 9, 2024, 6 pages. [cited by applicant]
U.S. Appl. No. 16/560,678 , First Action Interview Office Action Summary, Mailed On Dec. 8, 2021, 8 pages. [cited by applicant]
U.S. Appl. No. 16/560,678 , First Action Interview Pilot Program Pre-Interview Communication, Mailed On Aug. 3, 2021, 5 pages. [cited by applicant]
U.S. Appl. No. 16/560,678 , “Notice of Allowability”, mailed on Jul. 18, 2022, 8 pages. [cited by applicant]
U.S. Appl. No. 16/560,678 , Notice of Allowance, Mailed On Jun. 10, 2022, 13 pages. [cited by applicant]
U.S. Appl. No. 17/953,258 , “Corrected Notice of Allowability”, Mailed On Oct. 17, 2023, 2 pages. [cited by applicant]
U.S. Appl. No. 17/953,258 , Notice of Allowance, Mailed On Sep. 21, 2023, 12 pages. [cited by applicant]
Application No. CN202080039171.9 , Notice of Decision to Grant, Mailed On Sep. 19, 2023, 4 pages. [cited by applicant]
Application No. CN202080039171.9 , Office Action, Mailed On Feb. 24, 2023, 10 pages. [cited by applicant]
Application No. CN202080039171.9 , Office Action, Mailed On Jul. 3, 2023, 3 pages. [cited by applicant]
Application No. EP20732451.8 , Office Action, Mailed On Aug. 3, 2023, 9 pages. [cited by applicant]
Application No. IN202117055179 , “First Examination Report”, Mailed on May 25, 2022, 7 pages. [cited by applicant]
Application No. PCT/US2020/034763 , International Preliminary Report on Patentability, Mailed On Dec. 9, 2021, 9 pages. [cited by applicant]
Application No. PCT/US2020/034763 , International Search Report and Written Opinion, Mailed On Jul. 22, 2020, 13 pages. [cited by applicant]
European Patent Application No. 20732451.8, “Office Action”, May 22, 2025, 7 pages. [cited by applicant]