IP Library Granted Patent US 11,741,219
Granted Patent B2
US 11,741,219 · App. 17/468,842 · Granted Aug 29, 2023

Protocol and system for tee-based authenticating and editing of mobile-device captured visual and audio media

Inventors: Thomas Meng-tao Zeng (San Diego, CA); Oliver Rice (Huntsville, AL); Chi Shing Chan (San Diego, CA); Sherif Hanna (Carlsbad, CA)
Assignee: TruePic Inc.
G06F21/50G06F21/00G06F21/57G06F21/64G06F21/85H04N21/41407
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,741,219
App. No.
17/468,842
Filed
Sep 8, 2021
Granted
Aug 29, 2023
Kind
B2
Art Unit
2419
USPC
726/26
Abstract

In general, one aspect disclosed features a media asset capture and processing method, implemented via a computer-based state machine executing on a computer processor, the method comprising: implementing a first phase including media asset capture and frame processing limited to Rich Execution Environment (REE) read-only (RO) frame access; implementing a second phase including processing with REE read-write (RW) frame access; and implementing a third phase including processing with REE read-only (RO) frame access.

Claims (61)

1. A media asset capture and processing method, implemented via a computer-based state machine executing on a computer processor, the method comprising:

implementing a first phase including media asset capture and frame processing limited to Rich Execution Environment (REE) read-only (RO) access to frame buffer objects of the captured media asset;

implementing a second phase following the first phase and including processing with REE read-write (RW) access to the frame buffer objects; and

implementing a third phase following the second phase and including processing with REE read-only (RO) frame access to the frame buffer objects;

computing a perceptual hash value of a current state of the frame buffer objects after the first phase and before the second phase;

verifying the frame buffer objects match the perceptual hash value after the second phase and before the third phase; and

moving a given frame buffer object to an “Error” state responsive to the given frame buffer object not matching the perceptual hash value.

2. The method of claim 1 , further comprising:

verifying that an elapsed time of the second phase is less than a threshold.

3. The method of claim 1 , further comprising:

providing an interface for state transitions and a mechanism to validate authenticity.

4. The method of claim 1 , further comprising:

implementing a state-machine that comprises an access-control mechanism, including at least two states, depending on whether REE requires RO access to the frame buffer objects, or RW access to the frame buffer objects.

5. The method of claim 1 , further comprising:

performing media asset authentication in a Trusted Execution Environment (TEE) on the same device where the media asset is captured.

6. The method of claim 5 , wherein:

the TEE is a secure, integrity protected processing environment comprising processing, memory and storage devices isolated from the REE on the device.

7. The method of claim 5 , wherein:

the TEE may inspect and approve requests from the REE to transition between states.

8. The method of claim 5 , wherein, in the first phase:

the media asset is captured and processed by hardware in a camera pipeline of a capture device;

the REE is only permitted to read frame buffer objects according to hardware page table attribute settings; and

an output of the first phase comprises earliest viable image (EVI) objects.

9. The method of claim 8 , wherein performing media asset authentication comprises:

generating thumbnail images of the EVI objects;

attaching each thumbnail image to the corresponding EVI object; and

for each EVI object, attaching metadata to the EVI object, wherein the metadata comprises at least one of data, time, or depth information.

10. The method of claim 5 , wherein, in the second phase:

The TEE computes the perceptual hash values on the current state of the buffer objects;

the TEE updates the hardware page table attributes to give permission to REE to write to the frame buffer objects;

an API calls from REE to TEE to set frame objects to the RW state, for a given frame object identification;

TEE records the state and timestamp of the frame buffers when REE is granted the write permission; and

an output of the second phase comprises an uncompressed, raw image.

11. The method of claim 10 , wherein:

TEE preserves the un-tampered media asset until a perceptual hash classification can achieve accurate detection.

12. The method of claim 5 , wherein, in the third phase:

REE calls into TEE to close the session and the TEE removes the write permission from REE;

TEE conducts security validations, including one or more of:

verifying that an elapse time, since granting RW access to REE, is less than a stored threshold,

verifying that new frame objects match the perceptual hash values computed in the second phase, and

compressing the frame objects in a predetermined format; and

when validation fails during a security validation step, the TEE discontinues signature generation and moves the corresponding frame object to an error state to prevent the REE from falsely claiming the media asset to be authentic.

13. A system, comprising:

a hardware processor; and

a non-transitory machine-readable storage medium encoded with instructions executable by the hardware processor to perform a media asset capture and processing method, implemented via a computer-based state machine executing on the hardware processor, the method comprising:

implementing a first phase including media asset capture and frame processing limited to Rich Execution Environment (REE) read-only (RO) access to frame buffer objects of the captured media asset;

implementing a second phase following the first phase and including processing with REE read-write (RW) access to the frame buffer objects; and

implementing a third phase following the second phase and including processing with REE read-only (RO) frame access to the frame buffer objects;

computing a perceptual hash value of a current state of the frame buffer objects after the first phase and before the second phase;

verifying the frame buffer objects match the perceptual hash value after the second phase and before the third phase; and

moving a given frame buffer object to an “Error” state responsive to the given frame buffer object not matching the perceptual hash value.

14. The system of claim 13 , the method further comprising:

verifying that an elapsed time of the second phase is less than a threshold.

15. The system of claim 13 , the method further comprising:

providing an interface for state transitions and a mechanism to validate authenticity.

16. The system of claim 13 , the method further comprising:

implementing a state-machine that comprises an access-control mechanism, including at least two states, depending on whether REE requires RO access to the frame buffer objects, or RW access to the frame buffer objects.

17. The system of claim 13 , the method further comprising:

performing media asset authentication in a Trusted Execution Environment (TEE) on the same device where the media asset is captured.

18. The system of claim 17 , wherein:

the TEE is a secure, integrity protected processing environment comprising processing, memory and storage devices isolated from the REE on the device.

Assignments (2)
SECURITY INTEREST Recorded Jul 11, 2024
From: TRUEPIC INC.
To: WTI FUND X, INC.; WTI FUND XI, INC.
Reel/Frame 067970/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2021
From: ZENG, THOMAS MENG-TAO; RICE, OLIVER; CHAN, CHI SHING; HANNA, SHERIF
To: TRUEPIC INC.
Reel/Frame 057409/0450 →
Continuity (2)
Provisional Application 63075370 · Sep 8, 2020
Related Publication 20220078522A1 · Mar 10, 2022
Cited By (5)
US 12,216,802 US 12,585,830 US 12,626,424 US 12,639,429 US 12,688,622