IP Library › Granted Patent US 12,573,093
Granted Patent B2
US 12,573,093 · App. 18/170,060 · Granted Mar 10, 2026

Object blurring on compressed videos

Inventors: Chuan Li (Troy, MI); Andrew W. Averhart (Redford, MI); Fan Bai (Ann Arbor, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06T9/00G06T5/70G06V10/764G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,093
App. No.
18/170,060
Granted
Mar 10, 2026
Kind
B2
Abstract

A system for object blurring in compressed videos includes sensors, human machine interfaces (HMIs), and control modules. Each control module has a processor, memory, and input/output (I/O) ports. The control modules communicate with the sensors and the HMIs via the I/O ports. The memory stores control logic that is executed by the processor. The control logic receives raw image data from the sensors, encodes the raw image data into compressed image data and stores the compressed image data in memory. The control logic parses and partially decodes the compressed image data to access raw independent video frames and performs post-processing algorithms on the raw independent video frames to generate post-processed independent video frames. The post-processed independent video frames are encoded and replace raw independent video frames in the compressed image data. The control logic transmits an output including the encoded post-processed independent and dependent video frames to the HMI.

Claims (58)

1 . A system for object blurring in compressed videos, the system comprising:

one or more sensors;

one or more human machine interfaces (HMIs);

one or more control modules, each of the one or more control modules having a processor, a memory, and one or more input/output (I/O) ports, the one or more control modules in communication with the one or more sensors and in communication with the one or more HMIs via the I/O ports, the memory storing programmatic control logic, the processor executing the programmatic control logic, the programmatic control logic comprising:

a first control logic that receives, via the I/O ports, raw input image data from the one or more sensors;

a second control logic that encodes the raw input image data into compressed image data and stores the compressed image data in memory;

a third control logic that parses and partially decodes the compressed image data to access raw independent video frames, including:

control logic that identifies independent video frames within the compressed image data;

control logic that decodes the independent video frames within the compressed video data and outputs the raw independent video frames;

control logic for one or more object detection algorithms, the one or more object detection algorithms executed on the raw independent video frames;

control logic that classifies objects detected within the raw independent video frames; and

upon determining that an object within the raw independent video frames is within a protected class, executes an obfuscation control logic on the object in the protected class; and

upon determining that an object in the raw independent video frames is not within a protected class, does not execute the obfuscation control logic with respect to the object not in a protected class;

a fourth control logic that performs one or more post-processing algorithms on the raw independent video frames to generate post-processed independent video frames;

a fifth control logic that encodes the post-processed independent video frames, and replaces previously encoded raw independent video frames in the compressed image data with the encoded post-processed independent video frames; and

a sixth control logic that transmits, via the I/O ports, an output to the HMI, wherein the output includes the encoded post-processed independent video frames, and a plurality of dependent video frames, wherein the plurality of dependent video frames depend from the encoded post-processed independent video frames.

2 . The system of claim 1 , wherein the one or more sensors comprise:

one or more cameras; and

wherein the one or more HMIs further comprise: a screen visible by a human.

3 . The system of claim 1 , wherein the obfuscation control logic alters pixel values of the object in the protected class, thereby at least partially obfuscating the object in the protected class.

4 . The system of claim 1 , wherein the fifth control logic encodes the post-processed independent video frames including obfuscated objects; and

overwrites previous encoded raw independent video frames in the compressed image data with the encoded post-processed independent video frames.

5 . The system of claim 4 , wherein the sixth control logic that transmits an output to the HMI, wherein the output is in a group of pictures (GOP) concept that includes the encoded post-processed independent video frames and the plurality of dependent video frames.

6 . The system of claim 5 , wherein dependent video frames include time and spatial reference information that associates each of the plurality of dependent video frames with an independent video frame, and wherein upon decoding the dependent video frames, obfuscated objects in the independent video frames are also associated with corresponding dependent video frames.

7 . A method for object blurring in compressed videos, the method comprising:

capturing raw input image data with one or more cameras;

utilizing one or more control modules, each of the one or more control modules having a processor, a memory, and one or more input/output (I/O) ports, the one or more control modules in communication with the one or more cameras and in communication with one or more human-machine interfaces (HMIs) via the I/O ports, the memory storing programmatic control logic, the processor executing the programmatic control logic for:

encoding the raw input image data into compressed image data and stores the compressed image data in memory;

parsing and partially decoding the compressed image data to access raw independent video frames, including:

identifying independent video frames within the compressed image data;

decoding the independent video frames within the compressed video data and outputs the raw independent video frames;

executing one or more object detection algorithms, the one or more object detection algorithms executed on the raw independent video frames;

classifying objects detected within the raw independent video frames;

upon determining that an object within the raw independent video frames is within a protected class, executing an obfuscation control logic on the object in the protected class; and

upon determining that objects in the raw independent video frames are not within a protected class, not executing the obfuscation control logic with respect to the object not in a protected class;

performing one or more post-processing algorithms on the raw independent video frames to generate post-processed independent video frames;

encoding the post-processed independent video frames, and replaces previously encoded raw independent video frames in the compressed image data with the encoded post-processed independent video frames; and

transmitting, via the I/O ports, an output to the one or more HMIs, wherein the output includes the encoded post-processed independent video frames, and a plurality of dependent video frames, wherein the plurality of dependent video frames depend from the encoded post-processed independent video frames.

8 . The method of claim 7 , further comprising:

altering pixel values of the object in the protected class, thereby at least partially obfuscating the object in the protected class.

9 . The method of claim 7 , further comprising:

encoding the post-processed independent video frames including obfuscated objects; and

overwriting previous encoded raw independent video frames in the compressed image data with the encoded post-processed independent video frames.

10 . The method of claim 9 , wherein transmitting an output further comprises:

transmitting a group of picture (GOP) output that includes the encoded post-processed independent video frames and a plurality of dependent video frames.

11 . The method of claim 9 , wherein upon decoding the dependent video frames, obfuscated objects in the independent video frames are also associated with corresponding dependent video frames utilizing time and spatial reference information that associates each of the plurality of dependent video frames with an independent video frame.

12 . A system for object blurring in compressed videos, the system comprising:

one or more cameras;

one or more human machine interfaces (HMIs), each of the one or more HMIs having a screen visible by humans;

one or more control modules, each of the one or more control modules having a processor, a memory, and one or more input/output (I/O) ports, the one or more control modules in communication with the one or more cameras and in communication with the one or more HMIs via the I/O ports, the memory storing programmatic control logic, the processor executing the programmatic control logic, the programmatic control logic comprising:

a first control logic that receives, via the I/O ports, raw input image data from the one or more sensors;

a second control logic that encodes the raw input image data into compressed image data and stores the compressed image data in memory;

a third control logic that parses and partially decodes the compressed image data to access raw independent video frames by identifying independent video frames within the compressed image data and decoding the independent video frames within the compressed video data, wherein the third control logic further includes control logic to output the raw independent video frames and to execute one or more object detection algorithms on the raw independent video frames; and control logic that classifies objects detected within the raw independent video frames; and upon determining that an object within the raw independent video frames is within a protected class, executes an obfuscation control logic on the object in the protected class; and upon determining that an object in the raw independent video frames is not within a protected class, does not execute the obfuscation control logic with respect to the object not in a protected class;

a fourth control logic that performs one or more post-processing algorithms on the raw independent video frames to generate post-processed independent video frames;

a fifth control logic that encodes the post-processed independent video frames, and replaces and overwrites previously encoded raw independent video frames in the compressed image data with the encoded post-processed independent video frames; and

a sixth control logic that transmits, via the I/O ports, an output to the HMI, wherein the output includes the encoded post-processed independent video frames, and a plurality of dependent video frames, wherein the plurality of dependent video frames depend from the encoded post-processed independent video frames.

13 . The system of claim 12 , wherein the obfuscation control logic alters pixel values of the object in the protected class, thereby at least partially obfuscating the object in the protected class.

14 . The system of claim 12 , wherein the sixth control logic that transmits an output to the HMI, wherein the output is in a group of picture (GOP) concept that includes the encoded post-processed independent video frames and a plurality of dependent video frames, wherein the dependent video frames include time and spatial reference information that associates each of the plurality of dependent video frames with an independent video frame, and wherein upon decoding the dependent video frames, obfuscated objects in the independent video frames are also associated with corresponding dependent video frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: LI, CHUAN; AVERHART, ANDREW W.; BAI, FAN
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 062720/0196 →
Continuity (1)
Related Publication 20240282008A1 · Aug 22, 2024
References Cited (43)
US 11595619B1 · Gate et al. · 2023 [cited by applicant]
US 20120105637A1 · Yousefi et al. · 2012 [cited by applicant]
US 20130321629A1 · Zhang et al. · 2013 [cited by applicant]
US 20170150299A1 · Coutinho et al. · 2017 [cited by applicant]
US 20170347158A1 · Fu et al. · 2017 [cited by applicant]
US 20180139585A1 · Gholmieh et al. · 2018 [cited by applicant]
US 20180297210A1 · Peterson et al. · 2018 [cited by applicant]
US 20180299900A1 · Bae et al. · 2018 [cited by applicant]
US 20180324436A1 · Danielsson Fan · 2018 [cited by examiner]
US 20180367731A1 · Gatti et al. · 2018 [cited by applicant]
US 20180376067A1 · Martineau · 2018 [cited by applicant]
US 20190073539A1 · Yu et al. · 2019 [cited by applicant]
US 20190230323A1 · Koravadi et al. · 2019 [cited by applicant]
US 20190253853A1 · Makled et al. · 2019 [cited by applicant]
US 20190320328A1 · Magzimof et al. · 2019 [cited by applicant]
US 20190325667A1 · Kim et al. · 2019 [cited by applicant]
US 20190340844A1 · Tonshal et al. · 2019 [cited by applicant]
US 20190354111A1 · Cheng et al. · 2019 [cited by applicant]
US 20190355178A1 · Martinez et al. · 2019 [cited by applicant]
US 20200074326A1 · Balakrishnan et al. · 2020 [cited by applicant]
US 20200351322A1 · Magzimof et al. · 2020 [cited by applicant]
US 20210092387A1 · Edpalm · 2021 [cited by examiner]
US 20210109881A1 · Moustafa et al. · 2021 [cited by applicant]
US 20210256754A1 · Guo · 2021 [cited by applicant]
US 20220137615A1 · Eperjesi et al. · 2022 [cited by applicant]
US 20220161816A1 · Gyllenhammar et al. · 2022 [cited by applicant]
US 20220368860A1 · Shinohara et al. · 2022 [cited by applicant]
US 20220368972A1 · Cheraghi et al. · 2022 [cited by applicant]
US 20220394283A1 · Cao · 2022 [cited by applicant]
US 20230026675A1 · Wingarten · 2023 [cited by applicant]
US 20230096468A1 · Ong et al. · 2023 [cited by applicant]
US 20230269566A1 · Spagnolini et al. · 2023 [cited by applicant]
US 20240048839A1 · Pujari · 2024 [cited by examiner]
US 20240338486A1 · Kalva · 2024 [cited by examiner]
“Cadillac CELESTIQ Establishes New Standard of Automotive Luxury,” Cadillac Pressroom, Oct. 27, 2022, https://media.cadillac.com/media/us/en/cadillac/home.detail.print.html/content/Pages/news/us/en/2022/oct/1017-celesti… [cited by applicant]
Ahlswede, et al. “Network Information Flow,” IEEE Transactions on Information Theory, vol. 46, No. 4, Jul. 2000, pp. 1204-1216. [cited by applicant]
Byers, et al. “A digital fountain approach to reliable distribution of bulk data,” Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, 1998, pp. 56-67. [cited by applicant]
Chou, et al. “Practical Network Coding,” Microsoft Allerton Conference on Communication, Control, and Computing, Oct. 2003, pp. 1-10. [cited by applicant]
Lopez, Jonathan. “General Motors Developing Connected Camera Platform,” GM Authority Blog, Oct. 11, 2021, https://gmauthority.com/blog/2021/10/general-motors-developing-connected-camera-platform/. [cited by applicant]
U.S. Appl. No. 18/150,371, filed Jan. 5, 2023. [cited by applicant]
U.S. Appl. No. 18/158,743, filed Jan. 24, 2023. [cited by applicant]
U.S. Appl. No. 18/170,038, filed Feb. 16, 2023. [cited by applicant]
U.S. Appl. No. 18/170,033, filed Feb. 16, 2023. [cited by applicant]