IP Library Patent Application 16661731
Patent Application
App. No. 16/661,731

REDUCING SIZE AND POWER CONSUMPTION FOR FRAME BUFFERS USING LOSSY COMPRESSION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/661,731
Abstract

Disclosed herein a system, a method and a device for reducing a size and power consumption in encoder and decoder frame buffers using lossy compression. An encoder of a first device can provide a first video frame for encoding, to a prediction loop of the first device. In the prediction loop, lossy compression can be applied to the first video frame to generate a first compressed video frame. In the prediction loop, lossy decompression can be applied to the first compressed video frame. The encoder can provide, to a decoder of a second device to perform decoding, encoded video data corresponding to the first video frame and a configuration of the lossy compression.

Claims (46)

1 . A method comprising:

providing, by an encoder of a first device, a first video frame for encoding, to a prediction loop of the first device;

applying, by a lossy compression device in the prediction loop, lossy compression to the first video frame to generate a first compressed video frame;

applying, by a lossy decompression device in the prediction loop, lossy decompression to the first compressed video frame, wherein a decompression rate of the lossy decompression corresponds to a compression rate of the lossy compression; and

providing, by the encoder to a decoder of a second device to perform decoding, encoded video data corresponding to the first video frame and a configuration of the lossy compression.

2 . The method of claim 1 , comprising:

receiving, by the encoder, a second video frame subsequent to the first video frame;

receiving, from the prediction loop via a storage device of the first device, a decompressed video frame generated by applying the lossy decompression to the first video frame; and

estimating, by a frame predictor of the encoder, a motion metric according to the second video frame and the decompressed video frame.

3 . The method of claim 1 , comprising:

encoding, by the encoder, the first video frame using data from one or more previous video frames, to provide the encoded video data; and

transmitting, by the encoder, the encoded video data to the decoder of the second device.

4 . The method of claim 1 , further comprising causing the decoder to perform decoding of the encoded video data using the configuration of the lossy compression.

5 . The method of claim 4 , further comprising causing the second device to apply lossy compression in a reference loop of the second device, according to the configuration.

6 . The method of claim 1 , wherein providing the configuration of the lossy compression further comprises transmitting the configuration in at least one of: subband metadata, a header of a video frame transmitted from the encoder to the decoder, or a handshake message for establishing a transmission channel between the encoder and the decoder.

7 . The method of claim 1 , comprising:

decoding, by a decoder of the second device, the encoded video data to generate a decoded video frame; and

combining, by the second device using a reference loop of the second device, the decoded video frame and a previous decoded video frame provided by the reference loop of the second device to generate a decompressed video frame associated with the first video frame.

8 . The method of claim 1 , further comprising storing the first compressed video frame in a storage device in the first device rather than external to the first device.

9 . The method of claim 1 , further comprising storing the first compressed video frame in a static random access memory (SRAM) in the first device rather than a dynamic random access memory (DRAM) external to the first device.

10 . The method of claim 1 , wherein the configuration of the lossy compression comprises at least one of the compression rate of the lossy compression, the decompression rate of the lossy decompression, a loss factor, a quality metric or a sampling rate.

11 . The method of claim 1 , comprising:

configuring the lossy compression applied in the prediction loop of the first device and lossy compression applied by a reference loop of the second device to have a same compression rate to provide bit-identical results having the same number of bits.

12 . A device comprising:

at least one processor configured to:

provide a first video frame for encoding, to a prediction loop of the device;

apply, by a lossy compression device in the prediction loop, lossy compression to the first video frame to generate a first compressed video frame; and

apply, by a lossy decompression device in the prediction loop, lossy decompression to the first compressed video frame, wherein a decompression rate of the lossy decompression corresponds to a compression rate of the lossy compression; and

an encoder configured to:

provide, to a decoder of another device to perform decoding, encoded video data corresponding to the first video frame and a configuration of the lossy compression.

13 . The device of claim 12 , wherein the first compressed video frame is stored in a storage device in the device rather than external to the device.

14 . The device of claim 12 , wherein the first compressed video frame is stored in a static random access memory (SRAM) in the device rather than a dynamic random access memory (DRAM) external to the device.

15 . The device of claim 12 , wherein the at least one processor is further configured to:

cause the decoder to perform decoding of the encoded video data using the configuration of the lossy compression.

16 . The device of claim 12 , wherein the at least one processor is further configured to:

cause the another device to apply lossy compression in a reference loop of the another device, according to the configuration.

17 . The device of claim 14 , wherein the configuration of the lossy compression comprises at least one of the compression rate of the lossy compression, the decompression rate of the lossy decompression, a loss factor, a quality metric or a sampling rate.

18 . The device of claim 14 , wherein the at least one processor is further configured to:

cause lossy compression applied by a reference loop of the another device to have a same compression rate as the lossy compression applied in the prediction loop of the device to provide bit-identical results having the same number of bits.

19 . A non-transitory computer readable medium storing instructions when executed by one or more processors cause the one or more processors to:

provide a first video frame for encoding, to a prediction loop of the device;

apply, through a lossy compression device in the prediction loop, lossy compression to the first video frame to generate a first compressed video frame;

apply, through a lossy decompression device in the prediction loop, lossy decompression to the first compressed video frame, wherein a decompression rate of the lossy decompression corresponds to a compression rate of the lossy compression; and

provide, to a decoder of another device to perform decoding, encoded video data corresponding to the first video frame and a configuration of the lossy compression.

20 . The non-transitory computer readable medium of claim 19 , further comprising instructions when executed by the one or more processors further cause the one or more processors to:

cause the decoder to perform decoding of the encoded video data using the configuration of the lossy compression.

Assignments (2)
CHANGE OF NAME Recorded Jul 22, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060816/0634 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2019
From: FRUCHTER, VLAD; GREENE, RICHARD LAWRENCE; WEBB, RICHARD
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 051370/0584 →