IP Library Granted Patent US 12,022,091
Granted Patent B2
US 12,022,091 · App. 18/017,731 · Granted Jun 25, 2024

Metadata allowing decoding and displaying processes energy and quality control

Inventors: Edouard Francois (Bourg des Comptes, FR); Christel Chamaret (Chantepie, FR); Erik Reinhard (Hédé-Bazouges, FR)
Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
H04N19/156H04N19/127H04N19/154H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,022,091
App. No.
18/017,731
Granted
Jun 25, 2024
Kind
B2
Abstract

A method comprising: receiving at least one bitstream comprising encoded video data and a message corresponding to said encoded video data and decoding said message, said message comprising for each coding tool of a plurality of coding tools used for encoding the video data, information representative of an energy consumed by a device in charge of decoding and/or displaying the encoded video data induced by said coding tool and information representative of an impact of said coding tool on a quality of the encoded video data after decoding; using the information comprised in the decoded message to select at least one coding tool of the plurality of coding tools to deactivate or modify; and, decoding the encoded video data by using a decoding process wherein the selected coding tools are deactivated or modified.

Claims (36)

1. A method comprising:

obtaining video data comprising a message, said message comprising:

for a first coding tool specified in the video data, first information representative of at least one of an estimate of an energy consumed for decoding the video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being modified, and an estimate of an energy consumed for displaying a result of a decoding of the video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool being modified; and

second information representative of an impact of said first coding tool on a quality of the result of the decoding of the video data, wherein, responsive to the first coding tool being modified, the impact comprises an amount of reduction of a quality of the result of the decoding of the video data;

determining whether to modify the first coding tool based on at least one of the first information and the second information; and

decoding the video data based on the determination.

2. The method according to claim 1 , wherein the first and the second information are provided for at least a sub-part of the video data corresponding to at least one temporal layer and/or at least one picture and/or at least one slice in a picture and/or at least one tile in a picture and/or at least one block of pixels in a picture and/or at least one block of a picture encoded according to a predetermined coding mode.

3. The method according to claim 1 , wherein the first information is representative of at least one of an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being deactivated, an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being activated in a modified form, an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool being deactivated, and an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool being activated in a modified form, and the second information is representative of at least one of an amount of reduction of a quality of the result of the decoding of the video data responsive to said first coding tool being deactivated and an amount of reduction of a quality of a result of the decoding of the video data responsive to said first coding tool being activated in a modified form.

4. The method according to claim 1 , wherein the first information is representative of at least one of an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being deactivated and an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being activated in a modified form, and the second information is representative of an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool being deactivated and an amount of reduction of an energy consumed for displaying the result of the decoding of the video data responsive to said first coding tool being activated in a modified form.

5. The method according to claim 1 , wherein each coding tool belongs to a plurality of coding tools comprising a deblocking filter, a SAO, coding tools of the family of tools using weightings of at least one predictor, and inverse mapping.

6. A device comprising electronic circuitry adapted for:

receiving video data comprising a message, said message comprising:

for a first coding tool specified in the video data, first information representative of at least one of an estimate of an energy consumed for decoding the video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being modified, and an estimate of an energy consumed for displaying a result of the decoding of the video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool being modified; and

second information representative of an impact of said first coding tool on a quality of the result of the decoding of the video data, wherein, responsive to the first coding tool being modified, the impact comprises an amount of reduction of a quality of the result of the decoding of the video data;

determining whether to modify the first coding tool based on at least one of the first information and the second information; and

decoding the video data based on the determination.

7. The device according to claim 6 , wherein the first and the second information are provided for at least a sub-part of the video data corresponding to at least one temporal layer and/or at least one picture and/or at least one slice in a picture and/or at least one tile in a picture and/or at least one block of pixels in a picture and/or at least one block of a picture encoded according to a predetermined coding mode.

8. The device according to claim 6 , wherein the first information is representative of at least one of an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being deactivated, an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being modified, an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool is deactivated and an amount of reduction of an energy consumed for displaying a result of the decoding of the video data responsive to said first coding tool is activated in a modified form, and the second information is representative of at least one of an amount of reduction of a quality of the result of the decoding of the video data responsive to said first coding tool being deactivated and an amount of reduction of a quality of the result of the decoding of the video data responsive to said first coding tool being activated in a modified form.

9. The device according to claim 6 , wherein the first information is representative of at least one of an amount of reduction of an energy consumed for decoding the video data responsive to said first coding tool being deactivated and an amount of reduction of an energy consumed for decoding the data responsive to said first coding tool is activated in a modified form, and the second information is representative of at least one of an amount of reduction of an energy consumed for displaying the video data responsive to said first coding tool being deactivated and an amount of reduction of an energy consumed for displaying the video data responsive to said first coding tool being activated in a modified form.

10. The device according to claim 6 , wherein each coding tool belongs to a plurality of coding tools comprising a deblocking filter, a SAO, coding tools of the family of tools using weightings of at least one predictor, and inverse mapping.

11. A method comprising:

encoding video data;

generating a message comprising:

for a first coding tool used for encoding the video data, first information representative of at least one of an estimate of an energy consumed for reconstructing the encoded video data responsive to applying the first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for reconstructing the encoded video data responsive to said first coding tool being modified, and an estimate of an energy consumed for displaying a result of a reconstruction of the encoded video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for displaying a result of the reconstruction of the encoded video data responsive to said first coding tool being modified; and

second information representative of an impact of said first coding tool on a quality of the result of the reconstruction of the encoded video data, wherein, responsive to the first coding tool being modified, the impact comprises an amount of reduction of a quality of the result of the reconstruction of the encoded video data; and

inserting the generated message into the video data.

12. A device comprising electronic circuitry adapted for:

encoding video data;

generating a message comprising:

for a first coding tool used for encoding the video data, information representative of at least one of an estimate of an energy consumed for reconstructing the encoded video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for reconstructing the encoded video data responsive to said first coding tool being modified, and an estimate of an energy consumed for displaying a result of the reconstruction of the encoded video data responsive to applying said first coding tool, wherein the estimate comprises an amount of reduction of an energy consumed for displaying a result of the reconstruction of the encoded video data responsive to said first coding tool being modified; and

second information representative of an impact of said first coding tool on a quality of the result of the reconstruction of the encoded video data, wherein, responsive to the first coding tool being modified, the impact comprises an amount of reduction of a quality of the result of the reconstruction of the encoded video data; and

inserting the generated message into the video data.

13. A non-transitory information storage medium storing program code instructions for implementing the method according to claim 1 .

14. The method according to claim 1 , wherein the message comprises a first information and a second information for at least one second coding tool.

15. The device according to claim 6 , wherein the message comprises a first information and a second information for at least one second coding tool.

16. A non-transitory information storage medium storing program code instructions for implementing the method according to claim 11 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064460/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2023
From: FRANCOIS, EDOUARD; CHAMARET, CHRISTEL; REINHARD, ERIK
To: INTERDIGITAL VC HOLDINGS FRANCE, SAS
Reel/Frame 062466/0866 →
Priority Claims (1)
EP 20305851 · Jul 24, 2020 · regional
Continuity (1)
Related Publication 20230291910A1 · Sep 14, 2023