IP Library › Granted Patent US 11,330,276
Granted Patent B2
US 11,330,276 · App. 16/735,275 · Granted May 10, 2022

Systems and methods for encoder-guided adaptive-quality rendering

Inventor: Michael Kopietz (Frankfurt, DE)
Assignee: ZeniMax Media Inc.
H04N19/172A63F13/30A63F13/355A63F13/52G06T15/005H04N19/124H04N19/154A63F2300/538A63F2300/66
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,276
App. No.
16/735,275
Granted
May 10, 2022
Kind
B2
Abstract

Systems and methods for improving computer technology related to the rendering and encoding of images are disclosed, preferably for use in a video-game environment. In certain embodiments, a codec is used to encode one or more reference images for a partial range of encoder settings and a renderer is used to generate one or more rendering quality-settings profiles, generate one or more reference images, calculate perceived qualities for each of the one or more reference images, re-render the one or more reference images for each of the one or more rendering quality-setting profiles, and calculate perceived qualities for each of the one or more re-rendered reference images. The renderer compares the perceived qualities of the reference images to the perceived qualities of the re-rendered images and matches them. Those matches result in an association of one or more encoder settings with their matching rendering quality-settings profiles into a look-up table. The lookup table is used to generate a rendered image at a substantially identical perceived quality to an encoded frame during gameplay.

Claims (35)

1. A computer-implemented method for rendering, comprising:

reading a reported quantization parameter;

comparing the reported quantization parameter to effective quantization settings associated with a previously rendered frame;

changing the rendering quality to match the effective quantization settings, depending on the results of said comparison; and

generating a rendered image based on the altered rendering quality.

2. The computer-implemented method of claim 1 , wherein the reported quantization parameter is read at a renderer.

3. The computer-implemented method of claim 2 , wherein the renderer read the reported quantization parameter prior to rendering each frame of the rendered image.

4. The computer-implemented method of claim 1 , wherein the rendering quality changes if the quantization parameter is different from the previously rendered frame or if it is the first frame to be encoded.

5. The computer-implemented method of claim 1 , wherein the rendering quality is lowered if the quantization parameter has increased since the previously rendered frame.

6. The computer-implemented method of claim 5 , wherein the rendering quality matches the compression level at an encoder.

7. The computer-implemented method of claim 1 , wherein a renderer checks a pre-generated lookup table that includes a rendering quality-settings profile associated with the quantization parameter to determine how to change the rendering quality.

8. The computer-implemented method of claim 7 , wherein there is a unique rendering quality-settings profile for each quantization parameter.

9. A system for image rendering comprising a renderer, wherein:

the renderer reads a reported quantization parameter;

compares the reported quantization parameter to effective quantization settings associated with a previously rendered frame;

changes the rendering quality to match the effective quantization settings, depending on the results of said comparison; and

generates a rendered image based on the altered rendering quality.

10. The system of claim 9 , wherein the renderer read the reported quantization parameter prior to rendering each frame of the rendered image.

11. The system of claim 9 , wherein the rendering quality changes if the quantization parameter is different from the previously rendered frame or if it is the first frame to be encoded.

12. The system of claim 9 , wherein the rendering quality is lowered if the quantization parameter has increased since the previously rendered frame.

13. The system of claim 12 , wherein the rendering quality matches the compression level at an encoder.

14. The system of claim 9 , wherein a renderer checks a pre-generated lookup table that includes a rendering quality-settings profile associated with the quantization parameter to determine how to change the rendering quality.

15. The system of claim 14 , wherein there is a unique rendering quality-settings profile for each quantization parameter.

16. The system of claim 14 , wherein the rendering quality-settings profile is defined as a list of values for each available rendering quality.

17. A computer-implemented method for rendering comprising:

monitoring quantization settings for changes at a renderer;

querying a lookup table for a rendering quality-settings profile;

receiving a quantization parameter from an encoder;

applying an associated rendering quality-settings profile associated with the quantization parameter; and

changing rendering quality settings to match the quantization settings if the quantization settings differ from a previously rendered frame, wherein the matching of quantization settings results is raising or lowering frame quality to match compression level at an encoder.

18. The method of claim 17 , wherein the lookup table defines rendering settings for each partial range of quantization parameters between 0 and 51.

19. The method of claim 17 , wherein the renderer alters quality settings according to the rendering quality-settings profile received from the lookup table before rendering a next frame.

20. The method of claim 17 , wherein the renderer takes no action if the quantization settings have not changed.

21. The method of claim 17 , wherein the renderer checks quantization settings for every frame.

22. The method of claim 17 , wherein the lookup table is comprised of a representative set of elements from a game level.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: KOPIETZ, MICHAEL
To: ZENIMAX MEDIA INC.
Reel/Frame 052588/0656 →
Continuity (5)
Continuation 16391898 · Apr 23, 2019
Continuation 15959069 · Apr 20, 2018
Provisional Application 62653056 · Apr 5, 2018
Provisional Application 62488526 · Apr 21, 2017
Related Publication 20200154112A1 · May 14, 2020