IP Library › Granted Patent US 11,631,216
Granted Patent B2
US 11,631,216 · App. 17/303,083 · Granted Apr 18, 2023

Method and system for filtering shadow maps with sub-frame accumulation

Inventors: Jean-Philippe Leroux (Mascouche, CA); Yohann Christophe Vaast (Montreal, CA)
Assignee: Unity IPR ApS
G06T15/60G06T1/20G06T13/20G06T15/005G06T15/04G06T2215/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,631,216
App. No.
17/303,083
Granted
Apr 18, 2023
Kind
B2
Abstract

A method of rendering an image of an environment is disclosed. Environment data for the environment is accessed. The environment data corresponds to a frame of a video. A plurality of subframes associated with the frame is determined. An angle for each of the plurality of subframes is determined. One or more lights corresponding to the environment are selected. For each light of the one or more lights, a shadow map is generated. The shadow map corresponds to a subframe of the plurality of subframes based on a frustum view oriented at the angle determined for the subframe. The image of the environment is rendered. The rendering includes using the generated shadow map for each light of the one or more lights.

Claims (52)

1. A system comprising:

one or more computer processors;

one or more computer memories;

a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations comprising:

accessing environment data for an environment corresponding to a frame of a video;

determining a plurality of subframes associated with the frame;

determining a rotation angle for each of the plurality of subframes based on a total rotation angle associated with the plurality of subframes and a count of the plurality of subframes;

selecting one or more lights corresponding to the environment;

generating, for a light of the one or more lights, a shadow map, the shadow map corresponding to a subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the subframe, the frustum associated with the light; and

rendering an image of the environment, the rendering including using the generated shadow map for the light of the one or more lights.

2. The system of claim 1 , the operations further comprising:

generating, for each light of the one or more lights, an additional shadow map, the additional shadow map corresponding to an additional subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the additional subframe; and

wherein the rendering includes using the additional generated shadow map for each light of the one or more lights.

3. The system of claim 2 , the operations further comprising:

creating an averaged single image for the subframe and the additional subframe; and

using the averaged single frame as the image.

4. The system of claim 3 , wherein the creating of the averaged single image includes adding a rendered image and an additional rendered image into an accumulation buffer, the rendered image corresponding to the subframe and the additional rendered image corresponding to the additional subframe.

5. The system of claim 1 , wherein the selecting of the one or more lights is based on a type of the light.

6. The system of claim 1 , wherein the type of the light is one of a spot light, point light, line light, directional light, or plane light.

7. The system of claim 1 , wherein the frustum view dimensions are determined in order to include a predetermined percentage of light output interacting with the environment, the light output emanating from the light of the one or more lights, and wherein the determination may additionally be based one or more of the following: a type of the light of the one or more lights or data describing the light output.

8. The system of claim 1 , wherein the rendering is from a camera frustum view.

9. The system of claim 1 , wherein the rendering is performed by a module that is separate from a rendering pipeline, the module configured to supply the environment data to the rendering pipeline.

10. The non-transitory computer-readable storage medium of claim 1 , wherein the type of the light is one of a spot light, point light, line light, directional light, or plane light.

11. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform operations, the operations comprising:

accessing environment data for an environment corresponding to a frame of a video;

determining a plurality of subframes associated with the frame;

determining rotation angle for each of the plurality of subframes based on a total rotation angle associated with the plurality of subframes and a count of the plurality of subframes;

selecting one or more lights corresponding to the environment;

generating, for a light of the one or more lights, a shadow map, the shadow map corresponding to a subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the subframe, the frustum associated with the light; and

rendering an image of the environment, the rendering including using the generated shadow map for the light of the one or more lights.

12. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising:

generating, for each light of the one or more lights, an additional shadow map, the additional shadow map corresponding to an additional subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the additional subframe; and

wherein the rendering includes using the additional generated shadow map for each light of the one or more lights.

13. The non-transitory computer-readable storage medium of claim 12 , the operations further comprising:

creating an averaged single image for the subframe and the additional subframe; and

using the averaged single frame as the image.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the creating of the averaged single image includes adding a rendered image and an additional rendered image into an accumulation buffer, the rendered image corresponding to the subframe and the additional rendered image corresponding to the additional subframe.

15. The non-transitory computer-readable storage medium of claim 11 , wherein the selecting of the one or more lights is based on a type of the light.

16. The non-transitory computer-readable storage medium of claim 11 , wherein the frustum view dimensions are determined in order to include a predetermined percentage of light output interacting with the environment, the light output emanating from the light of the one or more lights, and wherein the determination may additionally be based one or more of the following:

a type of the light of the one or more lights or data describing the light output.

17. The non-transitory computer-readable storage medium of claim 11 , wherein the rendering is from a camera frustum view.

18. The non-transitory computer-readable storage medium of claim 11 , wherein the rendering is performed by a module that is separate from a rendering pipeline, the module configured to supply the environment data to the rendering pipeline.

19. A method comprising:

accessing environment data for an environment corresponding to a frame of a video;

determining a plurality of subframes associated with the frame;

determining rotation angle for each of the plurality of subframes based on a total rotation angle associated with the plurality of subframes and a count of the plurality of subframes;

selecting one or more lights corresponding to the environment;

generating, for a light of the one or more lights, a shadow map, the shadow map corresponding to a subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the subframe, the frustum associated with the light; and

rendering an image of the environment, the rendering including using the generated shadow map for the light of the one or more lights.

20. The method of claim 19 , further comprising:

generating, for each light of the one or more lights, an additional shadow map, the additional shadow map corresponding to an additional subframe of the plurality of subframes based on a frustum view oriented at the rotation angle determined for the additional subframe; and

wherein the rendering includes using the additional generated shadow map for each light of the one or more lights.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2025
From: UNITY IPR APS
To: UNITY TECHNOLOGIES APS
Reel/Frame 072926/0322 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: LEROUX, JEAN-PHILIPPE; VAAST, YOHANN CHRISTOPHE
To: UNITY IPR APS
Reel/Frame 056840/0070 →
Continuity (2)
Provisional Application 63027330 · May 19, 2020
Related Publication 20210366184A1 · Nov 25, 2021