IP Library › Granted Patent US 12,322,037
Granted Patent B2
US 12,322,037 · App. 17/909,016 · Granted Jun 3, 2025

System and method for real-time ray tracing in a 3D environment

Inventors: Heqi Lu (Bordeaux, FR); Patrice Hirtzlin (Betton, FR); Francois-Louis Tariolle (Liffre, FR); Merwan Achibet (Rennes, FR)
Assignee: InterDigital CE Patent Holdings, SAS
G06T15/506G06T7/12G06T7/90G06T15/06G06T2207/10021G06T2207/10024G06T2207/20021G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,037
App. No.
17/909,016
Granted
Jun 3, 2025
Kind
B2
Abstract

A method and a system for rendering a 3D scene are disclosed. A set of parameters for objects in the 3D scene are identified. The objects are grouped based on the identified set of parameters and spatial boundaries for an intermediate structure group of objects based on an object type is determined. An illumination contribution for each plane of the spatial boundary of the intermediate structure is determined for the objects in the 3D scene. The 3D scene is then rendered based on the determined spatial boundary and the illumination contribution of the intermediate structure for each object in the scene.

Claims (38)

1. A method, comprising:

identifying a set of parameters for one or more virtual objects in a 3D scene of a video;

determining a spatial boundary of an intermediate structure for each of the one or more virtual objects in the 3D scene based on a respective object type and a respective object importance weight parameter;

determining an illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more virtual objects in the 3D scene; and

generating the 3D scene of the video based on the determined spatial boundary and the determined illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more objects in the 3D scene.

2. The method of claim 1 , wherein the set of parameters comprises an object planarity, object refractivity, and object importance in the 3D scene of the video.

3. The method of claim 1 , further comprising grouping said one or more objects based on the identified set of parameters.

4. The method of claim 1 , wherein the spatial boundary of the intermediate structure comprises a plane or a set of planes.

5. The method of claim 4 , wherein the spatial boundary of the intermediate structure is subdivided.

6. The method of claim 1 , wherein the spatial boundary comprises a bounding box, and wherein the intermediate structure comprises a middle-field structure.

7. The method of claim 1 , wherein the one or more virtual objects comprise one or more of an invisible virtual mirror, an invisible virtual light, or an invisible glossy plane.

8. The method of claim 1 , wherein the 3D scene of the video further comprises one or more real objects.

9. The method of claim 1 , wherein the object type is one of a light, a camera, or other object.

10. The method of claim 1 , wherein determining the illumination contribution comprises at least one of:

determining a visibility for each plane of said spatial boundary for emissive objects; and

determining color information for each plane of said spatial boundary for non-emissive objects.

11. A device for rendering a 3D scene of a video, comprising:

at least one processor, configured to:

identify a set of parameters for one or more virtual objects in a 3D scene of a video;

determine a spatial boundary of an intermediate structure for each of the one or more virtual objects in the 3D scene based on a respective object type and a respective object importance weight parameter;

determine an illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more virtual objects in the 3D scene; and

generate the 3D scene of the video based on the determined spatial boundary and the determined illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more objects in the 3D scene.

12. The device of claim 11 , wherein the set of parameters comprises an object planarity, object refractivity, and object importance in the 3D scene of the video.

13. The device of claim 11 , further comprising grouping said one or more objects based on the identified set of parameters.

14. The device of claim 11 , wherein the spatial boundary of the intermediate structure comprises a plane or a set of planes.

15. The device of claim 11 , wherein the spatial boundary comprises a bounding box, and wherein the intermediate structure comprises a middle-field structure.

16. The device of claim 11 , wherein the one or more virtual objects comprise one or more of an invisible virtual mirror, an invisible virtual light, or an invisible glossy plane.

17. The device of claim 11 , wherein the 3D scene of the video further comprises one or more real objects.

18. The device of claim 11 , wherein the object type is one of a light, a camera, or other object.

19. The device of claim 11 , wherein, to determine the illumination contribution, the processor is configured to:

determine a visibility for each plane of said spatial boundary for emissive objects; and

determine color information for each plane of said spatial boundary for non-emissive objects.

20. A device for rendering a 3D scene of a video, comprising:

at least one processor, configured to:

identify a set of parameters for one or more virtual objects in a 3D scene of a video, wherein the set of parameters comprises an object planarity, an object refractivity, or an object importance in the 3D scene of the video;

determine a spatial boundary of an intermediate structure for each of the one or more virtual objects in the 3D scene based on a respective object type and a respective object importance weight parameter;

determine an illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more virtual objects in the 3D scene; and

generate the 3D scene of the video based on the determined spatial boundary and the determined illumination contribution for each plane of the spatial boundary of the intermediate structure for each of the one or more objects in the 3D scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2022
From: LU, HEQI; HIRTZLIN, PATRICE; TARIOLLE, FRANCOIS-LOUIS; ACHIBET, MERWAN
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 060975/0577 →
Priority Claims (2)
EP 20305276 · Mar 17, 2020 · regional
EP 20305970 · Sep 2, 2020 · regional
Continuity (1)
Related Publication 20230090732A1 · Mar 23, 2023
References Cited (10)
US 9390315B1 · Yalniz · 2016 [cited by examiner]
US 20030052891A1 · Bragg et al. · 2003 [cited by applicant]
US 20150262407A1 · Fursund et al. · 2015 [cited by applicant]
US 20170358123A1 · Novak · 2017 [cited by examiner]
US 20180033191A1 · Mendez · 2018 [cited by examiner]
US 20190102935A1 · Neulander · 2019 [cited by applicant]
US 20200051318A1 · Muthler · 2020 [cited by examiner]
CN 110930497B · 2020 [cited by applicant]
EP 3343443A1 · 2018 [cited by applicant]
GB 2535792A · 2016 [cited by applicant]
Cited By (1)
US 12,620,172