IP Library Granted Patent US 12,406,429
Granted Patent B2
US 12,406,429 · App. 18/069,390 · Granted Sep 2, 2025

Occlusion detection

Inventors: Donny Tytgat (Oosterzele, BE); Jean-Francois Macq (Ganshoren, BE); Christoph Stevens (Stekene, BE)
Assignee: NOKIA TECHNOLOGIES OY
G06T15/06G06T15/20G06T17/00G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,429
App. No.
18/069,390
Granted
Sep 2, 2025
Kind
B2
Abstract

An apparatus and method provide for occlusion detection. An example apparatus includes means for: receiving first data comprising a reference viewpoint of a real-world space; receiving second data comprising a position of a target object in the real-world space; transforming, based on the first and second data, at least one of the reference viewpoint and the target object position into a common virtual reference space; generating one or more rays which extend between the reference viewpoint and a respective spatial point associated with the position of the target object in the common virtual reference space; and determining the digital model representing the real-world space and including one or more real-world features, an occlusion status between the reference viewpoint and the target object. The occlusion status is based on an intersection of the one or more real-world features and the one or more generated rays.

Claims (48)

1. An apparatus, comprising:

at least one processor; and

at least one memory storing instructions which, when executed by the at least one processor, cause the apparatus to:

receive first data comprising a reference viewpoint of a real-world space;

receive second data comprising a position of a target object in the real-world space, wherein the second data further comprises a three-dimensional volume associated with the target object;

transform, based on the first and second data, at least one of the reference viewpoint and the target object position into a common virtual reference space;

spatially sample a plurality of points of the three-dimensional volume to determine one or more spatial points associated with the position of the target object;

generate one or more rays which extend between the reference viewpoint and a respective one of the one or more spatial points associated with the position of the target object in the common virtual reference space, wherein generating one or more rays comprises generating a plurality of rays extending between the reference viewpoint and each of the plurality of sampled points of the volume; and

determine, using the generated one or more rays and a digital model, the digital model representing the real-world space and including one or more real-world features thereof, an occlusion status between the reference viewpoint and the target object,

wherein the occlusion status is based on a number of the plurality of rays intersected by the one or more real-world features.

2. The apparatus of claim 1 , wherein the common virtual reference space corresponds to, or maps to, the reference space of the digital model.

3. The apparatus of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the apparatus to transform the reference space of the digital model into the common virtual reference space.

4. The apparatus of claim 1 , wherein the one or more real-world features of the digital model comprise static features of the real-world space.

5. The apparatus of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the apparatus to receive a weight map comprising a plurality of weights, each of the plurality of weights associated with a respective portion of the three-dimensional volume,

wherein, for each respective portion of the three-dimensional volume, the sampling comprises sampling a respective portion of the plurality of points.

6. The apparatus of claim 5 , wherein the sampling comprises sampling the respective portion of the plurality of points using a sampling rate which is reflective of the weight associated with the respective portion of the three-dimensional volume.

7. The apparatus of claim 5 , wherein the instructions, when executed by the at least one processor, further cause the apparatus to generate a two-dimensional projection of the weight map based on a two-dimensional projection of the three-dimensional volume from the reference viewpoint,

wherein the sampling comprises sampling the respective portion of the plurality of points using a sampling rate determined based on the two-dimensional projection of the weight map.

8. The apparatus of claim 5 , wherein the second data is received from one or more sensors, wherein one or more of the plurality of weights of the weight map are indicative of a margin of error of the one or more sensors.

9. The apparatus of claim 1 , wherein:

the sampling comprises spatially sampling the plurality of points of the three-dimensional volume at a uniform sampling rate; or

the sampling comprises spatially sampling the plurality of points of the three-dimensional volume at a sampling rate determined based on a two-dimensional projection of the three-dimensional volume from the reference viewpoint; or

the sampling comprises randomly sampling the plurality of points, optionally configured to randomly sample the plurality of points using a Monte Carlo method.

10. The apparatus of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the apparatus to generate an occlusion vector by transforming each of the one or more generated rays into a reference space of the reference viewpoint,

the occlusion vector comprising, for each of the one or more generated rays and the respective spatial point associated with the position of the target object, a transformation of the respective spatial point into the reference space of the reference viewpoint and an indication of whether the ray is occluded.

11. The apparatus of claim 10 , wherein the instructions, when executed by the at least one processor, further cause the apparatus to output the occlusion vector.

12. A method comprising:

receiving first data comprising a reference viewpoint of a real-world space;

receiving second data comprising a position of a target object in the real-world space, wherein the second data further comprises a three-dimensional volume associated with the target object;

transforming, based on the first and second data, at least one of the reference viewpoint and the target object position into a common virtual reference space;

spatially sampling a plurality of points of the three-dimensional volume to determine one or more spatial points associated with the position of the target object;

generating one or more rays which extend between the reference viewpoint and a respective one of the one or more spatial points associated with the position of the target object in the common virtual reference space, wherein generating one or more rays comprises generating a plurality of rays extending between the reference viewpoint and each of the plurality of sampled points of the volume; and

determining, using the generated one or more rays and a digital model, the digital model representing the real-world space and including one or more real-world features thereof, an occlusion status between the reference viewpoint and the target object,

wherein the occlusion status is based on a number of the plurality of rays intersected by the one or more real-world features.

13. The method of claim 12 , further comprising generating an occlusion vector by transforming each of the one or more generated rays into a reference space of the reference viewpoint, the occlusion vector comprising, for each of the one or more generated rays and the respective spatial point associated with the position of the target object, a transformation of the respective spatial point into the reference space of the reference viewpoint and an indication of whether the ray is occluded.

14. The method of claim 12 , wherein the common virtual reference space corresponds to, or maps to, the reference space of the digital model.

15. The method of claim 12 , further comprising transforming the reference space of the digital model into the common virtual reference space.

16. The method of claim 12 , wherein the one or more real-world features of the digital model comprise static features of the real-world space.

17. The method of claim 12 , further comprising receiving a weight map comprising a plurality of weights, each of the plurality of weights associated with a respective portion of the three-dimensional volume,

wherein, for each respective portion of the three-dimensional volume, the sampling comprises sampling a respective portion of the plurality of points.

18. A non-transitory computer readable medium comprising program instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:

receiving first data comprising a reference viewpoint of a real-world space;

receiving second data comprising a position of a target object in the real-world space, wherein the second data further comprises a three-dimensional volume associated with the target object;

transforming, based on the first and second data, at least one of the reference viewpoint and the target object position into a common virtual reference space;

spatially sampling a plurality of points of the three-dimensional volume to determine one or more spatial points associated with the position of the target object;

generating one or more rays which extend between the reference viewpoint and a respective one of the one or more spatial points associated with the position of the target object in the common virtual reference space, wherein generating one or more rays comprises generating a plurality of rays extending between the reference viewpoint and each of the plurality of sampled points of the volume; and

determining, using the generated one or more rays and a digital model, the digital model representing the real-world space and including one or more real-world features thereof, an occlusion status between the reference viewpoint and the target object,

wherein the occlusion status is based on a number of the plurality of rays intersected by the one or more real-world features.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2022
From: TYTGAT, DONNY; MACQ, JEAN-FRANCOIS; STEVENS, CHRISTOPH
To: NOKIA BELL NV
Reel/Frame 062171/0563 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2022
From: NOKIA BELL NV
To: NOKIA TECHNOLOGIES OY
Reel/Frame 062171/0711 →
Priority Claims (1)
EP 21216280.4 · Dec 21, 2021 · regional
Continuity (1)
Related Publication 20230196655A1 · Jun 22, 2023
References Cited (12)
US 20120105450A1 · Sourimant · 2012 [cited by examiner]
US 20190212746A1 · Cheng et al. · 2019 [cited by applicant]
US 20190371072A1 · Lindberg et al. · 2019 [cited by applicant]
US 20200126415A1 · Lin et al. · 2020 [cited by applicant]
US 20210073430A1 · Levy et al. · 2021 [cited by applicant]
US 20210233305A1 · Garcia · 2021 [cited by examiner]
EP 3258445A1 · 2017 [cited by applicant]
Extended European Search Report for European Application No. 21216280.4 dated Aug. 8, 2022, 11 pages. [cited by applicant]
Hou et al., “Literature Review of Digital Twins Applications in Construction Workforce Safety”, Journal of Applied Sciences, 11(1), (Dec. 31, 2020), 21 pages. [cited by applicant]
Kikuchi et al., “Landscape Visualization by Integrating Augmented Reality and Drones with Occlusion Handling to Link Real and Virtual Worlds—Towards City Digital Twin Realization”, Proceedings of the 39th eCADDe Confere… [cited by applicant]
Méndez-Feliu et al., “From Obscurances to Ambient Occlusion: A Survey”, The Visual Computer 25, (Feb. 15, 2008), 16 pages. [cited by applicant]
Tian et al., “Occlusion Handling Using Moving Volume and Ray Casting Techniques for Augmented Reality Systems”, Multimedia Tools and Applications, 77, (Sep. 30, 2017), 18 pages. [cited by applicant]