Granted Patent B2

US 12,524,951 · App. 18/016,121 · Granted Jan 13, 2026

Inventors: Christian Schumann (Bremen, DE); Valentin Kraft (Bremen, DE); Florian Link (Bremen, DE)

Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E. V.

G06T15/08G06T15/06G06T15/50G06T15/506G06T2210/41

Abstract

Claims (34)

1 . A direct volume rendering apparatus for volume rendering a three-dimensional image data set, wherein the direct volume rendering apparatus comprises a two-dimensional image calculator configured to calculate a two-dimensional image to be shown to a user by:

providing for each primary ray of a plurality of primary rays, which traverse through the three-dimensional image data set and meet a respective pixel of a two-dimensional image in a two-dimensional image plane on which the three-dimensional image data set should be projected, colors and opacities along the primary ray;

subdividing each primary ray into segments based on the opacities and/or colors along the respective primary ray;

calculating, for each segment, a segment lighting value in accordance with a predetermined lighting calculation rule, by a) defining a lighting value position within the respective segment and b) calculating, for the respective lighting value deamination position, the respective segment lighting value in accordance with the predetermined lighting calculation rule; and

projecting the colors and segment lighting values along the primary rays onto the pixels based on a predetermined projection rule.

2 . The direct volume rendering apparatus as defined by claim 1 , wherein the three-dimensional image data set comprises image elements, wherein the two-dimensional image calculator is configured to provide for each primary ray colors and opacities along the respective primary ray by:

assigning to each image element of the three-dimensional image data set a color and an opacity; and

calculating for each primary ray colors and opacities along the primary ray based on the colors and opacities assigned to image elements traversed by the primary ray.

3 . The direct volume rendering apparatus of claim 2 , wherein the predetermined lighting value calculation rule includes calculating a) the ambient lighting value by providing an environment map defining in which direction first incoming light has which intensity and modifying the intensity of the first in-coming light based on the opacities assigned to the image elements, and b) the at least one directional lighting value by providing directional lighting information for a lighting value determination position, which is indicative of the light intensity of second incoming light from a virtual light source, and modifying the intensity of the second incoming light based on the opacities assigned to the image elements.

4 . The direct volume rendering apparatus of claim 3 , wherein the ambient lighting value is calculated by:

defining several cones within a hemisphere for the lighting value determination position, wherein the hemisphere is defined by a gradient of the colors and/or opacities assigned to the image elements at the lighting value determination position, wherein the hemisphere points in the direction of the gradient and an end plane of the hemisphere traverses the lighting value determination position and is normal to the gradient, wherein the apices of the cones are located at the lighting value determination position;

defining, for each cone, spheres centered on the axis of the respective cone, wherein the radii of the spheres increase with increasing distance to the respective apex;

determining an occlusion value for each sphere and combining the occlusion values determined for all spheres of the respective cone, in order to determine an occlusion value for the entire cone;

determining, for each cone, a modified light intensity based on the occlusion value determined for the respective cone and the light intensity of the light incoming through the respective cone as defined by the environment map; and

combining the modified light intensities determined for the cones of the respective lighting value determination position, in order to determine for the respective lighting value determination position an ambient lighting value.

5 . The direct volume rendering apparatus of claim 1 , wherein the two-dimensional image calculator is configured to subdivide each primary ray into segments by defining segment borders, wherein a segment border is defined by a position along a primary ray at which a function of the opacities and/or color exceeds a predefined threshold value.

6 . The direct volume rendering apparatus of claim 5 , wherein the function of the opacities is a function selected from the group consisting of:

the identity function, a linear function, an integrating function and a derivating function, directly applied to the opacities and/or colors and/or applied to accumulated opacities.

7 . The direct volume rendering apparatus of claim 5 , wherein the two-dimensional image calculator is configured to provide several threshold values, wherein a segment border is defined by a position along a primary ray at which a function of the opacities and/or colors exceeds a predefined threshold value of the provided several threshold values.

8 . The direct volume rendering apparatus of claim 7 , wherein the difference between neighboring provided thresholds is constant.

9 . The direct volume rendering apparatus of claim 7 , wherein the two-dimensional image calculator is configured to provide the several threshold values in accordance with a predefined linear threshold function or an exponential threshold function.

10 . The direct volume rendering apparatus of claim 1 , wherein the two-dimensional image calculator is configured to define the lighting value determination position within the respective segment such that it is within a quarter of the respective segment, which is arranged at the end of each segment with the primary ray being traced from the pixel position towards the volume.

11 . The direct volume rendering apparatus of claim 1 , wherein the predetermined lighting value calculation rule includes at least one of a) calculating an ambient lighting value and b) calculating at least one directional lighting value.

12 . The direct volume rendering apparatus of claim 1 , wherein the two-dimensional image calculator is further configured to calculate for each segment a segment color based on the colors and opacities along the respective segment and to project the colors and segment lighting values along the primary rays onto the pixels by projecting the segment colors and segment lighting values.

13 . A computer-implemented direct volume rendering method in a direct volume rendering apparatus for volume rendering a three-dimensional image data set, wherein the direct volume rendering method comprises:

providing for each primary ray of a plurality of primary rays, which traverse through the three-dimensional image data set and meet a respective pixel of a two-dimensional image in a two-dimensional image plane on which the three-dimensional image data set should be projected, colors and opacities along the primary ray;

subdividing each primary ray into segments based on the opacities and/or colors along the respective primary ray;

calculating, for each segment, a segment lighting value in accordance with a predetermined lighting calculation rule, by a) defining a lighting value deamination position within the respective segment and b) calculating, for the respective lighting value deamination position, the respective segment lighting value in accordance with the predetermined lighting value calculation rule; and

projecting the colors and segment lighting values along the primary rays onto the pixels based on a predetermined projection rule.

14 . A computer readable memory medium storing program code instructions for controlling a computer processor of a direct volume rendering apparatus, when executed, to cause volume rendering of a three-dimensional image data set, by performing a method comprising:

providing for each primary ray of a plurality of primary rays, which traverse through the three-dimensional image data set and meet a respective pixel of a two-dimensional image in a two-dimensional image plane on which the three-dimensional image data set should be projected, colors and opacities along the primary ray;

subdividing each primary ray into segments based on the opacities and/or colors along the respective primary ray;

calculating, for each segment, a segment lighting value in accordance with a predetermined lighting calculation rule, by a) defining a lighting value deamination position within the respective segment and b) calculating, for the respective lighting value deamination position, the respective segment lighting value in accordance with the predetermined lighting value calculation rule; and

projecting the colors and segment lighting values along the primary rays onto the pixels based on a predetermined projection rule.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (13)