Technique for dynamically adapting an exposure value in interactive rendering
An exposure value is dynamically adapted for consistent interactive rendering of a volumetric medical dataset. A rendering set of a plurality of rendering types with each rendering type adapted for providing an image dataset derived from the volumetric medical dataset is provided. An image dataset according to a first rendering type using a first exposure value is output. An exposure value for each rendering type within the rendering set is determined based on the first exposure value of the first rendering type and on a consistency requirement for changing rendering types of the image dataset output. Upon receiving a user input for modifying the output of the image dataset, a second rendering type with a second exposure value is selected and output.
1. A computer-implemented method for dynamically adapting an exposure value for consistent interactive rendering of a volumetric medical dataset, the method comprising:
receiving a volumetric medical dataset;
providing a rendering set comprising a plurality of rendering types, wherein each rendering type within the rendering set is adapted for providing an image dataset derived from the received volumetric medical dataset, wherein the plurality of rendering types comprises at least two different rendering types;
outputting, to a display device, an image dataset pertaining to the received volumetric medical dataset according to a first rendering type within the rendering set, wherein the outputting comprises applying a first exposure value to the image dataset;
determining a second exposure value for each rendering type within the rendering set, wherein the exposure value is adapted for displaying the image dataset according to the rendering type on the display device, and wherein the second exposure value for each rendering type is determined based on the first exposure value according to the first rendering type, wherein the determining of the exposure value for each rendering type is based on a consistency requirement for changing rendering types of the image dataset output;
receiving a user input for modifying the output of the image dataset;
selecting, based on the received user input, a second rendering type with the determined second exposure value for outputting the image dataset pertaining to the received volumetric medical dataset, wherein the second rendering type differs from the first rendering type; and
outputting, to the display device, the image dataset according to the selected second rendering type with the determined second exposure value.
2. The method according to claim 1 , wherein a rendering type is selected from the group consisting of: a rendering algorithm; a classification of anatomical structures comprised in the volumetric medical dataset; and a rendering preset comprising a camera view, a light source profile, a clipping plane, and/or a rendering window.
3. The method according to claim 2 , wherein the rendering algorithm is selected from the group consisting of: raycasting; path tracing; interactive volume lighting, IVL; and half-angle slicing.
4. The method according to claim 1 , wherein the volumetric medical dataset is received from a medical scanner.
5. The method according to claim 1 , wherein the outputting of the image dataset according to the selected second rending type with the determined second exposure value is applied to the next rendered frame or a predetermined number of later rendered frames after the user input was received.
6. The method according to claim 1 , wherein the determined second exposure value is based on an image metric.
7. The method according to claim 6 , wherein the image metric is optimized and selected from the group consisting of: an average image luminance; a logarithmic image exposure value; a local luminance; and a perceptual metric.
8. The method according to claim 1 , wherein the determined second exposure value for a frame is based on multiple previous frames, wherein a frame is a time instance of the volumetric medical dataset, and wherein the volumetric medical dataset comprises a time dimension.
9. The method according to claim 1 , wherein, in the act of outputting the image dataset according to the second rendering type, a smoothing transition operation from the first rendering type to the second rendering type is applied.
10. The method according to claim 9 , wherein the smoothing transition operation is selected from the group consisting of: an easing function; a gamma correction; a tone mapping operator; a custom response curve; and a relaxation parameter.
11. The method according to claim 1 , wherein the user input is received by a human machine interface; a graphic user interface; a mouse; a keyboard; and/or an eye tracking device tracking the view of the user.
12. The method according to claim 1 , wherein the display device comprises a see-through device, and wherein determining the second exposure value for each rendering type comprises adjusting the exposure value according to a real-world background.
13. The method according to claim 1 , wherein the display device comprises a pass-through device, and wherein determining the exposure value for each rendering type comprises adjusting the exposure value applied to a real-world background and/or the output image dataset.
14. The method according to claim 1 , wherein determining the second exposure value for each rendering comprises assigning weights to voxels, pixels, and/or zones of the volumetric medical dataset, render viewports, and/or to the image dataset, and determining the second exposure value for each rendering type based on the weights of the voxels, pixels, and/or zones, render viewports, and/or the image dataset.
15. The method according to claim 1 , wherein the determined second exposure values for each rendering type are stored in a temporary buffer, and wherein the outputting of the image dataset according to the selected second rendering type comprises accessing the temporary buffer for retrieving the determined second exposure value.
16. The method according to claim 1 , wherein a machine learning algorithm across at least part of the plurality of rendering types is employed for the determining of the second exposure values of the rendering types within the rendering set.
17. A computing device for dynamically adapting an exposure value for consistent interactive rendering of a volumetric medical dataset, the computing device comprising:
a first receiver configured to receive a volumetric medical dataset;
a processor configured to provide a rendering set comprising a plurality of rendering types, wherein each rendering type within the rendering set is adapted for providing an image dataset derived from the received volumetric medical dataset, wherein the plurality of rendering types comprises at least two different rendering types;
a graphics processing unit configured to output, to a display device, an image dataset pertaining to the received volumetric medical dataset according to a first rendering type within the rendering set, wherein the outputting comprises applying a first exposure value to the image dataset;
wherein the processor is further configured to determine a second exposure value for a second rendering type within the rendering set, wherein the second exposure value is adapted for displaying the image dataset according to the rendering type on a display device, and wherein the second exposure value for the second rendering type is determined based on the first exposure value according to the first rendering type, wherein the determining of the second exposure value for the second rendering type is based on a consistency requirement for changing rendering types of the image dataset output;
a second receiver configured to receive a user input for modifying the output of the image dataset;
wherein the processor is further configured to select, based on the received user input, the second rendering type with the determined second exposure value for outputting the image dataset pertaining to the received volumetric medical dataset, wherein the second rendering type differs from the first rendering type;
wherein the graphics processing unit is further configured for outputting, to the display device, the image dataset according to the selected second rendering type with the determined second exposure value.
18. The computer device of claim 17 , further comprising:
the display device configured to receive the image dataset from the graphics processing unit;
a user interface configured to forward the user input to the second receiver.
19. The computer device of claim 17 , further comprising
at least one medical scanner configured to provide the volumetric medical dataset to the first receiver.
20. A non-transitory computer readable storage medium having stored thereon a computer program, that when executed by a computer, performs:
receipt of a volumetric medical dataset;
provision of a rendering set comprising a plurality of rendering types, wherein each rendering type within the rendering set is adapted for providing an image dataset derived from the received volumetric medical dataset, wherein the plurality of rendering types comprises at least two different rendering types;
output, to a display device, of an image dataset pertaining to the received volumetric medical dataset according to a first rendering type within the rendering set, wherein the outputting comprises applying a first exposure value to the image dataset;
determination of a second exposure value for each rendering type within the rendering set, wherein the exposure value is adapted for displaying the image dataset according to the rendering type on the display device, and wherein the second exposure value for each rendering type is determined based on the first exposure value according to the first rendering type, wherein the determining of the exposure value for each rendering type is based on a consistency requirement for changing rendering types of the image dataset output;
receipt of a user input for modifying the output of the image dataset;
selection, based on the received user input, of a second rendering type with the determined second exposure value for outputting the image dataset pertaining to the received volumetric medical dataset, wherein the second rendering type differs from the first rendering type; and
output, to the display device, of the image dataset according to the selected second rendering type with the determined second exposure value.