Method and visualization system for displaying image data
A method and a visualization system for displaying image data are provided, which, based on a set of different sequences, which are already predefined and stored in a memory, of visualization modes following one another in a specific order, always only provides a limited subselection of overall visualization modes usable using the visualization system for selection to a user, so that the user can change back and forth quickly and efficiently with the aid of an input between the visualization modes which are best suitable for the present application of the visualization system.
1 . A method for visualizing image data on a display device ( 5 ) of a medical device visualization system ( 1 ) comprising a microscope, an exoscope, or an endoscope, the visualization system ( 1 ) comprising:
at least one of a camera ( 2 ) or image sensor, which generates live image data to be displayed on the display device ( 5 ),
wherein various sequences of visualization modes are stored in a memory of a computer device ( 3 ) of the visualization system ( 1 ), and
wherein the different visualization modes of a sequence each comprise a combination made up of:
a respective imaging mode, which is based on a specific image signal processing of the received live image data, and
an associated display layout, in which the live image data are presented on the display device, and
the method comprises the following steps:
individually selecting by a user, a predefined sequence (a-g) of visualization modes from the stored various sequences of visualization modes, the predefined sequence (a-g) comprising a first and a second visualization mode,
receiving ( 110 ) the live image data;
displaying ( 120 ) the received live image data by the display device ( 5 ) in the first visualization mode of the predefined sequence (a-g) of visualization modes, wherein the first visualization mode is based on a first parameter set of a multidimensional parameter space of visualization parameters;
in reaction to receiving ( 130 ) a first user input of at least one user input, determining ( 140 ) a second parameter set of the multidimensional parameter space for the second visualization mode of the predefined sequence (a-g) of visualization modes; and
changing ( 150 ) from the first visualization mode to the second visualization mode based on the determined second parameter set;
wherein the second visualization mode differs from the first visualization mode in at least one of the respective imaging mode or the associated display layout.
2 . The method according to claim 1 , wherein the selected sequence of visualization modes comprises at least one of
(i) different imaging modes based on at least one of: a) different processing or filtering of the received live image data or b) recording by different spectral illumination from a light source ( 6 ), or
(ii) different display layouts including at least one of: a full image layout, a split-screen layout, a picture-in-picture layout, a superposition layout, a picture-out-of-picture layout, a zoom layout, or a detail enlargement layout.
3 . The method according to claim 1 , wherein at least one of:
the second visualization mode directly precedes or directly follows the first visualization mode in the predefined sequence, or
the change from the first visualization mode to the second visualization mode or to multiple second visualization modes of the selected sequence takes place step-by-step in each case in response to the first user input, and does so in an order which is predetermined by the presently selected sequence.
4 . The method according to claim 1 , wherein the visualization modes comprised by the selected sequence of different visualization modes is a subset of a larger number of overall visualization modes that are settable using the visualization system ( 1 ).
5 . The method according to claim 1 , further comprising:
determining or changing ( 160 ) the selected predefined sequence of different visualization modes based on at least one of:
a second user input,
stored user preferences,
a specific system parameter,
application parameter, or
the received live image data.
6 . The method according to claim 1 , wherein the user or the computer device ( 3 ) at least one of changes or predefines one or more of the various sequences of visualization modes stored in the memory, to define a plurality of applicable sequences of visualization modes reasonable for a respective application.
7 . The method according to claim 1 , wherein the different visualization modes of one or more of the sequences of visualization modes stored in the memory are determined or changed by the computer device ( 3 ) by using at least one of artificial intelligence or machine learning based on at least one of:
the visualization modes used last by the user,
a medical application, or
the received live image data.
8 . The method according to claim 1 , further comprising:
determining ( 160 ) the predefined sequence of various visualization modes based on a plurality of predefined various sequences of the different visualization modes which are stored in the memory.
9 . The method according to claim 1 , further comprising:
in reaction to a second user input, changing at least one of an imaging mode, a display layout, or individual parameters of at least one of the different visualization modes of the selected sequence of visualization modes in response to a second user input.
10 . The method according to claim 1 , wherein the step of displaying ( 120 ) the received live image data in the first visualization mode (a) further comprises:
displaying a preview representation ( 9 ) of the received live image data in a further visualization mode or in multiple further visualization modes of the predefined sequence.
11 . The method of claim 10 , wherein all of the different visualization modes of the predefined selected sequence, or a visualization mode directly preceding or following the first visualization mode are displayed in the preview representation ( 9 ).
12 . A medical device visualization system ( 1 ) comprising a microscope, exoscope, or endoscope for displaying image data, the medical device visualization system ( 1 ) comprising:
a camera ( 2 ) for generating live image data;
an imaging device ( 2 ) for receiving the live image data;
a display device ( 5 ) for displaying the received live image data;
an input device ( 8 ) for receiving a user input; and
a computer ( 3 , 4 ) configured to carry out the method according to claim 1 , the computer including said memory for storing the various sequences of visualization modes, with each visualization mode comprising said specific combination of the imaging mode and the associated display layout, and the selected sequence is stored in the memory and is selectable by the user;
wherein the visualization system ( 1 ) is configured, in response to the at least one user input,
to make a change in a predefined and currently selected sequence of visualization modes from the first visualization mode of the selected sequence to the second visualization mode of the selected sequence, and
to represent the received live image data via the display device ( 5 ) based on the change to the second visualization mode of the selected sequence,
wherein the user can change step-by-step between the various visualization modes of the currently selected sequence by actuating the input device ( 8 ), and
wherein the second visualization mode differs from the first visualization mode in the combination of the respective imaging mode and the associated display layout used.
13 . The medical device visualization system ( 1 ) according to claim 12 , wherein the camera is a video endoscope.
14 . A non-transitory, computer-readable storage medium, comprising commands, which, upon execution by the computer device ( 3 , 4 ) of the medical device visualization system ( 1 ) according to claim 12 , prompt the computer device ( 3 , 4 ) to carry out the method.