Reconfigurable display in computer-assisted tele-operated surgery

1 . A method comprising:

operating a surgical system to perform a surgical process, the surgical system comprising a display device, and the surgical process comprising a plurality of phases;

determining that a current phase of the surgical process corresponds to a first phase of the plurality of phases;

generating, based on at least a profile and determining that the current phase corresponds to the first phase, a first display configuration for first visual representations corresponding to data from a first set of data sources selected from multiple data sources, the profile defining a configuration for visual representations presentable on the display device, wherein the configuration for the visual representations limits certain adjustments to a size of a view or prevents the view from being removed from the display device by a user, the configuration further defining a minimum size of the view presentable on the display device, the minimum size being defined by a safety condition specific to the current phase of the surgical process; and

presenting, on the display device, the first display configuration for the first visual representations.

2 . The method of claim 1 , further comprising:

determining that the current phase of the surgical process corresponds to a second phase of the plurality of phases;

generating, based on at least the profile and determining that the current phase corresponds to the second phase, a second display configuration for second visual representations corresponding to data from a second set of data sources selected from the multiple data sources; and

presenting, on the display device, the second display configuration for the second visual representations.

3 . The method of claim 1 , further comprising, after presenting the first display configuration for the first visual representations:

receiving a user input indicative of an adjustment to the first display configuration for the first visual representations;

determining whether the adjustment violates a safety condition associated with the profile; and

presenting, on the display device:

an updated display configuration of the visual representations based on at least the user input if the adjustment is determined to violate the safety condition; or

the first display configuration if the adjustment is determined to not violate the safety condition.

4 . The method of claim 3 , wherein:

determining whether the adjustment violates the safety condition associated with the profile comprises:

determining that the adjustment violates the safety condition; and

the method further comprises:

presenting, on the display device, an alert indicating that the adjustment violates the safety condition.

5 . The method of claim 1 , wherein:

the multiple data sources comprise at least two of: an endoscope, an ultrasound imaging device, a computed tomography (CT) imaging device, a nuclear imaging device, a radiography imaging device, or a magnetic resonance imaging (MRI) device.

6 . The method of claim 1 , wherein:

determining that the current phase of the surgical process corresponds to the first phase of the plurality of phases comprises:

executing an image analysis process on the data from the first set of data sources selected from the multiple data sources.

7 . The method of claim 1 , wherein:

the configuration for the visual representations presentable on the display device corresponds to a phase-specific configuration associated with the current phase of the plurality of phases.

8 . The method of claim 7 , wherein:

the phase-specific configuration defines a visibility of a visual representation corresponding to data from a data source of the multiple data sources.

9 . The method of claim 1 , wherein:

the data from the first set of data sources selected from the multiple data sources comprise first data from a first data source of the first set of data sources and second data from a second data source of the first set of data sources, the first data comprising first positional information with respect to a common reference frame, and the second data comprising second positional information with respect to the common reference frame.

10 . The method of claim 9 , wherein:

generating, based on at least the profile and determining that the current phase corresponds to the first phase, the first display configuration comprises:

registering a first visual representation of the first visual representations corresponding to the first data and a second visual representation of the first visual representations corresponding to the second data based on the common reference frame;

generating the first display configuration for the first visual representations based on at least the profile;

determining that the current phase corresponds to the first phase; and

registering the first visual representation and the second visual representation.

11 . The method of claim 1 , wherein:

the first display configuration is determined based on a user profile loaded prior to commencement of the surgical process, the user profile identifying an individual performing the surgical process and including user-preferences of the individual regarding organization of the visual representations corresponding to the data from the multiple data sources during different phases of the surgical process.

12 . The method of claim 1 , wherein:

generating, based on at least the profile and determining that the current phase corresponds to the first phase, the first display configuration for the first visual representations comprises:

generating the first display configuration for the first visual representations based on at least the profile, and

determining that the current phase corresponds to the first phase, and a user preference record.

13 . The method of claim 12 , wherein:

the user preference record is maintained as a user profile defined prior to commencement of the surgical process, the user profile comprising:

an identification of an individual performing the surgical process, and

a user preference associated with the individual, the user preference defining an organization of the first visual representations in the first display configuration.

14 . A surgical system comprising:

a display device; and

one or more processing devices configured to perform operations comprising:

operating the surgical system to perform a surgical process comprising a plurality of phases;

determining that a current phase of the surgical process corresponds to a first phase of the plurality of phases;

generating, based on at least a profile and determining that the current phase corresponds to the first phase, a first display configuration for first visual representations corresponding to data from a first set of data sources selected from multiple data sources, the profile defining a configuration for visual representations presentable on the display device, wherein the configuration for the visual representations limits certain adjustments to a size of a view or prevents the view from being removed from the display device by a user, the configuration further defining a minimum size of the view presentable on the display device, the minimum size being defined by a safety condition specific to the current phase of the surgical process; and

presenting, on the display device, the first display configuration for the first visual representations.

15 . The surgical system of claim 14 , wherein:

the configuration for the visual representations presentable on the display device defines a visibility of a visual representation corresponding to data from a data source of the multiple data sources.

16 . The surgical system of claim 14 , wherein the operations further comprise:

determining that the current phase of the surgical process corresponds to a second phase of the plurality of phases;

generating, based on at least the profile and determining that the current phase corresponds to the second phase, a second display configuration for second visual representations corresponding to data from a second set of data sources selected from the multiple data sources; and

presenting, on the display device, the second display configuration for the second visual representations,

wherein the configuration corresponds to a first configuration associated with the first phase of the plurality of phases, and

wherein the profile defines a second configuration for the visual representations presentable on the display device, the second configuration associated with the second phase of the plurality of phases.

17 . One or more machine-readable non-transitory storage devices encoded with machine-readable instructions configured to cause one or more processing devices to perform operations, the operations comprising:

operating a surgical system to perform a surgical process, the surgical system comprising a display device, and the surgical process comprising a plurality of phases;

determining that a current phase of the surgical process corresponds to a first phase of the plurality of phases;

generating, based on at least a profile and determining that the current phase corresponds to the first phase, a first display configuration for first visual representations corresponding to data from a first set of data sources selected from multiple data sources, the profile defining a configuration for visual representations presentable on the display device, wherein the configuration for the visual representations limits certain adjustments to a size of a view or prevents the view from being removed from the display device by a user, the configuration further defining a minimum size of the view presentable on the display device, the minimum size being defined by a safety condition specific to the current phase of the surgical process; and

presenting, on the display device, the first display configuration for the first visual representations.

18 . The one or more machine-readable non-transitory storage devices of claim 17 , wherein:

the configuration for the visual representations presentable on the display device defines a visibility of a visual representation corresponding to data from a data source of the multiple data sources.

19 . The one or more machine-readable non-transitory storage devices of claim 17 , wherein the operations further comprise:

determining that the current phase of the surgical process corresponds to a second phase of the plurality of phases;

generating, based on at least the profile and determining that the current phase corresponds to the second phase, a second display configuration for second visual representations corresponding to data from a second set of data sources selected from the multiple data sources; and

presenting, on the display device, the second display configuration for the second visual representations,

wherein the configuration corresponds to a first configuration associated with the first phase of the plurality of phases, and

wherein the profile defines a second configuration for the visual representations presentable on the display device, the second configuration associated with the second phase of the plurality of phases.

20 . The method of claim 1 , wherein the configuration for the visual representations causes an alert to be presented on the display device that indicates that adjustment of the size of the view has been limited or removal of the view has been prevented.

21 . The surgical system of claim 14 , wherein the configuration for the visual representations causes an alert to be presented on the display device that indicates that adjustment of the size of the view has been limited or removal of the view has been prevented.

22 . The one or more machine-readable non-transitory storage devices of claim 17 , wherein the configuration for the visual representations causes an alert to be presented on the display device that indicates that adjustment of the size of the view has been limited or removal of the view has been prevented.