Surgical augmented reality
Devices, systems, and methods for augmented reality in surgical environments include an optical lens, which may be wearable by the user, and an augmented reality control system for generating an augmented reality presentation in the optical lens. The augmented reality presentation can depict the surgical area of the patient while artificially omitting one or more obstructions from the user's view point of the surgical area.
1. A surgical augmented reality system, comprising:
an optical lens through which a user can directly observe surgical procedures, the optical lens defining a field of view and configured for presenting visual information augmenting observation of the user;
an augmented reality control system in communication with the optical lens to provide presentation of visual information augmenting observation by the user, the augmented reality control system comprising at least one processor, at least one memory storage for storing instructions for execution by the at least one processor, and communication circuitry for communicating signals according to the processor, the augmented reality control system configured to receive indication of at least one reference datum and to communicate with the optical lens to provide an augmented reality presentation of a surgical area of the patient artificially omitting one or more obstructions from the user's view point of the surgical area within the field of view,
wherein the augmented reality presentation includes a virtual monitor for viewing the surgical area with augmentation, wherein the virtual monitor is visually arranged within the optical lens offset from the surgical area of the patient to appear as an offset view screen, wherein the augmented reality control system is configured to display the surgical area within the field of view including a viewpoint configuration having visual augmentation of the surgical area and to display the virtual monitor including a monitoring configuration having visual augmentation of the surgical area, different from the viewpoint configuration.
2. The surgical augmented reality system of claim 1 , wherein each of the viewpoint configuration and the monitoring configuration are selectively configurable by the augmented reality system to omit different aspects from the user's view point of the surgical area.
3. The surgical augmented reality system of claim 1 , wherein the augmented reality presentation includes display of the augmented reality presentation visually arranged in the optical lens for observation by the user to appear stationary with reference to the surgical area under relative movement of the optical lens.
4. The surgical augmented reality system of claim 1 , wherein the optical lens is configured as a wearable lens.
5. The surgical augmented reality system of claim 4 , wherein the optical lens is formed as a set of optical glasses comprising at least one sensor for capturing indication of a position of the at least one reference datum.
6. The surgical augmented reality system of claim 5 , wherein the at least one reference datum includes one or more reference datum arranged on a ceiling of an operating room of the patient.
7. The surgical augmented reality system of claim 5 , wherein the at least one reference datum includes one or more reference datum arranged on a surgical patient support table.
8. The surgical augmented reality system of claim 1 , wherein the augmented reality control system is arranged in communication with a surgeon interface for control of a robotic surgery device.
9. The surgical augmented reality system of claim 1 , wherein the augmented reality control system is arranged in communication with a remote network.
10. The surgical augmented reality system of claim 9 , wherein the remote network is a hospital network.
11. The surgical augmented reality system of claim 1 , wherein the augmented reality control system is arranged in communication with one or more local surgical devices.
12. The surgical augmented reality system of claim 11 , wherein the one or more local surgical devices include at least one of a local server and local surgical instruments.
13. The surgical augmented reality system of claim 1 , wherein the augmented reality control system is arranged at least partly on a wearable device comprising the optical lens.
14. The surgical augmented reality system of claim 1 , wherein the augmented reality control system is arranged at least partly on a surgical server.
15. The surgical augmented reality system of claim 1 , wherein the augmented reality presentation is arranged by the optical lens to overlay the surgical area of the patient to create impression of direct observation.