IP Library Granted Patent US 10,073,515
Granted Patent B2
US 10,073,515 · App. 14/488,850 · Granted Sep 11, 2018

Surgical navigation system and method

Inventor: Richard Awdeh (Miami, FL)
Assignee: Nanophthalmos, LLC
G06F3/012A61B3/005A61B3/0058A61B3/14A61B34/20A61B34/25A61F9/00G06F3/011G06T11/00A61B90/20A61B2034/2061A61B2034/252A61B2090/365A61B2090/371A61B2090/372A61B2090/3735A61B2090/502A61F9/007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,073,515
App. No.
14/488,850
Granted
Sep 11, 2018
Kind
B2
Abstract

A surgical guidance system and method for assisting a surgeon in a surgical procedure performed on a patient is disclosed. The system comprises an image acquisition device configured to generate substantially real-time digital video data representing patient images of an eye of the patient. The system further comprises a processor coupled to the image acquisition device and configured to receive the digital video data from the image acquisition device, receive external data from an external data source, and generate composite digital image data based on the digital video data and the external data. The system further comprises a display device coupled to the processor, the display device being configured to display, to the surgeon from the composite digital image data, overlaid images including procedural prompts according to the patient images and the external data.

Claims (92)

1. A surgical guidance system for assisting a surgeon in a surgical procedure performed on a patient, the system comprising:

an image acquisition device configured to generate substantially real-time digital video data representing patient images of an eye of the patient;

a processor coupled to the image acquisition device and configured to:

receive the digital video data from the image acquisition device;

receive external data from an external data source;

generate composite digital image data based on the digital video data and the external data;

determine an expected result of the surgical procedure based on the external data; and

incorporate the expected result into the composite digital image data; and

a display device coupled to the processor, the display device being configured to display, to the surgeon from the composite digital image data, overlaid images including procedural prompts according to the patient images and the external data, wherein the display device includes first and second display modules configured to display the first and second patient images respectively to left and right eyes of the surgeon;

wherein the overlaid images further include the expected result superimposed on the patient images of the eye of the patient, the expected result indicates a surgical incision in the eye, and the surgical incision is a capsulorhexis incision.

2. The system of claim 1 , wherein the image acquisition device comprises first and second cameras generating video data representing patient images at first and second viewing angles, respectively.

3. The system of claim 1 , wherein the first and second patient images data form a stereoscopic representation of a portion of the patient images.

4. The system of claim 1 , wherein the processor is further configured to generate prompts indicating steps of the surgical procedure for the surgeon to perform.

5. The system of claim 4 , wherein the prompts comprise text data and image data.

6. The system of claim 5 , wherein the image data comprise one or more image icons corresponding to the text data.

7. The system of claim 1 , wherein the overlaid images include a first region representing the eye of the patient and a second region representing the external data.

8. The system of claim 7 , wherein:

the first region is at a central portion of the overlaid images; and

second region is at a peripheral portion of the overlaid images.

9. The system of claim 7 , wherein the first region and the second region partially overlap.

10. The system of claim 1 , wherein:

the external data include anatomical measurements of the eye of the patient; and

the overlaid images include a first representation of the eye of the patient and a second representation of the anatomical measurement superimposed on the first representation.

11. The system of claim 10 , wherein the processor is further configured to align the video data with the anatomical measurements.

12. The system of claim 11 , wherein the processor is further configured to:

detect one or more anatomical features of the eye of the patient in the digital video data;

register the detected anatomical features to the anatomical measurements;

generate the prompts based on the registration; and

incorporate the prompts into the composite digital image data.

13. The system of claim 10 , wherein the external data include at least one of ultrasound power, vacuum pressure, aspiration, or bottle height.

14. The system of claim 10 , wherein the external data include a pre-operative image of the eye of the patient.

15. The system of claim 14 , wherein the pre-operative image includes at least one of an MRI image, a CT image, an OTC image, an X-Ray image, or an fluorescein angiography image.

16. The system of claim 14 , wherein the pre-operative image indicates one or more marks placed on the eye of the patient.

17. The system of claim 16 , wherein the processor is further configured to register the digital video data to the pre-operative image based on the one or more marks.

18. The system of claim 10 , wherein the processor is further configured to generate the anatomical measurements based on the external data.

19. The system of claim 1 , wherein:

the overlaid images include a graphical representation of the eye of the patient; and

the graphical representation of the expected result indicates a surgical incision expected in the eye.

20. The system of claim 19 , wherein the graphical representation of the expected result indicate an expected limbic incision.

21. The system of claim 19 , wherein the processor is further configured to:

track anatomical features of the eye of the patient based on the image data;

compare the anatomical features with the expected surgical incision; and

display the prompts based on the comparison.

22. The system of claim 21 , wherein the anatomical features include at least one of a blood vessel pattern or an iris pattern of the eye.

23. The system of claim 19 , wherein the graphical representation of an expected result indicates an expected orientation of an axis of an artificial lens.

24. The system of claim 23 , wherein the processor is further configured to determine an alignment of the expected orientation with a current axis of the artificial lens.

25. A medical data visualization system, comprising:

an image acquisition device configured to generate substantially real-time video data representing patient images of a patient corresponding to a field of view;

a processor coupled to the image acquisition device and configured to:

receive the video data from the image acquisition device;

receive external data from an external data source; and

generate composite digital image data based on the video data and the external data; and

a display device coupled to the processor, the display device being configured to display overlaid images including:

a portion of the patient image corresponding to a region of interest; and

a graphical representation of the external data,

wherein the region of interest is smaller than the field of view and a magnification of the region of interest is greater than the magnification of the field of view.

26. The system of claim 25 , wherein the display device is further configured to adjust the region of interest within the field of view.

27. The system of claim 26 , wherein the display device is an eyewear device configured to be worn by the surgeon.

28. The system of claim 27 , wherein:

the system further comprises a motion sensor configured to generate a motion signal conveying a head motion of the surgeon; and

the processor is further configured to adjust the region of interest according to the motion signal.

29. The system of claim 28 , wherein the motion sensor is disposed in the eyewear device.

30. The system of claim 28 , wherein:

the motion sensor is configured to detect a rotation of a head portion of the surgeon.

31. A computer system for assisting a surgeon in a surgical procedure performed on a

patient, the computer system comprising:

an input module configured to receive:

from an image acquisition device, substantially real-time digital video data representing patient images of an eye of the patient; and

external data;

a processing module configured to generate composite digital image data based on the digital video data and the external data; and

an output module configured to transmit the composite digital image data to a display device for display of overlaid images including procedural prompts corresponding to the patient images and the external data, wherein the display device includes first and second display modules configured to display the first and second patient images respectively to left and right eyes of the surgeon.

32. A display device for assisting a surgeon in a surgical procedure performed on a patient, the device comprising:

a housing configured to be worn by the surgeon;

a receiving module; and

a display module, wherein:

the receiving module is configured to receive composite digital image data from a processor including substantially real-time digital video data and external data, the digital video data representing patient images of an eye of the patient, wherein the digital video data includes first and second images of an eye of the patient;

the display module is configured to display, to the surgeon from the composite digital image data, overlaid images including procedural prompts corresponding to the patient images and the external data; and

wherein the display module includes first and second display modules configured to display the first and second patient images respectively to left and right eyes of the surgeon.

33. The device of claim 32 , further comprising a motion sensor disposed within the housing and configured to detect a motion of the surgeon, wherein the display module is further configured adjust the overlaid images according to the detected motion of the surgeon.

34. A method for assisting a surgeon in a surgical procedure performed on a patient, the method comprising:

receiving substantially real-time digital video data representing patient images of an eye of the patient, wherein the substantially real-time digital video data includes first and second images of an eye of the patient;

receiving external data from an external data source;

generating composite digital image data based on the digital video data and the external data; and

transmitting the composite digital image data to a display device for display of overlaid images from the composite digital image data, the overlaid images including procedural prompts for the surgical procedure corresponding to the patient images and the external data, wherein the display device includes first and second display modules configured to display the first and second patient images respectively to left and right eyes of the surgeon.

35. The method of claim 34 , wherein the overlaid images include a virtual gauge comprising the prompts.

36. The method of claim 35 , wherein the virtual gauge has a shape conformed to a contour of the eye of the patient.

37. The method of claim 36 , wherein the virtual gauge has one of a circular shape or a fan shape.

38. A non-transitory computer-readable medium comprising instructions, which, when executed by one or more processors, cause the processors to perform a method for assisting a surgeon in a surgical procedure performed on a patient, the method comprising:

receiving substantially real-time digital video data representing patient images of an eye of the patient, wherein the substantially real-time digital video data includes first and second images of an eye of the patient;

receiving external data from an external data source;

generating composite digital image data based on the digital video data and the external data; and

transmitting the composite digital image data to a display device, for display of overlaid images from the composite digital image data, the overlaid images including procedural prompts for the surgical procedure corresponding to the patient images and the external data, wherein the display device includes first and second display modules configured to display the first and second patient images respectively to left and right eyes of the surgeon.

Continuity (2)
Provisional Application 61879652 · Sep 18, 2013
Related Publication 20150077528A1 · Mar 19, 2015
Cited By (35)
US 12,186,028 US 12,201,384 US 12,206,837 US 12,220,176 US 12,225,181 US 12,226,345 US 12,229,906 US 12,239,385 US 12,245,813 US 12,245,974 US 12,290,416 US 12,295,798 US 12,310,678 US 12,336,771 US 12,336,868 US 12,349,987 US 12,354,227 US 12,383,369 US 12,412,346 US 12,415,269 US 12,417,595 US 12,458,411 US 12,458,533 US 12,461,375 US 12,465,523 US 12,475,662 US 12,484,971 US 12,491,044 US 12,502,163 US 12,514,659 US 12,515,318 US 12,521,188 US 12,521,201 US 12,623,341 US 12,642,699