IP Library › Granted Patent US 12,186,235
Granted Patent B2
US 12,186,235 · App. 18/595,529 · Granted Jan 7, 2025

System and method for improved electronic assisted medical procedures

Inventor: Rani Ben-Yishai (Haifa, IL)
Assignee: BEYEONICS SURGICAL LTD.
A61F9/007A61B3/0025A61B3/102A61F2009/00872
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,186,235
App. No.
18/595,529
Granted
Jan 7, 2025
Kind
B2
Abstract

Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Claims (33)

1. A method for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure, the method comprising:

receiving, by a computing device, the stereoscopic intraoperative image pair comprising a left intraoperative image and a right intraoperative image of the surgical field in the medical ophthalmic procedure;

receiving, by the computing device, overlay data;

determining, by the computing device, a left-right disparity, wherein the left-right disparity corresponds to a desired depth; and

generating, by the computing device, a left overlay and a right overlay for superimposing with the left and right intraoperative images, based on the overlay data and the left-right disparity,

wherein when the left and right intraoperative images are viewed via a stereoscopic display with the left overlay superimposed with the left intraoperative image and the right overlay superimposed with the right intraoperative image, the left overlay and the right overlay appear as a single overlay at the desired depth, and

wherein the left-right disparity is calculated based on an element from the surgical field, wherein the depth of the desired depth of the overlay relative to said element is known and wherein the depth of the element is different from the desired depth.

2. The method of claim 1 , wherein the overlay data comprises a guidance overlay for an IOL placement, a guidance overlay for a capsulotomy, a guidance overlay for an incision, an enhancement of a membrane or part of a membrane, an enhancement of a capsule or part of a capsule, symbolic overlay, textual overlay, pictorial overlay or any combination thereof.

3. The method of claim 1 , wherein determining the left-right disparity is based at least on one of the stereoscopic intraoperative image pair, and a previous stereoscopic intraoperative image pair.

4. The method of claim 3 , wherein determining the left-right disparity further comprises:

determining, by the computing device, a first location of the element from the surgical field in the left intraoperative image of i) the stereoscopic intraoperative image pair or ii) the previous stereoscopic intraoperative image pair;

determining, by the computing device, a second location of the element in the right intraoperative image of i) the stereoscopic intraoperative image pair or ii) the previous stereoscopic intraoperative image pair;

determining, by the computing device, a left-right disparity based on the first location and the second location.

5. The method of claim 4 , wherein determining the left-right disparity is further based on a known calibration of a device that captured the stereoscopic image pair.

6. The method of claim 1 , wherein the left-right disparity is further based on a distance of a device that captured the left and right intraoperative images from the element.

7. The method of claim 6 , wherein determining the left-right disparity is further based on a known calibration of a device that captured the stereoscopic image pair.

8. The method of claim 1 , wherein the depth of the element relative to the desired depth is known based on at least one of:

a typical anatomy of an eye,

patient-specific preoperative diagnostic measurements of the eye being operated on,

a 3D patient-specific model of the eye being operated on, and

an input from a user.

9. The method of claim 1 , wherein the surgical field includes an element that is to appear as above the single overlay, wherein at least one first portion in the left intraoperative image and at least one second portion in the right intraoperative image are associated with the element, and wherein the method further comprises:

displaying, via the stereoscopic display, the left overlay superimposed with the left intraoperative image such that an appearance of the left overlay in the at least one first portion of the left intraoperative image is different than the appearance of the left overlay outside of the at least one first portion of the left intraoperative image;

displaying, via the stereoscopic display, the right overlay superimposed with the right intraoperative image such that an appearance of the right overlay in the at least one second portion of the right intraoperative image is different than the appearance of the right overlay outside of the least one second portion of the right intraoperative image;

wherein the different overlay appearances cause the single overlay to appear as being below the element and being partially occluded by the element.

10. The method according to claim 1 , further comprising determining multi-depth stereoscopic overlay by determining multiple single depth overlays and connecting thereof.

11. The method of claim 1 , further comprising compensating, by the computing device, for an optical distortion of the cornea when determining the left-right disparity, wherein the optical distortion of the cornea is known from at least one of:

a typical anatomy of an eye,

patient-specific preoperative diagnostic measurements of the eye being operated on,

a 3D patient-specific model of the eye being operated on, and

an input from a user.

12. The method of claim 1 , wherein the stereoscopic display is one of: a 3D monitor with or without glasses, a 3D head mounted display (HMD), or a binocular surgical microscope.

13. The method of claim 1 , further comprising displaying via the stereoscopic display the left overlay superimposed with the left intraoperative image and the right overlay superimposed with the right intraoperative image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2024
From: BEN-YISHAI, RANI
To: BEYEONICS SURGICAL LTD.
Reel/Frame 068089/0548 →
Continuity (4)
Continuation 17870297 · Jul 21, 2022
Continuation PCTIL2021050069 · Jan 22, 2021
Provisional Application 62964456 · Jan 22, 2020
Related Publication 20240207093A1 · Jun 27, 2024
References Cited (19)
US 10517690B2 · Kosmecki et al. · 2019 [cited by applicant]
US 11484363B2 · Schneider · 2022 [cited by applicant]
US 11490986B2 · Ben-Yishai · 2022 [cited by examiner]
US 11918424B2 · Ben-Yishai · 2024 [cited by examiner]
US 11986240B2 · Tripathi · 2024 [cited by examiner]
US 20100177163A1 · Yang · 2010 [cited by applicant]
US 20110050852A1 · Lamprecht · 2011 [cited by applicant]
US 20150077528A1 · Awdeh · 2015 [cited by examiner]
US 20180309980A1 · Ootsuki · 2018 [cited by applicant]
US 20180322666A1 · Tripathi et al. · 2018 [cited by applicant]
US 20190000314A1 · Awdeh · 2019 [cited by applicant]
US 20190117459A1 · Berlin · 2019 [cited by applicant]
US 20230071841A1 · Ben-Yishai · 2023 [cited by examiner]
WO PCTIL2020051090 · 2020 [cited by applicant]
WO WO2021149056 · 2021 [cited by applicant]
Hongen et al., 3-D Augmented Reality for MIR-Guided Surgery Using Integral Videography Autostereoscopic Image Overly; IEEE Transactions on Bioledical Engeneering, Vo. 57, No. 6. Jun. 2010. [cited by examiner]
International Search Report and Written Opinion for PCT Application No. PCT/IL2021/050069, mailed Jun. 3, 2021. [cited by applicant]
Office Action for U.S. Appl. No. 17/870,297, mailed May 31, 2023. [cited by applicant]
International Preliminary Examination Report for PCT Application No. PCT/IL2021/050069, mailed Mar. 14, 2022. [cited by applicant]