IP Library Granted Patent US 12,016,737
Granted Patent B2
US 12,016,737 · App. 17/592,270 · Granted Jun 25, 2024

Systems and methods for displaying medical video images and/or medical 3D models

Inventors: John W. Komp (Dillon, CO); Irena Cantrall (Boulder, CO); Francesca Rossetto (Longmont, CO); Robert W. Pierce (Franklin, MA); Fiona A. Morrison (Perth, GB); Mark N. Florio (Hamden, CT)
Assignee: Covidien LP
A61B90/361A61B1/000094A61B1/00055A61B1/00194A61B1/05G02B23/2415G16H30/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,016,737
App. No.
17/592,270
Granted
Jun 25, 2024
Kind
B2
Abstract

Computer-assisted surgical systems and methods provide intraoperative playback of and interaction with recorded video images and/or a 3D model while displaying current video images. The methods and related surgical systems involve capturing, by a two-dimensional (2D) or three-dimensional (3D) video camera, current video images and recording the captured video images. A user interface displays the current video images and the recorded video images and/or the 3D model and enables a user to interact with either or both of them.

Claims (64)

1. An intraoperative method comprising:

capturing, by a video camera, video images;

recording at least a portion of the video images, yielding recorded video images;

causing simultaneous display of at least a portion of the recorded video images and current video images captured by the video camera;

receiving a signal to highlight an anatomic structure;

determining positions of the anatomic structure in the at least a portion of the recorded video images; and

highlighting, in response to the signal to highlight the anatomic structure, the anatomic structure in the at least a portion of the recorded video images based on the positions of the anatomic structure, yielding a highlighted anatomic structure;

determining that the highlighted anatomic structure is outside of a window; and

in response to determining that the highlighted anatomic structure is outside of the window, causing display of an object in the window indicating a direction of a position of the highlighted anatomic structure or the direction, in the recorded video images, of a recorded video image that contains at least a portion of the highlighted anatomic structure.

2. The method of claim 1 , wherein the video camera is a laparoscopic video camera or an endoscopic video camera.

3. The method of claim 1 , further comprising receiving a signal indicating selection of at least one of the current video images,

wherein recording the at least a portion of the video images includes recording the selected at least one of the current video images.

4. The method of claim 1 , further comprising:

causing display of the current video images in a first window; and

causing display of the at least a portion of the recorded video images in a second window.

5. The method of claim 4 , wherein the second window is smaller than the first window, and

further comprising overlaying the second window on the first window.

6. The method of claim 5 , further comprising overlaying the second window on a corner portion or a quadrant of the first window.

7. The method of claim 1 , further comprising:

causing display of the current video images in a first window; and

causing display of the at least a portion of the recorded video images in a second window, which is smaller than the first window and which is overlaid on the first window.

8. The method of claim 1 , further comprising causing display of the at least a portion of the recorded video images as semitransparent video images overlaid on the current video images.

9. The method of claim 1 , further comprising causing display of forward or backward movement through the recorded video images in response to a signal to move through the recorded video images in a forwards or backwards direction, respectively, while causing display of the current video images.

10. A system comprising:

a video capturing device configured to capture video images;

a processor;

a memory coupled to the processor and configured to store at least a portion of the video images, yielding stored video images; and

a display configured to simultaneously display at least a portion of the stored video images and current video images captured by the video capturing device,

wherein the memory is further configured to store instructions, which, when executed by the processor, causes the processor to:

receive a signal to highlight an anatomic structure;

determine a position of the anatomic structure in the at least a portion of the stored video images; and

highlight, in response to the signal to highlight the anatomic structure, the anatomic structure in the at least a portion of the stored video images based on the positions of the anatomic structure, yielding a highlighted anatomic structure;

cause display of a window on the display;

determine that the highlighted anatomic structure is outside of the window; and

in response to determining that the highlighted anatomic structure is outside of the window, cause display of an object in the window indicating a direction of a position of the highlighted anatomic structure or the direction, in the stored video images, of a stored video image that contains at least a portion of the highlighted anatomic structure.

11. The system of claim 10 , wherein the video capturing device is a laparoscopic video camera or an endoscopic video camera.

12. The system of claim 10 , wherein the instructions, when executed by the processor, further cause the processor to receive a user selection of at least one of the current video images, and

wherein storing the at least a portion of the video images includes storing the user selection of the at least one of the current video images.

13. The system of claim 10 , wherein the instructions, when executed by the processor, further cause the processor to:

cause display of a first window and a second window on the display;

cause display of the current video images in the first window; and

cause display of the at least a portion of the stored video images in the second window.

14. The system of claim 13 , wherein the second window is smaller than the first window, and

wherein the instructions, when executed by the processor, further cause the processor to overlay the second window on the first window.

15. The system of claim 14 , wherein the instructions, when executed by the processor, further cause the processor to overlay the second window on a corner portion or a quadrant of the first window.

16. The system of claim 10 , wherein the instructions, when executed by the processor, further cause the processor to:

receive a signal to move through the stored video images in a forwards or backwards direction; and

cause display of forward or backward movement through the stored video images in response to the signal to move through the stored video images in a forwards or backwards direction, respectively, while causing display of the current video images.

17. The system of claim 10 , wherein the instructions, when executed by the processor, further cause the processor to cause display of the at least a portion of the stored video images as semitransparent video images overlaid on the current video images.

18. A system comprising:

a video capturing device configured to capture video images;

a display configured to display the video images;

a processor; and

a memory configured to store the video images, yielding stored video images, and configured to store instructions, which, when executed by the processor, causes the processor to:

cause simultaneous display of a first window and a second window on the display;

cause display of current video images in the first window;

cause display of the stored video images in the second window;

receive a signal to move through the stored video images;

cause display of movement through the stored video images in response to the signal to move through the stored video images;

receive a signal to highlight an anatomic structure;

determine a position of the anatomic structure in the stored video images;

highlight, in response to the signal to highlight the anatomic structure, the anatomic structure in the stored video images based on the positions of the anatomic structure;

determine that the highlighted anatomic structure is outside of the second window; and

in response to determining that the highlighted anatomic structure is outside of the second window, cause display of an object in the second window indicating a direction of a position of the highlighted anatomic structure or the direction, in the stored video images, of a recorded video image that contains at least a portion of the highlighted anatomic structure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2022
From: KOMP, JOHN W.; CANTRALL, IRENA; ROSSETTO, FRANCESCA; PIERCE, ROBERT W.; MORRISON, FIONA A.; FLORIO, MARK N.
To: COVIDIEN LP
Reel/Frame 058882/0547 →
Continuity (3)
Continuation 16892598 · Jun 4, 2020
Provisional Application 62888892 · Aug 19, 2019
Related Publication 20220163785A1 · May 26, 2022