IP Library › Granted Patent US 10,231,642
Granted Patent B2
US 10,231,642 · App. 15/345,488 · Granted Mar 19, 2019

Apparatus and method for registering images in real-time

Inventors: Eve Coste-Maniere (Nice, FR); Thierry Vieville (Mougins, FR); Fabien Mourgues (Cannes, FR)
Assignee: Intuitive Surgical Operations, Inc.
A61B5/066A61B1/00009A61B1/04A61B5/055A61B5/749A61B34/10A61B34/30G06T7/30G06T7/60A61B2034/107A61B2034/301A61B2090/365A61B2090/373A61B2090/374G06F3/0484G06T2200/24G06T2207/10068G06T2207/10072G06T2207/20092G06T2207/30048G06T2207/30101Y10S128/922
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,231,642
App. No.
15/345,488
Filed
Nov 7, 2016
Granted
Mar 19, 2019
Kind
B2
Art Unit
2668
USPC
382/128
Abstract

The invention relates to a device for superimposing known patterns, characteristic of a region, on (real) images of said region. The device comprises, a memory in which patterns are stored, which are representative of a selected region, of known position and orientation with relation to a common reference and processing means, for determining a pattern representative of the selected portion in the memory, on receipt of the designation of at least one portion of an observed image of the selected region, taken at a selected angle and at least one representative attribute of said region, taking account of the attribute selected, then superimposing the determined pattern on the selected portion of the image taking account of the selected angle.

Claims (25)

1. An apparatus comprising:

an image capturing device configured to capture images of a selected region at a selected angle;

a display device configured to display the captured images received from the image capturing devices;

a user interface configured to successively receive a plurality of user designations comprising designations of portions of the captured images and attributes corresponding to the designated portions; and

a registration device configured to register a predetermined pattern to the captured images by minimizing a criterion constructed from a plurality of measurement equations determined from the plurality of user designations and the selected angle to select an optimized pattern, wherein the display device is further configured to display an image of the predetermined pattern superimposed on the captured images.

2. The apparatus of claim 1 , the image capturing device comprising an endoscope.

3. The apparatus of claim 1 , said attributes comprising identity attributes representing said designated portions.

4. The apparatus of claim 3 , wherein said predetermined patterns correspond to three-dimensional models of objects having said corresponding identity attributes.

5. The apparatus of claim 1 , the selected angle of the image capturing device being determined based on position of a robotic arm supporting the image capturing device.

6. The apparatus of claim 1 , the registration device configured to perform external registration, wherein markers present in the displayed images are correlated to markers present in the predetermined pattern.

7. The apparatus of claim 1 , the user interface comprising a mouse.

8. The apparatus of claim 1 , the user interface comprising a voice recognition system.

9. A method comprising:

capturing images of a selected region at a selected angle using a capturing device;

displaying the captured images on a display device;

successively receiving a plurality of user designations comprising designations of portions of the displayed images using a user interface;

registering a predetermined pattern to the captured images by minimizing a criterion constructed from a plurality of measurement equations determined from the plurality of user designations and the selected angle to select an optimized pattern; and

displaying the predetermined pattern superimposed onto the captured images according to the registering.

10. The method of claim 9 , the capturing device comprising an endoscope.

11. The method of claim 9 , said attributes comprising identity attributes representing said portions.

12. The method of claim 11 , wherein said predetermined patterns correspond to three-dimensional models of objects having said corresponding identity attributes.

13. The method of claim 9 , the selected angle of the capturing device being determined based on position of a robotic arm supporting the capturing device.

14. The method of claim 9 , the registering comprising correlating markers present in the displayed images to markers present in the predetermined pattern.

15. The method of claim 9 , the user interface comprising a mouse.

16. The method of claim 9 , the user interface comprising a voice recognition system.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2021
From: COSTE-MANIERE, EVE; VIEVILLE, THIERRY; MOURGUES, FABIEN
To: INRIA INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
Reel/Frame 055574/0255 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2021
From: INRIA INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
To: COSTE-MANIERE, EVE
Reel/Frame 055574/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2021
From: COSTE-MANIERE, EVE
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 055574/0434 →
Priority Claims (1)
FR 03 06176 · May 22, 2003 · national
Continuity (5)
Continuation 14215915 · Mar 17, 2014
Continuation 13299676 · Nov 18, 2011
Continuation 12908298 · Oct 20, 2010
Continuation 10557790
Related Publication 20170049358A1 · Feb 23, 2017
Cited By (1)
US 12,702,491