IP Library Granted Patent US 8,253,779
Granted Patent B2
US 8,253,779 · App. 12/043,624 · Granted Aug 28, 2012

System for remote guidance by expert for imaging device

Assignee: University of Pittsbugh—Of The Commonwealth System of Higher Education
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,253,779
App. No.
12/043,624
Granted
Aug 28, 2012
Kind
B2
Abstract

Systems and methods for combining tomographic images with human vision. The systems preferably include a first assembly located proximal to an object to be imaged and a second assembly remote from the target. The first assembly is preferably able to collect a tomographic image from a target object and superimpose that tomographic image onto a direct view of the target object. The first assembly also includes components that allow the transmission of the tomographic image to the remote assembly. At the remote location, a highly trained expert may interact with the captured image by placing electronic markers on the image via an electronic interface. The captured image plus electronic marker are then preferably transmitted back to the local site via a second transmitter-receiver. The local user may use the electronic marker to guide his actions during the appropriate task. The systems have particular utility in the medical field where a trained clinician at a remote location may provide guidance to an untrained individual in performing a medical procedure on a patient.

Claims (36)

1. An imaging system, comprising:

a local assembly proximal to a target object to be imaged, comprising:

an image capture device for capturing an image of the internal structure of the target object;

a first display for displaying a captured image from the image capture device;

a partially reflective surface oriented to reflect the captured image to an operator of the imaging device, such that the reflected captured image is merged with a direct view of the target object independent of the viewing location of the operator when the angle between the surface and the display is equal to angle between the surface and the image plane; and

a first transmitter-receiver adapted to transmit said captured image to a second transmitter-receiver; and

a remote assembly distal from said target object, comprising:

said second transmitter-receiver adapted to receive said captured image;

a second display for displaying the captured image; wherein said first transmitter-receiver and said second transmitter-receiver comprise a communication channel adapted to transmit information from a user at said remote assembly to said local assembly.

2. The system of claim 1 , wherein said information is audio information, electronic information, or combinations thereof.

3. The system of claim 2 , wherein said second assembly further comprises an electronic interface adapted to place an electronic marker onto said captured image, further wherein said second transmitter-receiver is adapted to transmit information about the location and nature of said electronic marker to said first transmitter-receiver over said communication channel.

4. The system of claim 3 , wherein second transmitter-receiver is further adapted to transmit an altered captured image.

5. The system of claim 1 , wherein said image capture device is selected from the group consisting of: ultrasound-based probe, radar-based probe, LIDAR-based probe, and SONAR-based probe.

6. The system of claim 1 , wherein said first assembly further comprises an electronic camera.

7. The system of claim 6 , wherein said electronic camera is adapted to capture said merger of said reflected captured image and said direct view of the target object.

8. The system of claim 7 , wherein said first transmitter-receiver is adapted to transmit both said captured image and said merger of said reflected capture image and said direct view of the target object to said second transmitter-receiver.

9. The system of claim 8 , wherein said second display is adapted to display both said captured image and said merger of said reflected captured image and said direct view of the target object.

10. The system of claim 1 , wherein said electronic marker is selected from the group consisting of cursor, arrow, writing, shapes, and highlighting.

11. A method of imaging a target object, comprising the steps of:

at a first location, capturing an image from said target object using an image capture device;

transmitting the captured image to a second location via a first transmitter/receiver;

at said second location, receiving said transmitted captured image;

displaying said captured image;

providing an individual at the second location with an interface, wherein said interface allows said individual to communicate information about said captured image to said first location;

at said first location, receiving said information about said captured image;

displaying said captured image on a electronic display; and

reflecting said captured image to an operator, such that the reflected captured image is merged with a direct view of the target object independent of the viewing location of the operator when the angle between the surface and the display is equal to angle between the surface and the image plane.

12. The method of claim 11 , wherein said information about said captured image is audio information, electronic information, or combinations thereof.

13. Original) The method of claim 12 , wherein said interface is an electronic interface that allows said individual to place an electronic marker on said captured image.

14. The method of claim 13 , wherein said electronic information is information about the location and nature of said electronic marker.

15. The method of claim 14 , wherein said step of displaying said captured image on a electronic display further includes displaying said electronic marker on said captured image.

16. The method of claim 15 , wherein said step of reflecting said captured image further includes reflecting said electronic marker on said captured image.

17. The method of claim 11 , wherein said image capture device is selected from the group consisting of ultrasound-based probe, radar-based probe, LIDAR-based probe, and SONAR-based probe.

18. The method of claim 11 , wherein said first assembly further comprises an electronic camera.

19. The method of claim 18 , wherein said electronic camera captures said merger of said reflected captured image and said direct view of the target object.

20. The method of claim 19 , wherein said first transmitter/receiver is adapted to transmit both said captured image and said merger of said reflected capture image and said direct view of the target object to said second transmitter/receiver.

Assignments (2)
EXECUTIVE ORDER 9424, CONFIRMATORY LICENSE Recorded Oct 27, 2008
From: UNIVERSITY OF PITTSBURGH
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 021743/0734 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2008
From: STETTEN, GEORGE DEWITT
To: UNIVERSITY OF PITTSBURGH - OF THE COMMONWEALTH SYSTEM OF HIGHER EDUCATION
Reel/Frame 020884/0481 →
Continuity (4)
Continuation In Part 10126453 · Apr 19, 2002
Continuation In Part 09686677 · Oct 11, 2000
Provisional Application 60893245 · Mar 6, 2007
Related Publication 20080218588A1 · Sep 11, 2008