IP Library › Granted Patent US 10,219,782
Granted Patent B2
US 10,219,782 · App. 15/418,569 · Granted Mar 5, 2019

Position correlated ultrasonic imaging

Inventors: Gaurav Pandey (Jersey City, NJ); Richard Koplin (New York, NY); Martin Weinberg (New Canaan, CT)
Assignee: NOBLE SENSORS, LLC
A61B8/4245A61B8/4254A61B8/4263A61B8/4488A61B8/483A61B8/565A61B8/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,219,782
App. No.
15/418,569
Granted
Mar 5, 2019
Kind
B2
Abstract

An imaging apparatus includes a transducer, a detecting device and a processor. The transducer includes an emitter and receiver configured to detect a property of an object being scanned at a scanning location. The detecting device is configured to detect a position of the transducer relative to the object being scanned. The processor is configured to obtain, from the transducer, scan information representative of the property when the transducer is positioned at a first position; obtain, form the detecting device, position information representative of the position of the transducer relative to the object being scanned when the transducer is disposed in the first position; determine a coordinate location from the position information; associate the coordinate location with the scan information; and cause the coordinate location associated with the scan information to be stored in a storage.

Claims (70)

1. An imaging apparatus, comprising:

a transducer including an emitter and receiver configured to detect a property of an object being scanned at a scanning location;

an imaging device external to the transducer and configured to capture an image of the transducer and the object being scanned;

an inertial measurement unit coupled to the transducer; and

a processor configured to

obtain, from the transducer, scan information representative of the property when the transducer is positioned at a first position;

determine, based on the image from the imaging device, a coordinate location of the transducer representative of the position of the transducer relative to the object being scanned when the transducer is disposed in the first position;

associate the coordinate location with the scan information;

cause the coordinate location associated with the scan information to be stored in a storage;

periodically determine a calibration of the inertial measurement unit based at least in part on a location of the transducer in the images of the imaging device; and

determine coordinate locations of the transducer between the periodic calibrations based on motion sensed by the inertial measurement unit.

2. The imaging apparatus of claim 1 , wherein the processor is configured to

obtain, from the transducer, a plurality of scan information representative of properties when the transducer is respectively positioned at a plurality of positions position;

obtain, form the imaging device, a plurality of images of the transducer and the object being scanned when the transducer is respectively disposed in the plurality of positions;

determine a plurality of coordinate locations respectively from the plurality of images;

associate a plurality of coordinate locations respectively with the plurality of scan information; and

cause the coordinate locations respectively associated with the scan information to be stored in a storage.

3. The imaging apparatus of claim 2 , wherein the plurality of positions are not on a line.

4. The imaging apparatus of claim 2 , wherein the imaging device includes a camera.

5. The imaging apparatus of claim 4 wherein the imaging device includes at least two cameras.

6. The imaging apparatus of claim 5 , wherein the cameras have focal axis rotated with respect to each other and the object.

7. The imaging apparatus of claim 1 , wherein

the transducer includes indicia that is detectable by the detecting device, and

the processor is configured to identify the indicia in the image.

8. The imaging apparatus of claim 7 , wherein the indicia includes an ultraviolet or infrared marker.

9. The imaging apparatus of claim 7 , further comprising a projector that projects the indicia onto the transducer or the object.

10. The imaging apparatus of claim 7 , wherein the indicia is emitted, and the imaging device is configured to detect the emissions.

11. The imaging apparatus of claim 1 , further comprising a calibration marker disposed on the object, wherein the processor is configured to detect the position of the transducer relative to the object being scanned based on the calibration marker detected in the image.

12. An imaging apparatus, comprising:

an ultrasonic transducer including at least one of a point probe and an array probe and configured to scan a body;

at least one camera external to the transducer and configured to capture images of the transducer and the body;

an inertial measurement unit coupled to the transducer; and

a processor configured to

determine, based on the image from the camera, a coordinate position of the ultrasonic transducer with respect to the body and correlate the coordinate position with scan data from the transducer;

periodically determine a calibration of the inertial measurement unit based at least in part on a location of the transducer in the images of the at least one camera; and

determine coordinate positions of the transducer between the periodic calibrations based on motion sensed by the inertial measurement unit.

13. The imaging apparatus of claim 12 , wherein the at least one camera includes at least two cameras, and the processor is configured to determine the coordinate position of the transducer in three dimensions.

14. An apparatus, comprising:

the imaging apparatus of claim 12 ; and

a server communicatively coupled with the imaging apparatus, wherein

the imaging apparatus is configured to provide correlated position and scan data to the server,

the server is configured to process the correlated position and scan data, the processing including executing a pattern recognition process with a database of scan data, and

the server is configured to provide a result of the pattern recognition process to the imaging apparatus.

15. The apparatus of claim 14 , wherein the scan data includes time sequenced impedance measurements.

16. A method of imaging, comprising:

performing an ultrasonic scan of an object using an ultrasonic transducer to provide scan data;

capturing an image of the transducer and the object during the ultrasonic scan using an optical system external to the transducer;

determining a coordinate location of the transducer based on the image;

correlating the scan data and the coordinate location of the transducer;

periodically determining a calibration of an inertial measurement unit based at least in part on the location of the transducer in the image, the inertial measurement unit being coupled to the transducer;

determining coordinate positions of the transducer between the periodic calibrations based on motion sensed by the inertial measurement unit;

determining a two or three dimensional representation of the scan data;

displaying the representation of the scan data on a display at a location associated with the determined coordinate location of the transducer;

freely moving the ultrasonic transducer to a different location on the object;

performing an ultrasonic scan of the object using the ultrasonic transducer to provide second scan data;

determining a second coordinate location of the moved transducer using the optical system;

correlating the second scan data and the second coordinate location of the moved transducer;

determining a two or three dimensional representation of the second scan data; and

displaying the representation of the second scan data on a display at a location associated with the determined second coordinate location of the moved transducer.

17. The method of claim 16 , wherein at least one of the determining the location steps includes determining the location based at least in part on data of the inertial measurement unit.

18. The method of claim 16 , further comprising comparing the scan data with scan data of a different scan.

19. The method of claim 18 , wherein the different scan is a scan of the object at a different point in time.

20. The method of claim 19 , further comprising determining differences between the scan data and scan data of the different scan to detect changes in the object over time.

21. The method of claim 18 , wherein the different scan is a scan of a different object.

22. The imaging apparatus of claim 1 , wherein the imaging device is configured to detect the transducer to determine the position of the transducer relative to the object.

23. The imaging apparatus of claim 10 , wherein the indicia is emitted by an LED.

24. The imaging apparatus of claim 1 , wherein the transducer is separate from the imaging device such that the transducer may be moved independent of the imaging device during a scan of the object.

25. The imaging apparatus of claim 1 , further comprising a display, wherein the processor is configured to cause the display to display an overlay of scan data of the transducer with associated locations of the scan data on an image of the object.

26. The imaging apparatus of claim 1 , wherein the processor is configured to reduce a sensing field in the image based upon an expected location of the transducer.

27. The imaging apparatus of claim 1 , wherein the processor is configured to adjust a recalibration rate of the inertial measurement unit based on data from the inertial measurement unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2017
From: PANDEY, GAURAV; KOPLIN, RICHARD; WEINBERG, MARTIN J.
To: NOBLE SENSORS, LLC
Reel/Frame 042953/0851 →
Continuity (2)
Provisional Application 62288515 · Jan 29, 2016
Related Publication 20170215841A1 · Aug 3, 2017
Cited By (2)
US 12,239,301 US 12,329,551