IP Library › Granted Patent US 11,393,092
Granted Patent B2
US 11,393,092 · App. 17/070,705 · Granted Jul 19, 2022

Motion tracking and strain determination

Inventors: Shanhui Sun (Lexington, MA); Hanchao Yu (Champaign, IL); Qiaoying Huang (Edison, NJ); Zhang Chen (Brookline, MA); Terrence Chen (Lexington, MA)
Assignee: SHANGHAI UNITED IMAGING INTELLIGENCE CO., LTD.
G06T7/0012A61B5/0044A61B5/1128A61B5/7264G06F3/0485G06K9/6267G06N3/0454G06N3/08G06T3/0093G06T7/0014G06T7/11G06T7/248G06T7/55G06T7/73G06T11/206G06T13/80G06T19/00G16H30/40G16H50/30G16H50/50G06T2200/24G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30048G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,393,092
App. No.
17/070,705
Granted
Jul 19, 2022
Kind
B2
Abstract

Described herein are systems, methods and instrumentalities associated with motion tracking and strain determination. A motion tracking apparatus as described herein may track the motion of an anatomical structure from a source image to a target image and determine corresponding points on one or more surfaces of the anatomical structure in both the source image and the target image. Using these surface points, the motion tracking apparatus may calculate one or more strain parameters associated with the anatomical structure and provide the strain parameters for medical diagnosis and/or treatment.

Claims (58)

1. An apparatus, comprising one or more processors, wherein the one or more processors are configured to:

obtain a source image of an anatomical structure and a target image of the anatomical structure;

determine, in the source image, a first plurality of points on a first surface of the anatomical structure and a second plurality of points on a second surface of the anatomical structure, wherein the first plurality of points and the second plurality of points are determined based on a partial differential equation such that each point in the second plurality of points corresponds to a point in the first plurality of points;

determine, based on the source image and the target image, a motion field that indicates a motion of the anatomical structure from the source image to the target image;

estimate, based on the motion field and respective locations of the first plurality of points and the second plurality of points in the source image, respective locations of the first plurality of points and the second plurality of points in the target image;

determine one or more strain parameters associated with the anatomical structure, wherein:

the one or more strain parameters include at least one of a radial strain of the anatomical structure or a circumferential strain of the anatomical structure;

if the one or more strain parameters include the radial strain, the radial strain is determined based on a change in a radial distance between one of the first plurality of points and one of the second plurality of points from the source image to the target image; and

if the one or more strain parameters include the circumferential strain, the circumferential strain is determined based on a change in a circumferential distance from the source image to the target image, the circumferential distance being a projection of the radial distance in a circumferential direction of the anatomical structure.

2. The apparatus of claim 1 , wherein the partial differential equation comprises Laplace's equation.

3. The apparatus of claim 2 , wherein the first plurality of points and the second plurality of points are determined by solving Laplace's equation to determine one or more equal-potential surfaces and wherein each of the one or more equal-potential surfaces comprises at least one point from the first plurality of points and at least one point from the second plurality of points.

4. The apparatus of claim 1 , wherein the first surface of the anatomical structure comprises an inner surface of the anatomical structure and the second surface of the anatomical structure comprises an outer surface of the anatomical structure.

5. The apparatus of claim 1 , wherein the motion field is determined using one or more artificial neural networks and wherein the determination comprises deriving a first motion field based on respective features extracted from the source image and the target image, and refining the first motion field to obtain a refined motion field.

6. The apparatus of claim 5 , wherein the refinement of the first motion field is performed by at least:

deriving a warped image based on the source image and the first motion field;

determining a second motion field based on respective features extracted from the warped image and the target image; and

combining the first motion field and the second motion field.

7. The apparatus of claim 1 , wherein the source image of the anatomical structure comprises a source segmentation mask associated with the anatomical structure and wherein the target image of the anatomical structure comprises a target segmentation mask associated with the anatomical structure.

8. The apparatus of claim 1 , wherein the one or more strain parameters include the radial strain of the anatomical structure, and wherein the one or more processors are configured to:

determine, in the source image, a first radial distance between a first point on the first surface of the anatomical structure and a second point on the second surface of the anatomical structure, wherein the first point belongs to the first plurality of points and the second point belongs to the second plurality of points, and wherein the first point corresponds to the second point in accordance with the partial differential equation;

determine, in the target image, a second radial distance between the first point on the first surface of the anatomical structure and the second point on the second surface of the anatomical structure;

determine a change between the first radial distance and the second radial distance; and

determine the radial strain based on the change between the first radial distance and the second radial distance.

9. The apparatus of claim 1 , wherein the one or more strain parameters include the circumferential strain of the anatomical structure, and wherein the one or more processors are configured to:

determine, in the source image, a first circumferential distance in the circumferential direction of the anatomical structure that corresponds to a projection of a first radial distance in the source image between a first point and a second point that are respectively located on the first and second surfaces of the anatomical structure, wherein the first point and the second point are among the first plurality of points and the second plurality of points, respectively;

determine, in the target image, a second circumferential distance in the circumferential direction of the anatomical structure that corresponds to a projection of a second radial distance in the target image between the first point and the second point;

determine a change between the first circumferential distance and the second circumferential distance; and

determine the circumferential strain based on the change between the first circumferential distance and the second circumferential distance.

10. The apparatus of claim 1 , wherein the anatomical structure comprises a myocardium.

11. A method for motion tracking and strain determination, the method comprising:

obtaining a source image of an anatomical structure and a target image of the anatomical structure;

determining, in the source image, a first plurality of points on a first surface of the anatomical structure and a second plurality of points on a second surface of the anatomical structure, wherein the first plurality of points and the second plurality of points are determined based on a partial differential equation such that each point in the second plurality of points corresponds to a point in the first plurality of points;

determining, based on the source image and the target image, a motion field that indicates a motion of the anatomical structure from the source image to the target image;

estimating, based on the motion field and respective locations of the first plurality of points and the second plurality of points in the source image, respective locations of the first plurality of points and the second plurality of points in the target image;

determining one or more strain parameters associated with the anatomical structure, wherein:

the one or more strain parameters include at least one of a radial strain of the anatomical structure or a circumferential strain of the anatomical structure;

if the one or more strain parameters include the radial strain, the radial strain is determined based on a change in a radial distance between one of the first plurality of points and one of the second plurality of points from the source image to the target image; and

if the one or more strain parameters include the circumferential strain, the circumferential strain is determined based on a change in a circumferential distance from the source image to the target image, the circumferential distance being a projection of the radial distance in a circumferential direction of the anatomical structure.

12. The method of claim 11 , wherein the partial differential equation comprises Laplace's equation.

13. The method of claim 12 , wherein the first plurality of points and the second plurality of points are determined by solving Laplace's equation to determine one or more equal-potential surfaces and wherein each of the one or more equal-potential surfaces comprises at least one point from the first plurality of points and at least one point from the second plurality of points.

14. The method of claim 11 , wherein the first surface of the anatomical structure comprises an inner surface of the anatomical structure and the second surface of the anatomical structure comprises an outer surface of the anatomical structure.

15. The method of claim 11 , wherein the motion field is determined using one or more artificial neural networks and wherein the determination comprises deriving a first motion field based on respective features extracted from the source image and the target image, and refining the first motion field to obtain a refined motion field.

16. The method of claim 15 , wherein the refinement of the first motion field is performed by at least:

deriving a warped image based on the source image and the first motion field;

determining a second motion field based on respective features extracted from the warped image and the target image; and

combining the first motion field and the second motion field.

17. The method of claim 11 , wherein the source image of the anatomical structure comprises a source segmentation mask associated with the anatomical structure and wherein the target image of the anatomical structure comprises a target segmentation mask associated with the anatomical structure.

18. The method of claim 11 , wherein the one or more strain parameters include the radial strain of the anatomical structure and wherein determining the one or more strain parameters associated with the anatomical structure comprises:

determining, in the source image, a first radial distance between a first point on the first surface of the anatomical structure and a second point on the second surface of the anatomical structure, wherein the first point belongs to the first plurality of points and the second point belongs to the second plurality of points, and wherein the first point corresponds to the second point in accordance with the partial differential equation;

determining, in the target image, a second radial distance between the first point on the first surface of the anatomical structure and the second point on the second surface of the anatomical structure;

determining a change between the first radial distance and the second radial distance; and

determining the radial strain based on the change between the first radial distance and the second radial distance.

19. The method of claim 11 , wherein the one or more strain parameters include the circumferential strain of the anatomical structure and wherein determining the one or more strain parameters associated with the anatomical structure comprises:

determining, in the source image, a first circumferential distance in the circumferential direction of the anatomical structure that corresponds to a projection of a first radial distance in the source image between a first point and a second point that are respectively located on the first and second surfaces of the anatomical structure, wherein the first point and the second point are among the first plurality of points and the second plurality of points, respectively;

determining, in the target image, a second circumferential distance in the circumferential direction of the anatomical structure that corresponds to a projection of a second radial distance in the target image between the first point and the second point;

determining a change between the first circumferential distance and the second circumferential distance; and

determining the circumferential strain based on the change between the first circumferential distance and the second circumferential distance.

20. The method of claim 11 , wherein the anatomical structure comprises a myocardium.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: UII AMERICA, INC.
To: SHANGHAI UNITED IMAGING INTELLIGENCE CO., LTD.
Reel/Frame 054170/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2020
From: SUN, SHANHUI; YU, HANCHAO; HUANG, QIAOYING; CHEN, ZHANG; CHEN, TERRENCE
To: UII AMERICA, INC.
Reel/Frame 054056/0387 →
Continuity (2)
Provisional Application 62941198 · Nov 27, 2019
Related Publication 20210158543A1 · May 27, 2021
Cited By (2)
US 12,266,444 US 12,340,028