IP Library Granted Patent US 10,896,762
Granted Patent B2
US 10,896,762 · App. 16/567,553 · Granted Jan 19, 2021

3D web-based annotation

Inventors: Shafiqul Abedin (San Jose, CA); Hakan Bulu (Los Gatos, CA)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G16H50/50G06F3/011G06F3/0346G06F3/04815G06F3/04845G16H30/20G16H30/40G16H40/20G06T2210/41G06T2219/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,896,762
App. No.
16/567,553
Granted
Jan 19, 2021
Kind
B2
Abstract

Web-based annotation of three dimensional medical imagery is provided. In various embodiments, a plurality of two dimensional medical images is read from a data store. The plurality of two dimensional images is a subset of a three dimensional medical imaging study. The plurality of two dimensional medical images is provided to a remote user. Regional annotations for each of the plurality of medical images are received from the remote user. A volumetric description of the three dimensional imaging study is generated by interpolation of the regional annotations. The volumetric description of the three dimensional imaging is provided for rendering and display to the remote user.

Claims (48)

1. A method comprising:

reading a three dimensional medical imaging study from a data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;

selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images, the second plurality of two dimensional medical images being a strict subset of the first plurality of two dimensional medical images;

providing the second plurality of two dimensional medical images to a remote user;

receiving from the remote user regional annotations for each of the second plurality of medical images;

generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;

providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein:

said selecting of the second plurality of two dimensional images minimizes an estimated error rate of the interpolation by selecting the second plurality of two dimensional images to represent clusters of the first plurality of two dimensional images, each cluster having a similar interslice propagation error, and

the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

2. The method of claim 1 , wherein the data store comprises a PACS.

3. The method of claim 1 , wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.

4. The method of claim 3 , wherein applying k-means clustering comprises clustering the first plurality of two dimensional medical images based on a minimization of the error rate.

5. The method of claim 3 , wherein applying k-means clustering comprises iteratively initializing centers of a plurality of clusters of the first plurality of two dimensional medical images and selecting a clustering having a minimum error rate.

6. The method of claim 1 , wherein the second plurality of two dimensional medical images corresponds to centers of clusters obtained by applying k-means clustering to the first plurality of two dimensional medical images.

7. The method of claim 1 , wherein the estimated error rate corresponds to a matching between manually segmented images and warped manually segmented images.

8. The method of claim 1 , wherein the error rate is based on a predetermined region of the first plurality of two dimensional images.

9. The method of claim 1 , further comprising:

providing a web application to the remote user, the web application being adapted to receive input of the regional annotations from the remote user.

10. The method of claim 1 , wherein the second plurality of two dimensional medical images is provided to the remote user via the internet.

11. The method of claim 1 , further comprising:

providing a web application to the remote user, the web application being adapted to render the volumetric description and display the rendering to the remote user.

12. A system comprising:

a data store;

a computing node comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of the computing node to cause the processor to perform a method comprising:

reading a three dimensional medical imaging study from the data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;

selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images, the second plurality of two dimensional medical images being a strict subset of the first plurality of two dimensional medical images;

providing the second plurality of two dimensional medical images to a remote user;

receiving from the remote user regional annotations for each of the second plurality of medical images;

generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;

providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein

said selecting of the second plurality of images minimizes an estimated error rate of the interpolation by selecting the second plurality of two dimensional images to represent clusters of the first plurality of two dimensional images, each cluster having a similar interslice propagation error, and

the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

13. The system of claim 12 , wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.

14. The system of claim 13 , wherein applying k-means clustering comprises clustering the first plurality of two dimensional medical images based on a minimization of the error rate.

15. The system of claim 13 , wherein applying k-means clustering comprises iteratively initializing centers of a plurality of clusters of the first plurality of two dimensional medical images and selecting a clustering having a minimum error rate.

16. The system of claim 12 , wherein the second plurality of two dimensional medical images corresponds to centers of clusters obtained by applying k-means clustering to the first plurality of two dimensional medical images.

17. The system of claim 12 , wherein the estimated error rate corresponds to a matching between manually segmented images and warped manually segmented images.

18. The system of claim 12 , wherein the error rate is based on a predetermined region of the first plurality of two dimensional images.

19. A computer program product for medical imagery annotation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

reading a three dimensional medical imaging study from a data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;

selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images, the second plurality of two dimensional medical images being a strict subset of the first plurality of two dimensional medical images;

providing the second plurality of two dimensional medical images to a remote user;

receiving from the remote user regional annotations for each of the second plurality of medical images;

generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;

providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein

said selecting of the second plurality of images minimizes an estimated error rate of the interpolation by selecting the second plurality of two dimensional images to represent clusters of the first plurality of two dimensional images, each cluster having a similar interslice propagation error, and

the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

20. The computer program product of claim 19 , wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2019
From: ABEDIN, SHAFIQUL; BULU, HAKAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 050359/0758 →