IP Library › Granted Patent US 10,068,330
Granted Patent B2
US 10,068,330 · App. 15/055,140 · Granted Sep 4, 2018

Automatic segmentation of breast tissue in a thermographic image

Inventors: Arun Koushik Parthasarathy (Karnataka, IN); Krithika Venkataramani (Bangalore, IN); Siva Teja Kakileti (Andhra Pradesh, IN)
G06T7/0012A61B5/0091A61B5/015A61B5/4312A61B10/0041G06K9/00201G06K9/00624G06K9/4604G06K9/4652G06K9/52G06T7/0085G06T7/408G06T7/60G06T7/90A61B2576/02G06K2209/05G06T2207/10048G06T2207/30068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,068,330
App. No.
15/055,140
Granted
Sep 4, 2018
Kind
B2
Abstract

What is disclosed is a system and method for automatically segmenting a breast from surrounding tissue in a thermal image. A thermal image of at least one breast of the patient is received. The thermal image is then analyzed to identify a set of N points around the breast, a contour of an outline of the body, and isotherms of the axilla and infra-mammary fold. Thereafter, the points are connected together to form a N-sided irregular polygon which segments the breast from surrounding tissue. Each of the points is a vertex of the polygon and comprises a draggable object which enables a user to selectively manipulate a shape of the polygon. A user can add/delete vertices from the polygon as desired. The area of the image encompassed by the polygon is communicated to a breast cancer screening algorithm performing automated or semi-automated screening.

Claims (50)

1. A method for segmenting a breast from surrounding tissue in a thermographic image for breast cancer screening, the method comprising:

receiving a thermal image of an upper body of a person, which represents temperature distribution on a breast area of the person as pixels in the thermal image with a highest temperature value being displayed in a first color and pixels with a lowest temperature value being displayed in a second color, pixels with temperature values between the lowest and highest temperature values being displayed in gradations of color between the first and second colors, wherein the thermal image is captured by a thermal imaging camera, the thermal imaging camera comprising:

an array of sensors that converts infrared energy into electrical signals on a per-pixel basis;

a lens that focuses the infrared energy from the person's breast onto the array of sensors, wherein the array of sensors detects temperature values from the person's breast; and

a specialized processor that processes the detected temperature values into at least one block of pixels to generate the thermal image;

analyzing, using an image processing technique, the thermal image to identify a plurality of points P N , where N≥5, in the thermal image surrounding the breast area, wherein the analyzing of the thermal image comprises

determining a view angle of the thermal image,

determining a contour of an outline of an edge of the breast area of the person;

determining an upper boundary and a lower boundary of an isotherm of the breast;

determining a lower boundary of an isotherm of axilla of the person; and

determining an upper boundary of an isotherm of infra-mammary fold of the person;

generating a N-sided polygon by connecting the points together to segment the breast from surrounding tissue in the thermal image; and

transforming the thermal image into a segmented thermal image by overlaying the N-sided polygon onto the thermal image, wherein the segmented thermal image is configured for analysis using a breast cancer screening algorithm for screening the breast cancer.

2. The method of claim 1 , wherein identifying points comprises:

identifying points which lie along the contour of the outline of the edge of the breast area of the person;

identifying points which lie between the lower boundary of the isotherm of the axilla and the upper boundary of the isotherm of the breast; and

identifying points which lie between the lower boundary of the isotherm of the breast and the upper boundary of the isotherm of the inframammary fold.

3. The method of claim 1 , wherein each of vertices of the polygon comprise draggable objects, further comprising a user to selectively manipulating a shape of the polygon.

4. The method of claim 1 , further comprising communicating at least a portion of an area of the segmented thermal image encompassed by the polygon to the breast cancer screening algorithm.

5. The method of claim 1 , further comprising one of: a user adding at least one new vertex into the polygon, and a user deleting at least one vertex from the polygon.

6. The method of claim 1 , wherein when said N-sided polygon is a 10-sided irregular polygon, the identifying points comprises

identifying points P 1 , P 7 , P 8 , P 9 and P 10 which lie along the contour of the outline of the edge of the breast area of the person;

identifying points P 1 , P 2 and P 3 which lie between the lower boundary of the isotherm of the axilla and the upper boundary of the isotherm of the breast; and

identifying points P 4 , P 5 , P 6 and P 7 which lie between the lower boundary of the isotherm of the breast and the upper boundary of the isotherm of the inframammary fold.

7. The method of claim 1 , wherein when said N-sided polygon is a 9-sided irregular polygon, the identifying points comprises

identifying points P 1 and P 2 which lie between the lower boundary of the isotherm of the axilla and the upper boundary of the isotherm of the breast;

identifying point P 3 which resides along a contour of the outline of the edge of the breast area of the person; and

identifying points P 3 through P 9 which lie between the lower boundary of the isotherm of the breast and the upper boundary of the isotherm of the inframammary fold.

8. The method of claim 7 , wherein the method comprises shifting a location of the point P 3 from along the contour edge of the breast to a position that is closer to the breast tissue.

9. A system for segmenting a breast from surrounding tissue in a thermographic image for breast cancer screening, the system comprising:

a storage device;

a processor in communication with the storage device, the processor executing machine readable instructions for performing:

receiving a thermal image of an upper body of a person, which represents temperature distribution on a breast area of the person as pixels in the thermal image with a highest temperature value being displayed in a first color and pixels with a lowest temperature value being displayed in a second color, pixels with temperature values between the lowest and highest temperature values being displayed in gradations of color between the first and second colors, wherein the thermal image is captured by a thermal imaging camera, the thermal imaging camera comprising:

an array of sensors that converts infrared energy into electrical signals on a per-pixel basis;

a lens that focuses the infrared energy from the person's breast onto the array of sensors, wherein the array of sensors detects temperature values from the person's breast; and

a specialized processor that processes the detected temperature values into at least one block of pixels to generate the thermal image;

analyzing, using an image processing technique, the thermal image to identify a plurality of points P N , where N≥3, in the thermal image surrounding the breast area, wherein the analyzing of the thermal image comprises

determining a view angle of the thermal image,

determining a contour of an outline of an edge of the breast area of the person;

determining an upper boundary and a lower boundary of an isotherm of the breast;

determining a lower boundary of an isotherm of axilla of the person; and

determining an upper boundary of an isotherm of infra-mammary fold of the person;

generating N-sided polygon by connecting the points together to segment the breast from surrounding tissue in the thermal image; and

transforming the thermal image into a segmented thermal image by overlaying the N-sided polygon onto the thermal image, wherein the segmented thermal image is configured for analysis using a breast cancer screening algorithm for screening the breast cancer.

10. The system of claim 9 , wherein identifying points comprises:

identifying points which lie along the contour of the outline of the edge of the breast area of the person;

identifying points which lie between the lower boundary of the isotherm of the axilla and the upper boundary of the isotherm of the breast; and

identifying points which lie between the lower boundary of the isotherm of the breast and the upper boundary of the isotherm of the inframammary fold.

11. The system of claim 9 , wherein each of vertices of the polygon comprise draggable objects, further comprising a user to selectively manipulating a shape of the polygon.

12. The system of claim 9 , further comprising communicating at least a portion of an area of the segmented thermal image encompassed by the polygon to the breast cancer screening algorithm.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2017
From: XEROX CORPORATION
To: NIRAMAI HEALTH ANALYTIX PVT LTD
Reel/Frame 042437/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2016
From: PARTHASARATHY, ARUN KOUSHIK; VENKATARAMANI, KRITHIKA; KAKILETI, SIVA TEJA
To: XEROX CORPORATION
Reel/Frame 037842/0865 →
Continuity (1)
Related Publication 20170249734A1 · Aug 31, 2017