IP Library Granted Patent US 11,238,583
Granted Patent B2
US 11,238,583 · App. 16/829,629 · Granted Feb 1, 2022

System and method for generating a stained image

Inventors: Condon Lau (Kowloon, HK); Yixuan Yuan (Kowloon, HK); Chi Shing Cho (Kowloon, HK); Wah Cheuk (Kowloon, HK); Wan San Victor Ma (Kowloon, HK); Wing Lun Law (Kowloon, HK)
Assignee: City University of Hong Kong
G06T7/0012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,238,583
App. No.
16/829,629
Granted
Feb 1, 2022
Kind
B2
Abstract

A system and method for generating a stained image including the steps of obtaining a first image of a key sample section; and processing the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain.

Claims (37)

1. A method for generating a stained image comprising the steps of:

obtaining a first image of a key sample section;

processing the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, and the key sample section is stained with a standard stain; and

obtaining an adjacent image of at least one adjacent sample section obtained in proximity to the key sample section, wherein the at least one adjacent sample section is stained with at least one non-standard stain;

wherein the at least one stained image represents the key sample section stained with at least one non-standard stain; and

wherein the adjacent image of at least one adjacent sample section obtained is processed by the stain learning engine to generate the at least one stained image.

2. A method for generating a stained image comprising the steps of:

obtaining a first image of a key sample section; and

processing the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, wherein the key sample section is stained with a standard stain, the stain learning engine includes a machine learning network arranged to generate the at least one stained image, and

the machine learning network includes a generator network arranged to generate the at least one stained image over a plurality of cycles and a discriminator network arranged to analysis the at least one stained image to provide feedback to the generator network on each of the plurality of cycles.

3. A method for generating a stained image in accordance with claim 2 , wherein the machine learning network is a generative adversarial network.

4. A method for generating a stained image in accordance with claim 3 , wherein the generative adversarial network is trained with images of key sample sections and images of stained key sample sections.

5. A method for generating a stained image in accordance with claim 4 , wherein the generative adversarial network is further trained with images of adjacent sample sections adjacent to the key sample sections.

6. A method for generating a stained image in accordance with claim 5 , wherein the adjacent sample sections are stained.

7. A method for generating a stained image comprising the steps of:

obtaining a first image of a key sample section; and

processing the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, and the key sample section is stained with a standard stain; and

obtaining an adjacent image of at least one adjacent sample section obtained in proximity to the key sample section, wherein the at least one adjacent sample section is stained with at least one non-standard stain, and the standard stain includes hematoxylin and eosin (H&E).

8. A method for generating a stained image in accordance with claim 7 , wherein the non-standard stain includes special stains and/or immunostains.

9. A method for generating a stained image in accordance with claim 8 , wherein the key sample section and the at least one adjacent sample section are frozen.

10. A method for generating a stained image in accordance with claim 9 , wherein the key sample section and the at least one adjacent sample section are not formalin-fixed or embedded in paraffin.

11. A system for generating a stained image comprising:

an image gateway arranged to obtain a first image of a key sample section; and

an image generator arranged to process the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, the key sample section is stained with a standard stain, the image gateway is further arranged to obtain at least one adjacent image of at least one adjacent sample section obtained in proximity to the key sample section, the at least one adjacent sample section is stained with at least one non-standard stain, the at least one stained image represents the key sample section stained with at least one non-standard stain; and the at least one adjacent image of at least one adjacent sample section obtained is processed by the stain learning engine to generate the at least one stained image.

12. A system for generating a stained image comprising:

an image gateway arranged to obtain a first image of a key sample section; and

an image generator arranged to process the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, the key sample section is stained with a standard stain, the stain learning engine includes a machine learning network arranged to generate the at least one stained image; and the machine learning network includes a generator network arranged to generate the at least one stained image over a plurality of cycles and a discriminator network arranged to analysis the at least one stained image to provide feedback to the generator network on each of the plurality of cycles.

13. A system for generating a stained image in accordance with claim 12 , wherein the machine learning network is a generative adversarial network.

14. A system for generating a stained image in accordance with claim 13 , wherein the generative adversarial network is trained with images of key sample sections and images of stained key sample sections.

15. A system for generating a stained image in accordance with claim 14 , wherein the generative adversarial network is further trained with images of adjacent sample sections adjacent to the key sample sections.

16. A system for generating a stained image in accordance with claim 15 , wherein the adjacent sample sections are stained.

17. A system for generating a stained image comprising:

an image gateway arranged to obtain a first image of a key sample section; and

an image generator arranged to process the first image with a stain learning engine arranged to generate at least one stained image, wherein the at least one stained image represents the key sample section stained with at least one stain, the key sample section is stained with a standard stain, the image gateway is further arranged to obtain at least one adjacent image of at least one adjacent sample section obtained in proximity to the key sample section, the at least one adjacent sample section is stained with at least one non-standard stain, and the standard stain includes hematoxylin and eosin (H&E).

18. A system for generating a stained image in accordance with claim 17 , wherein the non-standard stain includes special stains and/or immunostains.

19. A system for generating a stained image in accordance with claim 18 , wherein the key sample section and the at least one adjacent sample section are frozen.

20. A system for generating a stained image in accordance with claim 19 , wherein the key sample section and the at least one adjacent sample section are not formalin-fixed or embedded in paraffin.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2020
From: LAU, CONDON; YUAN, YIXUAN; CHO, CHI SHING; CHEUK, WAH; MA, WAN SAN VICTOR; LAW, WING LUN
To: CITY UNIVERSITY OF HONG KONG
Reel/Frame 052225/0668 →
Continuity (1)
Related Publication 20210304401A1 · Sep 30, 2021