IP Library › Granted Patent US 12,322,194
Granted Patent B2
US 12,322,194 · App. 18/088,988 · Granted Jun 3, 2025

System and method for determining characteristic cells based on image recognition

Inventors: Tzu-Kuei Shen (Hsinchu, TW); Linda Siana (Hsinchu, TW); Guang-Hao Suen (Hsinchu, TW); Liang-Wei Sheu (Hsinchu, TW); Chien-Ting Yang (Hsinchu, TW); Yuh-Min Chen (Taipei, TW); Heng-sheng Chao (Taipei, TW); Chung-Wei Chou (Taipei, TW); Tsu-Hui Shiao (Taipei, TW); Yi-Han Hsiao (Taipei, TW); Chi-Lu Chiang (Taipei, TW)
Assignees: V5MED INC.; TAIPEI VETERANS GENERAL HOSPITAL
G06V20/693G06T7/0012G06V20/698G06T2207/10056G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,194
App. No.
18/088,988
Granted
Jun 3, 2025
Kind
B2
Abstract

A system and a method for determining characteristic cells based on image recognition. In the method, a scanning device capturing a full image of the microslide; a host selecting images that comprise stained blocks from the full image; the host sequentially performing image recognition to recognize stained cells of the images, and determining whether the stained cells comprise the characteristic cells with an AI model; and selecting interested images from the images that comprise the characteristic cells, transforming the coordinate system of the interested images into the original coordinate system of the full image, and employing the scanning device to capture the interested images along the Z axis of the original coordinate system of the full image, thereby obtaining and outputting sets of pictures. The present invention can quickly determine whether there are characteristic cells in the tissue under test, so as to provide a diagnostic reference for doctors.

Claims (19)

1. A method for determining characteristic cells based on image recognition, scanning a stained tissue solution on a microslide to recognize the characteristic cells of the stained tissue solution, and the method comprising:

by a scanning device, capturing a full image of the microslide, wherein the scanning device comprises a microscope and camera;

by a host, receiving the full image and selecting a plurality of images that comprise stained blocks from the full image with an image processing algorithm;

by the host, sequentially performing image recognition on the plurality of images to recognize a plurality of stained cells of the plurality of images, and determining whether the plurality of stained cells comprise the characteristic cells with an artificial intelligence (AI) model; and

selecting a plurality of interested images from the plurality of images that comprise the characteristic cells, transforming a coordinate system of the plurality of interested images into an original coordinate system of the full image, and employing the scanning device to capture the plurality of interested images along a Z axis of the original coordinate system of the full image, thereby obtaining and outputting a plurality of sets of pictures,

wherein when the AI model determines that the plurality of stained cells comprise the characteristic cells, the characteristic cells are scored and the plurality of interested images are selected according to scores of the characteristic cells, and

wherein the characteristic cells are scored according to sizes and integrity of the characteristic cells.

2. The method for determining the characteristic cells based on image recognition according to claim 1 , wherein the scanning device further comprises an electric stage, the microscope is mounted on the electric stage, the camera is mounted on the microscope, and microslide is mounted on the electric stage.

3. The method for determining the characteristic cells based on image recognition according to claim 2 , wherein the microscope scans the microslide and then employs the camera to obtain the full image of the microslide after adjusting a magnification.

4. The method for determining the characteristic cells based on image recognition according to claim 1 , wherein the step of determining whether the plurality of stained cells comprise the characteristic cells with the AI model comprises:

the AI model determines whether the characteristic cells comprised by the plurality of stained cells are abnormal when the plurality of stained cells comprise the characteristic cells; and

the AI model determines whether the plurality of stained cells in a next image comprise the characteristic cells when the plurality of stained cells do not comprise the characteristic cells.

5. A system for determining characteristic cells based on image recognition, configured to scan a stained tissue solution on a microslide to recognize the characteristic cells of the stained tissue solution, comprising:

a scanning device comprising an electric stage, a microscope, and a camera, wherein the microscope is mounted on the electric stage and configured to display a full image of the microslide, and the camera is mounted on a lens of the microscope and configured to capture the full image; and

a host electrically connected to the camera, wherein the host is configured to receive the full image, select a plurality of images that comprise stained blocks from the full image with an image processing algorithm, sequentially perform image recognition on the plurality of images to recognize a plurality of stained cells of the plurality of images, determine whether the plurality of stained cells comprise the characteristic cells with an artificial intelligence (AI) model, select a plurality of interested images from the plurality of images that comprise the characteristic cells, transform a coordinate system of the plurality of interested images into an original coordinate system of the full image, and employ the scanning device to capture the plurality of interested images along a Z axis of the original coordinate system of the full image, thereby obtaining and outputting a plurality of sets of pictures,

wherein when the AI model determines that the plurality of stained cells comprise the characteristic cells, the characteristic cells are scored and the plurality of interested images are selected according to scores of the characteristic cells, and

wherein the characteristic cells are scored according to sizes and integrity of the characteristic cells.

6. The system for determining the characteristic cells based on image recognition according to claim 5 , wherein the microscope scans the microslide and then employs the camera to obtain the full image of the microslide after adjusting a magnification.

7. The system for determining the characteristic cells based on image recognition according to claim 5 , wherein the AI model determines whether the characteristic cells comprised by the plurality of stained cells are abnormal when the plurality of stained cells comprise the characteristic cells, and the AI model determines whether the plurality of stained cells in a next image comprise the characteristic cells when the plurality of stained cells do not comprise the characteristic cells.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2024
From: V5 TECHNOLOGIES CO., LTD.
To: V5MED INC.
Reel/Frame 066045/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2022
From: SHEN, TZU-KUEI; SIANA, LINDA; SUEN, GUANG-HAO; SHEU, LIANG-WEI; YANG, CHIEN-TING; CHEN, YUH-MIN; CHAO, HENG-SHENG; CHOU, CHUNG-WEI; SHIAO, TSU-HUI; HSIAO, YI-HAN; CHIANG, CHI-LU
To: V5 TECHNOLOGIES CO., LTD.; TAIPEI VETERANS GENERAL HOSPITAL
Reel/Frame 062210/0068 →
Priority Claims (1)
TW 111131295 · Aug 19, 2022 · national
Continuity (1)
Related Publication 20240062563A1 · Feb 22, 2024
References Cited (25)
US 7226788B2 · De La Torre-Bueno · 2007 [cited by examiner]
US 9784666B2 · Mai et al. · 2017 [cited by applicant]
US 20160083681A1 · Tavana et al. · 2016 [cited by applicant]
US 20210158521A1 · Shaked · 2021 [cited by examiner]
US 20220058369A1 · Alahmari · 2022 [cited by examiner]
US 20220101519A1 · Yip · 2022 [cited by examiner]
US 20220282202A1 · Wagner · 2022 [cited by examiner]
US 20230127698A1 · Dave · 2023 [cited by examiner]
US 20230420133A1 · Zalah · 2023 [cited by examiner]
CN 108982500A · 2018 [cited by applicant]
CN 109034208A · 2018 [cited by applicant]
CN 111458279A · 2020 [cited by applicant]
CN 111527519A · 2020 [cited by applicant]
CN 113167714A · 2021 [cited by applicant]
CN 113454458A · 2021 [cited by applicant]
CN 113508290A · 2021 [cited by applicant]
CN 113705318A · 2021 [cited by applicant]
CN 114152610A · 2022 [cited by applicant]
EP 0592997A2 · 1994 [cited by applicant]
TW I687898B · 2020 [cited by applicant]
TW 202142856A · 2021 [cited by applicant]
TW I753448B · 2022 [cited by applicant]
TW 202217838A · 2022 [cited by applicant]
WO WO2018196335A1 · 2018 [cited by applicant]
Identification of a Novel Cell Type in Peripheral Lymphoid Organs of Mice I. ˜-˜Iorphology, Quantitation, Tissue Distribution* by Ralph M. Steinman$ and Zanvil A. Cohn (Year: 1973). [cited by examiner]