IP Library › Granted Patent US 12,682,452
Granted Patent B2
US 12,682,452 · App. 18/302,243 · Granted Jul 14, 2026

Training of machine-learning algorithms for digital pathalogy using healthy-tissue whole slide images

Inventors: Andre Aichert (Erlangen, DE); Marvin Teichmann (Erlangen, DE); Hanibal Bohnenberger (Bovenden, DE); Birgi Tamersoy (Erlangen, DE)
Assignees: SIEMENS HEALTHINEERS AG; GEORG-AUGUST-UNIVERSITÄT GÖTTINGEN STIFTUNG ÖFFENTLICHEN RECHTS UNIVERSITÄTSMEDIZIN GÖTTINGEN
G06T7/0012G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,682,452
App. No.
18/302,243
Filed
Apr 18, 2023
Granted
Jul 14, 2026
Kind
B2
Art Unit
2683
USPC
382/128
Abstract

Various examples of the disclosure pertain to using whole-slide images that depict healthy tissue for a training process for at least one machine-learning algorithm for digital pathology. For instance, an autoencoder neural network can be trained based on the healthy tissue.

Claims (49)

1 . A computer-implemented method of facilitating a training process of at least one machine-learning algorithm for digital pathology, the computer-implemented method comprising:

obtaining multiple whole-slide images exclusively depicting healthy tissue;

providing, to the training process, the multiple whole-slide images with an indication that the multiple whole-slide images exclusively depict healthy tissue; and

batch processing the multiple whole-slide images in an annotation process to automatically assign ground-truth labels to the multiple whole-slide images that identify each one of the multiple whole-slide images as exclusively depicting healthy tissue, wherein

the at least one machine-learning algorithm includes a novelty-detection algorithm including an auto encoder neural network algorithm,

the auto encoder neural network algorithm is exclusively trained on the multiple whole-slide images, and

an entirety of each of the multiple whole-slide images is provided to the training process.

2 . The computer-implemented method of claim 1 ,

wherein the training process comprises the annotation process for determining ground-truth labels for a plurality of whole-slide images, the plurality of whole-slide images comprising the multiple whole-slide images and multiple further whole-slide images, the multiple further whole-slide images depicting healthy tissue and unhealthy tissue.

3 . The computer-implemented method of claim 2 ,

wherein the annotation process comprises an interactive active-learning user-interaction protocol comprising multiple iterations, each iteration comprising at least one user query to obtain at least one respective ground-truth label, wherein user queries of subsequent iterations depend on user queries of preceding iterations, and

the batch processing of the multiple whole-slide images is implemented in a selected one of the multiple iterations.

4 . The computer-implemented method of claim 1 , further comprising:

executing the training process based on the multiple whole-slide images; and

upon training the novelty-detection algorithm, detecting unhealthy tissue by processing a further whole-slide image using the novelty-detection algorithm, unhealthy tissue being associated with abnormalities identified by the novelty-detection algorithm.

5 . The computer-implemented method of claim 4 ,

wherein the auto encoder neural network algorithm includes an encoder branch configured to encode an input data and a decoder branch configured to decode an encoded representation of the input data encoded by the encoder branch, and

the detecting detects the abnormalities based on a reconstruction error between the input data and an output data output by the decoder branch.

6 . The computer-implemented method of claim 1 ,

wherein the at least one machine-learning algorithm further comprises an anatomical modelling algorithm to rate an organ fitness of an organ anatomy in view of tumor growth, and the computer-implemented method further comprises:

executing the training process to train the anatomical modelling algorithm based on the multiple whole-slide images.

7 . The computer-implemented method of claim 6 , further comprising:

determining a cancer grade of a tumor based on a result of the novelty-detection algorithm and a further result of the anatomical modelling algorithm.

8 . The computer-implemented method of claim 1 , further comprising:

executing the training process in an unsupervised manner.

9 . The computer-implemented method of claim 1 , further comprising:

automatically determining one or more ground-truth labels based on the indication that the multiple whole-slide images exclusively depict healthy tissue; and

setting weights of the at least one machine-learning algorithm based on the multiple whole-slide images that depict healthy tissue and the one or more ground-truth labels.

10 . A non-transitory computer readable medium comprising program code, when executed by a processor, causes the processor to execute a method of facilitating a training process of at least one machine-learning algorithm for digital pathology, the method comprising:

obtaining multiple whole-slide images depicting healthy tissue;

providing, to the training process, the multiple whole-slide images with an indication that the multiple whole-slide images exclusively depict healthy tissue; and

batch processing the multiple whole-slide images in an annotation process to assign ground-truth labels to the multiple whole-slide images that identify each one of the multiple whole-slide images as exclusively depicting healthy tissue, wherein

the at least one machine-learning algorithm includes a novelty-detection algorithm including an autoencoder neural network algorithm,

the autoencoder neural network algorithm is exclusively trained on the multiple whole-slide images, and

an entirety of each of the multiple whole-slide images is provided to the training process.

11 . The non-transitory computer readable medium of claim 10 , wherein the program code, when executed by the processor, causes the processor to further execute:

automatically determining one or more ground-truth labels based on the indication that the multiple whole-slide images exclusively depict healthy tissue; and

setting weights of the at least one machine-learning algorithm based on the multiple whole-slide images that depict healthy tissue and the one or more ground-truth labels.

12 . The computer-implemented method of claim 3 , further comprising:

executing the training process based on the multiple whole-slide images; and

upon training the novelty-detection algorithm, detecting unhealthy tissue by processing a further whole-slide image using the novelty-detection algorithm, unhealthy tissue being associated with abnormalities identified by the novelty-detection algorithm.

13 . The computer-implemented method of claim 12 ,

wherein the auto encoder neural network algorithm includes an encoder branch configured to encode an input data and a decoder branch configured to decode an encoded representation of the input data encoded by the encoder branch, and

the detecting detects the abnormalities based on a reconstruction error between the input data and an output data output by the decoder branch.

14 . The computer-implemented method of claim 5 ,

wherein the at least one machine-learning algorithm further comprises an anatomical modelling algorithm to rate an organ fitness of an organ anatomy in view of tumor growth, and the computer-implemented method further comprises:

executing the training process to train the anatomical modelling algorithm based on the multiple whole-slide images.

15 . The computer-implemented method of claim 14 , further comprising:

determining a cancer grade of a tumor based on a result of the novelty-detection algorithm and a further result of the anatomical modelling algorithm.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2026
From: BOHNENBERGER, HANIBAL
To: GEORG-AUGUST-UNIVERSITÄT GÖTTINGEN STIFTUNG ÖFFENTLICHEN RECHTS UNIVERSITÄTSMEDIZIN GÖTTINGEN
Reel/Frame 074424/0957 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2026
From: TAMERSOY, BIRGI
To: SIEMENS HEALTHINEERS AG
Reel/Frame 074425/0243 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2026
From: AICHERT, ANDRÉ; TEICHMANN, MARVIN
To: SIEMENS HEALTHINEERS AG
Reel/Frame 074425/0452 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
Priority Claims (1)
EP 22168971 · Apr 20, 2022 · regional
Continuity (1)
Related Publication 20230342927A1 · Oct 26, 2023
References Cited (19)
US 20210248736A1 · Kamen et al. · 2021 [cited by applicant]
US 20220076053A1 · Gulsun · 2022 [cited by examiner]
US 20220198666A1 · Gorton · 2022 [cited by examiner]
Nazeri et al., “Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification” Apr. 1, 2018, Whole Document. (Year: 2018). [cited by examiner]
Li et al. “Discriminative Pattern Mining for Breast Cancer Histopathology Image Classification via Fully Convolutional Autoencoder”. Date: Feb. 20, 2019, Whole Document. Address: https://ieeexplore.ieee.org/document/866… [cited by examiner]
Ström P.-et al.:“Pathologist-level grading of prostate biopsies with artificial intelligence” arXiv preprint arXiv:1907.01368, 2019. [cited by applicant]
Simonyan, Karen, and Zisserman, Andrew “Very Deep Convolutional Networks for Large-Scale Image Recognition” https://arxiv.org/abs/1409.1556v6 (2014); 2014. [cited by applicant]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. CoRR, abs/1512.03385, 2015. [cited by applicant]
Nazeri K. et al.:“Two-stage convolutional neural network for breast cancer histology image classification” In International Conference Image Analysis and Recognition, pp. 717-726. Springer, 2018. [cited by applicant]
Gillard, R. et al.: “Using Progressive Context Encoders for Anomaly Detection in Digital Pathology Images”, in: bioRxiv, Jul. 4, 2021. https://www.biorxiv.org/content/10.1101/2021.07.02.450957v1.full.pdf. [cited by applicant]
Radosavovic I. et al.:“Designing network design spaces”. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10428-10436, 2020. [cited by applicant]
Shen, Y.; Ke, J.: “Representative Region Based Active Learning for Histological Classification of Colorectal Cancer”, in: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)Apr. 13-16, 2021, Nice, France… [cited by applicant]
Kather, J.N. et al.:“Pan-cancer image-based detection of clinically actionable genetic alterations”, in: Nat Cancer. Aug. 2020 ; 1(8): 789-799. doi:10.1038/s43018-020-0087-6. [cited by applicant]
Mingxing Tan et al.:“Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv preprint”, arXiv:1905.11946, 2019. [cited by applicant]
Lee, Sanghoon et al: “Interactive Classification of Whole-Slide Imaging Data for Cancer Researchers”; Cancer Research, vol. 81, No. 4, Feb. 15, 2021 (Feb. 15, 2021); pp. 1171-1177, XP055963044; 2021. [cited by applicant]
Pocevičiüté, M. et al.:“Unsupervised Anomaly Detection in Digital Pathology Using Gans”, in: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) Apr. 13-16, 2021, Nice, France. [cited by applicant]
Redekop, E.; Chernyavskiy, A.:“Uncertainty-Based Method for Improving Poorly Labeled Segmentation Datasets”, in: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) Apr. 13-16, 2021, Nice, France., pp. 1… [cited by applicant]
Li, Xingyu et al; “Discriminative Pattern Mining for Breast Cancer Histopathology Image Classification via Fully Convolutional Autoencoder”; arxiv.org, May 5, 2020 (May 5, 2020), XP081657733; Retrieved from the Internet… [cited by applicant]
Vaswani, A. et al.:“Attention Is All You Need”, in: 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA. [cited by applicant]