IP Library Granted Patent US 10,832,407
Granted Patent B2
US 10,832,407 · App. 16/293,667 · Granted Nov 10, 2020

Training a neural network adapter

Inventors: Alon Hazan (Zikhron Yaakov, IL); Yoel Shoshan (Haifa, IL); Vadim Ratner (Haifa, IL); Aviad Zlotnick (Mitzpeh Netofah, IL); Flora Gilboa (Haifa, IL)
Assignee: International Business Machines Corporation
G06T7/0012G06N3/0454G06N3/0481G06N3/084G06T2207/10088G06T2207/10116G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,832,407
App. No.
16/293,667
Granted
Nov 10, 2020
Kind
B2
Abstract

In some examples, a system for training a neural network can include a processor to detect a trained neural network application. The processor can also detect a set of images, wherein the neural network application is not trained with the set of images. Additionally, the processor can train an adapter network based on the trained neural network application and the set of images, wherein the adapter network is to be trained by freezing weights of the trained neural network and modifying weights of the adapter network. Furthermore, the processor can use the trained adapter network to process at least one additional image, the processed additional image to be transmitted to the trained neural network to generate an output signal.

Claims (31)

1. A system comprising:

a processor to:

detect a trained neural network application;

detect a set of images from a medical device, wherein the trained neural network application is not trained with the set of images;

train an adapter network based on the trained neural network application and the set of images, wherein the adapter network is to be trained by freezing weights of the trained neural network application and modifying weights of the adapter network, wherein the processor is to initialize the weights of the adapter network to weights of a pass through function; and

use the trained adapter network to process at least one additional image, the at least one processed additional image to be transmitted to the trained neural network application to generate an output signal.

2. The system of claim 1 , wherein the output signal indicates a medical condition corresponding to the at least one additional image, wherein the at least one image is an x-ray, an ultrasound image, or an MRI image.

3. The system of claim 1 , wherein the processor is to use the trained neural network application as a loss function and use a backpropagation technique to determine the weights of the adapter network.

4. The system of claim 1 , wherein the processed additional image comprises a modification to the at least one additional image, the modification comprising a modified color, a modified hue, a modified saturation value, or a modified brightness.

5. The system of claim 1 , wherein the at least one processed additional image comprises a modified scaling or a modified skew.

6. The system of claim 1 , wherein the at least one processed additional image comprises characteristics shared with a sample image from a first image capturing device, wherein the at least one processed additional image is detected from a second image capturing device.

7. The system of claim 1 , wherein the processor is to generate the at least one processed additional image by applying a modified sigmoid function associated with the adapter network to the at least one additional image.

8. The system of claim 7 , wherein the modified sigmoid function corresponds to a degradation of the medical device over time, and the at least one processed additional image represents characteristics shared with output from the medical device at an earlier date.

9. The system of claim 1 , wherein the adapter network comprises a plurality of rectified linear units and a plurality of convolutional neural networks.

10. A method comprising:

detecting a trained neural network application;

detecting a set of images from a medical device, wherein the trained neural network application is not trained with the set of images;

training an adapter network based on the trained neural network application and the set of images, wherein the adapter network is to be trained by freezing weights of the trained neural network application and modifying weights of the adapter network, wherein the weights of the adapter network are initialized to weights of a pass through function; and

using the trained adapter network to process at least one additional image, the at least one processed additional image to be transmitted to the trained neural network application to generate an output signal.

11. The method of claim 10 , wherein the output signal indicates a medical condition corresponding to the at least one additional image, wherein the at least one additional image is an x-ray, an ultrasound image, or an MRI image.

12. The method of claim 10 , comprising using the trained neural network application as a loss function and use a backpropagation technique to determine the weights of the adapter network.

13. The method of claim 10 , wherein the at least one processed additional image comprises a modification to the at least one image, the modification comprising a modified color, a modified hue, a modified saturation value, or a modified brightness.

14. The method of claim 10 , wherein the at least one processed additional image comprises a modified scaling or a modified skew.

15. The method of claim 10 , wherein the at least one processed additional image comprises characteristics shared with a sample image from a first image capturing device, wherein the at least one processed additional image is detected from a second image capturing device.

16. The method of claim 10 , comprising generating the at least one processed additional image by applying a modified sigmoid function associated with the adapter network to the at least one additional image.

17. A computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, wherein the program instructions are executable by a processor to cause the processor to:

detect a trained neural network application;

detect a set of images from a medical device, wherein the trained neural network application is not trained with the set of images;

train an adapter network based on the trained neural network application and the set of images, wherein the adapter network is to be trained by freezing weights of the trained neural network application and modifying weights of the adapter network, wherein the processor is to initialize the weights of the adapter network to weights of a pass through function; and

use the trained adapter network to process at least one additional image, the processed additional image to be transmitted to the trained neural network application to generate an output signal.

18. The computer program product of claim 17 , wherein the output signal indicates a medical condition corresponding to the at least one additional image, wherein the at least one additional image is an x-ray, an ultrasound image, or an MRI image.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2019
From: HAZAN, ALON; SHOSHAN, YOEL; RATNER, VADIM; ZLOTNICK, AVIAD; GILBOA, FLORA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 048511/0531 →