IP Library Granted Patent US 12,427,339
Granted Patent B2
US 12,427,339 · App. 18/190,345 · Granted Sep 30, 2025

Training artificial intelligence models for radiation therapy

Inventors: Shahab Basiri (Siuntio, FI); Mikko Hakala (Rajamaki, FI); Esa Kuusela (Espoo, FI); Elena Czeizler (Helsinki, FI)
Assignee: SIEMENS HEALTHINEERS INTERNATIONAL AG
A61N5/1038G06N3/08A61N2005/1041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,427,339
App. No.
18/190,345
Granted
Sep 30, 2025
Kind
B2
Abstract

Disclosed herein are systems and methods for iteratively training artificial intelligence models using reinforcement learning techniques. With each iteration, a training agent applies a random radiation therapy treatment attribute corresponding to the radiation therapy treatment attribute associated with previously performed radiation therapy treatments when an epsilon value indicative of a likelihood of exploration and exploitation training of the artificial intelligence model satisfies a threshold. When the epsilon value does not satisfy the threshold, the agent generates, using an existing policy, a first predicted radiation therapy treatment attribute, and generates, using a predefined model, a second predicted radiation therapy treatment attribute. The agent applies one of the first predicted radiation therapy treatment attribute or the second predicted radiation therapy treatment attribute that is associated with a higher reward. The agent iteratively repeats training the artificial intelligence model until the existing policy satisfies an accuracy threshold.

Claims (44)

1. A method comprising:

iteratively training, by a server, an artificial intelligence model, wherein with each iteration the server:

identifies a radiation therapy treatment attribute; and

when an epsilon value does not satisfy a threshold corresponding to a likelihood of exploration or exploitation training of the artificial intelligence model, the server:

generates, using an existing policy applied to the identified radiation therapy treatment attribute, a first predicted radiation therapy treatment attribute;

generates, using a predefined computer model, a second predicted radiation therapy treatment attribute; and

trains the artificial intelligence model using one of the first predicted radiation therapy treatment attribute or the second predicted radiation therapy treatment attribute that is associated with a higher reward, such that the artificial intelligence model is configured to predict a third predicted radiation therapy treatment attribute in accordance with its corresponding reward.

2. The method of claim 1 , wherein the server iteratively repeats training the artificial intelligence model until the existing policy satisfies an accuracy threshold.

3. The method of claim 1 , wherein the epsilon value is received from a system administrator.

4. The method of claim 1 , wherein the server further trains the existing policy based on the predefined computer model using a supervised training method.

5. The method of claim 1 , wherein the server revises the epsilon value, such that a likelihood of generation of the first or second predicted radiation therapy treatment attribute is higher or lower than generation of a random radiation therapy treatment attribute.

6. The method of claim 1 , wherein the predefined computer model is specific to a clinic.

7. The method of claim 1 , wherein the predefined computer model is configured to optimize a dose-histogram volume calculation.

8. A system comprising:

one or more processors; and

a non-transitory memory to store computer code instructions, the computer code instructions when executed cause the one or more processors to:

iteratively train an artificial intelligence model, wherein with each iteration the processor;

identifies a radiation therapy treatment attribute; and

when an epsilon value does not satisfy a threshold corresponding to a likelihood of exploration or exploitation training of the artificial intelligence model, the one or more processors:

generate, using an existing policy applied to the identified radiation therapy treatment attribute, a first predicted radiation therapy treatment attribute;

generate, using a predefined computer model, a second predicted radiation therapy treatment attribute; and

train the artificial intelligence model using one of the first predicted radiation therapy treatment attribute or the second predicted radiation therapy treatment attribute that is associated with a higher reward, such that the artificial intelligence model is configured to predict a third predicted radiation therapy treatment attribute in accordance with its corresponding reward.

9. The system of claim 8 , wherein the one or more processors iteratively repeat training the artificial intelligence model until the existing policy satisfies an accuracy threshold.

10. The system of claim 8 , wherein the epsilon value is received from a system administrator.

11. The system of claim 8 , wherein the one or more processors further train the existing policy based on the predefined computer model using a supervised training method.

12. The system of claim 8 , wherein the one or more processors revise the epsilon value, such that a likelihood of generation of the first or second predicted radiation therapy treatment attribute is higher or lower than generation of a random radiation therapy treatment attribute.

13. The system of claim 8 , wherein the predefined computer model is specific to a clinic.

14. The system of claim 8 , wherein the predefined computer model is configured to optimize a dose-histogram volume calculation.

15. A system comprising:

a server in communication with an artificial intelligence model, the server configured to:

iteratively train the artificial intelligence model, wherein with each iteration the server is configured to:

identifies a radiation therapy treatment attribute; and

when an epsilon value does not satisfy a threshold corresponding to a likelihood of exploration or exploitation training of the artificial intelligence model, the server:

generates, using an existing policy applied to the identified radiation therapy treatment attribute, a first predicted radiation therapy treatment attribute;

generates, using a predefined computer model, a second predicted radiation therapy treatment attribute; and

trains the artificial intelligence model using one of the first predicted radiation therapy treatment attribute or the second predicted radiation therapy treatment attribute that is associated with a higher reward, such that the artificial intelligence model is configured to predict a third predicted radiation therapy treatment attribute in accordance with its corresponding reward.

16. The system of claim 15 , wherein the server is further configured to:

iteratively repeat training the artificial intelligence model until the existing policy satisfies an accuracy threshold.

17. The system of claim 15 , wherein the epsilon value is received from a system administrator.

18. The system of claim 15 , wherein the server is further configured to:

train the existing policy based on the predefined computer model using a supervised training method.

19. The system of claim 15 , wherein the server is further configured to:

revise the epsilon value, such that a likelihood of generation of the first or second predicted radiation therapy treatment attribute is higher or lower than generation of a random radiation therapy treatment attribute.

20. The system of claim 15 , wherein the predefined computer model is specific to a clinic.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2023
From: BASIRI, SHAHAB; HAKALA, MIKKO; KUUSELA, ESA; CZEIZLER, ELENA
To: VARIAN MEDICAL SYSTEMS, INC.
Reel/Frame 063442/0948 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2023
From: VARIAN MEDICAL SYSTEMS, INC.
To: VARIAN MEDICAL SYSTEMS INTERNATIONAL AG
Reel/Frame 063443/0120 →
MERGER AND CHANGE OF NAME Recorded Apr 26, 2023
From: VARIAN MEDICAL SYSTEMS INTERNATIONAL AG; SIEMENS HEALTHINEERS INTERNATIONAL AG
To: SIEMENS HEALTHINEERS INTERNATIONAL AG
Reel/Frame 063456/0393 →
Continuity (2)
Continuation 17124249 · Dec 16, 2020
Related Publication 20230347175A1 · Nov 2, 2023
References Cited (6)
US 20190333623A1 · Hibbard · 2019 [cited by applicant]
US 20220296923A1 · Peltola et al. · 2022 [cited by applicant]
US 20220296924A1 · Peltola et al. · 2022 [cited by applicant]
WO WO2018048575A1 · 2018 [cited by applicant]
Notice of Allowance on U.S. Appl. No. 17/124,249 DTD Nov. 25, 2022. [cited by applicant]
International Search Report and Written Opinion dated May 4, 2022 on PCT App. PCT/EP2021/085848 (18 pages). [cited by applicant]