IP Library › Granted Patent US 11,720,826
Granted Patent B2
US 11,720,826 · App. 16/521,185 · Granted Aug 8, 2023

Feedback loop learning between artificial intelligence systems

Inventors: Jinho Hwang (Ossining, NY); Larisa Shwartz (Greenwich, CT); Hagen Völzer (Zurich, CH); Michael Elton Nidd (Zurich, CH); Rodrigo Otavio Castrillon (Campinas, BR)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06N20/20G06F9/541G06F9/542G06F18/2413G06N3/044G06N3/082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,720,826
App. No.
16/521,185
Granted
Aug 8, 2023
Kind
B2
Abstract

Techniques that facilitate feedback loop learning between artificial intelligence systems are provided. In one example, a system includes a monitoring component and a machine learning component. The monitoring component identifies a data pattern associated with data for an artificial intelligence system. The machine learning component compares the data pattern to historical data patterns for the artificial intelligence system to facilitate modification of at least a component of the artificial intelligence system and/or one or more dependent systems of the artificial intelligence system.

Claims (45)

1. A system, comprising:

a memory that stores computer executable components; and

a processor that executes the computer executable components stored in the memory, wherein the computer executable components comprise:

a data analytics component that, based on an analysis of a microservices mesh, constructs a dependency mapping graph for artificial intelligence components of the microservices mesh, wherein the nodes of dependency mapping graph represent the artificial intelligence components, and edges of the dependency mapping graph represent respective dependencies between the artificial intelligence components;

a monitoring component that identifies, in real time, a data pattern associated with data generated during execution of the artificial intelligence components of the microservices mesh in a runtime environment of an artificial intelligence system;

a machine learning component that employs machine learning to:

determine, in real time, a deviation of the data pattern from one or more historical data patterns associated with one or more prior executions of the artificial intelligence components in the runtime environment of the artificial intelligence system, wherein the deviation indicates a need for a modification of at least one corresponding artificial intelligence component, in a development environment of the artificial intelligence system, that corresponds to at least one artificial intelligence component of the artificial intelligence components, and wherein the deviation comprises a new class of data representative of a new use case for the artificial intelligence components, and

determine, based on the dependency mapping graph, a need for another modification of at least one other artificial intelligence component that depends on the at least one corresponding artificial intelligence component based on the modification of at least one corresponding artificial intelligence component; and

a development component that implements the modification of the at least one corresponding artificial intelligence component and the other modification of the at least one other artificial intelligence component in the development environment of the artificial intelligence system.

2. The system of claim 1 , wherein the monitoring component identifies the data pattern associated with the data based on the dependency mapping graph for the artificial intelligence components.

3. The system of claim 1 , wherein the monitoring component monitors one or more application programming interface communications in the data associated with the artificial intelligence components.

4. The system of claim 1 , wherein the monitoring component monitors one or more events in the data associated with the artificial intelligence components.

5. The system of claim 1 , wherein the monitoring component monitors accuracy of output data in the data generated by the at least one artificial intelligence component of the artificial intelligence components.

6. The system of claim 1 , wherein the machine learning component infers a new classification for the at least one corresponding artificial intelligence component.

7. The system of claim 1 , wherein the development component that trains the at least one corresponding artificial intelligence component based on the data pattern.

8. The system of claim 1 , wherein the development component updates respective artificial intelligence models of the at least one corresponding artificial intelligence component based on the data pattern.

9. The system of claim 1 , wherein the machine learning component compares the data pattern to the one or more historical data patterns to improve performance of the artificial intelligence system.

10. A computer-implemented method, comprising:

based on an analysis of a microservices mesh, constructing, by a system operatively coupled to a processor, a dependency mapping graph for artificial intelligence components of the microservices mesh, wherein the nodes of dependency mapping graph represent the artificial intelligence components, and edges of the dependency mapping graph represent respective dependencies between the artificial intelligence components;

identifying, by the system, in real time, a data pattern associated with data generated during execution of artificial intelligence components of the microservices mesh in a runtime environment of a the artificial intelligence system; and

determining, by the system, using machine learning, in real time, a deviation of the data pattern from one or more historical data patterns associated with one or more prior executions of the artificial intelligence components in the runtime environment of the artificial intelligence system, wherein the deviation indicates a need for a modification of at least one corresponding artificial intelligence component, in a development environment of the artificial intelligence system, that corresponds to at least one artificial intelligence component of the artificial intelligence components, and wherein the deviation comprises a new class of data representative of a new use case for the artificial intelligence components;

determining, by the system, based on the dependency mapping graph, a need for another modification of at least one other artificial intelligence component that depends on the at least one corresponding artificial intelligence component based on the modification of at least one corresponding artificial intelligence component; and

implementing, by the system, the modification of the at least one corresponding artificial intelligence component and the other modification of the at least one other artificial intelligence component in the development environment of the artificial intelligence system.

11. The computer-implemented method of claim 10 , further comprising:

inferring, by the system, a new classification for the at least one corresponding artificial intelligence component based on the comparing.

12. The computer-implemented method of claim 10 , wherein the modification comprises:

modifying, by the system, one or more weights of the at least one corresponding artificial intelligence component.

13. The computer-implemented method of claim 10 , wherein the modification comprises:

modifying, by the system, one or more respective models associated with the at least one corresponding artificial intelligence component.

14. The computer-implemented method of claim 10 , wherein the modification comprises:

modifying, by the system, respective training data associated with the at least one corresponding artificial intelligence component.

15. The computer-implemented method of claim 10 , wherein the identifying the data pattern is based on the dependency mapping graph for the artificial intelligence components.

16. A computer program product facilitating feedback loop learning for an artificial intelligence system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

based on an analysis of a microservices mesh, constructing, by the processor, a dependency mapping graph for artificial intelligence components of the microservices mesh, wherein the nodes of dependency mapping graph represent the artificial intelligence components, and edges of the dependency mapping graph represent respective dependencies between the artificial intelligence components;

identify, by the processor, in real time, a data pattern associated with data generated during execution of artificial intelligence components of the microservices mesh in a runtime environment of the artificial intelligence system;

determine, by the processor, using machine learning, in real time, a deviation of the data pattern from one or more historical data patterns associated with one or more prior executions of the artificial intelligence components in the runtime environment of the artificial intelligence system, wherein the deviation indicates a need for a modification of at least one corresponding artificial intelligence component, in a development environment of the artificial intelligence system, that corresponds to at least one artificial intelligence component of the artificial intelligence components, and wherein the deviation comprises a new class of data representative of a new use case for the artificial intelligence components;

determining, by the processor, based on the dependency mapping graph, a need for another modification of at least one other artificial intelligence component that depends on the at least one corresponding artificial intelligence component based on the modification of at least one corresponding artificial intelligence component; and

implement, by the processor, the modification of the at least one corresponding artificial intelligence component and the other modification of the at least one other artificial intelligence component in the development environment of the artificial intelligence system.

17. The computer program product of claim 16 , wherein the modification comprises:

modify, by the processor, one or more weights of the at least one corresponding artificial intelligence component.

18. The computer program product of claim 16 , wherein the modification comprises:

modify, by the processor, one or more respective artificial intelligence models of the at least one corresponding artificial intelligence component.

19. The computer program product of claim 16 , wherein the modifying comprises:

modification, by the processor, respective training data for the at least one corresponding artificial intelligence component.

20. The computer program product of claim 16 , wherein the identifying the data pattern is based on the dependency mapping graph for the artificial intelligence components.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: HWANG, JINHO; SHWARTZ, LARISA; VÖLZER, HAGEN; NIDD, MICHAEL ELTON; CASTRILLON, RODRIGO OTAVIO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049851/0482 →
Continuity (1)
Related Publication 20210027136A1 · Jan 28, 2021