IP Library Granted Patent US 12,626,166
Granted Patent B2
US 12,626,166 · App. 17/807,039 · Granted May 12, 2026

Predicting the need for XAI in artificial intelligence systems

Inventors: Vagner Figueredo de Santana (São Paulo, BR); Ana Fucs (Rio de Janeiro, BR); Vinicius Costa Villas Boas Segura (Rio de Janeiro, BR); Daniel Brugnaro De Moraes (São Paulo, BR); Renato Fontoura de Gusmao Cerqueira (Rio de Janeiro, BR)
Assignee: International Business Machines Corporation
G06N5/045G06F11/3438G06F18/214G06F18/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,626,166
App. No.
17/807,039
Granted
May 12, 2026
Kind
B2
Abstract

A method, computer program, and computer system are provided for selecting an artificial intelligence algorithm. Data corresponding to a user interaction with an artificial intelligence system is received. A need by the user for an explanation associated with the artificial intelligence system is identified based on the received data corresponding to the user interaction with the artificial intelligence system. An artificial intelligence algorithm is selected from among a plurality of artificial intelligence algorithms. The selected artificial intelligence algorithm includes an explainable artificial intelligence component. A model is created for the the selected artificial intelligence algorithm corresponding to the received data.

Claims (40)

1 . A computer-implemented method of selecting an artificial intelligence algorithm, executable by a processor, comprising:

receiving received data corresponding to a user interaction in a user interface with an artificial intelligence system, wherein the received data includes a dataset selected by a user in the user interface, wherein the user interaction includes an event and a target;

creating embeddings based on the received data and a usage graph used to train a model training module, wherein the usage graph comprises events and targets of users interacting with the artificial intelligence system;

calculating a similarity value between the embeddings;

identifying a need by the user for an explanation associated with the artificial intelligence system based on the similarity value;

selecting an artificial intelligence algorithm from among a plurality of artificial intelligence algorithms, wherein the selected artificial intelligence algorithm includes an explainable artificial intelligence component;

creating a model for the selected artificial intelligence algorithm corresponding to the received data; and

providing feedback related to the created model back to the user through the user interface.

2 . The computer-implemented method of claim 1 , wherein the artificial intelligence algorithm is selected based on previous user interactions with the artificial intelligence system selecting an artificial intelligence algorithm having an explainable artificial intelligence component.

3 . The computer-implemented method of claim 1 , further comprising training the model based on measuring a similarity value between the received data and data corresponding to previous user interactions having a need for an explanation associated with the artificial intelligence system.

4 . The computer-implemented method of claim 1 , wherein the similarity value corresponds to a cosine similarity value between vectors associated with the created embeddings.

5 . The computer-implemented method of claim 1 , further comprising providing an explanation of the artificial intelligence algorithm to the user.

6 . The computer-implemented method of claim 1 , wherein the data corresponding to the user interaction with the artificial intelligence system includes data corresponding to an identifier, a timestamp, an event, a target, and metadata.

7 . A computer system for selecting an artificial intelligence algorithm, the computer system comprising:

one or more computer-readable storage media configured to store computer program code; and

one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:

receiving code configured to cause the one or more computer processors to receive received data corresponding to a user interaction in a user interface with an artificial intelligence system, wherein the received data includes a dataset selected by a user in the user interface, wherein the user interaction includes an event and a target;

creating code configured to cause the one or more computer processors to create embeddings based on the received data and a usage graph used to train a model training module, wherein the usage graph comprises events and targets of users interacting with the artificial intelligence system;

calculating code configured to cause the one or more computer processors to calculate a similarity value between the embeddings;

identifying code configured to cause the one or more computer processors to identify a need by the user for an explanation associated with the artificial intelligence system based on the similarity value;

selecting code configured to cause the one or more computer processors to select an artificial intelligence algorithm from among a plurality of artificial intelligence algorithms, wherein the selected artificial intelligence algorithm includes an explainable artificial intelligence component;

creating code configured to cause the one or more computer processors to create a model for the selected artificial intelligence algorithm corresponding to the received data; and

providing feedback related to the created model back to the user through the user interface.

8 . The computer system of claim 7 , wherein the artificial intelligence algorithm is selected based on previous user interactions with the artificial intelligence system selecting an artificial intelligence algorithm having an explainable artificial intelligence component.

9 . The computer system of claim 7 , further comprising training code configured to cause the one or more computer processors to train the model based on measuring a similarity value between the received data and data corresponding to previous user interactions having a need for an explanation associated with the artificial intelligence system.

10 . The computer system of claim 7 , wherein the similarity value corresponds to a cosine similarity value between vectors associated with the created embeddings.

11 . The computer system of claim 7 , further comprising providing code configured to cause the one or more computer processors to provide an explanation of the artificial intelligence algorithm to the user.

12 . The computer system of claim 7 , wherein the data corresponding to the user interaction with the artificial intelligence system includes data corresponding to an identifier, a timestamp, an event, a target, and metadata.

13 . A computer readable medium having stored thereon a computer program for selecting an artificial intelligence algorithm, the computer program configured to cause one or more computer processors to:

receive received data corresponding to a user interaction in a user interface with an artificial intelligence system, wherein the received data includes a dataset selected by a user in the user interface, wherein the user interaction includes an event and a target;

create embeddings based on the received data and a usage graph used to train a model training module, wherein the usage graph comprises events and targets of users interacting with the artificial intelligence system;

calculate a similarity value between the embeddings;

identify a need by the user for an explanation associated with the artificial intelligence system based on the similarity value;

select an artificial intelligence algorithm from among a plurality of artificial intelligence algorithms, wherein the selected artificial intelligence algorithm includes an explainable artificial intelligence component;

create a model for the selected artificial intelligence algorithm corresponding to the received data; and

providing feedback related to the created model back to the user through the user interface.

14 . The computer readable medium of claim 13 , wherein the artificial intelligence algorithm is selected based on previous user interactions with the artificial intelligence system selecting an artificial intelligence algorithm having an explainable artificial intelligence component.

15 . The computer readable medium of claim 13 , wherein the computer program is further configured to cause the one or more computer processors to train the model based on measuring a similarity value between the received data and data corresponding to previous user interactions having a need for an explanation associated with the artificial intelligence system.

16 . The computer readable medium of claim 13 , wherein the similarity value corresponds to a cosine similarity value between vectors associated with the created embeddings.

17 . The computer readable medium of claim 13 , wherein the computer program is further configured to cause the one or more computer processors to provide an explanation of the artificial intelligence algorithm to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2022
From: FIGUEREDO DE SANTANA, VAGNER; FUCS, ANA; COSTA VILLAS BOAS SEGURA, VINICIUS; BRUGNARO DE MORAES, DANIEL; FONTOURA DE GUSMAO CERQUEIRA, RENATO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 060212/0894 →
Continuity (1)
Related Publication 20230409935A1 · Dec 21, 2023
References Cited (29)
US 8078554B2 · Fung · 2011 [cited by applicant]
US 11049043B2 · Dalli · 2021 [cited by applicant]
US 20180158552A1 · Liu · 2018 [cited by applicant]
US 20190244122A1 · Li · 2019 [cited by applicant]
US 20190303404A1 · Amer · 2019 [cited by applicant]
US 20190378006A1 · Fukuda · 2019 [cited by applicant]
US 20200294231A1 · Tosun · 2020 [cited by applicant]
US 20200380556A1 · Ainscough · 2020 [cited by examiner]
US 20210232940A1 · Dalli · 2021 [cited by examiner]
US 20220012565A1 · Hansen · 2022 [cited by examiner]
US 20220036221A1 · Hargras · 2022 [cited by applicant]
US 20220277192A1 · Gou · 2022 [cited by examiner]
US 20230245197A1 · Iyer · 2023 [cited by examiner]
US 20240078473A1 · Laszczuk · 2024 [cited by examiner]
US 20250342394A1 · St-Amant · 2025 [cited by examiner]
CN 112101574B · 2020 [cited by applicant]
CN 113518999A · 2021 [cited by applicant]
WO 2017186048A1 · 2017 [cited by applicant]
WO 2020123985A1 · 2020 [cited by applicant]
WO 2021137897A1 · 2021 [cited by applicant]
Ramon, Yanou, et al. “How should artificial intelligence explain itself? understanding preferences for explanations generated by XAI algorithms.” Understanding Preferences for Explanations Generated by XAI Algorithms (J… [cited by examiner]
Henin, Clément, and Daniel Le Métayer. “A multi-layered approach for tailored black-box explanations.” International conference on pattern recognition. Cham: Springer International Publishing, 2021 (Year: 2021). [cited by examiner]
Adadi, et al., “Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI),” IEEE Access, vol. 6, Oct. 12, 2018, pp. 52138-52160, <https://ieeexplore.ieee.org/document/8466590>. [cited by applicant]
Arya, et al., “One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques,” arXiv:1909.03012v2 [cs.AI], Sep. 14, 2019, 18 pgs, <https://arxiv.org/abs/1909.03012>. [cited by applicant]
Duval, “Explainable Artificial Intelligence (XAI),” ResearchGate, Preprint Apr. 2019, 58 pgs., <https://www.researchgate.net/publication 332209054_Explainable_Artificial_Intelligence_XAI?channel=doi&linkld=5ca6269aa6fdc… [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing”, National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, pp. 1-7. [cited by applicant]
Santana, “Welfit: A Remote Evaluation Tool for Identifying Web Usage Patterns Through Client-Side Logging,” Science Direct, Elsevier, Int. J. Human-Computer Studies vol. 76 (2015), pp. 40-49, <https://www.sciencedirect.… [cited by applicant]
Santana, et al., “Summarizing Observational Client-side Data to Reveal Web Usage Patterns,” SAC '10, Mar. 22-26, 2010, Sierre Switzerland, pp. 1219-1223, <https://dl.acm.org/doi/10.1145/1774088.1774344>. [cited by applicant]
W3Schools, “HTML Dom Events,” W3Schools.com, [accessed May 2, 2022], 19 pgs., Retrieved from the Internet: <https://www.w3schools.com/jsref/dom_obj_event.asp>. [cited by applicant]