IP Library Granted Patent US 12,293,401
Granted Patent B2
US 12,293,401 · App. 18/050,135 · Granted May 6, 2025

Automatically generating personalized and context-aware explanation formats for a recommendation

Inventors: Oznur Alkan (Clonsilla, IE); Elizabeth Daly (Dublin, IE); Bei Chen (Blanchardstown, IE); Massimiliano Mattetti (Dublin, IE); Rahul Nair (Dublin, IE)
Assignee: International Business Machines Corporation
G06Q30/0631G06F16/248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,401
App. No.
18/050,135
Filed
Oct 27, 2022
Granted
May 6, 2025
Kind
B2
Art Unit
3688
USPC
705/26.7
Abstract

Embodiments of the invention are directed to a computer-implemented method. A non-limiting example of the computer-implemented method includes accessing, using an explanation generator module of a processor system, information of a recommendation associated with an application, information of the application, and information of a user of the application. The explanation generator module of the processor system is used to determine an explanation format of an explanation of the recommendation based at least in part on the information of the recommendation associated with the application, the information of the application, and the information of the user of the application.

Claims (51)

1. A computer-implemented method comprising:

executing, using an interaction manager module of a recommender system, user feedback operations comprising receiving and storing user feedback on explanation formats of recommendation-explanation pairs generated by a recommender of the recommender system;

wherein the recommendation-explanation pairs comprise a first recommendation-explanation pair; and

determining, using an explanation generator module of the recommender system, a predicted explanation format of the first recommendation-explanation pair;

wherein the explanation generator module comprises a machine learning model trained based at least in part on the user feedback on the explanation formats of the recommendation-explanation pairs generated by the recommender.

2. The computer-implemented method of claim 1 , wherein the predicted explanation format of the first recommendation-explanation pair is based at least in part on a prediction, using the machine learning model, that a user of the recommender system will accept the predicted explanation format.

3. The computer-implemented method of claim 1 , wherein the predicted explanation format of the first recommendation-explanation pair is based at least in part on a prediction that a user of the recommender system will act on a recommendation portion of the first recommendation-explanation pair.

4. The computer-implemented method of claim 1 further comprising using the predicted explanation format type to generate a personalized combination output associated with the first recommendation-explanation pair, wherein the personalized combination output comprises an explanation format and an explanation component.

5. The computer-implemented method of claim 1 , wherein:

the recommendation-explanation pairs are associated with one or more applications; and

the machine learning model is further trained based at least in part on context information comprising:

information of a plurality of recommendations associated with the one or more applications;

information of the one or more applications; and

information of a user of the recommendation system.

6. The computer-implemented method of claim 4 , wherein the explanation component comprises one or more of natural language text, a diagram, a chart, a table, video, and audio.

7. The computer-implemented method of claim 1 , wherein the interaction manager module comprises a conversational agent configured to actively solicit the user feedback from a user of the recommender system by executing a conversational loop between the conversational agent and a user of the recommendation system.

8. A computer system comprising a processor system communicatively coupled to a memory, wherein the processor system is operable to perform processor system operations comprising:

executing, using an interaction manager module of a recommender system, user feedback operations comprising receiving and storing user feedback on explanation formats of recommendation-explanation pairs generated by a recommender of the recommender system;

wherein the recommendation-explanation pairs comprise a first recommendation-explanation pair; and

determining, using an explanation generator module of the recommender system, a predicted explanation format of the first recommendation-explanation pair;

wherein the explanation generator module comprises a machine learning model trained based at least in part on the user feedback on the explanation formats of the recommendation-explanation pairs generated by the recommender.

9. The computer system of claim 8 , wherein the predicted explanation format of the first recommendation-explanation pair is based at least in part on a prediction, using the machine learning model, that a user of the recommender system will accept the predicted explanation format.

10. The computer system of claim 8 , wherein the predicted explanation format of the first recommendation-explanation pair is based at least in part on a prediction that a user of the recommender system will act on a recommendation portion of the first recommendation-explanation pair.

11. The computer system of claim 8 , wherein:

the processor system operations further comprise using the predicted explanation format type to generate a personalized combination output associated with the first recommendation-explanation pair; and

the personalized combination output comprises an explanation format and an explanation component.

12. The computer system of claim 8 , wherein;

the recommendation-explanation pairs are associated with one or more applications; and

the machine learning model is further trained based at least in part on context information comprising:

information of a plurality of recommendations associated with the one or more applications;

information of the one or more applications; and

information of a user of the recommendation system.

13. The computer system of claim 11 , wherein the explanation component comprises one or more of natural language text, a diagram, a chart, a table, video, and audio.

14. The computer system of claim 13 , wherein the interaction manager module comprises a conversational agent configured to actively solicit the user feedback from a user of the recommender system by executing a conversational loop between the conversational agent and a user of the recommendation system.

15. A computer program product comprising a computer readable program stored on a computer readable storage medium, wherein the computer readable program, when executed on a processor system, causes the processor system to perform processor system operations comprising:

executing, using an interaction manager module of a recommender system, user feedback operations comprising receiving and storing user feedback on explanation formats of recommendation-explanation pairs generated by a recommender of the recommender system;

wherein the recommendation-explanation pairs comprise a first recommendation-explanation pair; and

determining, using an explanation generator module of the recommender system, a predicted explanation format of the first recommendation-explanation pair;

wherein the explanation generator module comprises a machine learning model trained based at least in part on the user feedback on the explanation formats of the recommendation-explanation pairs generated by the recommender.

16. The computer program product of claim 15 , wherein the predicted explanation format of the first recommendation-explanation pair is based at least in part on a prediction, using the machine learning model, that a user of the recommender system will accept the predicted explanation format.

17. The computer program product of claim 15 , wherein the interaction manager module comprises a conversational agent configured to actively solicit the user feedback from a user of the recommender system by executing a conversational loop between the conversational agent and a user of the recommendation system.

18. The computer program product of claim 15 , wherein:

the processor system operations further comprise using the predicted explanation format type to generate a personalized combination output associated with the first recommendation-explanation pair; and

the personalized combination output comprises an explanation format and an explanation component.

19. The computer program product of claim 15 , wherein:

the recommendation-explanation pairs are associated with one or more applications; and

the machine learning model is further trained based at least in part on context information comprising:

information of a plurality of recommendations associated with the one or more applications;

information of the one or more applications; and

the information of a user of the recommendation system.

20. The computer program product of claim 18 , wherein the explanation component comprises one or more of natural language text, a diagram, a chart, a table, video, and audio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2022
From: ALKAN, OZNUR; DALY, ELIZABETH; CHEN, BEI; MATTETTI, MASSIMILIANO; NAIR, RAHUL
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061560/0389 →
Continuity (1)
Related Publication 20240144346A1 · May 2, 2024
References Cited (21)
US 7860811B2 · Flinn et al. · 2010 [cited by applicant]
US 9449106B2 · Reese et al. · 2016 [cited by applicant]
US 11257144B1 · Hamel · 2022 [cited by examiner]
US 20170161818A1 · Jain et al. · 2017 [cited by applicant]
US 20180182015A1 · Su · 2018 [cited by examiner]
US 20200012681A1 · McInerney · 2020 [cited by examiner]
US 20200167834A1 · Matsuoka · 2020 [cited by examiner]
CN 109885776A · 2019 [cited by applicant]
Arya et al. “One explanation does not fit all: A toolkit and taxonomy of ai explainability techniques.” arXiv preprint arXiv:1909.03012 (2019). 18 pages. [cited by applicant]
Jung et al. “An information-theoretic approach to personalized explainable machine learning.” IEEE Signal Processing Letters 27 (2020): 825-829. [cited by applicant]
Kouki et al. “Personalized explanations for hybrid recommender systems.” Proceedings of the 24th International Conference on Intelligent User Interfaces. 2019. 12 pages. [cited by applicant]
Li et al. “A Contextual-Bandit Approach to Personalized News Article Recommendation.” arXiv preprint arXiv:1003.0146 (2010). 10 pages. [cited by applicant]
Lu et al. “Contextual multi-armed bandits.” Proceedings of the Thirteenth international conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, 2010. 8 pages. [cited by applicant]
Luo et al. “Hybrid Deep Embedding for Recommendations with Dynamic Aspect-Level Explanations.” arXiv preprint arXiv:2001.10341 (2020). 10 pages. [cited by applicant]
Mast et al. “Different approaches to build multilingual conversational systems.” International Conference on Text, Speech and Dialogue. Springer, Berlin, Heidelberg, 2002. 7 pages. [cited by applicant]
Sokol et al. “One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparency.” KI-Künstliche Intelligenz 34.2 (2020): 235-250. [cited by applicant]
Srivastava et al. “A Reference Architecture for Applications with Conversational Components.” 2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS). IEEE, 2019. 27 pages. [cited by applicant]
Tintarev et al. “Designing and evaluating explanations for recommender systems.” Recommender systems handbook. Springer, Boston, MA, 2011. 479-510. [cited by applicant]
Tintarev. “Explanations of recommendations.” Proceedings of the 2007 ACM conference on Recommender systems. 2007. 4 pages. [cited by applicant]
Tsai. “Controllability and explainability in a hybrid social recommender system.” Diss. University of Pittsburgh, 2019. 197 pages. [cited by applicant]
Zafari et al. “ReEx: An integrated architecture for preference model representation and explanation.” Expert Systems with Applications 161 (2020): 113706. 17 pages. [cited by applicant]