IP Library Granted Patent US 12,617,419
Granted Patent B2
US 12,617,419 · App. 18/542,554 · Granted May 5, 2026

Guiding a user to interact with an intelligent computing system using best practices

Inventors: Michelle Brachman (Quincy, MA); Zahra Ashktorab (Brooklyn, NY); Michael Desmond (White Plains, NY); Hyo Jin Do (Cambridge, MA); Casey Dugan (Cambridge, MA); James Johnson (Somerville, MA); Qian Pan (Canton, MA); Raj Sanjay Shah (Atlanta, GA)
Assignee: International Business Machines Corporation
B60W50/14B60K35/80B60K2360/11B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,617,419
App. No.
18/542,554
Granted
May 5, 2026
Kind
B2
Abstract

A plurality of best practice rules pertaining to best practices for interacting with a system can be received. A first user interaction from a user can received. A best practice determiner can determine whether the first user interaction fits at least one of the best practice rules. Responsive to determining, by the best practice determiner, that the first user interaction does not fit the at least one of the best practice rules, a modified user interaction can be generated by modifying the first user interaction based, at least in part, on the received plurality of best practice rules. The modified user interaction can be presented to the user.

Claims (90)

1 . A method, comprising:

receiving a plurality of best practice rules pertaining to best practices for interacting with a system, wherein the system is a smart vehicle system in a vehicle;

receiving a first user interaction from a user, wherein the first user interaction is a user control of a steering system changing a steering angle, and wherein the first user interaction is detected using a steering sensor;

determining, by a best practice determiner, whether the first user interaction fits at least one of the best practice rules;

responsive to determining, by the best practice determiner, that the first user interaction does not fit the at least one of the best practice rules, generating, using a processor, a modified user interaction by modifying the first user interaction based, at least in part, on the received plurality of best practice rules; and

presenting to the user the modified user interaction.

2 . The method of claim 1 , further comprising:

receiving a second user interaction from the user;

determining, by the best practice determiner, whether the second user interaction fits at least one of the best practice rules; and

responsive to determining, by the best practice determiner, that the second user interaction fits the at least one of the best practice rules, storing the second user interaction as a sample interaction comprising training data.

3 . The method of claim 1 , further comprising:

identifying system documentation for at least one other system;

determining best practices for the at least one other system by the best practice determiner analyzing the system documentation for the at least one other system;

determining whether the best practices for the at least one other system fit the first user interaction by comparing the first user interaction to the best practices for the at least one other system;

responsive to determining that the best practices for the at least one other system fit the first user interaction, generating a rationale explaining why the best practices for the at least one other system fit the first user interaction; and

presenting to the user the rationale explaining why the best practices for the at least one other system fit the first user interaction.

4 . The method of claim 1 , further comprising:

determining differences between the first user interaction and the best practice rules; and

outputting the determined differences to best practice descriptions of best practices for the system.

5 . The method of claim 1 , further comprising:

responsive to the steering sensor detecting the first user interaction, determining, by the best practice determiner, whether an adaptive cruise control for the vehicle is enabled while the first user interaction is detected; and

responsive to determining, by the best practice determiner, that the adaptive cruise control for the vehicle is enabled while the first user interaction is detected, determining, in real time based on the best practice rules, that best practice during use of the adaptive cruise control is for the user to keep control of steering system and for the vehicle not to drift into other lanes,

wherein the modified user interaction comprises a suggestion pertaining to safe operation of the vehicle.

6 . The method of claim 5 , further comprising:

accessing, using a transceiver, best practices for at least one other smart vehicle system;

determining whether the best practices for the at least one other smart vehicle system fit the first user interaction by comparing the first user interaction to the best practices for at least one other smart vehicle system;

responsive to determining that the best practices for the at least one other smart vehicle system fit the first user interaction, generating a rationale explaining why the best practices for the at least one other smart vehicle system fit the first user interaction; and

presenting to the user the rationale explaining why the best practices for the at least one other smart vehicle system fit the first user interaction.

7 . The method of claim 1 , wherein the best practice determiner comprises a large language model.

8 . A system, comprising:

a processor programmed to initiate executable operations comprising:

receiving a plurality of best practice rules pertaining to best practices for interacting with the system;

receiving a first user interaction from a user;

determining, by a best practice determiner, whether the first user interaction fits at least one of the best practice rules;

responsive to determining, by the best practice determiner, that the first user interaction does not fit the at least one of the best practice rules, generating a modified user interaction by modifying the first user interaction based, at least in part, on the received plurality of best practice rules; presenting to the user the modified user interaction;

identifying system documentation for at least one other system;

determining best practices for the at least one other system by the best practice determiner analyzing the system documentation for the at least one other system;

determining whether the best practices for the at least one other system fit the first user interaction by comparing the first user interaction to the best practices for the at least one other system;

responsive to determining that the best practices for the at least one other system fit the first user interaction, generating a rationale explaining why the best practices for the at least one other system fit the first user interaction; and

presenting to the user the rationale explaining why the best practices for the at least one other system fit the first user interaction.

9 . The system of claim 8 , the executable operations further comprising:

receiving a second user interaction from the user;

determining, by the best practice determiner, whether the second user interaction fits at least one of the best practice rules; and

responsive to determining, by the best practice determiner, that the second user interaction fits the at least one of the best practice rules, storing the second user interaction as a sample interaction comprising training data.

10 . The system of claim 8 , the executable operations further comprising:

determining differences between the first user interaction and the best practice rules; and

outputting the determined differences to best practice descriptions of best practices for the system.

11 . The system of claim 8 , wherein;

the system is a smart vehicle system in a vehicle;

the first user interaction from the user is a user control of a steering system changing a steering angle; and

the executable operations further comprise detecting, using a steering sensor, the first user interaction.

12 . The system of claim 11 , the executable operations further comprising:

responsive to the steering sensor detecting the first user interaction, determining, by the best practice determiner, whether an adaptive cruise control for the vehicle is enabled while the first user interaction is detected; and

responsive to determining, by the best practice determiner, that adaptive cruise control for the vehicle is enabled while the first user interaction is detected, determining, in real time based on the best practice rules, that best practice during use of the adaptive cruise control is for the user to keep control of steering system and for the vehicle not to drift into other lanes,

wherein the modified user interaction comprises a suggestion pertaining to safe operation of the vehicle.

13 . The system of claim 12 , the executable operations further comprising:

accessing, using a transceiver, best practices for at least one other smart vehicle system;

determining whether the best practices for the at least one other smart vehicle system fit the first user interaction by comparing the first user interaction to the best practices for at least one other smart vehicle system;

responsive to determining that the best practices for the at least one other smart vehicle system fit the first user interaction, generating a rationale explaining why the best practices for the at least one other smart vehicle system fit the first user interaction; and

presenting to the user the rationale explaining why the best practices for the at least one other smart vehicle system fit the first user interaction.

14 . The system of claim 8 , wherein the best practice determiner uses a transformer model architecture.

15 . A computer program product, comprising:

one or more computer readable storage mediums having program code stored thereon, the program code stored on the one or more computer readable storage mediums collectively executable by a data processing system to initiate operations including:

receiving a plurality of best practice rules pertaining to best practices for interacting with a system, wherein the system is a smart vehicle system in a vehicle;

receiving a first user interaction from a user, wherein the first user interaction from the user is a user control of a steering system changing a steering angle, and wherein the first user interaction is detected using a steering sensor;

determining, by a best practice determiner, whether the first user interaction fits at least one of the best practice rules;

responsive to determining, by the best practice determiner, that the first user interaction does not fit the at least one of the best practice rules, generating a modified user interaction by modifying the first user interaction based, at least in part, on the received plurality of best practice rules; and

presenting to the user the modified user interaction.

16 . The computer program product of claim 15 ,

wherein the program code is executable by the data processing system to initiate operations further comprising:

receiving a second user interaction from the user;

determining, by the best practice determiner, whether the second user interaction fits at least one of the best practice rules; and

responsive to determining, by the best practice determiner, that the second user interaction fits the at least one of the best practice rules, storing the second user interaction as a sample interaction comprising training data.

17 . The computer program product of claim 15 ,

wherein the program code is executable by the data processing system to initiate operations further comprising:

identifying system documentation for at least one other system;

determining best practices for the at least one other system by the best practice determiner analyzing the system documentation for the at least one other system;

determining whether the best practices for the at least one other system fit the first user interaction by comparing the first user interaction to the best practices for the at least one other system;

responsive to determining that the best practices for the at least one other system fit the first user interaction, generating a rationale explaining why the best practices for the at least one other system fit the first user interaction; and

presenting to the user the rationale explaining why the best practices for the at least one other system fit the first user interaction.

18 . The computer program product of claim 15 ,

wherein the program code is executable by the data processing system to initiate operations further comprising:

determining differences between the first user interaction and the best practice rules; and

outputting the determined differences to best practice descriptions of best practices for the system.

19 . The computer program product of claim 15 ,

wherein the program code is executable by the data processing system to initiate operations further comprising:

responsive to the steering sensor detecting the first user interaction, determining, by the best practice determiner, whether an adaptive cruise control for the vehicle is enabled while the first user interaction is detected; and

responsive to determining, by the best practice determiner, that adaptive cruise control for the vehicle is enabled while the first user interaction is detected, determining, in real time based on the best practice rules, that best practice during use of the adaptive cruise control is for the user to keep control of steering system and for the vehicle not to drift into other lanes,

wherein the modified user interaction comprises a suggestion pertaining to safe operation of the vehicle.

20 . The computer program product of claim 15 , wherein the best practice determiner determines whether adaptive cruise control is enabled.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: BRACHMAN, MICHELLE; ASHKTORAB, ZAHRA; DESMOND, MICHAEL; DO, HYO JIN; DUGAN, CASEY; JOHNSON, JAMES; PAN, QIAN; SHAH, RAJ SANJAY
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 066063/0204 →
Continuity (1)
Related Publication 20250196874A1 · Jun 19, 2025
References Cited (36)
US 9727326B2 · Ciudad et al. · 2017 [cited by applicant]
US 9751534B2 · Fung · 2017 [cited by examiner]
US 11074054B1 · Weibel · 2021 [cited by examiner]
US 20200285676A1 · Lawson et al. · 2020 [cited by applicant]
US 20210232373A1 · Weibel · 2021 [cited by examiner]
US 20220219691A1 · Maleki · 2022 [cited by examiner]
US 20240278770A1 · Zhao · 2024 [cited by examiner]
US 20240278831A1 · Matsumoto · 2024 [cited by examiner]
CN 116483977A · 2023 [cited by applicant]
CN 116483980A · 2023 [cited by applicant]
CN 116525068A · 2023 [cited by applicant]
CN 116595611A · 2023 [cited by applicant]
CN 116645243A · 2023 [cited by applicant]
EP 1612703A1 · 2006 [cited by examiner]
EP 3730332A1 · 2020 [cited by examiner]
EP 4130992A1 · 2023 [cited by examiner]
JP 2019220110A · 2019 [cited by applicant]
KR 102249623B1 · 2021 [cited by applicant]
Boggust et al., “Saliency Cards: A Framework to Characterize and Compare Saliency Methods”, arXiv:2206.02958v2 [cs.LG], May 30, 2023, 19 pages. [cited by applicant]
Brachman et al., “Follow the Successful Herd: Towards Explanations for Improved Use and Mental Models of Natural Language Systems”, IUI '23: Proceedings of the 28th International Conference on Intelligent User Interface… [cited by applicant]
Cabra-Acela et al., “On Using Information Retrieval to Recommend Machine Learning Good Practices for Software Engineers”, arXiv:2308.12095v2 [cs.SE], Aug. 25, 2023, 5 pages. [cited by applicant]
Chadha et al., “GPT-NeoXT-Chat-Base-20B foundation model for chatbot applications is now available on Amazon SageMaker”, https://aws.amazon.com/blogs/machine-learning/gpt-neoxt-chat-base-20b-foundation-model-for-chatbot… [cited by applicant]
Cortés-Coy et al., “On Automatically Generating Commit Messages via Summarization of Source Code Changes”, SCAM '14: Proceedings of the 2014 IEEE 14th International Working Conference on Source Code Analysis and Manipul… [cited by applicant]
Gero et al., “Mental Models of AI Agents in a Cooperative Game Setting”, CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Apr. 23, 2020, 12 pages. [cited by applicant]
Hodhod et al., “Closing the Cognitive Gap between Humans and Interactive Narrative Agents Using Shared Mental Models”, IUI '16: Proceedings of the 21st International Conference on Intelligent User Interfaces, Mar. 7, 20… [cited by applicant]
Jacovi et al., “Contrastive Explanations for Model Interpretability”, arXiv:2103.01378v3 [cs.CL], Sep. 14, 2021, 15 pages. [cited by applicant]
Jeremy J Webb, “Proof of Concept: Using ChatGPT to Teach Emergency Physicians How to Break Bad News”, Cureus, https://pubmed.ncbi.nlm.nih.gov/37303324/, May 9, 2023, 6 pages. [cited by applicant]
Lanciano et al., “Analyzing Declarative Deployment Code with Large Language Models”, 13th International Conference on Cloud Computing and Services Science, Jan. 2023, 8 pages. [cited by applicant]
Liang et al., “Holistic Evaluation of Language Models”, arXiv:2211.09110v2 [cs.CL], Oct. 1, 2023, 162 pages. [cited by applicant]
Liu et al., “ATOM: Commit Message Generation Based on Abstract Syntax Tree and Hybrid Ranking”, arXiv:1912.02972v2 [cs.SE], Nov. 11, 2020, 17 pages. [cited by applicant]
No Author, “Deploy FLAN-UL2 20B on Amazon SageMaker”, https://www.philschmid.de/deploy-flan-ul2-sagemaker, Mar. 20, 2023, 8 pages. [cited by applicant]
No Author, “Introduction: Use natural language to explore data with Power Bi Q&A”, https://web.archive.org/web/20240107142006/https://learn.microsoft.com/en-us/power-bi/natural-language/q-and-a-intro, Sep. 30, 2023, 6 p… [cited by applicant]
No Author, “Make Alexa Calls with Your Voice”, https://web.archive.org/web/20200317190644/https://www.amazon.com/gp/help/customer/display.html?nodeId=GEC6XC297YU93LDA, Mar. 17, 2020, 2 pages. [cited by applicant]
Wang et al., “Watch Out for Updates: Understanding the Effects of Model Explanation Updates in AI-Assisted Decision Making”, CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Apr. 19… [cited by applicant]
Weisz et al., “BigBlueBot: Teaching Strategies for Successful Human-Agent Interactions”, IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces, Mar. 17, 2019, pp. 448-459. [cited by applicant]
Weisz et al., “Perfection Not Required? Human-AI Partnerships in Code Translation”, arXiv:2104.03820v1 [cs.HC], Apr. 8, 2021, 18 pages. [cited by applicant]