IP Library Granted Patent US 12,711,392
Granted Patent B1
US 12,711,392 · App. 19/287,703 · Granted Aug 18, 2026

Fine-tuned artificial intelligence model with event mapping features

Inventors: Byungkyu Kang (San Diego, CA); Farzaneh Khoshnevisan (San Diego, CA); Ramakrishnan Sathyavageeswaran (Mountain View, CA); Swapnil Parekh (Mountain View, CA); Andrew Thomas Mattarella-Micke (Palo Alto, CA); Maya Vered Livshits (Campbell, CA); Katharine Vanessa Wurtzell (San Diego, CA); Royston Soares (San Francisco, CA); Sonia Sharma (Fremont, CA); Nicholas Kevin Anthony Yee (Toronto, CA); Samir Patel (Calgary, CA); Yvonne Yi Wen Ng (Toronto, CA); Joseph Liu (San Diego, CA); Shivakumara Narayanaswamy (Mountain View, CA)
Assignee: Intuit Inc.
G06N3/092G06F16/35G06N3/0475
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,711,392
App. No.
19/287,703
Granted
Aug 18, 2026
Kind
B1
Abstract

Certain aspects of the disclosure provide a method for fine-tuning a language model (LM) including obtaining a first conversation stream of a first conversation, wherein the first conversation stream includes one or more messages and one or more events; mapping an event to at least one message of the one or more messages, the mapping being performed using at least one of event-based labeling or content-based labeling; and fine tuning a language model (LM) using the event and the at least one message that are mapped, the fined-tuned LM being configured for: determining one or more tools that are external to the fine-tuned LM and invokable, by the fine-tuned LM, at least to generate an output that is related to the event and the at least one message, the output being usable by the fine-tuned LM during a second conversation to perform one or more actions.

Claims (37)

1 . A method, comprising:

obtaining a first conversation stream of a first conversation, wherein the first conversation stream includes one or more messages and one or more events;

mapping an event of the one or more events to at least one message of the one or more messages, wherein the mapping is performed using event-based labeling and comprises:

determining a first message of the at least one message that is closest in time to the event and precedes the event;

determining one or more additional messages of the at least one message that precede the first message, wherein a time delta between an earliest message of the one or more additional messages and the first message is within a threshold; and

determining an event type corresponding to the event; and

fine-tuning a language model (LM) according to the mapping of the event to the at least one message at least by using the event type as a label that is input to the LM and the at least one message as input data to the LM, the fine-tuning of the LM comprising adjusting one or more LM parameters such that the fine-tuned LM is configured for:

determining one or more tools that are external to the fine-tuned LM and invokable, by the fine-tuned LM, at least to generate an output that is related to the event type, the event, and the at least one message, the output being usable by the fine-tuned LM during a second conversation to perform one or more actions.

2 . The method of claim 1 , wherein the event type is a ground truth label for determining the one or more tools.

3 . The method of claim 1 , wherein:

the first message and the one or more additional messages comprise transcript data, and

the mapping further comprises joining the transcript data with the event.

4 . The method of claim 1 , wherein the event is another label usable to fine-tune the LM.

5 . The method of claim 1 , wherein:

the mapping is performed further using content-based labeling, and

the mapping comprises:

determining a content-based label based on a similarity measure between transcript data of the at least one message and a selected message; and

selecting the content-based label as a tool of the one or more tools if the similarity measure exceeds a similarity threshold.

6 . The method of claim 1 , wherein fine-tuning the LM comprises setting an input limit and an output limit for a prompt of the LM based on a quantity of tokens, the input limit and the output limit being set to satisfy a latency threshold of the LM.

7 . The method of claim 6 , wherein the quantity of tokens is at least one of a maximum quantity of tokens that meets a generation criterion or a set of tokens associated with the one or more LM parameters.

8 . The method of claim 1 , further comprising:

deploying the fine-tuned LM in a system; and

using the deployed fine-tuned LM to:

determine the one or more tools while the second conversation is ongoing; and

perform the one or more actions using the one or more tools.

9 . The method of claim 8 , wherein the one or more actions are performed within an interval of time measured from a start time of a corresponding message of the second conversation.

10 . An apparatus comprising a processing system that includes one or more memories and one or more processors coupled to the one or more memories, the processing system configured to cause the apparatus to:

obtain a first conversation stream of a first conversation, wherein the first conversation stream includes one or more messages and one or more events;

map an event of the one or more events to at least one message of the one or more messages, wherein the mapping is performed using event-based labeling and the processing system that is configured to cause the apparatus to map the event of the one or more events to the at least one message of the one or more messages is further configured to:

determine a first message of the at least one message that is closest in time to the event and precedes the event;

determine one or more additional messages of the at least one message that precede the first message, wherein a time delta between an earliest message of the one or more additional messages and the first message is within a threshold; and

determine an event type corresponding to the event; and

fine-tune a language model (LM) according to the mapping of the event to the at least one message at least by using the event type as a label that is input to the LM and the at least one message as input data to the LM, wherein the processing system that is configured to cause the apparatus to fine-tune the LM is further configured to adjust one or more LM parameters such that the fine-tuned LM is configured to:

determine one or more tools that are external to the fine-tuned LM and invokable, by the fine-tuned LM, at least to generate an output that is related to the event type, the event, and the at least one message, the output being usable by the fine-tuned LM during a second conversation to perform one or more actions.

11 . The apparatus of claim 10 , wherein the event type is a ground truth label for determining the one or more tools.

12 . The apparatus of claim 10 , wherein the event is another label usable to fine-tune the LM.

13 . The apparatus of claim 10 , wherein the processing system that is configured to cause the apparatus to fine-tune the LM is further configured to set an input limit and an output limit for a prompt of the LM based on a quantity of tokens.