IP Library Granted Patent US 12,602,385
Granted Patent B2
US 12,602,385 · App. 18/453,127 · Granted Apr 14, 2026

Context-aware relevance modeling in conversational systems

Inventors: Hui Wan (White Plains, NY); Xiaodong Cui (Chappaqua, NY); Songtao Lu (White Plains, NY); Marina Danilevsky Hailpern (San Jose, CA)
Assignee: International Business Machines Corporation
G06F16/24575
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,385
App. No.
18/453,127
Granted
Apr 14, 2026
Kind
B2
Abstract

A method, computer system, and a computer program product are provided for a context-aware relevancy modelling in conversational systems. A user query is received. A latent static content d is selected from a corpus of content D. A latent set of context C from a set of external context Cu is also selected. A result is generated using a scoring function and using the latent static content d from a corpus D and the latent set of context C from the set of external contexts CU so as to provide a most relevant context-base search response to said user query q. The result provides a most relevant context-base search response to said user query q. A response is then generated based on said result using said scoring function result to said user query q.

Claims (43)

1 . A method for providing context-aware relevancy modelling in conversational systems, comprising:

receiving a user query q;

processing said user query q using a scoring function, wherein said processing include collecting information relating to said user query q from one or more other users;

selecting a latent static content d from a corpus of content D and a latent set of context C from a set of external context Cu;

generating a result using said scoring function having said latent static content d from said corpus of content D and said latent set of context C from a set of external contexts CU, wherein said result generated is responsive to a most relevant context-base search to said user query q;

performing a search using said result;

generating a response based on the search performed using said result and using said scoring function, in response to said user query q; and

formulating from a dialogue extracted from user previous interactions, selecting said latent static content d from the search performed using said corpus of content D.

2 . The method of claim 1 , wherein the scoring function has a fusion function and a relevance function component.

3 . The method of claim 1 , wherein said most relevant context-base search includes an inference component.

4 . The method of claim 1 , wherein an inference is generated via at least one of a greedy search and beam search.

5 . The method of claim 4 , wherein said beam search is in a direction from q to d to C and a direction from q to C to d, wherein q is the user query and C is latent set of context and d is a latent static content.

6 . The method of claim 1 , wherein said response is stored.

7 . The method of claim 6 , wherein said response that is stored is used to train an artificial intelligence (AI) engine having one or more machine language models.

8 . The method of claim 7 , wherein one or more machine learning models includes a large language model (LLM).

9 . The method of claim 1 , given said corpus of content D, and said set of latent context C, and said user query q, wherein said latent set of context C={c1, . . . ,cn} from Cu, that that are the most relevant to the query q.

10 . A computer system for restoring an interrupted communication session, comprising:

one or more processors, one or more computer-readable memories and one or more computer-readable storage media;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to receive a user query q;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to process said user query q using a scoring function, wherein said processing include collecting information relating to said user query q from one or more other users;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to select a latent static content d from a corpus of content D and a latent set of context C from a set of external context Cu;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to generate a result using said scoring function having said latent static content d from said corpus of content D and said latent set of context C from a set of external contexts CU, wherein said result generated is responsive to a most relevant context-base search to said user query q;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform a search using said result;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to generate a response based on the search performed using said result and using said scoring function, in response to said user query q; and

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to formulate from a dialogue extracted from user previous interactions, selecting said latent static content d from the search performed using said corpus of content D.

11 . The computer system of claim 10 , wherein the scoring function has a fusion function and a relevance function component.

12 . The computer system of claim 10 , wherein a search result that is updated includes an inference component.

13 . The computer system of claim 10 , wherein the most relevant context-base search includes an inference component.

14 . The computer system of claim 13 , wherein said search is in a direction q to d to C and a direction from q to C to d wherein q is the user query and C is latent set of context and d is a latent static content.

15 . The computer system of claim 10 , wherein said response is stored.

16 . The computer system of claim 15 , wherein a stored result is used to train an artificial intelligence (AI) engine having one or more machine language models.

17 . The computer system of claim 15 , wherein one or more machine learning models includes a large language model (LLM).

18 . A computer program product for providing cleansing steps for using a plurality of different transformation assets, the computer program product comprising:

one or more non-transitory computer readable storage media, one or more processors and one or more memories;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of one or more computer-readable memories, to receive a user query q;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to process said user query q using a scoring function, wherein said processing include collecting information relating to said user query q from one or more other users;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to select a latent static content d from a corpus of content D and a latent set of context C from a set of external context Cu;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to generate a result using said scoring function having said latent static content d from said corpus of content D and said latent set of context C from a set of external contexts CU, wherein said result generated is responsive to a most relevant context-base search to said user query q;

program instructions, stored on at least one of one or more of a plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform a search using said result;

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to generate a response based on the search performed using said result and using said scoring function, in response to said user query q; and

program instructions, stored on at least one of the one or more of said plurality of storage media for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to formulate from a dialogue extracted from user previous interactions, selecting said latent static content d from the search performed using said corpus of content D.

19 . The computer program product of claim 18 , wherein said scoring function has a fusion function and a relevance function component.

20 . The computer program product of claim 18 , wherein a first search result that is updated includes an inference component and said inference component is generated via at least one of a greedy search and beam search.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2023
From: WAN, HUI; CUI, XIAODONG; LU, SONGTAO; HAILPERN, MARINA DANILEVSKY
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 064653/0690 →
Continuity (1)
Related Publication 20250068635A1 · Feb 27, 2025
References Cited (22)
US 10509829B2 · Rambhia · 2019 [cited by applicant]
US 10565279B2 · Reddy · 2020 [cited by applicant]
US 10664527B1 · Henderson · 2020 [cited by examiner]
US 11379529B2 · Fenton · 2022 [cited by applicant]
US 11449556B2 · Jawagal · 2022 [cited by applicant]
US 11455087B2 · Burke · 2022 [cited by applicant]
US 11971914B1 · Watson · 2024 [cited by examiner]
US 20140229462A1 · Lo · 2014 [cited by examiner]
US 20160041991A1 · Sahuguet · 2016 [cited by examiner]
US 20180060325A1 · Taylor · 2018 [cited by examiner]
US 20210240776A1 · Jawagal · 2021 [cited by examiner]
US 20230325603A1 · Galley · 2023 [cited by examiner]
US 20240265041A1 · Rennie · 2024 [cited by examiner]
WO 2025040297A1 · 2025 [cited by applicant]
Alami Merrouni, et al., “Toward Contextual Information Retrieval: A Review and Trends”, ScienceDirect, Procedia Computer Science 148 (2019) pp. 191-200, Elsevier, Second International Conference on Intelligent Computing… [cited by applicant]
Feng, et al., “Learning Multi-Turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation,” ACM Transactions on Information Systems, vol. 41, No. 4, Article 115, Apr. 2023, pp. 115-1… [cited by applicant]
Hua, et al., “Learning to Detect Relevant Context and Knowledge for Response Selection in Retrieval-Based Dialogue Systems,” ACM, CIKM '20, Oct. 19-23, 2020, pp. 525-534. [cited by applicant]
Limbu, et al., “A Framework for Contextual Information Retrieval from the WWW”, ResearchGate, ISCA 14th International Conference on Intelligent and Adaptive Systems and Software Engineering (IASSE-05), Toronto, Canada, … [cited by applicant]
Limbu, et al., “Improving Web Search Using Contextual Retrieval”, arXiv: 1407.6101, Jul. 23, 2014, 7 pgs., https://arxiv.org/abs/1407.6101. [cited by applicant]
Friedman et al. “Leveraging Large Language Models in Conversational Recommender Systems”, arXiv:2305.07961, May 16, 2023, 24 pages. [cited by applicant]
International Searching Authority, “Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or Declaration,” Patent Cooperation Treaty, Nov. 11, 2… [cited by applicant]
Zhu et al. “Large Language Models for Information Retrieval: A Survey”, arXiv:2308.07107, Sep. 4, 2024, 35 pages. [cited by applicant]