IP Library Granted Patent US 12,705,266
Granted Patent B2
US 12,705,266 · App. 18/353,449 · Granted Aug 11, 2026

Method and apparatus for AI-assisted virtual assistant for SME agent

Inventors: Paul Sheward (Chicago, IL); Chung-Sheng Li (Scarsdale, NY); Scott Likens (Austin, TX); Saverio Fato (Wilton Manors, FL); Joseph Doyle Harrington (Granite Bay, CA); Joseph David Voyles (Louisville, KY); Jonathan B. Rhine (Suffern, NY); Alexander Nicholas Boldizsar (Woodstock, CT); Winnie Cheng (West New York, NJ); Todd Christopher Morrill (Newburgh, NY); Yuan Wan (Irvine, CA); William Spotswood Seward (Los Angeles, CA)
Assignee: PwC Product Sales LLC
G06F16/3329
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,705,266
App. No.
18/353,449
Filed
Jul 17, 2023
Granted
Aug 11, 2026
Kind
B2
Art Unit
2659
USPC
704/9
Abstract

A method for providing a hybrid AI and human electronic communication interface includes receiving a first electronic transmission comprising a user query from a user device. The method further includes automatically generating, by processing the user query by a set of AI models, an automatic response to the user query. The method further includes electronically transmitting the automatic response to the user device. The method further includes receiving, from the user device, a second electronic transmission comprising a user input in response to the automatic response. The method further includes determining, based at least in part on processing the user input, that a set of criteria is met; and in accordance with the determination that the set of criteria are met, automatically instantiating an electronic communication connection between the user device and a second user device.

Claims (64)

1 . A method for providing a hybrid AI and human electronic communication interface, comprising:

receiving a first electronic transmission comprising a user query from a user device;

automatically generating, by processing the user query by a set of AI models, an automatic response to the user query;

electronically transmitting the automatic response to the user device;

receiving, from the user device, a second electronic transmission comprising a user input in response to the automatic response;

determining, based at least in part on processing the user input, that a set of criteria is met,

wherein determining that the set of criteria is met comprises evaluating a plurality of criteria,

wherein the plurality of criteria are evaluated based on a predetermined order, and

determining that the set of criteria is met when at least a threshold number of the plurality of criteria are satisfied,

wherein processing the user input comprises performing sentiment analysis on a text of the user input to determine a sentiment of the user input, and

wherein the set of criteria comprises the sentiment being a negative sentiment; and

in accordance with the determination that the set of criteria are met, automatically instantiating an electronic communication connection between the user device and a second user device.

2 . The method of claim 1 ,

wherein the user query is a first query,

wherein the user input comprises a second query,

wherein processing the user input comprises determining a similarity between the first query and the second query, and

wherein determining the similarity between the first query and the second query comprises:

generating a first text embedding for the first query and a second text embedding for the second query; and

determining a similarity score between the first text embedding and the second text embedding.

3 . The method of claim 1 , wherein the user input comprises one or more additional queries, wherein processing the user input comprises determining a quantity of the one or more additional queries, and wherein the set of criteria comprises the quantity satisfying a threshold number of queries.

4 . The method of claim 1 , wherein performing the sentiment analysis comprises detecting one or more keywords in the text of the user input.

5 . The method of claim 1 , wherein the user input comprises visual facial data of a user of the user device, wherein processing the user input comprises processing the visual facial data by a second set of AI models, and wherein the set of criteria comprises a negative sentiment output by the second set of AI models.

6 . The method of claim 1 , wherein the user input comprises negative feedback on the automatic response to the user query, and wherein the set of criteria comprises receiving the negative feedback.

7 . The method of claim 1 , further comprising storing the user query and an expert response to the user query provided by the second user device in a data store, wherein the user query is associated with the expert response in the data store.

8 . The method of claim 7 , further comprising automatically generating an improved automatic response to a subsequent user query based on the expert response stored in the data store.

9 . The method of claim 1 , wherein automatically generating the automatic response comprises determining that a similarity score between the user query and a stored query stored in a data store satisfies a similarity threshold, wherein the stored query is associated with a data structure comprising one or more supplemental queries of the stored query, and wherein the automatic response is generated based on information associated with the one or more supplemental queries.

10 . The method of claim 9 , further comprising:

receiving, from the second user device, subject matter information corresponding to an expert response provided to the user query by the second user device; and

updating the data structure with the subject matter information.

11 . The method of claim 10 , further comprising automatically generating an improved automatic response to a subsequent user query based on the updated data structure with the subject matter information.

12 . The method of claim 9 , wherein the data structure is a decision tree, wherein each of the one or more supplemental queries is a branching criteria for the decision tree, and wherein the information associated with the one or more supplemental queries are leaf nodes of the decision tree.

13 . The method of claim 1 , wherein automatically generating the automatic response comprises:

determining that a set of similarity scores between the user query and each of a plurality of stored queries stored in a data store is below a similarity threshold; and

generating one or more recommended queries to the user, wherein each of the one or more recommended queries is generated based on the user query.

14 . The method of claim 1 , wherein the second user device is selected from a set of user devices, wherein each user device of the set of user devices corresponds to one of a set of subject matter expert profiles, wherein the second user device is selected based on analyzing features in each of the set of subject matter expert profiles, wherein the features comprise at least one of:

an engagement history,

a success rate in generating responses to user queries, and

education and experience credentials.

15 . The method of claim 1 , further comprising:

transmitting, to the user device, a set of subject matter expert profiles to the user device; and

receiving, from the user device, a third electronic transmission comprising a selected subject matter expert profile, wherein the second user device corresponds to the selected subject matter expert profile.

16 . The method of claim 1 , further comprising:

automatically retrieving data on a user associated with the user device from a data store; and

wherein automatically instantiating the electronic communication comprises transmitting, to the second user device, the data on the user.

17 . A system for providing a hybrid AI and human electronic communication interface, the system comprising:

one or more processors; and

a memory coupled to the one or more processors comprising instructions executable by the one or more processors, the processors operable when executing the instructions to:

receive a first electronic transmission comprising a user query from a user device;

automatically generate, by processing the user query by a set of AI models, an automatic response to the user query;

electronically transmit the automatic response to the user device;

receive, from the user device, a second electronic transmission comprising a user input in response to the automatic response;

determine, based at least in part on processing the user input, that a set of criteria is met, wherein determining that the set of criteria is met comprises evaluating a plurality of criteria, wherein the plurality of criteria are evaluated based on a predetermined order, and determining that the set of criteria is met when at least a threshold number of the plurality of criteria are satisfied, and

wherein processing the user input comprises performing sentiment analysis on a text of the user input to determine a sentiment of the user input, and

wherein the set of criteria comprises the sentiment being a negative sentiment; and

in accordance with the determination that the set of criteria are met, automatically instantiate an electronic communication connection between the user device and a second user device.

18 . A non-transitory computer-readable storage medium storing instructions for providing a hybrid AI and human electronic communication interface, the instructions operable when executed by one or more processors of a system to cause the system to:

receive a first electronic transmission comprising a user query from a user device;

automatically generate, by processing the user query by a set of AI models, an automatic response to the user query;

electronically transmit the automatic response to the user device;

receive, from the user device, a second electronic transmission comprising a user input in response to the automatic response;

determine, based at least in part on processing the user input, that a set of criteria is met, wherein determining that the set of criteria is met comprises evaluating a plurality of criteria, wherein the plurality of criteria are evaluated based on a predetermined order, and determining that the set of criteria is met when at least a threshold number of the plurality of criteria are satisfied, and

wherein processing the user input comprises performing sentiment analysis on a text of the user input to determine a sentiment of the user input, and

wherein the set of criteria comprises the sentiment being a negative sentiment; and

in accordance with the determination that the set of criteria are met, automatically instantiate an electronic communication connection between the user device and a second user device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2025
From: PRICEWATERHOUSECOOPERS ADVISORY SERVICES LLC
To: PWC PRODUCT SALES LLC
Reel/Frame 069724/0064 →
EMPLOYMENT AGREEMENT Recorded Dec 23, 2024
From: TODD MORRILL
To: PRICEWATERHOUSECOOPERS ADVISORY SERVICES LLC
Reel/Frame 069761/0479 →
Continuity (1)
Related Publication 20250028742A1 · Jan 23, 2025
References Cited (49)
US 5331554A · Graham · 1994 [cited by examiner]
US 5754939A · Herz · 1998 [cited by examiner]
US 8375049B2 · Bailey et al. · 2013 [cited by applicant]
US 10031950B2 · Ullman · 2018 [cited by examiner]
US 10360265B1 · Agarwal · 2019 [cited by examiner]
US 10614101B2 · Agarwal · 2020 [cited by examiner]
US 12282501B2 · Sheward · 2025 [cited by examiner]
US 20030046277A1 · Jackson et al. · 2003 [cited by applicant]
US 20030144895A1 · Aksu · 2003 [cited by examiner]
US 20050055341A1 · Haahr · 2005 [cited by examiner]
US 20050118557A1 · Sumner, II · 2005 [cited by examiner]
US 20070203894A1 · Jones et al. · 2007 [cited by applicant]
US 20100299342A1 · Gustafson · 2010 [cited by examiner]
US 20130036062A1 · Natarajan et al. · 2013 [cited by applicant]
US 20130132203A1 · Cheng · 2013 [cited by examiner]
US 20150074096A1 · Roche · 2015 [cited by examiner]
US 20150088733A1 · Monastyrsky · 2015 [cited by examiner]
US 20160110422A1 · Roytman · 2016 [cited by examiner]
US 20170055895A1 · Des Jardins · 2017 [cited by examiner]
US 20170193997A1 · Chen · 2017 [cited by examiner]
US 20180054464A1 · Zhang et al. · 2018 [cited by applicant]
US 20180108025A1 · Agarwal · 2018 [cited by examiner]
US 20180357286A1 · Wang et al. · 2018 [cited by applicant]
US 20190163805A1 · Agarwal · 2019 [cited by examiner]
US 20190220695A1 · Nefedov · 2019 [cited by applicant]
US 20200034357A1 · Panuganty et al. · 2020 [cited by applicant]
US 20200202194A1 · Wu · 2020 [cited by examiner]
US 20210014354A1 · Ly et al. · 2021 [cited by applicant]
US 20210042800A1 · Chandra · 2021 [cited by examiner]
US 20210406735A1 · Nahamoo · 2021 [cited by examiner]
US 20220357177A1 · Skupin · 2022 [cited by applicant]
US 20230353516A1 · Banerjee · 2023 [cited by examiner]
US 20240168982A1 · Patnaik et al. · 2024 [cited by applicant]
US 20240338393A1 · Malon et al. · 2024 [cited by applicant]
US 20240378389A1 · Rose et al. · 2024 [cited by applicant]
US 20240419694A1 · Sheward · 2024 [cited by examiner]
US 20250028742A1 · Sheward · 2025 [cited by examiner]
US 20250231971A1 · Sheward et al. · 2025 [cited by applicant]
Al-Kofahi et al. (2001) “A machine learning approach to prior case retrieval,” Proceedings of the 8th International Conference on Artificial Intelligence and Law; pp. 88-93. [cited by applicant]
International Search Report and Written Opinion mailed Nov. 6, 2023, directed to International Application No. PCT/US2023/070333; 11 pages. [cited by applicant]
International Search Report and Written Opinion mailed Oct. 6, 2023, directed to International Application No. PCT/US2023/068607; 11 pages. [cited by applicant]
Lu, et al. (2012) “Bringing order to legal documents—an issue-based recommendation system via cluster association,” in Proceedings of the International Conference on Knowledge Engineering and Ontology Development, vol. … [cited by applicant]
Westermann, et al. “Paragraph similarity scoring and fine-tuned BERT for legal information retrieval and entailment,” New Frontiers in Artificial Intelligence: JSAI-isAI 2020 Workshops, Jurisin, Lenls 2020 Workshops, Vi… [cited by applicant]
Francesconi et al. “Legal Knowledge and Information Systems,” JURIX 2022: The Thirty-fifth Annual Conference, Dec. 14-16, 2022, Saarbrücken, Germany; 324 pages. [cited by applicant]
Kassner et al. (Oct. 2023). “Language Models with Rationality,” arXiv:2305.14250v2; 12 pages. [cited by applicant]
Lin et al. (May 2024). “Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models,” arXiv:2305.19187v3; 28 pages. [cited by applicant]
Rozen et al. (May 2021). “Answering Product-Questions by Utilizing Questions from Other Contextually Similar Products,” arXiv:2105.08956v1; 12 pages. [cited by applicant]
Sheward et al., U.S. Office Action dated Jan. 21, 2026, directed to U.S. Appl. No. 19/172,308; 19 pages. [cited by applicant]
Tian et al. (Oct. 2023). “Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback,” arXiv:2305.14975v2; 10 pages. [cited by applicant]