IP Library Granted Patent US 12,737,283
Granted Patent B1
US 12,737,283 · App. 19/213,065 · Granted Sep 15, 2026

System and method for automated testing of interaction summary evaluation system

Inventors: Vineta Livingstone (Iselin, NJ); Damola Olugboji (Monroe, NJ)
Assignee: Morgan Stanley Services Group Inc.
G06F11/3668G10L13/08H04N7/155
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,737,283
App. No.
19/213,065
Granted
Sep 15, 2026
Kind
B1
Abstract

A system and method for testing an interaction evaluation system may execute a process to control an e-mail application, CRM application and/or a communications application, the communications application hosting one or more of audio and video communications; where the process is provide an audio stream to the communications application, the audio stream including a simulated conversation among a plurality of simulated participants. The process may cause the communications application to conduct a meeting or interaction and may cause an interaction evaluation system to provide a summary for the meeting or interaction. The process may evaluate the functioning of one or more of the e-mail application, CRM application and/or video communications application. A prompt control process may create and provide to an LLM (large language model) prompts to cause the LLM to create text output, and the text output may be provided to a text-to-speech process to produce the audio stream.

Claims (34)

1 . A method for testing an interaction evaluation system, the method comprising:

executing by a computer processor, a process to control an e-mail application and a communications application, the communications application hosting one or more of audio and video communications;

the process to:

control the email application to automatically create a meeting with a plurality of simulated participants and send a meeting invitation to e-mail addresses of the simulated participants,

simulate the meeting by providing an audio stream from the process to the communications application, the audio stream comprising a simulated conversation among the plurality of simulated participants, wherein the audio stream includes a simulation of conversation for each of the plurality of simulated participants; and

causing an interaction evaluation system to provide a summary for the meeting;

wherein the process is to evaluate the functioning of a customer relations management (CRM) system which receives the summary of the meeting from an interaction evaluation system.

2 . The method of claim 1 , wherein the process is to evaluate the functioning of one or more of the e-mail application and video communications application.

3 . The method of claim 1 , comprising executing a prompt control process to provide to an LLM (large language model) prompts to cause the LLM to create text output, and providing the text output to a text-to-speech process to produce the audio stream.

4 . The method of claim 1 , comprising causing the communications application to conduct a meeting.

5 . The method of claim 1 , comprising a prompt control process inputting an input configuration file defining the parameters of a conversation, the prompt control process to cause an LLM to create text output, and to provide the text output to a text-to-speech process to produce the audio stream.

6 . The method of claim 1 , wherein at least one of the simulated participants corresponds to a browser process controlled by the process, the browser process entering input to the communications application.

7 . A system for testing an interaction evaluation system, the system comprising:

a memory; and

a computer processor configured to execute a process to control an e-mail application and a communications application, the communications application hosting one or more of audio and video communications;

the process to:

control the email application to automatically create a meeting with a plurality of simulated participants and send a meeting invitation to e-mail addresses of the simulated participants,

simulate the meeting by providing an audio stream from the process to the communications application, the audio stream comprising a simulated conversation among the plurality of simulated participants, wherein the audio stream includes a simulation of conversation for each of the plurality of simulated participants; and

wherein the processor is to cause an interaction evaluation system to provide a summary for the meeting;

wherein the process is to evaluate the functioning of a customer relations management (CRM) system which receives the summary of the meeting from an interaction evaluation system.

8 . The system of claim 7 , wherein the process is to evaluate the functioning of one or more of the e-mail application and video communications application.

9 . The system of claim 7 , wherein the processor is to execute a prompt control process to provide to an LLM (large language model) prompts to cause the LLM to create text output, and providing the text output to a text-to-speech process to produce the audio stream.

10 . The system of claim 7 , wherein the processor is to cause the communications application to conduct a meeting.

11 . The system of claim 7 , comprising a prompt control process inputting an input configuration file defining the parameters of a conversation, the prompt control process to cause an LLM to create text output, and to provide the text output to a text-to-speech process to produce the audio stream.

12 . A method for operating an interaction evaluation system, the method comprising:

executing by a computer processor, a process to control an e-mail application to create a meeting and to control and a videoconferencing application to host the meeting;

the process to:

control the email application to automatically create the meeting with a plurality of simulated multiple participants and send a meeting invitation to e-mail addresses of the simulated participants,

simulate the meeting by inputting an audio stream from the process to the videoconferencing application, the audio stream comprising a simulated conversation among the plurality of participants, wherein the audio stream includes a simulation of conversation for each of the plurality of simulated participants; and

causing an interaction evaluation system to provide a summary for the meeting hosted by the videoconference application;

wherein the process is to evaluate the functioning of a customer relations management (CRM) system which receives the summary of the meeting from an interaction evaluation system.

13 . The method of claim 12 , wherein the process is to evaluate the functioning of one or more of the e-mail application and videoconferencing application.

14 . The method of claim 12 , comprising executing a prompt generation process to provide to an LLM (large language model) prompts to cause the LLM to create text output, and providing the text output to a text-to-speech process to produce the audio stream.

15 . The method of claim 12 , comprising a prompt control process inputting an input configuration file defining the parameters of a conversation, the prompt control process to cause an LLM to create text output, and to provide the text output to a text-to-speech process to produce the audio stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2025
From: LIVINGSTONE, VINETA; OLUGBOJI, DAMOLA
To: MORGAN STANLEY SERVICES GROUP INC.
Reel/Frame 071166/0888 →
References Cited (22)
US 6205412B1 · Barskiy et al. · 2001 [cited by applicant]
US 11095774B1 · Willshire · 2021 [cited by applicant]
US 12149655B1 · Phule · 2024 [cited by applicant]
US 20040008825A1 · Seeley et al. · 2004 [cited by applicant]
US 20060167970A1 · Seeley et al. · 2006 [cited by applicant]
US 20080294482A1 · Bank · 2008 [cited by examiner]
US 20110150189A1 · Kulkarni · 2011 [cited by applicant]
US 20160212073A1 · Kulkarni et al. · 2016 [cited by applicant]
US 20160219143A1 · Zilles et al. · 2016 [cited by applicant]
US 20170264575A1 · Willshire · 2017 [cited by applicant]
US 20190007550A1 · Kulkarni et al. · 2019 [cited by applicant]
US 20200228476A1 · Fejes et al. · 2020 [cited by applicant]
US 20210174288A1 · Gvildys · 2021 [cited by examiner]
US 20220124057A1 · Kulkarni et al. · 2022 [cited by applicant]
US 20230057544A1 · Seigneurbieux · 2023 [cited by examiner]
US 20230112780A1 · Rivas-Micoud · 2023 [cited by applicant]
US 20230401146A1 · Allen · 2023 [cited by applicant]
US 20240039812A1 · Hearn · 2024 [cited by examiner]
US 20240223639A1 · Jia · 2024 [cited by examiner]
US 20250104712A1 · Lyu · 2025 [cited by examiner]
Cyara's Rest API:_Limitless Integration & Extensibility, 2023 https:/cyara.com/wp-content/uploads/2023/01/API-Datasheet-01062023.pdf, downloaded on Oct. 3, 2023. [cited by applicant]
Overview Developer Genesys, 2023, downloaded on Oct. 3, 2023, https:/developer.genesys.cloud/routing/conversations/. [cited by applicant]