IP Library Granted Patent US 11,394,668
Granted Patent B1
US 11,394,668 · App. 17/248,461 · Granted Jul 19, 2022

System and method for executing operations in a performance engineering environment

Inventors: Periyakaruppan Subbunarayanan (Mississauga, CA); Harmanjit Singh (Mississauga, CA); Aayush Kathuria (Brampton, CA)
Assignee: The Toronto-Dominion Bank
H04L51/02G06F3/0481G06F9/54G06F40/40G06N20/00H04L43/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,394,668
App. No.
17/248,461
Granted
Jul 19, 2022
Kind
B1
Abstract

A system and method are provided for executing operations in a performance engineering environment. The method includes receiving a request to implement a task within the environment, from an input to a conversational chat user interface; communicating with a logic system to determine an intent from the request; determining one or more executable instructions to implement one or more operations associated with the task, based on the determined intent; and communicating via the communications module, with at least one endpoint to trigger execution of the one or more operations using the one or more executable instructions; receiving via the communications module, data from the at least one endpoint, the data associated with execution of the one or more operations; generating a conversational response to the request based on or including the data received from the at least one endpoint; and having the conversational response rendered in the chat user interface.

Claims (60)

1. A device for executing operations in a performance engineering environment, the device comprising:

a processor;

a communications module coupled to the processor; and

a memory coupled to the processor, the memory storing computer executable instructions that when executed by the processor cause the processor to:

receive via the communications module, a request to implement automated testing within the performance engineering environment, from an input to a centrally integrated chat user interface connected to and between both an application testing environment and an application development environment of the performance engineering environment to coordinate testing operations among disparate systems;

generate and transmit, via the communications module to the centrally integrated chat user interface, one or more instructional elements that suggest modifications to the request;

receive, via the communications module, an updated request from another input to the centrally integrated chat user interface;

communicate with a logic system to determine an intent from the updated request;

determine one or more executable instructions to implement one or more operations associated with automated testing, based on the determined intent, wherein the one or more operations of the automated testing are implemented within one or more of the application testing environment and the application development environment;

communicate via the communications module, with at least one endpoint to trigger execution of the one or more operations using the one or more executable instructions;

receive via the communications module, data from the at least one endpoint, the data associated with execution of the one or more operations;

generate a conversational response to the updated request based on or including the data received from the at least one endpoint; and

have the conversational response rendered in the centrally integrated chat user interface.

2. The device of claim 1 , wherein the computer executable instructions further cause the processor to:

have the logic system access a language server to determine the intent from the updated request.

3. The device of claim 2 , wherein the computer executable instructions further cause the processor to:

have the logic system use the language server to apply a natural language understanding (NLU) process to correlate the updated request to the one or more operations associated with the automated testing.

4. The device of claim 1 , wherein the computer executable instructions further cause the processor to:

generate the executable instructions to implement the one or more operations in a format that is understandable to the at least one endpoint, wherein the device is configured to generate executable instructions in formats understandable to a plurality of disparate systems.

5. The device of claim 1 , wherein the computer executable instructions further cause the processor to:

have the logic system communicate with the at least one endpoint via a respective application programming interface (API) exposed by a respective endpoint, to trigger execution of the one or more operations.

6. The device of claim 1 , wherein the one or more operations comprises initiating an application build download process, and wherein the corresponding endpoint returns an initiation status.

7. The device of claim 1 , wherein the one or more operations comprises initiating a performance test, and wherein the corresponding endpoint returns test data which includes at least one of application traffic monitoring, determining UI response times, examining device logs, and determining device resource utilization metrics.

8. The device of claim 1 , wherein the one or more operations comprises checking the status of an executed or currently executing performance test, and wherein the corresponding endpoint returns a status indicator.

9. The device of claim 1 , wherein the updated request is translated from a first spoken language to a second spoken language processed by the logic system.

10. The device of claim 1 , wherein the computer executable instructions further cause the processor to:

have the logic system access a model generated by a machine learning system, the machine learning system using messages exchanged via the centrally integrated chat user interface to build and/or refine the model over time.

11. A method of executing operations in a performance engineering environment, the method executed by a device having a communications module and comprising:

receiving via the communications module, a request to implement automated testing within the performance engineering environment, from an input to a centrally integrated chat user interface connected to and between both an application testing environment and an application development environment of the performance engineering environment to coordinate testing operations among disparate systems;

generating and transmitting, via the communications module to the centrally integrated chat user interface, one or more instructional elements that suggest modifications to the request;

receiving, via the communications module, an updated request from another input to the centrally integrated chat user interface;

communicating with a logic system to determine an intent from the updated request;

determining one or more executable instructions to implement one or more operations associated with automated testing, based on the determined intent, wherein the one or more operations of the automated testing are implemented within one or more of the application testing environment and the application development environment;

communicating via the communications module, with at least one endpoint to trigger execution of the one or more operations using the one or more executable instructions;

receiving via the communications module, data from the at least one endpoint, the data associated with execution of the one or more operations;

generating a conversational response to the updated request based on or including the data received from the at least one endpoint; and

having the conversational response rendered in the centrally integrated chat user interface.

12. The method of claim 11 , further comprising:

generating the executable instructions to implement the one or more operations in a format that is understandable to the at least one endpoint, wherein the device is configured to generate executable instructions in formats understandable to a plurality of disparate systems.

13. The method of claim 11 , further comprising:

having the logic system communicate with the at least one endpoint via a respective application programming interface (API) exposed by a respective endpoint, to trigger execution of the one or more operations.

14. The method of claim 11 , wherein the one or more operations comprises initiating an application build download process, and wherein the corresponding endpoint returns an initiation status.

15. The method of claim 11 , wherein the one or more operations comprises initiating a performance test, and wherein the corresponding endpoint returns test data which includes at least one of application traffic monitoring, determining UI response times, examining device logs, and determining resource utilization metrics.

16. The method of claim 11 , wherein the one or more operations comprises checking the status of an executed or currently executing performance test, and wherein the corresponding endpoint returns a status indicator.

17. The method of claim 11 , further comprising:

having the logic system access a model generated by a machine learning system, the machine learning system using messages exchanged via the centrally integrated chat user interface to build and/or refine the model over time.

18. The method of claim 11 , further comprising:

having the logic system access a language server to determine the intent from the updated request.

19. The method of claim 18 , further comprising:

having the logic system use the language server to apply a natural language understanding (NLU) process to correlate the updated request to the one or more operations associated with the automated testing.

20. A non-transitory computer readable medium for executing operations in a performance engineering environment, the computer readable medium comprising computer executable instructions for:

receiving via the communications module, a request to implement automated testing within the performance engineering environment, from an input to a centrally integrated chat user interface connected to and between both an application testing environment and an application development environment of the performance engineering environment to coordinate testing operations among disparate systems;

generating and transmitting, via the communications module to the centrally integrated chat user interface, one or more instructional elements that suggest modifications to the request;

receiving, via the communications module, an updated request from another input to the centrally integrated chat user interface;

communicating with a logic system to determine an intent from the updated request;

determining one or more executable instructions to implement one or more operations associated with automated testing, based on the determined intent, wherein the one or more operations of the automated testing are implemented based one or more of the application testing environment and the application development environment;

communicating via the communications module, with at least one endpoint to trigger execution of the one or more operations using the one or more executable instructions;

receiving via the communications module, data from the at least one endpoint, the data associated with execution of the one or more operations;

generating a conversational response to the updated request based on or including the data received from the at least one endpoint; and

having the conversational response rendered in the centrally integrated chat user interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2022
From: SUBBUNARAYANAN, PERIYAKARUPPAN; SINGH, HARMANJIT; KATHURIA, AAYUSH
To: THE TORONTO-DOMINION BANK
Reel/Frame 060170/0378 →
Cited By (27)
US 12,316,715 US 12,399,687 US 12,499,241 US 12,517,812 US 12,536,264 US 12,541,544 US 12,541,894 US 12,566,541 US 12,585,435 US 12,591,559 US 12,592,301 US 12,625,680 US 12,641,178 US 12,645,429 US 12,645,689 US 12,645,838 US 12,646,051 US 12,650,836 US 12,657,566 US 12,670,334 US 12,670,640 US 12,688,620 US 12,693,842 US 12,699,556 US 12,705,398 US 12,711,683 US 12,725,152