Granted Patent B1

US 12,230,267 · App. 17/984,622 · Granted Feb 18, 2025

Inventors: Ivan Korobov (Moscow, RU); Andrey Omelyanchuk (Moscow, RU); Nikolay Dobrovolskiy (Moscow, RU); Sergei M. Beloussov (Singapore, SG)

Assignee: Parallels International GmbH

G10L15/22G06F8/61G06F21/32G10L15/1815G10L15/30H04L65/1069H04M1/2535H04M1/271G10L2015/223

Abstract

Claims (74)

1. A method for controlling a remote computer over a remote session established via a cloud infrastructure using an intelligent personal assistant (IPA) executing on a mobile device of a user, the method comprising:

generating a command object upon the IPA with a process comprising the steps of:

receiving, by the IPA, a speech-based instruction from a user of the mobile device, the speech-based instruction indicating a request to execute a task on the remote computer;

analyzing, by the IPA, the speech-based instruction to determine whether the speech-based instruction includes an intent of the user to initiate a remote session to the remote computer wherein the determination as to whether the speech-based instruction includes the intent of the user to initiate the remote session to the remote computer comprises:

identifying whether the speech-based command comprises an identity of a task to be executed which results in initiation of the remote session to the remote computer; and

determining whether the speech-based command comprises speech-based content defining a set of intent-specific objects where the set of intent-specific objects are established in dependence upon the identity of the task within the speech-based command to be executed;

determining, by the IPA, a remote client on the mobile device for creating the remote session with the remote computer;

generating, by the IPA, a command object that includes parameters relating to the execution of the task; and

transmitting the command object through the secure remote session to the computer, wherein

the command object causes a software agent on the computer to execute the task based at least partially on the parameters included in the command object.

2. The method according to claim 1 , further comprising

transmitting the command object from the IPA through the remote session to the remote computer.

3. The method according to claim 1 , further comprising

transmitting the command object from the IPA through the remote session to the remote computer,

receiving results from the execution of a task within the remote session from the remote computer to at least one of the mobile device and the IPA; wherein

the task is performed with a software agent on the remote computer where the software agent is established in dependence of the command object received from the IPA.

4. The method according to claim 1 , wherein

an operating system of the remote computer does not natively support speech-based instructions.

5. The method according to claim 1 , wherein

the remote client is configured to:

authenticate the user with the cloud infrastructure;

determine whether the remote computer is registered as a remote host with the cloud infrastructure;

obtain security tokens associated with the remote computer from the cloud infrastructure; and

establish a secure remote session with the registered computer using the security tokens.

6. The method according to claim 1 , further comprising:

installing the remote client on the mobile device; and

installing a software agent on the remote computer to perform a task where the software agent is established in dependence of the remote computer receiving the command object from the IPA.

7. The method according to claim 1 , wherein

the IPA analyzes the speech-based instruction with a process comprising:

performing automatic speech recognition and transcription of the speech-based instruction; and

identifying an identification of the remote client with the transcribed speed-based instruction.

8. The method of claim 1 , wherein

prior to establishing the remote session with the remote computer the IPA:

provides task information to the remote client using an operating system (OS) object;

performs a portion of the task with an application capable of performing the task; and

transmits the OS object from the application through the remote session to another instance of the application executing on the remote computer for completion of the task; and

the application is in execution upon the mobile device of the user.

9. A non-transitory computer readable medium comprising computer executable instructions for controlling a remote computer over a remote session established via a cloud infrastructure using an intelligent personal assistant (IPA) executing on a mobile device of a user, the computer executable instructions when executed by a processor of the mobile device cause the processor to execute a process comprising the steps of:

generating a command object upon the IPA with a process comprising the steps of:

receiving, by the IPA, a speech-based instruction from a user of the mobile device, the speech-based instruction indicating a request to execute a task on the remote computer;

analyzing, by the IPA, the speech-based instruction to determine whether the speech-based instruction includes an intent of the user to initiate a remote session to the remote computer wherein the determination as to whether the speech-based instruction includes the intent of the user to initiate the remote session to the remote computer comprises:

identifying whether the speech-based command comprises an identity of a task to be executed which results in initiation of the remote session to the remote computer; and

determining whether the speech-based command comprises speech-based content defining a set of intent-specific objects where the set of intent-specific objects are established in dependence upon the identity of the task within the speech-based command to be executed;

determining, by the IPA, a remote client on the mobile device for creating a remote session with the computer;

generating, by the IPA, a command object that includes parameters relating to the execution of the task; and

transmitting the command object through the secure remote session to the computer, wherein the command object causes a software agent on the computer to execute the task based at least partially on the parameters included in the command object.

10. The non-transitory computer readable medium according to claim 9 , wherein

the process further comprises the step of transmitting the command object from the IPA through the remote session to the remote computer.

11. The non-transitory computer readable medium according to claim 9 , wherein

the process further comprises the steps of:

transmitting the command object from the IPA through the remote session to the remote computer,

receiving results from the execution of a task within the remote session from the remote computer to at least one of the mobile device and the IPA; wherein

the task is performed with a software agent on the remote computer where the software agent is established in dependence of the command object received from the IPA.

12. The non-transitory computer readable medium according to claim 9 , wherein

an operating system of the remote computer does not natively support speech-based instructions.

13. The non-transitory computer readable medium according to claim 9 , wherein

the process further comprises the steps of:

installing the remote client on the mobile device; and

transmitting the command object from the IPA through the remote session to the remote computer; and

the remote computer installs a software agent upon receipt of the command object to perform a task where the software agent is established in dependence of the command object received from the IPA.

14. The non-transitory computer readable medium according to claim 9 ,

wherein

the computer executable instructions when executed by the processor of the mobile device cause the processor to execute another process when the IPA analyzes the speech-based instruction;

the another process comprising the steps of:

performing automatic speech recognition and transcription of the speech-based instruction; and

identifying an identification of the remote client with the transcribed speed-based instruction.

15. The non-transitory computer readable medium according to claim 9 ,

wherein

the computer executable instructions when executed by the processor of the mobile device cause the processor to execute another process prior to establishing the remote session with the remote computer the IPA;

the another process comprises the steps of:

providing task information to the remote client using an operating system (OS) object;

performing a portion of the task with an application capable of performing the task; and

transmitting the OS object from the application through the remote session to another instance of the application executing on the remote computer for completion of the task; and

the application is in execution upon the mobile device of the user.

Assignments (1)

Continuity (2)

References Cited (20)