IP Library Granted Patent US 10,379,823
Granted Patent B1
US 10,379,823 · App. 15/695,685 · Granted Aug 13, 2019

Conversion of remote application dialogs to native mobile controls

Inventors: Ruslan Sadovnikov (Moscow, RU); Nikolay Dobrovolskiy (Moscow, RU); Serguei M. Beloussov (Singapore, SG)
Assignee: Parallels International GmbH
G06F8/38G06F3/0488G06F8/47G06F8/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,379,823
App. No.
15/695,685
Granted
Aug 13, 2019
Kind
B1
Abstract

A processing device of a remote server identifies at least one control in an active application window and a plurality of control options associated with the at least one control. The active application window comprises a user interface in a first format generated by an application running on the remote server. The processing device generates a first metadata representation of the at least one control and of the plurality of control options and sends the first metadata representation to a mobile device communicatively coupled to the remote server. The mobile device generates a user interface in a second format based on the first metadata representation to present the control and the plurality of control options on the mobile device.

Claims (49)

1. A method comprising:

identifying, by a processing device of a remote server, pixel mapping data corresponding to an active application window, the active application window comprising a user interface in a first format generated by an application running on the remote server;

identifying, based on the pixel mapping data corresponding to the active application window, at least one control in the active application window and a plurality of control options associated with the at least one control;

generating a first metadata representation of the at least one control and of the plurality of control options; and

sending the first metadata representation to a mobile device communicatively coupled to the remote server, the mobile device to generate a user interface in a second format based on the first metadata representation to present the control and the plurality of control options on the mobile device.

2. The method of claim 1 , further comprising:

receiving a command issued by the mobile device, the command requesting a launch of the application on the remote server; and

launching the application on the remote server.

3. The method of claim 1 , further comprising:

detecting the active application window generated by the application running on the remote server.

4. The method of claim 1 , further comprising:

receiving a second metadata representation of an input action from the mobile device, the input action comprising a selection of one of the plurality of control options;

converting the second metadata representation to the first format used by the application running on the remote server; and

executing a command corresponding to the input action in the application running on the remote server.

5. The method of claim 1 , wherein identifying the at least one control and the plurality of control options comprises identifying a location of the control within the user interface in the first format and at least one parameter corresponding to the control.

6. The method of claim 1 , wherein the first metadata representation comprises a tree structure representing a relationship between the at least one control, the plurality of control options and one or more additional controls and corresponding control options in the active application window.

7. The method of claim 1 , wherein the mobile device to generate the user interface in the second format according to interface guidelines associated with a mobile operating system running on the mobile device.

8. A remote server computing system comprising:

a memory; and

a processing device operatively coupled to the memory, the processing device to:

identify pixel mapping data corresponding to an active application window, the active application window comprising a user interface in a first format generated by an application running on the remote server;

identify, based on the pixel mapping data corresponding to the active application window, at least one control in the active application window and a plurality of control options associated with the at least one control;

generate a first metadata representation of the at least one control and of the plurality of control options; and

send the first metadata representation to a mobile device communicatively coupled to the remote server, the mobile device to generate a user interface in a second format based on the first metadata representation to present the control and the plurality of control options on the mobile device.

9. The remote server computing system of claim 8 , the processing device further to:

receive a command issued by the mobile device, the command requesting a launch of the application on the remote server; and

launch the application on the remote server.

10. The remote server computing system of claim 8 , the processing device further to:

detect the active application window generated by the application running on the remote server.

11. The remote server computing system of claim 8 , the processing device further to:

receive a second metadata representation of an input action from the mobile device, the input action comprising a selection of one of the plurality of control options;

convert the second metadata representation to the first format used by the application running on the remote server; and

execute a command corresponding to the input action in the application running on the remote server.

12. The remote server computing system of claim 8 , wherein to identify the at least one control and the plurality of control options, the processing device to identify a location of the control within the user interface in the first format and at least one parameter corresponding to the control.

13. The remote server computing system of claim 8 , wherein the first metadata representation comprises a tree structure representing a relationship between the at least one control, the plurality of control options and one or more additional controls and corresponding control options in the active application window.

14. The remote server computing system of claim 8 , wherein the mobile device to generate the user interface in the second format according to interface guidelines associated with a mobile operating system running on the mobile device.

15. A non-transitory computer readable storage medium storing instructions that, when executed by a processing device of a mobile device, cause the processing device to:

receive, from a remote server communicatively coupled to the mobile device, a first metadata representation of at least one control in an active application window and of a plurality of control options associated with the at least one control, the at least one control and the plurality of control options identified based on pixel mapping data corresponding to the active application, wherein the active application window comprises a user interface in a first format generated by an application running on the remote server, and

generate, by the processing device of the mobile device, a user interface in a second format based on the first metadata representation to present the control and the plurality of control options on the mobile device.

16. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further cause the processing device to:

send a command to the remote server, the command requesting a launch of the application on the remote server.

17. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further cause the processing device to:

cause display of the user interface in the second format on the mobile device; and

capture an input action corresponding to an interaction with the user interface, the input action comprising a selection of one of the plurality of control options.

18. The non-transitory computer readable storage medium of claim 17 , wherein the instructions further cause the processing device to:

generate a second metadata representation of the input action; and

send the second metadata representation to the remote server.

19. The non-transitory computer readable storage medium of claim 15 , wherein the processing device to generate the user interface in the second format according to interface guidelines associated with a mobile operating system running on the mobile device.

20. The non-transitory computer readable storage medium of claim 15 , wherein the first metadata representation comprises a tree structure representing a relationship between the at least one control, the plurality of control options and one or more additional controls and corresponding control options in the active application window.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Jul 18, 2019
From: UBS AG, STAMFORD BRANCH, AS ADMINISTRATIVE AND COLLATERAL AGENT
To: COREL CORPORATION; CLEARSLIDE, INC.; PARALLELS INTERNATIONAL GMBH
Reel/Frame 049787/0073 →
RELEASE OF SECURITY INTEREST RECORDED AT : REEL 047973 FRAME 0797 Recorded Jul 17, 2019
From: UBS AG, STAMFORD BRANCH
To: PARALLELS INTERNATIONAL GMBH
Reel/Frame 049773/0590 →
SECURITY INTEREST Recorded Dec 21, 2018
From: PARALLELS INTERNATIONAL GMBH
To: UBS AG, STAMFORD BRANCH
Reel/Frame 047973/0797 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2017
From: SADOVNIKOV, RUSLAN; DOBROVOLSKIY, NIKOLAY; BELOUSSOV, SERGUEI M.
To: PARALLELS INTERNATIONAL GMBH
Reel/Frame 043491/0346 →