IP Library Granted Patent US 9,772,755
Granted Patent B2
US 9,772,755 · App. 14/246,806 · Granted Sep 26, 2017

Remote control for displaying application data on dissimilar screens

Inventors: John R. Sanders (Seattle, WA); Kevin H. Kahl (Redmond, WA); Feng Yu (Sammamish, WA); Jing Han Shiau (Redmond, WA); Joshua S. Bolduc (Seattle, WA); Patrick S. Boyd (Seattle, WA); Kha Lam (Renton, WA); David M. Gray (Bellevue, WA); Roopesh Kumar Rajamani (Sammamish, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/04842G06F3/0481G06F3/0488G06F3/1454G06T2200/24G09G2340/0407
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,772,755
App. No.
14/246,806
Granted
Sep 26, 2017
Kind
B2
Abstract

A remote control service on a mobile device interrogates a program on another computing device to obtain metadata describing the structure of information being displayed on the computing device. The remote control service then calculates a different data structure that is used to display a subset of the data on the display screen of the mobile device.

Claims (52)

1. A computer-implemented method, comprising:

receiving, by a mobile device, data structure metadata corresponding to a first application display displayed by an application on a computing device that is separate from the mobile device, wherein the data structure metadata is indicative of a layout of a plurality of display elements on the first application display;

generating, by the mobile device, a second application display based on the data structure metadata, the second application display being different from the first application display and displaying information from the first application display, wherein generating the second application display comprises:

analyzing, by the mobile device, the received data structure metadata indicative of the layout of the plurality of display elements on the first application display;

based on the analysis of the received data structure metadata, selecting, by the mobile device, a first subset of the display elements to display on the modified application display,

the first subset comprising some, but not all, of the plurality of display elements;

modifying, by the mobile device, the layout of display elements that are on the first application display to obtain a modified application display that includes the first subset of the display elements; and

displaying the modified application display, as the second application display, on the mobile device;

receiving a user interaction input interacting with the second application display; and

in response to the user interaction input, performing local processing on the mobile device to further modify the second application display, wherein the local processing is performed on the mobile device without communicating information to the application on the computing device and comprises:

selecting, by the mobile device, a second subset of the display elements to display on the modified application display,

the second subset comprising some, but not all, of the plurality of display elements, and the second subset including at least one display element not included in the first subset.

2. The computer-implemented method of claim 1 and further comprising:

sending user interaction information to the application on the computing device to control the application on the computing device.

3. The computer-implemented method of claim 2 wherein receiving a user interaction input comprises:

receiving a document launch input on the second application display, to open a document in the application, and wherein sending user interaction information comprises sending launch information to open the document on the computing device.

4. The computer-implemented method of claim 2 wherein receiving a user interaction input comprises:

receiving a data manipulation input on the second application display on the mobile device to manipulate data on the first application display on the computing device, and wherein sending user action information comprises sending data manipulation information to manipulate the data on the first application display on the computing device.

5. The computer-implemented method of claim 2 wherein receiving a user interaction input comprises:

receiving an application switch user input to switch focus to a different application on the computing device, and wherein sending user interaction information comprises sending application switch information to switch the focus to the different application on the computing device.

6. The computer-implemented method of claim 1 , wherein the data structure metadata is provided from an add-in component that is provided as an add-in for an application on a computing device that is separate from the mobile device.

7. The computer-implemented method of claim 1 wherein modifying the layout of the display elements that are on the first application display comprises at least one of:

modifying a configuration of the display elements to display on the modified application display; or

modifying a size of the display elements to display on the modified application.

8. The computer-implemented method of claim 1 wherein the computing device includes a non-touch sensitive display screen and wherein receiving a use interaction input comprises:

receiving a touch input on the second application display on the mobile device, and wherein sending user interaction information comprises:

sending an application control input to the computing device to control the application on the computing device, based on the touch input received on the second application display on the mobile device.

9. The computer-implemented method of claim 2 and further comprising:

prior to receiving the data structure metadata on the mobile device, receiving a set of application identifiers on the mobile device identifying programs on the computing device; and

requesting the data structure metadata, for each identified program, from an add-in component corresponding to each identified program.

10. The computer-implemented method of claim 9 wherein receiving the set of application identifiers comprises:

receiving the set of application identifiers identifying open or recently used programs on the computing device.

11. The computer-implemented method of claim 9 wherein requesting the data structure metadata comprises:

interrogating a public model corresponding to each identified program.

12. A mobile device, comprising:

a mobile remote component configured to:

receive an application identifier from a computing device that is separate from the mobile device;

based on the application identifier, identify an application program executable on the computing device;

based on identifying the application program, interrogate an add-in component, comprising an add-in for the application program executable on the computing device, for data structure metadata indicative of a layout of a plurality of display elements displayed by the application program, as a computing device display, on the computing device; and

receive the data structure metadata from the add-in component in response to the interrogation;

a display device; and

a display generator component configured to:

analyze the data structure metadata;

based on the analysis of the data structure metadata, select a first subset of the display elements to display on a modified application display, the first subset comprising some, but not all, of the plurality of display elements; and

generate the modified application display on the display device using a computer processor, the modified application display being modified from the computing device display and displaying the first subset of the display elements;

receive a user interaction input interacting with the modified application display; and

in response to the user interaction input, perform local processing on the mobile device to further modify the modified application display, wherein the local processing is performed on the mobile device without communicating information to the application on the computing device and comprises:

selecting, by the mobile device, a second subset of the display elements to display on the modified application display,

the second subset comprising some the plurality of display elements, and the second subset including at least one display element not included in the first subset.

13. The mobile device of claim 12 wherein the display device comprises a touch sensitive display device and wherein the display generator component is configured to receive a touch input on the mobile device display and wherein the mobile remote component is configured send a program control input to the computing device to control the program on the computing device, based on the touch input received on the mobile device display.

14. The mobile device of claim 12 wherein the display generator component is configured to receive a program launch input on the mobile device display to launch a different program on the computing device and wherein the mobile remote component is configured to send launch information to launch the different program on the computing device.

15. The mobile device of claim 12 wherein the display generator component is configured to receive a data manipulation input on the mobile device display to manipulate data on the computing device display on the computing device, and wherein mobile mote component is configured to send data manipulation information to manipulate the data on the computing device display on the computing device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2014
From: SANDERS, JOHN R.; KAHL, KEVIN H.; YU, FENG; SHIAU, JING HAN; BOLDUC, JOSHUA S.; BOYD, PATRICK S.; LAM, KHA; GRAY, DAVID M.; RAJAMANI, ROOPESH KUMAR
To: MICROSOFT CORPORATION
Reel/Frame 032707/0864 →
Continuity (2)
Provisional Application 61905117 · Nov 15, 2013
Related Publication 20150143271A1 · May 21, 2015