IP Library Patent Application 14824042
Patent Application
App. No. 14/824,042

MIXED ENVIRONMENT DISPLAY OF ATTACHED DATA

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/824,042
Abstract

A holographic user interface may display status information in proximity to relevant components of the computing device, such as a robot, allowing a user to readily associate the status information with the relevant components. Arrangements of the graphical displays may utilize graphical elements to show an association between any displayed data and any component of a computing device. Based on data indicating the size, shape, and configuration of a robot's physical parts, techniques disclosed herein can arrange displayed status data, which may involve a holographic UI, in a relevant context. In addition, techniques disclosed herein allow a user to edit data, or provide an input to one or more computing devices in response to the display of any status data.

Claims (51)

1 . A computer-implemented method, comprising:

obtaining status data, at a first computing device, indicating a status associated with a second computing device;

determining if the status is to be displayed; and

if the status is to be displayed,

generating a graphical element describing the status, and

causing a display of the graphical element describing the status on an interface of the first computing device, wherein the interface is configured to provide a real-world view of at least a portion of the second computing device and wherein the graphical element describing the status is configured to indicate an association between the graphical element describing the status and at least the portion of the real-world view of the second computing device.

2 . The method of claim 1 , wherein the first computing device is a head-mounted display comprising at least one image camera configured to generate image data, and wherein obtaining the status data comprises analyzing the image data to generate the status data.

3 . The method of claim 1 , wherein the first computing device is a head-mounted display comprising at least one image camera configured to generate image data, and wherein the method further comprises:

analyzing the image data to determine geometric parameters of at least one component of the second computing device; and

determining a size or a position of the graphical element describing the status based, at least in part, on the geometric parameters of at least one component of the second computing device.

4 . The computer-implemented method of claim 1 , wherein the status indicates a characteristic of a movement of the second computing device.

5 . The computer-implemented method of claim 1 , wherein the status indicates a characteristic of an interaction between the second computing device and at least one object.

6 . The computer-implemented method of claim 1 , wherein the second computing device is configured to perform one or more tasks defined in a set of instructions, and wherein the display of the graphical element includes a description of an individual task of one or more tasks defined in the set of instructions.

7 . The computer-implemented method of claim 1 , wherein the computer-implemented method further comprises:

causing a generation of a graphical augmentation of the second computing device; and

causing a display of the graphical augmentation on the interface, wherein the graphical augmentation is positioned in relation to a position of the real-world view of the second computing device through the interface, and wherein an arrangement of the display indicates an association between the graphical element and the graphical augmentation of the second computing device.

8 . The computer-implemented method of claim 1 , wherein the computer-implemented method further comprises:

determining a status of a component of the second computing device; and

causing a display of a graphical element describing the status of the component on the interface, wherein the graphical element describing the status of the component is configured to indicate an association between the graphical element describing the status of the component and at least a portion of the real-world view of the second computing device.

9 . The computer-implemented method of claim 1 , wherein the computer-implemented method further comprises:

determining if a status of a component of the second computing device exceeds a threshold; and

if the status of the component of the second computing device exceeds the threshold, causing a display of a graphical element indicating the status of the component on the interface, wherein the graphical element indicating the status of the component is configured to indicate an association between the graphical element indicating the status of the component and at least a portion of the real-world view of the second computing device.

10 . The computer-implemented method of claim 1 , wherein the second computing device is configured to perform one or more tasks defined in a set of instructions, and wherein the instructions define interactions between the second computing device and a real-world object, and wherein the method further comprises:

receiving a signal from one or more sensors attached to the second computing device, wherein the one or more sensors are configured to detect a status of the real-world object;

causing a generation of a graphical element indicating the status of the real-world object; and

causing a display of the graphical element indicating the status of the real-world object on the interface, wherein the graphical element indicating the status of the real-world object is configured to illustrate an association between the graphical element indicating the status of the real-world object and a real-world view of the real-world object or a graphical representation of the real-world object.

11 . A first computing device, comprising:

a processor;

an interface;

a memory having a set of computer-executable instructions stored thereupon which, when executed by the processor, cause the first computing device to

determine if a status associated with a component of a second computing device reaches a threshold; and

if the status reaches the threshold,

generate a graphical element describing the status and a graphical representation of the component, and

cause a display of the graphical representation of the status on the interface and a view of the component on or through the interface, wherein an arrangement of the display indicates an association between the graphical representation of the status and the view of the component.

12 . The first computing device of claim 11 , wherein the view of the component is a graphical representation of the component displayed on the interface.

13 . The first computing device of claim 11 , wherein the interface is configured to provide a real-world view of the component through a section of the interface, and wherein the view of the component is a real-world view of the component through the section of the interface.

14 . The first computing device of claim 11 , wherein the status comprises a power level.

15 . The first computing device of claim 11 , wherein the status comprises a temperature level.

16 . The first computing device of claim 11 , wherein the status comprises a usage level.

17 . A computer storage medium having a first set of computer-executable instructions stored thereupon which, when executed by a first computing device, cause the first computing device to:

obtain status data indicating a status associated with a second computing device performing one or more tasks defined in a second set of instructions;

determine if the status is to be displayed; and

if the status is to be displayed,

generate a graphical element describing the status, and

cause a display of the graphical element describing the status on an interface of the first computing device, wherein the interface is configured to provide a view of at least a portion of the second computing device, and

wherein the graphical element is configured to indicate an association between the graphical element describing the status and at least the portion of the view of the second computing device.

18 . The computer storage medium of claim 17 , wherein the view of the second computing device is a graphical representation of the second computing device displayed on the interface.

19 . The computer storage medium of claim 17 , wherein the interface is configured to provide a real-world view of the second computing device through a section of the interface, and wherein view of the second computing device is a real-world view of the second computing device through the section of the interface.

20 . The computer storage medium of claim 17 , wherein first set of computer-executable instructions cause the first computing device to:

receive an input in response to the display of the graphical element describing the status; and

modifying one or more settings of the second computing device in response to the input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2017
From: HILL, DAVID M.; CHARBONNEAU, EMIKO V.; EVERTT, JEFFREY J.; JEAN, ANDREW WILLIAM; JONES, ALAN M.; ROESLER, RICHARD C.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 043782/0872 →