IP Library › Granted Patent US 10,318,225
Granted Patent B2
US 10,318,225 · App. 15/154,288 · Granted Jun 11, 2019

Holographic augmented authoring

Inventor: Jonathan Kaufthal (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/1423G02B27/0103G02B27/0172G03H1/00G06F3/011G06F3/048G06F3/0482G06F3/04817G06T19/006G02B2027/0134G02B2027/0138G02B2027/0174G02B2027/0187G03H2001/0061G06F3/04815G06F17/21G09G3/003G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,318,225
App. No.
15/154,288
Granted
Jun 11, 2019
Kind
B2
Abstract

Holographic augmented authoring provides an extension to personal computing experiences of a universal or conventional productivity application. A user interface of a productivity application executing on a personal computing device can be switched from a touch or conventional mode to a holographic mode, which opens communication between the personal computing device and a holographic enabled device providing a mixed reality system. A semantic representation of a command in a productivity application is generated as a hologram in a mixed reality system and the change to a content file from performing the command in the mixed reality system does not require a holographic enabled device to view or even further edit.

Claims (56)

1. A system for holographic augmented authoring:

a holographic-enabled device comprising at least a holographic display, a processor, storage media, a communication interface; and at least a software component of a productivity application stored on the storage media; and

a second computing device comprising at least a second processor, second storage media, a second communication interface, and the productivity application stored on the second storage media,

wherein the productivity application, when executed by the second computing device, directs the second processor to:

display a content file in an authoring interface for the productivity application;

in response to receiving an indication of holographic mode, enable communication between the second computing device and the holographic-enabled device to provide holographic augmented authoring of the content file;

communicate to the holographic-enabled device that an aspect of the content file or the productivity application is to be holographically displayed by the holographic-enabled device;

display the aspect of the content file or the productivity application before communicating to the holographic-enabled device that the aspect is to be holographically displayed; and

remove the aspect of the content file or the productivity application from being displayed by the second computing device while the aspect is holographically displayed by the holographic-enabled device;

wherein the software component of the productivity application, when executed by the holographic-enabled device, provides at least one holographic authoring command corresponding to a semantic representation of an authoring command that can be enacted on at least one content component of the content file; and wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving a communication from the second computing device that the aspect of the content file or the productivity application is to be holographically displayed, display the aspect of the content file or the productivity application.

2. The system of claim 1 , wherein the productivity application comprises instructions that direct the second processor to:

in response to receiving the indication of the holographic mode, communicate the at least one content component of the content file to the holographic-enabled device.

3. The system of claim 1 , wherein the software component of the productivity application comprises instructions that direct the processor to:

communicate and receive information corresponding to at least one of new or modified content, command features, application configuration, interface configuration, and layout features.

4. The system of claim 1 , wherein the aspect of the content file or the productivity application comprises one or more of at least one content component of the content file, a command feature, or graphical icon.

5. The system of claim 1 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

communicate to the second computing device that an aspect of the content file or the productivity application is to be displayed by the second computing device;

wherein the productivity application, when executed by the second computing device, further directs the second processor to:

in response to receiving a communication from the holographic-enabled device that the aspect of the content file or the productivity application is to be displayed, display the aspect of the content file or the productivity application.

6. The system of claim 1 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file; and

communicate a modified content file or an indication of what is changed to the second computing device;

wherein the productivity application, when executed by the second computing device, further directs the second processor to:

in response to receiving the modified content file or the indication of what is changed, update the content file stored at the second computing device.

7. The system of claim 1 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file;

save the modified content file at the holographic-enabled device; and

upload the modified content file or an indication of what is changed to synchronize with a persisted content file at a remote storage location.

8. The system of claim 7 , wherein the selected holographic authoring command comprises a slide sort function and the content file comprises a presentation file of a presentation application having content components including at least slides,

wherein the semantic representation of the slide sort function comprises holographic images of each slide on a real surface in a surrounding environment of a user of the holographic-enabled device, the holographic images being rearrangeable on the real surface,

wherein a change in an arrangement of the holographic images corresponds to a modification to the order of the slides in the content file.

9. The system of claim 1 , wherein the indication of holographic mode comprises a request for holographic mode from the holographic-enabled device.

10. The system of claim 1 , wherein the indication of holographic mode is a selection via user input to the second computing device of holographic mode from a menu of the productivity application.

11. A method performed by a holographic-enabled device comprising:

providing a set of holographic authoring commands each of the holographic authoring commands corresponding to a semantic representation of an authoring command that can be enacted on at least one content component of a content file;

in response to receiving an indication to execute a selected holographic authoring command from the set of holographic authoring commands, performing the selected holographic authoring command to modify the content file;

saving the modified content file at the holographic-enabled device; and

uploading the modified content file or an indication of what is changed to synchronize with a persisted content file at a remote storage location.

12. The method of claim 11 , wherein the selected holographic authoring command comprises a slide sort function and the content file comprises a presentation file of a presentation application having content components including at least slides,

wherein the semantic representation of the slide sort function comprises holographic images of each slide on a real surface in a surrounding environment of a user of the holographic-enabled device, the holographic images being rearrangeable on the real surface,

wherein a change in an arrangement of the holographic images corresponds to a modification to the order of the slides in the content file.

13. A holographic-enabled device comprising at least a holographic display, a processor, storage media, a communication interface; and at least a software component of a productivity application stored on the storage media,

wherein the software component of the productivity application, when executed by the holographic-enabled device, provides at least one holographic authoring command corresponding to a semantic representation of an authoring command that can be enacted on at least one content component of a content file,

wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file;

save the modified content file at the holographic-enabled device; and

upload the modified content file or an indication of what is changed to synchronize with a persisted content file at a remote storage location.

14. The holographic-enabled device of claim 13 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving a communication that an aspect of the content file or the productivity application is to be holographically displayed, display the aspect of the content file or the productivity application.

15. The holographic-enabled device of claim 13 , wherein the aspect of the content file or the productivity application comprises one or more of at least one content component of the content file, a command feature, or graphical icon.

16. The holographic-enabled device of claim 13 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

communicate to a second computing device that an aspect of the content file or the productivity application is to be displayed by the second computing device, the second computing device providing a display separate from the holographic-enabled device.

17. The holographic-enabled device of claim 13 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file; and

communicate a modified content file or an indication of what is changed to a second computing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2016
From: KAUFTHAL, JONATHAN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 038593/0620 →
Continuity (2)
Provisional Application 62213089 · Sep 1, 2015
Related Publication 20170060514A1 · Mar 2, 2017