IP Library › Granted Patent US 10,664,218
Granted Patent B2
US 10,664,218 · App. 16/369,652 · Granted May 26, 2020

Holographic augmented authoring

Inventor: Jonathan Kaufthal (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/1423G02B27/0103G02B27/0172G03H1/00G06F3/011G06F3/048G06F3/0482G06F3/04817G06T19/006G02B2027/0134G02B2027/0138G02B2027/0174G02B2027/0187G03H2001/0061G06F3/04815G06F40/10G09G3/003G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,664,218
App. No.
16/369,652
Granted
May 26, 2020
Kind
B2
Abstract

Holographic augmented authoring provides an extension to personal computing experiences of a universal or conventional productivity application. A user interface of a productivity application executing on a personal computing device can be switched from a touch or conventional mode to a holographic mode, which opens communication between the personal computing device and a holographic enabled device providing a mixed reality system. A semantic representation of a command in a productivity application is generated as a hologram in a mixed reality system and the change to a content file from performing the command in the mixed reality system does not require a holographic enabled device to view or even further edit.

Claims (42)

1. A system for holographic augmented authoring:

a holographic-enabled device comprising at least a holographic display, a processor, storage media, a communication interface, a software component of a productivity application stored on the storage media, and a local copy of a content file stored on the storage media; and

a second computing device comprising at least a second processor, second storage media, a second communication interface, the productivity application stored on the second storage media, and a second local copy of the content file stored on the second storage media,

wherein the software component of the productivity application, when executed by the holographic-enabled device, directs the processor to:

communicate to the second computing device, via a server, that an aspect of the content file or the productivity application is to be displayed by the second computing device;

wherein the productivity application, when executed by the second computing device, directs the second processor to:

in response to receiving a communication from the holographic-enabled device via the server that the aspect of the content file or the productivity application is to be displayed, display the aspect of the content file or the productivity application.

2. The system of claim 1 , wherein the holographic-enabled device communicates with a service to update a master copy of the content file with changes made to the local copy of the content file by uploading a modified content file or an indication of what is changed to synchronize with the master copy of the content file at a remote storage location.

3. The system of claim 2 , wherein the second computing device communicates with the service to update the master copy of the content file with changes made to the second local copy of the content file by uploading a corresponding modified content file or an indication of what is changed to synchronize with the master copy of the content file at the remote storage location.

4. The system of claim 2 , wherein the second computing device displays a change to content in the modified content file according to the master content file stored at the remote storage location.

5. The system of claim 1 , wherein the software component of the productivity application comprises instructions that direct the processor to:

receive information corresponding to at least one of new or modified content, command features, application configuration, interface configuration, and layout features changed or removed at the second computing device.

6. The system of claim 1 , wherein the indication of holographic mode comprises a request for holographic mode from the holographic-enabled device.

7. The system of claim 1 , wherein the indication of holographic mode is a selection via user input to the second computing device of holographic mode from a menu of the productivity application.

8. A method performed by a holographic-enabled device comprising:

providing at least one holographic authoring command corresponding to a semantic representation of an authoring command that can be enacted on at least one content component of a content file;

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file; and

communicate a modified content file or an indication of what is changed to a second computing device.

9. The method of claim 8 , further comprising:

receiving information corresponding to at least one of new or modified content, command features, application configuration, interface configuration, and layout features from the second computing device.

10. The method of claim 8 , further comprising:

communicating to the second computing device that an aspect of the content file or the productivity application is to be displayed by the second computing device.

11. The method of claim 10 , wherein the communicating is via one or more application programming interfaces (APIs).

12. The method of claim 8 , further comprising:

in response to receiving a communication that an aspect of the content file or the productivity application is to be holographically displayed, displaying the aspect of the content file or the productivity application.

13. The method of claim 12 , wherein the aspect of the content file or the productivity application comprises one or more of at least one content component of the content file, a command feature, or graphical icon.

14. The method of claim 8 , wherein the selected holographic authoring command comprises a slide sort function and the content file comprises a presentation file of a presentation application having content components including at least slides,

wherein the semantic representation of the slide sort function comprises holographic images of each slide on a real surface in a surrounding environment of a user of the holographic-enabled device, the holographic images being rearrangeable on the real surface,

wherein a change in an arrangement of the holographic images corresponds to a modification to the order of the slides in the content file.

15. A holographic-enabled device comprising at least a holographic display, a processor, storage media, a communication interface; and at least a software component of a productivity application stored on the storage media, wherein the software component of the productivity application, when executed by the holographic-enabled device:

provides at least one holographic authoring command corresponding to a semantic representation of an authoring command that can be enacted on at least one content component of a content file;

in response to receiving an indication to execute a selected holographic authoring command from the at least one holographic authoring command, perform the selected holographic authoring command to modify the content file; and

communicate a modified content file or an indication of what is changed to a second computing device.

16. The holographic-enabled device of claim 15 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

in response to receiving a communication that an aspect of the content file or the productivity application is to be holographically displayed, display the aspect of the content file or the productivity application.

17. The holographic-enabled device of claim 16 , wherein the aspect of the content file or the productivity application comprises one or more of at least one content component of the content file, a command feature, or graphical icon.

18. The holographic-enabled device of claim 15 , wherein the software component of the productivity application, when executed by the holographic-enabled device, further directs the processor to:

communicate to the second computing device that an aspect of the content file or the productivity application is to be displayed by the second computing device, the second computing device providing a display separate from the holographic-enabled device.

19. The holographic-enabled device of claim 18 , wherein the aspect of the content file or the productivity application comprises one or more of at least one content component of the content file, a command feature, or graphical icon.

20. The holographic-enabled device of claim 15 , wherein the selected holographic authoring command comprises a slide sort function and the content file comprises a presentation file of a presentation application having content components including at least slides,

wherein the semantic representation of the slide sort function comprises holographic images of each slide on a real surface in a surrounding environment of a user of the holographic-enabled device, the holographic images being rearrangeable on the real surface,

wherein a change in an arrangement of the holographic images corresponds to a modification to the order of the slides in the content file.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2019
From: KAUFTHAL, JONATHAN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 048796/0526 →
Continuity (3)
Continuation 15154288 · May 13, 2016
Provisional Application 62213089 · Sep 1, 2015
Related Publication 20190227763A1 · Jul 25, 2019