Head mounted display system receiving three-dimensional push notification

1. A head-mounted display system, comprising:

a head-mounted display configured to display one or more virtual objects in a physical environment, the one or more virtual objects including an application program virtual object associated with an application program and displayed at a first location in the physical environment, wherein the application program virtual object is displayed to occupy a first volume of space in the physical environment;

at least one input device; and

a processor configured to:

receive a three-dimensional push notification at the application program via an application program interface (API) of one or more APIs included in a volumetric operating system, the three-dimensional push notification including location data indicating a second location relative to the first location in the physical environment;

determine whether a three-dimensional push notification virtual object is to be displayed inside or outside a field of view of a user;

generate the three-dimensional push notification virtual object based on the three-dimensional push notification;

responsive to determining that the three-dimensional push notification virtual object is to be displayed inside the field of view, output the three-dimensional push notification virtual object for display on the head-mounted display at the second location, wherein the three-dimensional push notification virtual object is displayed to occupy a second volume of space in the physical environment;

responsive to determining that the three-dimensional push notification virtual object is to be displayed outside the field of view, output an indication of a direction toward the second location; and

receive an interaction input via the at least one input device, wherein the interaction input includes an interaction with the three-dimensional push notification virtual object within the second volume of space.

2. The head-mounted display system of claim 1 , wherein the second location is a world-locked location in the physical environment.

3. The head-mounted display system of claim 2 , wherein at least one of the first location and the second location is an anchor location world-locked to a surface of a physical object in the physical environment.

4. The head-mounted display system of claim 1 , wherein the processor is further configured to:

generate at least one additional virtual object based on the interaction input; and

output the at least one additional virtual object for display on the head-mounted display.

5. The head-mounted display system of claim 4 , wherein the interaction input includes an interaction with the application program virtual object within the first volume of space.

6. The head-mounted display system of claim 1 , further comprising an inward-facing optical sensor configured to detect a gaze direction of a user, wherein:

the processor is further configured to determine the field of view of the user based on the gaze direction.

7. The head-mounted display system of claim 1 , further comprising a plurality of speakers, wherein the processor is further configured to:

generate a spatial sound output localized at the first location; and

output the spatial sound output to the plurality of speakers.

8. The head-mounted display system of claim 1 , wherein the three-dimensional push notification includes three-dimensional push notification data selected from the group consisting of color data, shape data, text data, animation data, interactivity data, and location data of the three-dimensional push notification virtual object.

9. The head-mounted display system of claim 1 , wherein the three-dimensional push notification virtual object is configured to replace the application program virtual object.

10. The head-mounted display system of claim 1 , wherein the three-dimensional push notification virtual object is displayed on a surface of the application program virtual object.

11. The head-mounted display system of claim 1 , wherein the three-dimensional push notification virtual object is displayed based at least in part on a display location of the head-mounted display in the physical environment.

12. The head-mounted display system of claim 11 , wherein the three-dimensional push notification virtual object is displayed along a direction from the display location to the first location.

13. The head-mounted display system of claim 1 , further comprising a haptic feedback device, wherein the processor is further configured to:

generate a haptic feedback output indicating a direction toward the first location; and

output the haptic feedback to the haptic feedback device.

14. The head-mounted display system of claim 1 , wherein the indication of the direction toward the second location includes one or more of a visual indicator, a spatial sound output, and a haptic feedback output.

15. A method for use with a head-mounted display system, the method comprising:

executing an application program in a volumetric operating system, wherein executing the application program includes outputting an application program virtual object for display on a head-mounted display at a first location in a physical environment, wherein the application program virtual object is displayed to occupy a first volume of space in the physical environment;

receiving a three-dimensional push notification at the application program via an application program interface (API) of one or more APIs included in the volumetric operating system, the three-dimensional push notification including location data indicating a second location relative to the first location in the physical environment;

determining whether a three-dimensional push notification virtual object is to be displayed inside or outside a field of view of a user;

generating the three-dimensional push notification virtual object based on the three-dimensional push notification; and

responsive to determining that the three-dimensional push notification virtual object is to be displayed inside the field of view, outputting the three-dimensional push notification virtual object for display on the head-mounted display at the second location, wherein the three-dimensional push notification virtual object is displayed to occupy a second volume of space in the physical environment;

responsive to determining that the three-dimensional push notification virtual object is to be displayed outside the field of view, outputting an indication of a direction toward the second location; and

receiving an interaction input via at least one input device, wherein the interaction input includes an interaction with the three-dimensional push notification virtual object within the second volume of space.

16. The method of claim 15 , wherein the second location is a world-locked location in the physical environment.

17. The method of claim 15 , further comprising:

generating at least one additional virtual object based on the interaction input; and

outputting the at least one additional virtual object for display on the head-mounted display.

18. The method of claim 15 , wherein the three-dimensional push notification includes three-dimensional push notification data selected from the group consisting of color data, shape data, text data, animation data, interactivity data, and location data of the three-dimensional push notification virtual object.

19. The method of claim 15 , wherein the three-dimensional push notification virtual object is generated based at least in part on a display location of the head-mounted display in the physical environment.

20. A head-mounted display system, comprising:

a head-mounted display configured to display one or more virtual objects in a physical environment;

at least one input device; and

a processor configured to:

receive a three-dimensional push notification at an application program via an application program interface (API) of one or more APIs included in a volumetric operating system, wherein:

the three-dimensional push notification indicates a first location in the physical environment of an application program virtual object included in the one or more virtual objects, wherein the application program virtual object is displayed to occupy a first volume of space in the physical environment;

the application program virtual object is associated with the application program; and

the three-dimensional push notification indicates a second location relative to the first location in the physical environment;

determine whether a three-dimensional push notification virtual object is to be displayed inside or outside a field of view of a user;

generate the three-dimensional push notification virtual object based on the three-dimensional push notification;

responsive to determining that the three-dimensional push notification virtual object is to be displayed inside the field of view, output the three-dimensional push notification virtual object for display on the head-mounted display at the second location, wherein the three-dimensional push notification virtual object occupies a second volume of space in the physical environment; and

responsive to determining that the three-dimensional push notification virtual object is to be displayed outside the field of view, output an indication of a direction toward the second location;

receive an interaction input via the at least one input device, wherein the interaction input includes an interaction with the three-dimensional push notification virtual object within the second volume of space.