Granted Patent B2

US 12,347,048 · App. 18/523,763 · Granted Jul 1, 2025

Inventors: Denys Bastov (Palo Alto, CA); Victor Ng-Thow-Hing (Los Altos, CA); Benjamin Zaaron Reinhardt (San Francisco, CA); Leonid Zolotarev (Weston, FL); Yannick Pellet (Plantation, FL); Aleksei Marchenko (Sunnyvale, CA); Brian Everett Meaney (Parkland, FL); Marc Coleman Shelton (Fort Lauderdale, FL); Megan Ann Geiman (Fort Lauderdale, FL); John A. Gotcher (Prosper, TX); Matthew Schon Bogue (McKinney, TX); Shivakumar Balasubramanyam (Rancho Santa Fe, CA); Jeffrey Edward Ruediger (McKinney, TX); David Charles Lundmark (Los Altos, CA)

Assignee: Magic Leap, Inc.

G06T19/006G06F3/011G06F3/04815G06T19/20G06T2207/10028H04N21/2542H04N21/4312H04N21/816

Abstract

Claims (32)

1. A computer-implemented method for presenting virtual content within a physical environment to a user, comprising:

receiving, at an extended reality system, virtual content from a content provider, the virtual content comprising a content element and a formatting tag associated with the content element, the formatting tag defining an attribute of a surface on which the content element is to be placed;

identifying content element within the received content;

extracting the formatting tag from the identified content element;

identifying a surface within the physical environment having the attribute of the surface defined by the formatting tag;

presenting a mixed reality landscape to the user, such that the identified content element is placed on the identified surface; and

identifying a plurality of surface options in the physical environment having the attribute of the surface defined by the formatting tag;

placing the identified content element on each of the identified plurality of surface options;

providing the user with an option to select one of the identified plurality of surface options; and

selecting the one of the identified plurality of surface options as the identified surface on which the identified content element is placed.

2. The method of claim 1 , wherein the attribute of the surface defined by the formatting tag comprises one of a surface contour and a surface texture.

3. The method of claim 1 , further comprising determining a plurality of different attributes of each of a plurality of surfaces in the physical environment, wherein identifying the surface within the physical environment having the attribute of the surface defined by the formatting tag comprises comparing the attribute of the surface to the different attributes of each of the plurality of surfaces in the physical environment.

4. The method of claim 1 , wherein the virtual content comprises a webpage, the formatting tag is an HTML tag, and the webpage is received at a web browser of the extended reality system.

5. The method of claim 4 , further comprising deconstructing content by parsing webpage, thereby identifying a plurality of content elements from the webpage, wherein one of the content elements is the content element associated with formatting tag, and presenting the mixed reality landscape to the user, such that plurality of content elements are placed on a plurality of different surfaces within the physical environment.

6. The method of claim of claim 5 , further comprising parsing the physical environment, thereby identifying the plurality of surfaces from the physical environment.

7. The method of claim 1 , wherein the identified content element is simultaneously placed on each of the identified plurality of surface options.

8. The method of claim 1 , wherein providing the user with an option to select the one identified surface option comprises presenting a plurality of virtual control elements to the user respectively corresponding to the plurality of surface options, and wherein selecting one surface option as the identified surface comprises manipulating the one of the plurality of virtual control elements corresponding to the one surface option.

9. The method of claim 1 , wherein the identified content element is placed on the identified surface in response to selecting the one of the plurality of surface options.

10. The method of claim 1 , wherein the identified plurality of surface options are in the field of view of the user, the method further comprising:

identifying at least one additional surface option in the physical environment within a new field of view of the user; and

providing the user with an option to select one of the identified at least one additional surface option; and

selecting the one of the identified at least one additional surface option as a new surface; and

presenting the mixed reality landscape to the user, such that the identified content element is placed on the new surface.

11. The method of claim 10 , further comparing a change in headpose of the user to a headpose change threshold, wherein the user is provided with the option to select one of the identified at least one additional surface option based on the comparison.

12. The method of claim 10 , further comprising comparing an elapsed time of the new field of view of the user to a time threshold, wherein the user is provided with the option to select one of the identified at least one additional surface option based on the comparison.

13. The method of claim 1 , wherein the virtual content has a plurality of content elements and a plurality of formatting tags respectively associated with the plurality of content elements, each of the plurality of formatting tags respectively defining an attribute of a surface on which the respective content element is to be placed, the method further comprising:

comparing the attribute of the identified surface to the plurality of attributes respectively identified by the plurality of formatting tags;

selecting the identified content element from the plurality of content elements based on the comparison, wherein the mixed reality landscape is presented to the user, such that the selected content element is placed on the identified surface.

14. The method of claim 1 , wherein the content element is a three-dimensional content element.

15. The method of claim 1 , wherein the virtual content comprises a video stream.

16. The method of claim 1 , wherein the extended reality system is worn by the user.

17. The method of claim 16 , wherein the extended reality system comprises a head-mounted display (HMD) device.

Assignments (3)

Continuity (7)

References Cited (322)