IP Library Granted Patent US 12,444,316
Granted Patent B2
US 12,444,316 · App. 18/933,172 · Granted Oct 14, 2025

Individual viewing in a shared space

Inventors: Earle M Alexander, IV (San Francisco, CA); Pedro Luis Arroyo (Fort Lauderdale, FL); Jean I. Venerin (San Francisco, CA); William Adams (New York, NY)
Assignee: Magic Leap, Inc.
G09B5/125G06F3/011G06T19/006H04L12/1822
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,444,316
App. No.
18/933,172
Granted
Oct 14, 2025
Kind
B2
Abstract

A mixed reality virtual environment is sharable among multiple users through the use of multiple view modes that are selectable by a presenter. Multiple users with wearable display systems may wish to view a common virtual object, which may be presented in a virtual room to any suitable number of users. A presentation may be controlled by a presenter using a presenter wearable system that leads multiple participants through information associated with the virtual object. Use of different viewing modes allows individual users to see different virtual content through their wearable display systems, despite being in a shared viewing space or alternatively, to see the same virtual content in different locations within a shared space.

Claims (35)

1. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a plurality of wearable systems associated with a virtual environment including a virtual object, the plurality of wearable systems including a plurality of participant wearable systems and a presenter wearable system authorized to update views of the participant wearable systems, wherein the presenter wearable system depicts, to a presenter a view of the virtual object that includes a panel selection area associated with a panel of multimedia content regarding the virtual object, wherein selection of the panel selection area by the presenter causes display of the panel of multimedia content at a first location with reference to the virtual object;

detecting a view change input from the presenter wearable system;

in response to determining that the view change input indicates an individual view mode, transmitting instructions to each of the participant wearable systems to update output of the participant wearable system to display the panel of multimedia content at a second location relative to a current head pose of the respective participant wearable system; and

in response to determining that the view change input indicates a group view mode, transmitting instructions to each of the participant wearable systems to update output of the participant wearable system to display the panel of multimedia content at a third location with reference to the virtual object.

2. The method of claim 1 , wherein voice input on the presenter wearable system is broadcast to each of the participant wearable systems.

3. The method of claim 1 , further comprising:

in response to rotation of the virtual object by the presenter, automatically initiating rotation of the virtual object in displays of the participant wearable systems.

4. The method of claim 1 , further comprising:

in response to determining that the view change input indicates a classroom view mode, transmitting instructions to each of the participant wearable systems to update output of the participant wearable system to include a plurality of avatars associated with a corresponding plurality of the participant wearable systems.

5. The method of claim 4 , wherein locations of the plurality of avatars in the virtual environment are updated in real-time causing the presenter wearable system to display movements of the participant wearable systems.

6. The method of claim 4 , wherein the plurality of avatars are arranged in a pattern in the virtual environment displayed in the presenter wearable systems.

7. The method of claim 4 , wherein a gaze direction of the avatars is visually indicated in the viewing environment displayed in the presenter wearable system.

8. The method of claim 7 , wherein the gaze direction is visually indicated with a marking on the avatar.

9. The method of claim 7 , wherein the gaze direction is visually indicated with a line extending outward from the avatar in the determined gaze direction.

10. The method of claim 1 , further comprising:

updating output of the presenter wearable system to display a view menu including selectable options associated with a view change input.

11. The method of claim 1 , wherein the panel of multimedia content includes one or more emission markers associated with respective content.

12. The method of claim 11 , wherein the emission markers are visible as colored circles.

13. The method of claim 1 , wherein the presenter wearable system is configured to allow the presenter to provide inputs to cause the virtual object to rotate.

14. The method of claim 1 , wherein the first location with reference to the virtual object is offset away from the virtual object by a first distance.

15. The method of claim 1 , wherein the panel of multimedia content is enlarged in the group view mode.

16. The method of claim 1 , wherein the third location with reference to the virtual object is offset away from the virtual object a second distance that is greater than the first distance.

17. The method of claim 1 , wherein the third location is above the virtual object.

18. The method of claim 1 , wherein each participant wearable system that is in the individual view mode displays an individual view of the panel of multimedia content that is viewable only by the individual user.

19. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a plurality of wearable systems associated with a virtual scene including a virtual object, wherein each of the wearable systems concurrently depicts (i) a shared portion of the virtual scene associated with the virtual object that is the same for each wearable system and (ii) an individual portion of the virtual scene associated with the virtual object that is customizable by the individual users, wherein a first wearable systems is configured to receive inputs to change a view mode of the virtual scene, wherein the view modes define which portions of the virtual scene are included in one or more of the shared and individual portions; and

in response to detecting a view change input from the first wearable system, electronically communicating with each of the wearable systems virtual scene information in accordance with a currently selected view mode.

20. A computing system comprising:

a hardware computer processor; and

a non-transitory computer readable medium having software instructions stored thereon, the software instructions executable by the hardware computer processor to cause the computing system to perform operations comprising:

determining a plurality of wearable systems associated with a virtual environment including a virtual object, the plurality of wearable systems including a plurality of participant wearable systems and a presenter wearable system authorized to update views of the participant wearable systems, wherein the presenter wearable system depicts to a presenter a view of the virtual object that includes a panel selection area associated with a panel of multimedia content regarding the virtual object, wherein selection of the panel selection area by the presenter causes display of the panel of multimedia content at a first location with reference to the virtual object;

detecting a view change input from the presenter wearable system;

in response to determining that the view change input indicates an individual view mode, transmitting instructions to each of the participant systems to update output of the participant wearable system to display the panel of multimedia content at a second location relative to a current head pose of the respective participant wearable system; and

in response to determining that the view change input indicates a group view mode, transmitting instructions to each of the participant wearable systems to update output of the participant wearable system to display the panel of multimedia content at a third location with reference to the virtual object.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2024
From: ALEXANDER, EARLE M., IV; ARROYO, PEDRO LUIS; VENERIN, JEAN I.
To: MAGIC LEAP, INC.
Reel/Frame 069090/0945 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2024
From: ADAMS, WILLIAM
To: MAGIC LEAP, INC.
Reel/Frame 069091/0183 →
Continuity (4)
Continuation 18470286 · Sep 19, 2023
Continuation 17029670 · Sep 23, 2020
Provisional Application 62907178 · Sep 27, 2019
Related Publication 20250124802A1 · Apr 17, 2025
References Cited (50)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 9824499B2 · Wright et al. · 2017 [cited by applicant]
US 9846972B2 · Montgomerie et al. · 2017 [cited by applicant]
US 10871934B2 · Paulovich et al. · 2020 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060170652A1 · Bannai et al. · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160371885A1 · Gavriliuc et al. · 2016 [cited by applicant]
US 20170199639A1 · O'Hara et al. · 2017 [cited by applicant]
US 20170301140A1 · Smith et al. · 2017 [cited by applicant]
US 20180307303A1 · Powderly et al. · 2018 [cited by applicant]
US 20180349700A1 · Percuoco et al. · 2018 [cited by applicant]
US 20180359448A1 · Harries · 2018 [cited by applicant]
US 20190130656A1 · Gebbie · 2019 [cited by examiner]
US 20190232500A1 · Bennett et al. · 2019 [cited by applicant]
US 20190250805A1 · Brewer · 2019 [cited by examiner]
US 20190253692A1 · El-Imad et al. · 2019 [cited by applicant]
US 20200066046A1 · Stahl et al. · 2020 [cited by applicant]
US 20210097875A1 · Alexander, IV et al. · 2021 [cited by applicant]
US 20240005808A1 · Alexander, IV et al. · 2024 [cited by applicant]
WO 2021061821A1 · 2021 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/ azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu/raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
EP20867763.3 Extended European Search Report dated Sep. 13, 2023. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US20/52282, issued Mar. 15, 2022. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US20/52282, mailed Jan. 13, 2021. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. AMC CHI 2000 Human Factors in Computin… [cited by applicant]