IP Library Granted Patent US 12,243,445
Granted Patent B2
US 12,243,445 · App. 18/470,286 · Granted Mar 4, 2025

Individual viewing in a shared space

Inventors: Earle M. Alexander, IV (San Francisco, CA); Pedro Luis Arroyo (Fort Lauderdale, FL); Jean I. Venerin (San Francisco, CA); William Adams (New York, NY)
Assignee: Magic Leap, Inc.
G09B5/125G06F3/011G06T19/006H04L12/1822
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,445
App. No.
18/470,286
Granted
Mar 4, 2025
Kind
B2
Abstract

A mixed reality virtual environment is sharable among multiple users through the use of multiple view modes that are selectable by a presenter. Multiple users may wish to view a common virtual object, such as one that is used for educational purposes, such as a piece of art in a museum, automobile, biological specimen, chemical compound, etc. The virtual object may be presented in a virtual room to any number of users. A presentation may be controlled by a presenter (e.g., a teacher of a class of students) that leads multiple participants (e.g., students) through information associated with the virtual object. Use of different viewing modes allows individual users to see different virtual content despite being in a shared viewing space or alternatively, to see the same virtual content in different locations within a shared space.

Claims (31)

1. A computer-implemented method performed by one or more hardware computer processors of a computing system, the method comprising:

determining a plurality of wearable systems associated with a virtual scene that includes a virtual object, wherein each of the wearable systems concurrently presents: (i) a shared portion of the virtual scene that is the same for each wearable system, and (ii) an individual portion of the virtual scene that is customizable by a user of the respective wearable system;

receiving an indication of a view change input that is received by a first wearable system of the plurality of wearable systems, the view change input indicating a selected view mode of the virtual scene that is being presented through the first wearable system, wherein the selected view mode is selected from a plurality of available view modes that define which portions of the virtual scene are included in one or more of the shared portion and the individual portions; and

in response to the indication of the view change input received by the first wearable system, communicating virtual scene information to each of the plurality wearable systems, wherein the virtual scene information causes each of the plurality of wearable systems to present at least one of the shared portion or the respective individual portion of the virtual scene according to the selected view mode.

2. The method of claim 1 , wherein the shared portion of the virtual scene includes a detail view including detailed information regarding the virtual object.

3. The method of claim 2 , wherein the detail view is presented, through each of the plurality of wearable systems, at a fixed real world location with respect to the virtual object.

4. The method of claim 2 , wherein the detail view is presented, through each of the plurality of wearable systems, at a location that corresponds to a gaze direction of a respective user of each of the plurality of wearable systems.

5. The method of claim 1 , wherein the selected view mode is selected through a view select menu that is presented by the first wearable system.

6. The method of claim 5 , wherein the first wearable system includes a hardware controller, and wherein a user of the first wearable system uses the hardware controller to select the selected view mode through the view select menu.

7. The method of claim 1 , wherein the selected view mode indicates that a user of the first wearable system is permitted to rotate the virtual object presented in the shared portion and that other users of the other wearable systems are not permitted to rotate the virtual object.

8. A computing system comprising:

one or more hardware computer processors;

non-transitory computer readable storage media storing instructions which, when executed, cause the one or more hardware computer processors to perform operations comprising:

determining a plurality of wearable systems associated with a virtual scene that includes a virtual object, wherein each of the wearable systems concurrently presents: (i) a shared portion of the virtual scene that is the same for each wearable system, and (ii) an individual portion of the virtual scene that is customizable by a user of the respective wearable system;

receiving an indication of a view change input that is received by a first wearable system of the plurality of wearable systems, the view change input indicating a selected view mode of the virtual scene that is being presented through the first wearable system, wherein the selected view mode is selected from a plurality of available view modes that define which portions of the virtual scene are included in one or more of the shared portion and the individual portions; and

in response to the indication of the view change input received by the first wearable system, communicating virtual scene information to each of the plurality wearable systems, wherein the virtual scene information causes each of the plurality of wearable systems to present at least one of the shared portion or the respective individual portion of the virtual scene according to the selected view mode.

9. The system of claim 8 , wherein the shared portion of the virtual scene includes a detail view including detailed information regarding the virtual object.

10. The system of claim 9 , wherein the detail view is presented, through each of the plurality of wearable systems, at a fixed real world location with respect to the virtual object.

11. The system of claim 9 , wherein the detail view is presented, through each of the plurality of wearable systems, at a location that corresponds to a gaze direction of a respective user of each of the plurality of wearable systems.

12. The system of claim 8 , wherein the selected view mode is selected through a view select menu that is presented by the first wearable system.

13. The system of claim 12 , wherein the first wearable system includes a hardware controller, and wherein a user of the first wearable system uses the hardware controller to select the selected view mode through the view select menu.

14. The system of claim 8 , wherein the selected view mode indicates that a user of the first wearable system is permitted to rotate the virtual object presented in the shared portion and that other users of the other wearable systems are not permitted to rotate the virtual object.

15. The system of claim 8 , wherein the computing system is the first wearable system.

16. One or more non-transitory computer-readable storage media storing instructions which, when executed, cause one or more hardware computer processors to perform operations comprising:

determining a plurality of wearable systems associated with a virtual scene that includes a virtual object, wherein each of the wearable systems concurrently presents: (i) a shared portion of the virtual scene that is the same for each wearable system, and (ii) an individual portion of the virtual scene that is customizable by a user of the respective wearable system;

receiving an indication of a view change input that is received by a first wearable system of the plurality of wearable systems, the view change input indicating a selected view mode of the virtual scene that is being presented through the first wearable system, wherein the selected view mode is selected from a plurality of available view modes that define which portions of the virtual scene are included in one or more of the shared portion and the individual portions; and

in response to the indication of the view change input received by the first wearable system, communicating virtual scene information to each of the plurality wearable systems, wherein the virtual scene information causes each of the plurality of wearable systems to present at least one of the shared portion or the respective individual portion of the virtual scene according to the selected view mode.

17. The one or more non-transitory computer-readable storage media of claim 16 , wherein the shared portion of the virtual scene includes a detail view including detailed information regarding the virtual object.

18. The one or more non-transitory computer-readable storage media of claim 17 , wherein the detail view is presented, through each of the plurality of wearable systems, at a fixed real world location with respect to the virtual object.

19. The one or more non-transitory computer-readable storage media of claim 17 , wherein the detail view is presented, through each of the plurality of wearable systems, at a location that corresponds to a gaze direction of a respective user of each of the plurality of wearable systems.

20. The one or more non-transitory computer-readable storage media of claim 16 , wherein the selected view mode is selected through a view select menu that is presented by the first wearable system.

Assignments (4)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073031/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2024
From: ALEXANDER, EARLE M., IV; ARROYO, PEDRO LUIS; VENERIN, JEAN I.
To: MAGIC LEAP, INC.
Reel/Frame 069090/0945 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2024
From: ADAMS, WILLIAM
To: MAGIC LEAP, INC.
Reel/Frame 069091/0183 →
Continuity (3)
Continuation 17029670 · Sep 23, 2020
Provisional Application 62907178 · Sep 27, 2019
Related Publication 20240005808A1 · Jan 4, 2024
References Cited (48)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 9824499B2 · Wright et al. · 2017 [cited by applicant]
US 9846972B2 · Montgomerie et al. · 2017 [cited by applicant]
US 10871934B2 · Paulovich et al. · 2020 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060170652A1 · Bannai et al. · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160371885A1 · Gavriliuc et al. · 2016 [cited by applicant]
US 20170199639A1 · O'Hara et al. · 2017 [cited by applicant]
US 20170301140A1 · Smith et al. · 2017 [cited by applicant]
US 20180307303A1 · Powderly et al. · 2018 [cited by applicant]
US 20180349700A1 · Percuoco et al. · 2018 [cited by applicant]
US 20180359448A1 · Harries · 2018 [cited by applicant]
US 20190130656A1 · Gebbie · 2019 [cited by examiner]
US 20190232500A1 · Bennett et al. · 2019 [cited by applicant]
US 20190250805A1 · Brewer · 2019 [cited by examiner]
US 20190253692A1 · El-Imad et al. · 2019 [cited by applicant]
US 20200066046A1 · Stahl et al. · 2020 [cited by applicant]
WO 2021061821A1 · 2021 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/ azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu/raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
EP20867763.3 Extended European Search Report dated Sep. 13, 2023. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US20/52282, issued Mar. 15, 2022. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US20/52282, mailed Jan. 13, 2021. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. AMC CHI 2000 Human Factors in Computin… [cited by applicant]