IP Library › Granted Patent US 12,229,898
Granted Patent B2
US 12,229,898 · App. 17/804,394 · Granted Feb 18, 2025

Methods, systems, and computer program product for managing and displaying webpages in a virtual three-dimensional space with a mixed reality system

Inventors: Yi Huang (Plantation, FL); Genevieve Mak (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/1454G06T19/20G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,898
App. No.
17/804,394
Granted
Feb 18, 2025
Kind
B2
Abstract

Disclosed are methods, systems, and articles of manufacture for managing and displaying web pages and web resources in a virtual three-dimensional (3D) space with an extended reality system. These techniques receive an input for 3D transform for a web page or a web page panel therefor. In response to the input, a browser engine coupled to a processor of an extended reality system determines 3D transform data for the web page or the web page panel based at least in part upon the 3D transform of the web page or the web page panel, wherein the 3D transform comprises a change in 3D position, rotation, or scale of the web page or the web page panel therefor in a virtual 3D space. A universe browser engine may present contents of the web page in a virtual 3D space based at least in part upon the 3D transform data.

Claims (44)

1. An extended reality system, comprising:

a display device configured for displaying three-dimensional virtual content within a physical environment, thereby presenting a mixed reality landscape to a user; and

at least one processor configured for receiving a web page or web page panel containing additional three-dimensional virtual content from a web site, generating and anchoring a first bounded prism at a first location within the mixed reality landscape, and rendering the additional three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism for display by the display device to the user.

2. The extended reality system of claim 1 , wherein the at least one processor is configured for selecting the first location within the mixed reality landscape, such that the additional three-dimensional virtual content of the web page or web page panel does not interpenetrate the mixed reality landscape.

3. The extended reality system of claim 1 , wherein the at least one processor is further configured for translating, rotating, scaling, or transforming the first bounded prism within the mixed reality landscape in response to input from the user.

4. The extending reality system of claim 1 , wherein the first bounded prism comprises one or more handles, and wherein the input from the user comprises interacting with the one or more handles.

5. The extended reality system of claim 1 , wherein the additional three-dimensional virtual content of the web page or web page panel comprises a parent virtual object and a plurality of children virtual objects, wherein the first bounded prism is a bounded parent prism, and wherein the at least one processor is further configured for generating a plurality of bounded children prisms, anchoring the parent bounded prism at the first location within the mixed reality landscape, rendering the parent virtual object within the bounded parent prism for display by the display device to the user, and rendering the children virtual objects respectively within the bounded children prisms for display by the display device to the user.

6. The extended reality system of claim 5 , wherein the at least one processor is further configured for translating, rotating, scaling, or transforming each of the plurality of children virtual objects relative to the parent virtual object in response to input from the user.

7. The extended reality system of claim 5 , wherein the at least one processor is further configured for translating, rotating, scaling, or transforming the parent virtual object and the plurality of children virtual objects together in response to input from the user.

8. The extended reality system of claim 1 , wherein the at least one processor comprises a universe browser engine configured for generating and anchoring the first bounded prism at the first location within the mixed reality landscape, and an application configured for rendering the additional three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism for display by the display device to the user.

9. The extended reality system of claim 8 , wherein the universe browser engine is configured generating and anchoring the first bounded prism at the first location within the mixed reality landscape in response to receiving a request from the application.

10. The extended reality system of claim 1 , wherein the at least one processor is further configured for receiving a three-dimensional (3D) transform for the web page or web page panel, determining 3D transform data for the web page or the web page panel therefor based at least in part upon the 3D transform, and determining a 3D boundary for the first bounded prism based at least in part upon the 3D transform data.

11. The extended reality system of claim 10 , wherein the at least one processor is further configured for determining a 3D position, rotation, or scale for the web page or web page panel based at least in part upon the 3D transform, and rendering the first three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism with the 3D position, rotation, or scale for the web page or web page panel.

12. The extended reality system of claim 11 , wherein the at least one processor is further configured for modifying the 3D transform data into updated 3D transform data in response to a user moving and/or rotating the web page or web page panel, and transmitting the updated 3D transform data to the web site.

13. A computer implemented method, comprising:

displaying three-dimensional virtual content within a physical environment, thereby presenting a mixed reality landscape to a user;

receiving a web page or web page panel containing additional three-dimensional virtual content from a web site;

generating and anchoring a first bounded prism at a first location within the mixed reality landscape; and

rendering the additional three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism for display to the user.

14. The computer implemented method of claim 13 , further comprising:

receiving a three-dimensional (3D) transform for the web page or web page panel;

determining 3D transform data for the web page or the web page panel therefor based at least in part upon the 3D transform; and

determining a 3D boundary for the first bounded prism based at least in part upon the 3D transform data.

15. The computer implemented method of claim 14 , further comprising:

determining a 3D position, rotation, or scale for the web page or web page panel based at least in part upon the 3D transform; and

rendering the first three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism with the 3D position, rotation, or scale for the web page or web page panel.

16. The computer implemented method of claim 15 , further comprising:

modifying the 3D transform data into updated 3D transform data in response to a user moving and/or rotating the web page or web page panel; and

transmitting the updated 3D transform data to the web site.

17. A computer program product embodied on a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method comprising:

displaying three-dimensional virtual content within a physical environment, thereby presenting a mixed reality landscape to a user;

receiving a web page or web page panel containing additional three-dimensional virtual content from a web site;

generating and anchoring a first bounded prism at a first location within the mixed reality landscape; and

rendering the additional three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism for display to the user.

18. The computer program product of claim 17 , wherein the method further comprises:

receiving a three-dimensional (3D) transform for the web page or web page panel;

determining 3D transform data for the web page or the web page panel therefor based at least in part upon the 3D transform; and

determining a 3D boundary for the first bounded prism based at least in part upon the 3D transform data.

19. The computer program product of claim 18 , wherein the method further comprises:

determining a 3D position, rotation, or scale for the web page or web page panel based at least in part upon the 3D transform; and

rendering the first three-dimensional virtual content of the web page or web page panel within the anchored first bounded prism with the 3D position, rotation, or scale for the web page or web page panel.

20. The computer program product of claim 19 , wherein the method further comprises:

modifying the 3D transform data into updated 3D transform data in response to a user moving and/or rotating the web page or web page panel; and

transmitting the updated 3D transform data to the web site.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Jul 1, 2022
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060560/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2022
From: HUANG, YI; MAK, GENEVIEVE
To: MAGIC LEAP, INC.
Reel/Frame 060044/0230 →
Continuity (4)
Continuation 16839727 · Apr 3, 2020
Provisional Application 62976254 · Feb 13, 2020
Provisional Application 62828917 · Apr 3, 2019
Related Publication 20220292788A1 · Sep 15, 2022
References Cited (299)
US 5923318A · Zhai et al. · 1999 [cited by applicant]
US 6629065B1 · Gadh · 2003 [cited by examiner]
US 6720949B1 · Pryor et al. · 2004 [cited by applicant]
US 8912979B1 · Gomez · 2014 [cited by applicant]
US 8924862B1 · Luo · 2014 [cited by applicant]
US 9411422B1 · McClendon et al. · 2016 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US 9734633B2 · Bennett et al. · 2017 [cited by applicant]
US 9761055B2 · Miller · 2017 [cited by applicant]
US 10803663B2 · Wang et al. · 2020 [cited by applicant]
US 20020033845A1 · Elber et al. · 2002 [cited by applicant]
US 20060193510A1 · Matsumoto et al. · 2006 [cited by applicant]
US 20070226647A1 · Louch · 2007 [cited by applicant]
US 20080115081A1 · Sankaravadivelu et al. · 2008 [cited by applicant]
US 20090089364A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20120030617A1 · Louch · 2012 [cited by applicant]
US 20120131496A1 · Goossens et al. · 2012 [cited by applicant]
US 20120179426A1 · Fontes et al. · 2012 [cited by applicant]
US 20120212484A1 · Haddick et al. · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20120266101A1 · Shah · 2012 [cited by applicant]
US 20120294539A1 · Lim et al. · 2012 [cited by applicant]
US 20130278631A1 · Border et al. · 2013 [cited by applicant]
US 20130342572A1 · Poulos et al. · 2013 [cited by applicant]
US 20140002444A1 · Bennett et al. · 2014 [cited by applicant]
US 20140118397A1 · Lee et al. · 2014 [cited by applicant]
US 20140168262A1 · Forutanpour et al. · 2014 [cited by applicant]
US 20140184496A1 · Gribetz et al. · 2014 [cited by applicant]
US 20140195988A1 · Kramer et al. · 2014 [cited by applicant]
US 20140200863A1 · Kamat et al. · 2014 [cited by applicant]
US 20140225922A1 · Sbardella · 2014 [cited by examiner]
US 20140232639A1 · Hayashi et al. · 2014 [cited by applicant]
US 20140237393A1 · Van Wie et al. · 2014 [cited by applicant]
US 20140248950A1 · Tosas Bautista · 2014 [cited by applicant]
US 20140267228A1 · Ofek et al. · 2014 [cited by applicant]
US 20140282274A1 · Everitt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20140337792A1 · Phang et al. · 2014 [cited by applicant]
US 20140375683A1 · Salter et al. · 2014 [cited by applicant]
US 20150143302A1 · Chang et al. · 2015 [cited by applicant]
US 20150163345A1 · Cornaby et al. · 2015 [cited by applicant]
US 20150185825A1 · Mullins · 2015 [cited by applicant]
US 20150206343A1 · Mattila et al. · 2015 [cited by applicant]
US 20150206349A1 · Rosenthal et al. · 2015 [cited by applicant]
US 20150253862A1 · Seo et al. · 2015 [cited by applicant]
US 20150268831A1 · Sripada · 2015 [cited by applicant]
US 20150277699A1 · Algreatly · 2015 [cited by examiner]
US 20150302651A1 · Shpigelman · 2015 [cited by applicant]
US 20150317831A1 · Ebstyne et al. · 2015 [cited by applicant]
US 20150331240A1 · Poulos et al. · 2015 [cited by applicant]
US 20150332509A1 · Jovanovic · 2015 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160027214A1 · Memmott et al. · 2016 [cited by applicant]
US 20160048204A1 · Scott et al. · 2016 [cited by applicant]
US 20160077677A1 · Valdes · 2016 [cited by applicant]
US 20160180602A1 · Fuchs · 2016 [cited by applicant]
US 20160210602A1 · Siddique et al. · 2016 [cited by applicant]
US 20160266386A1 · Scott et al. · 2016 [cited by applicant]
US 20160300392A1 · Jonczyk et al. · 2016 [cited by applicant]
US 20160321378A1 · Kagan et al. · 2016 [cited by applicant]
US 20170011557A1 · Lee et al. · 2017 [cited by applicant]
US 20170046881A1 · Kuribara · 2017 [cited by applicant]
US 20170052994A1 · Jain et al. · 2017 [cited by applicant]
US 20170054569A1 · Harms et al. · 2017 [cited by applicant]
US 20170060514A1 · Kaufthal · 2017 [cited by applicant]
US 20170109936A1 · Powderly et al. · 2017 [cited by applicant]
US 20170132835A1 · Halliday et al. · 2017 [cited by applicant]
US 20170235848A1 · Van Dusen et al. · 2017 [cited by applicant]
US 20170256096A1 · Faaborg et al. · 2017 [cited by applicant]
US 20170256099A1 · Li · 2017 [cited by applicant]
US 20170258526A1 · Lang · 2017 [cited by applicant]
US 20170287218A1 · Nuernberger · 2017 [cited by examiner]
US 20170322622A1 · Hong et al. · 2017 [cited by applicant]
US 20180004283A1 · Mathey-Owens et al. · 2018 [cited by applicant]
US 20180005034A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180012330A1 · Holzer et al. · 2018 [cited by applicant]
US 20180033204A1 · Dimitrov et al. · 2018 [cited by applicant]
US 20180045963A1 · Hoover et al. · 2018 [cited by applicant]
US 20180082480A1 · White et al. · 2018 [cited by applicant]
US 20180095276A1 · Ng-Thow-Hing · 2018 [cited by applicant]
US 20180101994A1 · Da Veiga et al. · 2018 [cited by applicant]
US 20180131788A1 · Roberts · 2018 [cited by applicant]
US 20180144111A1 · Katingari · 2018 [cited by applicant]
US 20180144556A1 · Champion et al. · 2018 [cited by applicant]
US 20180150204A1 · Macgillivray · 2018 [cited by applicant]
US 20180210206A1 · Eronen et al. · 2018 [cited by applicant]
US 20180225885A1 · Dishno · 2018 [cited by examiner]
US 20180349485A1 · Carlisle et al. · 2018 [cited by applicant]
US 20180365897A1 · Pahud et al. · 2018 [cited by applicant]
US 20180374143A1 · Williamson et al. · 2018 [cited by applicant]
US 20190005724A1 · Pahud et al. · 2019 [cited by applicant]
US 20190025999A1 · Murphy et al. · 2019 [cited by applicant]
US 20190043259A1 · Wang et al. · 2019 [cited by applicant]
US 20190079648A1 · Karunamuni et al. · 2019 [cited by applicant]
US 20190156585A1 · Mott · 2019 [cited by examiner]
US 20190197785A1 · Tate-Gans et al. · 2019 [cited by applicant]
US 20210097775A1 · Zurmoehle et al. · 2021 [cited by applicant]
AU 2018261328B2 · 2022 [cited by applicant]
AU 2022271460B2 · 2022 [cited by applicant]
CN 103460256 · 2013 [cited by applicant]
CN 105229719 · 2016 [cited by applicant]
EP 1556805 · 2011 [cited by applicant]
EP 2455858 · 2012 [cited by applicant]
JP 200758332 · 2007 [cited by applicant]
JP 2009518699 · 2009 [cited by applicant]
JP 2010534974 · 2010 [cited by applicant]
JP 2014515962 · 2014 [cited by applicant]
JP 2015504616 · 2015 [cited by applicant]
JP 2016500891 · 2016 [cited by applicant]
JP 2016508257 · 2016 [cited by applicant]
JP 2016511492 · 2016 [cited by applicant]
KR 1020080047575 · 2008 [cited by applicant]
KR 1020140071086 · 2014 [cited by applicant]
KR 1020150130495 · 2015 [cited by applicant]
KR 1020170018930 · 2017 [cited by applicant]
WO WO2007038090 · 2007 [cited by applicant]
WO WO2015033377 · 2015 [cited by applicant]
WO WO2016203792 · 2016 [cited by applicant]
WO WO2017040442 · 2017 [cited by applicant]
WO WO2017062289 · 2017 [cited by applicant]
Schmalstieg, Dieter, et al. “The studierstube augmented reality project.” Presence: Teleoperators & Virtual Environments 11.1 (2002): 33-54. (Year: 2002). [cited by examiner]
Szalavári, Zsolt, Erik Eckstein, and Michael Gervautz. “Collaborative gaming in augmented reality.” Proceedings of the ACM symposium on Virtual reality software and technology. 1998. (Year: 1998). [cited by examiner]
Foreign Response for CA Patent Appln. No. 3060209 dated Oct. 26, 2023. [cited by applicant]
Foreign Response for AU Patent Appln. No. 2022271460 dated Oct. 26, 2023. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2021-559089 dated Oct. 30, 2023. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-142067 dated Oct. 31, 2023. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2023-7023782 dated Nov. 7, 2023. [cited by applicant]
Response After Final for U.S. Appl. No. 17/316,925 dated Nov. 14, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-143449 dated Nov. 1, 2022 (with English translation). [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2020-534227 dated Nov. 15, 2022. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880043910.4 dated Nov. 18, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/663,792 dated Nov. 22, 2022. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2022-7027516 dated Dec. 5, 2022. [cited by applicant]
Foreign Exam Report for AU Patent Appln. No. 2022271460 dated Dec. 7, 2022. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 275461 dated Nov. 9, 2022 in English. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2020-7021106 dated Dec. 9, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/368,495 dated Dec. 14, 2022. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19756664.9 dated Dec. 20, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/241,977 dated Aug. 3, 2022. [cited by applicant]
Wade et al. “A Gaze-Contingent Adaptive Virtual Reality Driving Environment for Intervention in Individuals with Autism Spectrum Disorders”, 2016, ACM (Year: 2016). [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 20784393.9 dated Jun. 20, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544237 dated Aug. 4, 2022. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2019-559343 dated Aug. 12, 2022. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 270249 dated Dec. 4, 2022 in English. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 276629 dated Dec. 21, 2022 in English. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 276621 dated Dec. 21, 2022 in English. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-143449 dated Jan. 24, 2023. [cited by applicant]
Foreign NOA for CN Patent AppIn. No. 201880043910.4 dated Jan. 11, 2023. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-143449 dated Apr. 4, 2023. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/241,977 dated Apr. 12, 2023. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2022-7027516 dated Apr. 10, 2023. [cited by applicant]
Foreign Decision of Rejection for CN Patent Appln. No. 202080026322.7 dated Mar. 18, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/839,727 dated Jun. 30, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/839,727 dated Nov. 9, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/839,727 dated Feb. 10, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/839,727 dated Feb. 28, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/968,673 dated Jul. 15, 2020. [cited by applicant]
PCT Notification of the International Search Report and Written Opinion mailed Jul. 11, 2018 for PCT Application No. PCT/US2018/030535, Applicant Magic Leap, Inc., 14 pages. [cited by applicant]
Extended European Search Report for EP Appln. No. 18794284.2 dated Jan. 29, 2020 (7 pages). [cited by applicant]
Foreign Response to 70(2) for EP Patent Appln. No. 18794284.2 dated Aug. 28, 2020. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/968,673 dated Oct. 17, 2019. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/968,673 dated Mar. 30, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 15/968,673 dated Jan. 17, 2020. [cited by applicant]
Amendment Response to Final Office Action for U.S. Appl. No. 15/968,673 dated Jun. 26, 2020. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/281,540 dated May 4, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 16/281,540 dated Aug. 4, 2020. [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US2019/018932, Applicant Magic Leap, Inc., forms PCT/ISA/210, 220, and 237, dated May 14, 2019. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/224,719 dated Feb. 6, 2020. [cited by applicant]
Final Office Action for U.S. Appln. No. 224,719 dated Jun. 18, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 16/224,719 dated May 6, 2020. [cited by applicant]
IT Jungles, “iPhone—How to Move Re-arrange Home Screen Icons”, 20150315, YouTube.com (Year: 2015). [cited by applicant]
PCT Invitation to Pay Additional Fees for International Patent Appln. No. PCT/US18/66331, Applicant Magic Leap Inc., form PCT/ISA/206, dated Mar. 13, 2019 (3 pages). [cited by applicant]
PCT International Search Report and Written Opinion for International Patent Appln. No. PCT/US18/66331, Applicant Magic Leap Inc., forms PCT/ISA/210, 220, and 237, dated May 8, 2019 (11 pages). [cited by applicant]
Amendment After Final for U.S. Appl. No. 16/224,719 dated Sep. 18, 2020. [cited by applicant]
Non-Final Office Actino for U.S. Appl. No. 16/224,719 dated Oct. 5, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/968,673 dated Oct. 7, 2020. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/281,540 dated Oct. 27, 2020. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 16/224,719 dated Jan. 5, 2021. [cited by applicant]
RCE and Response to Final Office Action for U.S. Appl. No. 16/281,540, filed Jan. 27, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/224,719 dated Jan. 27, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/281,540 dated Feb. 11, 2021. [cited by applicant]
Extended European Search Report for EP Appln. No. 18891755.3 dated Dec. 23, 2020 (9 pages). [cited by applicant]
Dieter Schmal stieg et al: “The 1-13 Studierstube Augmented Reality Project—TR-186-2-00-22”, Technical Reports of the Technical University of Vienna, Dec. 31, 2000 (Dec. 31, 2000), pp. 1-24, XP055270593, Retrieved from … [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US20/26656, Applicant Magic Leap, Inc., dated Jun. 22, 2020 (13 pages). [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 16/839,727 dated May 10, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/971,603 dated Feb. 18, 2021. [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US19/18920, Applicant Magic Leap, Inc., dated May 14, 2019. [cited by applicant]
Foreign OA for CN Patent AppIn. No. 201880043910.4 dated May 31, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/142,210 dated Aug. 5, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No. 18891755.3 dated Jul. 29, 2021. [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 19756664.9 dated Mar. 29, 2021. [cited by applicant]
RCE and Amendment Response to FOA for U.S. Appl. No. 16/839,727, filed Sep. 30, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No 19756664.9 dated Oct. 25, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19757809.9 dated Oct. 22, 2021. [cited by applicant]
Foreign Exam Report for AU Patent Appln. No. 2018261328 dated Sep. 6, 2021. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2019-559343 dated Oct. 6, 2021 (with English translation). [cited by applicant]
Uchiyama, H., et al., “Method for Displaying Images on Urban Structures by Augmented Reality,” IEICE technical report, JP, the Institute of Electronics, Information and Communication Engineers, Mar. 22, 2012, vol. 111 N… [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880043910.4 dated Jan. 5, 2022. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2019-7035273 dated Sep. 16, 2021. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2019-7035273 dated Jan. 18, 2022. [cited by applicant]
Amendment Response for U.S. Appl. No. 16/839,727 dated Feb. 7, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 201947046799 dated Feb. 11, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/142,210 dated Feb. 18, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/368,495 dated Feb. 25, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544237 dated Feb. 21, 2022 (with English translation). [cited by applicant]
Foreign FOA for JP Patent Appln. No. 2019-559343 dated Mar. 8, 2022 (with English translation). [cited by applicant]
Foreign OA for IL Patent Appln. No. 270249 dated Jan. 28, 2022. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880043910.4 dated Mar. 16, 2022. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2019-7035273 dated Mar. 15, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544190 dated Mar. 15, 2022 (with English translation). [cited by applicant]
Foreign Rejection Decision for CN Patent Appln. No. 201880043910.4 dated Apr. 29, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2020-544237 dated May 17, 2022. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2019-7035273 dated May 9, 2022. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/368,495 dated May 25, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-534227 dated May 20, 2022. [cited by applicant]
Foreign Response for IL Patent Appln. No. 270249 dated May 26, 2022. [cited by applicant]
Foreign Response for EP Patent Appln. No. 18794284.2 dated Jun. 3, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2019-559343 dated Jun. 7, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2020-544190 dated Jun. 13, 2022. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2020-544190 dated Jun. 24, 2022. [cited by applicant]
Foreign Response for AU Patent Appln. No. 2018261328 dated Jul. 20, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/368,495 dated Jul. 27, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 202047032176 dated Jul. 19, 2022. [cited by applicant]
Foreign NOA for AU Patent Appln. No. 2018261328 dated Aug. 10, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 202047029094 dated Aug. 26, 2022. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/368,495 dated Sep. 22, 2022. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880043910.4 dated Sep. 23, 2022. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2022-7027516 dated Feb. 3, 2023. [cited by applicant]
Foreign Response for CN Patent Appln. No. 202080026322.7 dated Feb. 9, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/316,925 dated Feb. 16, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/241,977 dated Feb. 17, 2023. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/663,792 dated Feb. 22, 2023. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2020-7021106 dated Apr. 18, 2023. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/316,925 dated May 16, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/241,977 dated May 12, 2023. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/241,977 dated Nov. 2, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-117087 dated Nov. 17, 2023. [cited by applicant]
Foreign NOA for AU Patent Appln. No. 2022271460 dated Nov. 7, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/316,925 dated Dec. 11, 2023. [cited by applicant]
Foreign Response for CN Patent Appln. No. 202080026322.7 dated Jun. 26, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/663,792 dated May 24, 2023. [cited by applicant]
Foreign Exam Report for NZ Patent Appln. No. 758288 dated May 12, 2023. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/663,792 dated Jul. 24, 2023. [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 23159324.5 dated Jun. 1, 2023. [cited by applicant]
Foreign Exam Report for CA Patent Appln. No. 3060209 dated Jun. 30, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/316,925 dated Aug. 14, 2023. [cited by applicant]
Foreign Reexamination Decision for CN Patent Appln. No. 201880043910.4 dated Aug. 22, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2021-559089 dated Aug. 10, 2023 (with English translation). [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-142067 dated Aug. 7, 2023 (with English translation). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/663,792 dated Aug. 30, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-117087 dated Aug. 14, 2023 (with English translation). [cited by applicant]
Foreign OA for CN Patent Appln. No. 202080026322.7 dated Oct. 12, 2022. [cited by applicant]
Schmalstieg, D., et al., “The Studierstube Augmented Reality Project,” Presence, vol. 11, No. 1, Feb. 2002, 33-54, © 2002 by the Massachusetts Institute of Technology. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7021106 dated Oct. 14, 2022. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2023-7023782 dated Dec. 28, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-199311 dated Dec. 21, 2023 (with English translation). [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2021-559089 dated Jan. 16, 2024. [cited by applicant]
Foreign Response for EP Patent Appln. No. 23159324.5 dated Jan. 19, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Dec. 28, 2023 (with English translation). [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-117087 dated Jan. 26, 2024 (with English translation). [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-142067 dated Jan. 25, 2024 (with English translation). [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880088453.0 dated Feb. 28, 2024. [cited by applicant]
Foreign NOA for CA Patent Appln. No. 3060209 dated Feb. 1, 2024. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-199311 dated Mar. 13, 2024. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-199311 dated Mar. 21, 2024. [cited by applicant]
Foreign Exam Report for EP Patent Appln. No. 19756664.9 dated Jan. 29, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/182,590 dated Apr. 2, 2024. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 270249 dated Apr. 15, 2024 in English. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-142067 dated Apr. 25, 2024. [cited by applicant]
Foreign Hearing Notice for IN Patent Appln. No. 201947046799 dated Apr. 26, 2024 in English. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7026917 dated Apr. 19, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014588.7 dated May 13, 2024. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2023-7023782 dated May 14, 2024. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2023-7023413 dated May 20, 2024 (with English translation). [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-117087 dated May 28, 2024. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19756664.9 dated May 29, 2024. [cited by applicant]
Foreign Refusal Order for IN Patent Appln. No. 201947046799 dated Jun. 6, 2024 in English. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-117087 dated Jun. 25, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014719.1 dated Jun. 24, 2024 (with English translation). [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-142067 dated Jun. 26, 2024. [cited by applicant]
Foreign NOA for JP Patent AppIn No. 2023-76383 dated Jun. 12, 2024 (with English translation). [cited by applicant]
Amendment Response for U.S. Appl. No. 18/182,590 dated Jul. 1, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880088453.0 dated Jun. 28, 2024. [cited by applicant]
Foreign OA Response for KR Patent Appln. No. 10-2023-7023413 dated Jul. 22, 2024 (with English translation). [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7026920 dated Jul. 28, 2024 (with English translation). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/523,763 dated Aug. 15, 2024. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2023-7023413 dated Aug. 21, 2024. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2023-76383 dated Aug. 27, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Aug. 15, 2024 (with English translation). [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2020-7026920 dated Sep. 20, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014588.7 dated Oct. 11, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880088453.0 dated Oct. 12, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014719.1 dated Oct. 17, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Dec. 6, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/182,590 dated Oct. 29, 2024. [cited by applicant]
Amendment Response to NFOA for U.S. Appln. No. 18/523.763 dated Nov. 12, 2024. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2024-21089 dated Oct. 24, 2024 (with English translation). [cited by applicant]
Foreign NOA for CN Patent Appln. No. 201880088453.0 dated Nov. 6, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/523,763 dated Nov. 25, 2024. [cited by applicant]