IP Library › Granted Patent US 12,236,550
Granted Patent B2
US 12,236,550 · App. 18/182,590 · Granted Feb 25, 2025

Object creation with physical manipulation

Inventors: Tim Zurmoehle (Plantation, FL); Andrea Isabel Montoya (Plantation, FL); Robert John Cummings Macdonald (Plantation, FL); Sakina Groth (Plantation, FL); Genevieve Mak (Plantation, FL)
Assignee: Magic Leap, Inc.
G06T19/20G06F3/011G06F3/016G06F3/017G06F3/0346G06T19/006G06T2200/24G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,550
App. No.
18/182,590
Granted
Feb 25, 2025
Kind
B2
Abstract

Described are improved systems and methods for navigation and manipulation of interactable objects in a 3D mixed reality environment. Improved systems and methods are provided to implement physical manipulation for creation and placement of interactable objects, such as browser windows and wall hangings. A method includes receiving data indicating a selection of an interactable object contained within a first prism at the start of a user interaction. The method also includes receiving data indicating an end of the user interaction with the interactable object. The method further includes receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction. Moreover, the method includes creating a second prism to contain the data associated with the interactable object at the end of the user interaction with the interactable object.

Claims (61)

1. A system, comprising:

a mixed reality display device configured for displaying an interactable object as virtual content at a first location within a spatially organized three-dimensional environment to a user;

a user interface configured for detecting interaction of the user with the interactable object; and

a processor configured for:

receiving data indicating a selection of the interactable object contained within a first prism at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of the user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

instructing the mixed reality display device to display the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating an end of the user interaction with the interactable object;

receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a second prism to contain the interactable object at the end of the user interaction with the interactable object,

wherein the three-dimensional environment includes a deconstructed two-dimensional web page.

2. The system of claim 1 , wherein the processor is also configured for instructing the mixed reality display device to display the preview at a location of the interactable object between the start and the end of the user interaction when the interactable object is located outside of bounds of the first prism.

3. The system of claim 1 , further comprising a user input device configured to provide the data indicating the selection of the interactable object and the data indicating the end of the user interaction with the interactable object.

4. The system of claim 3 , wherein the user input device is a haptics controller.

5. The system of claim 4 , wherein the haptics controller is a totem device having at least six degrees of freedom.

6. The system of claim 4 , further comprising a processing system associated with the haptics controller,

wherein the processing system is configured to translate the physical movement of the user into event objects, and

wherein the event objects correlate to data for movement or positioning of the haptics controller.

7. The system of claim 4 , wherein the haptics controller comprises a trigger, and

wherein a location of the interactable object at the end of the user interaction is determined by identifying a location at which the trigger is released after the selection of the interactable object.

8. The system of claim 3 , wherein the user input device is a camera to detect a user gesture.

9. The system of claim 8 , wherein the data indicating the selection of the interactable object corresponds to a selection gesture.

10. The system of claim 8 , wherein the data indicating the end of the user interaction with the interactable object corresponds to a release gesture.

11. The system of claim 1 , wherein the interactable object is both opened and placed with the user interaction.

12. The system of claim 1 , wherein the processor is also configured for determining an orientation for the interactable object by:

determining a surface normal of a location of the interactable object at the end of the user interaction;

determining an orientation data of the interactable object; and

aligning the surface normal of the location with the orientation data of the interactable object.

13. The system of claim 1 , wherein the interactable object comprises a wall hanging.

14. A system, comprising:

a mixed reality display device configured for displaying an interactable object as virtual content at a first location within a spatially organized three-dimensional environment to a user;

a user interface configured for detecting interaction of the user with the interactable object; and

a processor configured for:

receiving data indicating a selection of the interactable object at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of the user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

displaying the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating an end of the user interaction with the interactable object;

determining a location of the interactable object at the end of the user interaction;

receiving data indicating a physical movement of the user, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a new prism for the interactable object at the end of the user interaction when the location of the interactable object at the end of the user interaction is outside of an initial prism of the interactable object,

wherein the three-dimensional environment includes a deconstructed two-dimensional web page.

15. The system of claim 14 , further comprising a user input device configured to provide the data indicating the selection of the interactable object and the data indicating the end of the user interaction with the interactable object.

16. The system of claim 15 , wherein the user input device is a haptics controller.

17. The system of claim 16 , further comprising a processing system associated with the haptics controller,

wherein the processing system is configured to translate the physical movement of the user into event objects, and

wherein the event objects correlate to data for movement or positioning of the haptics controller.

18. A system, comprising:

a mixed reality display device configured for displaying an interactable object as virtual content at a first location within a spatially organized three-dimensional environment to a user;

a user interface configured for detecting interaction of the user with the interactable object; and

a processor configured for:

receiving data indicating the selection of the interactable object contained within a first prism at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of the user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

displaying the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating a physical movement of the user, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a second prism at a location of the interactable object at an end of the user interaction to contain the interactable object when the data indicating the physical movement of the user indicates that the interactable object is outside of the first prism at the end of the user interaction,

wherein the processor is further configured to deconstruct a two-dimensional web page and to have the deconstructed two-dimensional web page displayed in the three-dimensional environment.

19. The system of claim 18 , further comprising a user input device configured to provide the data indicating the selection of the interactable object and the data indicating the end of the user interaction with the interactable object,

wherein the user input device is a haptics controller.

20. The system of claim 19 , further comprising a processing system associated with the haptics controller,

wherein the processing system is configured to translate the physical movement of the user into event objects, and

wherein the event objects correlate to data for movement or positioning of the haptics controller.

Assignments (2)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0476 →
Continuity (5)
Continuation 17368495 · Jul 6, 2021
Continuation 16971603
Provisional Application 62665251 · May 1, 2018
Provisional Application 62634007 · Feb 22, 2018
Related Publication 20230267697A1 · Aug 24, 2023
References Cited (305)
US 5923318A · Zhai et al. · 1999 [cited by applicant]
US 6629065B1 · Gadh et al. · 2003 [cited by applicant]
US 6720949B1 · Pryor et al. · 2004 [cited by applicant]
US 8912979B1 · Gomez · 2014 [cited by applicant]
US 8924862B1 · Luo · 2014 [cited by applicant]
US 9411422B1 · McClendon et al. · 2016 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US 9734633B2 · Bennett et al. · 2017 [cited by applicant]
US 9761055B2 · Miller · 2017 [cited by applicant]
US 10803663B2 · Wang et al. · 2020 [cited by applicant]
US 20020033845A1 · Elber et al. · 2002 [cited by applicant]
US 20060193510A1 · Matsumoto et al. · 2006 [cited by applicant]
US 20070226647A1 · Louch · 2007 [cited by applicant]
US 20080115081A1 · Sankaravadivelu et al. · 2008 [cited by applicant]
US 20090089364A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20120030617A1 · Louch · 2012 [cited by applicant]
US 20120131496A1 · Goossens et al. · 2012 [cited by applicant]
US 20120179426A1 · Fontes et al. · 2012 [cited by applicant]
US 20120212484A1 · Haddick et al. · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20120266101A1 · Shah · 2012 [cited by applicant]
US 20120294539A1 · Lim et al. · 2012 [cited by applicant]
US 20130278631A1 · Border · 2013 [cited by examiner]
US 20130342572A1 · Poulos et al. · 2013 [cited by applicant]
US 20140002444A1 · Bennett et al. · 2014 [cited by applicant]
US 20140118397A1 · Lee et al. · 2014 [cited by applicant]
US 20140168262A1 · Forutanpour et al. · 2014 [cited by applicant]
US 20140184496A1 · Gribetz et al. · 2014 [cited by applicant]
US 20140195988A1 · Kramer et al. · 2014 [cited by applicant]
US 20140200863A1 · Kamat et al. · 2014 [cited by applicant]
US 20140225922A1 · Sbardella · 2014 [cited by applicant]
US 20140232639A1 · Hayashi et al. · 2014 [cited by applicant]
US 20140237393A1 · Van Wie et al. · 2014 [cited by applicant]
US 20140248950A1 · Tosas Bautista · 2014 [cited by applicant]
US 20140267228A1 · Ofek et al. · 2014 [cited by applicant]
US 20140282274A1 · Everitt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20140337792A1 · Phang · 2014 [cited by examiner]
US 20140375683A1 · Salter et al. · 2014 [cited by applicant]
US 20150143302A1 · Chang · 2015 [cited by examiner]
US 20150163345A1 · Cornaby et al. · 2015 [cited by applicant]
US 20150185825A1 · Mullins · 2015 [cited by applicant]
US 20150206343A1 · Mattila et al. · 2015 [cited by applicant]
US 20150206349A1 · Rosenthal et al. · 2015 [cited by applicant]
US 20150253862A1 · Seo et al. · 2015 [cited by applicant]
US 20150268831A1 · Sripada · 2015 [cited by examiner]
US 20150277699A1 · Algreatly · 2015 [cited by applicant]
US 20150302651A1 · Shpigelman · 2015 [cited by applicant]
US 20150317831A1 · Ebstyne et al. · 2015 [cited by applicant]
US 20150331240A1 · Poulos et al. · 2015 [cited by applicant]
US 20150332509A1 · Jovanovic · 2015 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160027214A1 · Memmott et al. · 2016 [cited by applicant]
US 20160048204A1 · Scott et al. · 2016 [cited by applicant]
US 20160077677A1 · Valdes · 2016 [cited by applicant]
US 20160180602A1 · Fuchs · 2016 [cited by applicant]
US 20160210602A1 · Siddique et al. · 2016 [cited by applicant]
US 20160266386A1 · Scott et al. · 2016 [cited by applicant]
US 20160300392A1 · Jonczyk et al. · 2016 [cited by applicant]
US 20160321378A1 · Kagan et al. · 2016 [cited by applicant]
US 20170011557A1 · Lee et al. · 2017 [cited by applicant]
US 20170046881A1 · Kuribara · 2017 [cited by applicant]
US 20170052994A1 · Jain et al. · 2017 [cited by applicant]
US 20170054569A1 · Harms et al. · 2017 [cited by applicant]
US 20170060514A1 · Kaufthal · 2017 [cited by applicant]
US 20170109936A1 · Powderly et al. · 2017 [cited by applicant]
US 20170132835A1 · Halliday et al. · 2017 [cited by applicant]
US 20170235848A1 · Van Dusen et al. · 2017 [cited by applicant]
US 20170256096A1 · Faaborg · 2017 [cited by examiner]
US 20170256099A1 · Li · 2017 [cited by applicant]
US 20170258526A1 · Lang · 2017 [cited by applicant]
US 20170287218A1 · Nuernberger et al. · 2017 [cited by applicant]
US 20170322622A1 · Hong et al. · 2017 [cited by applicant]
US 20180004283A1 · Mathey-Owens et al. · 2018 [cited by applicant]
US 20180005034A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180012330A1 · Holzer et al. · 2018 [cited by applicant]
US 20180033204A1 · Dimitrov et al. · 2018 [cited by applicant]
US 20180045963A1 · Hoover et al. · 2018 [cited by applicant]
US 20180082480A1 · White et al. · 2018 [cited by applicant]
US 20180095276A1 · Ng-Thow-Hing · 2018 [cited by applicant]
US 20180101994A1 · Da Veiga et al. · 2018 [cited by applicant]
US 20180131788A1 · Roberts · 2018 [cited by examiner]
US 20180144111A1 · Katingari · 2018 [cited by applicant]
US 20180144556A1 · Champion · 2018 [cited by examiner]
US 20180150204A1 · Macgillivray · 2018 [cited by applicant]
US 20180210206A1 · Eronen et al. · 2018 [cited by applicant]
US 20180225885A1 · Dishno · 2018 [cited by applicant]
US 20180349485A1 · Carlisle et al. · 2018 [cited by applicant]
US 20180365897A1 · Pahud et al. · 2018 [cited by applicant]
US 20180374143A1 · Williamson et al. · 2018 [cited by applicant]
US 20190005724A1 · Pahud et al. · 2019 [cited by applicant]
US 20190025999A1 · Murphy et al. · 2019 [cited by applicant]
US 20190043259A1 · Wang et al. · 2019 [cited by applicant]
US 20190079648A1 · Karunamuni et al. · 2019 [cited by applicant]
US 20190156585A1 · Mott et al. · 2019 [cited by applicant]
US 20190197785A1 · Tate-Gans et al. · 2019 [cited by applicant]
US 20210097775A1 · Zurmoehle · 2021 [cited by examiner]
AU 2018261328B2 · 2022 [cited by applicant]
AU 2022271460B2 · 2022 [cited by applicant]
CN 103460256 · 2013 [cited by applicant]
CN 105229719 · 2016 [cited by applicant]
EP 1556805 · 2011 [cited by applicant]
EP 2455858 · 2012 [cited by applicant]
JP 200758332 · 2007 [cited by applicant]
JP 2009518699 · 2009 [cited by applicant]
JP 2010534974 · 2010 [cited by applicant]
JP 2014515962 · 2014 [cited by applicant]
JP 2015504616 · 2015 [cited by applicant]
JP 2016500891 · 2016 [cited by applicant]
JP 2016508257 · 2016 [cited by applicant]
JP 2016511492 · 2016 [cited by applicant]
KR 1020080047575 · 2008 [cited by applicant]
KR 1020130137692 · 2013 [cited by applicant]
KR 1020140071086 · 2014 [cited by applicant]
KR 1020150130495 · 2015 [cited by applicant]
KR 1020170018930 · 2017 [cited by applicant]
WO WO2007038090 · 2007 [cited by applicant]
WO WO2015033377 · 2015 [cited by applicant]
WO WO2016203792 · 2016 [cited by applicant]
WO WO2017040442 · 2017 [cited by applicant]
WO WO2017062289 · 2017 [cited by applicant]
Foreign Response for CN Patent Appln. No. 202080026322.7 dated Jun. 26, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/316,925 dated Aug. 14, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2021-559089 dated Aug. 10, 2023 (with English translation). [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-142067 dated Aug. 7, 2023 (with English translation). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/663,792 dated Aug. 30, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-117087 dated Aug. 14, 2023 (with English translation). [cited by applicant]
Foreign Response for CA Patent Appln. No. 3060209 dated Oct. 26, 2023. [cited by applicant]
Foreign Response for AU Patent Appln. No. 2022271460 dated Oct. 26, 2023. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2021-559089 dated Oct. 30, 2023. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-142067 dated Oct. 31, 2023. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2023-7023782 dated Nov. 7, 2023. [cited by applicant]
Response After Final for U.S. Appl. No. 17/316,925 dated Nov. 14, 2023. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2022-7027516 dated Apr. 10, 2023. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2020-7021106 dated Apr. 18, 2023. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/316,925 dated May 16, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/241,977 dated May 12, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/663,792 dated May 24, 2023. [cited by applicant]
Foreign Exam Report for NZ Patent Appln. No. 758288 dated May 12, 2023. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-117087 dated Jan. 26, 2024 (with English translation). [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-142067 dated Jan. 25, 2024 (with English translation). [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880088453.0 dated Feb. 28, 2024. [cited by applicant]
Foreign NOA for CA Patent Appln. No. 3060209 dated Feb. 1, 2024. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-199311 dated Mar. 13, 2024. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2023-7023782 dated Dec. 28, 2023. [cited by applicant]
Foreign Decision of Rejection for CN Patent Appln. No. 202080026322.7 dated Mar. 18, 2023. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-143449 dated Apr. 4, 2023. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/241,977 dated Apr. 12, 2023. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-117087 dated Nov. 17, 2023. [cited by applicant]
Foreign NOA for AU Patent Appln. No. 2022271460 dated Nov. 7, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/316,925 dated Dec. 11, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/804,394 dated Jan. 11, 2024. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-199311 dated Dec. 21, 2023 (with English translation). [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2021-559089 dated Jan. 16, 2024. [cited by applicant]
Foreign Response for EP Patent Appln. No. 23159324.5 dated Jan. 19, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Dec. 28, 2023 (with English translation). [cited by applicant]
Szalavari, Zsolt, Erik Eckstein, and Michael Gervautz. “Collaborative gaming in augmented reality.” Proceedings of the ACM symposium on Virtual reality software and technology. 1998. (Year: 1998). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/968,673 dated Jul. 15, 2020. [cited by applicant]
PCT Notification of the International Search Report and Written Opinion mailed Jul. 11, 2018 for PCT Application No. PCT/US2018/030535, Applicant Magic Leap, Inc., 14 pages. [cited by applicant]
Extended European Search Report for EP Appln. No. 18794284.2 dated Jan. 29, 2020 (7 pages). [cited by applicant]
Foreign Response to 70(2) for EP Patent Appln. No. 18794284.2 dated Aug. 28, 2020. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/968,673 dated Oct. 17, 2019. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/968,673 dated Mar. 30, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 15/968,673 dated Jan. 17, 2020. [cited by applicant]
Amendment Response to Final Office Action for U.S. Appl. No. 15/968,673 dated Jun. 26, 2020. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/281,540 dated May 4, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 16/281,540 dated Aug. 4, 2020. [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US2019/018932, Applicant Magic Leap, Inc., forms PCT/ISA/210, 220, and 237, dated May 14, 2019. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/224,719 dated Feb. 6, 2020. [cited by applicant]
Final Office Action for U.S. Appln. No. 224,719 dated Jun. 18, 2020. [cited by applicant]
Amendment Response to Non-Final Office Action for U.S. Appl. No. 16/224,719 dated May 6, 2020. [cited by applicant]
IT Jungles, “iPhone—How to Move Re-arrange Home Screen Icons”, Mar. 15, 2015, YouTube.com (Year: 2015). [cited by applicant]
PCT Invitation to Pay Additional Fees for International Patent Appln. No. PCT/US18/66331, Applicant Magic Leap Inc., form PCT/ISA/206, dated Mar. 13, 2019 (3 pages). [cited by applicant]
PCT International Search Report and Written Opinion for International Patent AppIn. No. PCT/US18/66331, Applicant Magic Leap Inc., forms PCT/ISA/210, 220, and 237, dated May 8, 2019 (11 pages). [cited by applicant]
Amendment After Final for U.S. Appl. No. 16/224,719 dated Sep. 18, 2020. [cited by applicant]
Non-Final Office Actino for U.S. Appl. No. 16/224,719 dated Oct. 5, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/968,673 dated Oct. 7, 2020. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/281,540 dated Oct. 27, 2020. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 16/224,719 dated Jan. 5, 2021. [cited by applicant]
RCE and Response to Final Office Action for U.S. Appl. No. 16/281,540, filed Jan. 27, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/224,719 dated Jan. 27, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/281,540 dated Feb. 11, 2021. [cited by applicant]
Extended European Search Report for EP Appln. No. 18891755.3 dated Dec. 23, 2020 (9 pages). [cited by applicant]
Dieter Schmalstieg et al: “The Studierstube Augmented Reality Project—TR-186-2-00-22”, Technical Reports of the Technical University of Vienna, Dec. 31, 2000 (Dec. 31, 2000), pp. 1-24, XP055270593, Retrieved from the In… [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US20/26656, Applicant Magic Leap, Inc., dated Jun. 22, 2020 (13 pages). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/839,727 dated Feb. 10, 2021. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 16/839,727 dated May 10, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/971,603 dated Feb. 18, 2021. [cited by applicant]
PCT International Search Report and Written Opinion for International Appln. No. PCT/US19/18920, Applicant Magic Leap, Inc., dated May 14, 2019. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880043910.4 dated May 31, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/142,210 dated Aug. 5, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No. 18891755.3 dated Jul. 29, 2021. [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 19756664.9 dated Mar. 29, 2021. [cited by applicant]
RCE and Amendment Response to FOA for U.S. Appl. No. 16/839,727, filed Sep. 30, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No 19756664.9 dated Oct. 25, 2021. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19757809.9 dated Oct. 22, 2021. [cited by applicant]
Foreign Exam Report for AU Patent Appln. No. 2018261328 dated Sep. 6, 2021. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2019-559343 dated Oct. 6, 2021 (with English translation). [cited by applicant]
Uchiyama, H., et al., “Method for Displaying Images on Urban Structures by Augmented Reality,” IEICE technical report, JP, The Institute of Electronics, Information and Communication Engineers, Mar. 22, 2012, vol. 111 N… [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880043910.4 dated Jan. 5, 2022. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2019-7035273 dated Sep. 16, 2021. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2019-7035273 dated Jan. 18, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/839,727 dated Jun. 30, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/839,727 dated Nov. 9, 2021. [cited by applicant]
Amendment Response for U.S. Appl. No. 16/839,727 dated Feb. 7, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 201947046799 dated Feb. 11, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/142,210 dated Feb. 18, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/368,495 dated Feb. 25, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/839,727 dated Feb. 28, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544237 dated Feb. 21, 2022 (with English translation). [cited by applicant]
Foreign FOA for JP Patent Appln. No. 2019-559343 dated Mar. 8, 2022 (with English translation). [cited by applicant]
Foreign OA for IL Patent Appln. No. 270249 dated Jan. 28, 2022. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880043910.4 dated Mar. 16, 2022. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2019-7035273 dated Mar. 15, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544190 dated Mar. 15, 2022 (with English translation). [cited by applicant]
Foreign Rejection Decision for CN Patent Appln. No. 201880043910.4 dated Apr. 29, 2022 (with English translation). [cited by applicant]
Foreign Response for JP Patent Appln. No. 2020-544237 dated May 17, 2022. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2019-7035273 dated May 9, 2022. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/368,495 dated May 25, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-534227 dated May 20, 2022. [cited by applicant]
Foreign Response for IL Patent Appln. No. 270249 dated May 26, 2022. [cited by applicant]
Foreign Response for EP Patent Appln. No. 18794284.2 dated Jun. 3, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2019-559343 dated Jun. 7, 2022. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2020-544190 dated Jun. 13, 2022. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2020-544190 dated Jun. 24, 2022. [cited by applicant]
Foreign Response for AU Patent Appln. No. 2018261328 dated Jul. 20, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/368,495 dated Jul. 27, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 202047032176 dated Jul. 19, 2022 in English. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/241,977 dated Aug. 3, 2022. [cited by applicant]
Wade et al. “A Gaze-Contingent Adaptive Virtual Reality Driving Environment for Intervention in Individuals with Autism Spectrum Disorders”, 2016, ACM (Year: 2016). [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 20784393.9 dated Jun. 20, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2020-544237 dated Aug. 4, 2022. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2019-559343 dated Aug. 12, 2022. [cited by applicant]
Foreign Reexamination Decision for CN Patent Appln. No. 201880043910.4 dated Aug. 22, 2022. [cited by applicant]
Foreign NOA for AU Patent Appln. No. 2018261328 dated Aug. 10, 2022. [cited by applicant]
Foreign Exam Report for IN Patent Appln. No. 202047029094 dated Aug. 26, 2022 in English. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/368,495 dated Sep. 22, 2022. [cited by applicant]
Foreign OA for CN Patent AppIn. No. 201880043910.4 dated Sep. 23, 2022 (with English translation). [cited by applicant]
Foreign OA for CN Patent Appln. No. 202080026322.7 dated Oct. 12, 2022. [cited by applicant]
Schmalstieg, D., et al., “The Studierstube Augmented Reality Project,” Presence, vol. 11, No. 1, Feb. 2002, 33-54, © 2002 by the Massachusetts Institute of Technology. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7021106 dated Oct. 14, 2022 (with English translation). [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/241,977 dated Nov. 2, 2022. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2022-143449 dated Nov. 1, 2022 (with English translation). [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2020-534227 dated Nov. 15, 2022. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880043910.4 dated Nov. 18, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/663,792 dated Nov. 22, 2022. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2022-7027516 dated Dec. 5, 2022. [cited by applicant]
Foreign Exam Report for AU Patent Appln. No. 2022271460 dated Dec. 7, 2022. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 275461 dated Nov. 9, 2022 in English. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2020-7021106 dated Dec. 9, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/368,495 dated Dec. 14, 2022. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19756664.9 dated Dec. 20, 2022. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 270249 dated Dec. 4, 2022 in English. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 276629 dated Dec. 21, 2022 in English. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 276621 dated Dec. 21, 2022 in English. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-143449 dated Jan. 24, 2023. [cited by applicant]
Foreign NOA for CN Patent Appln. No. 201880043910.4 dated Jan. 11, 2023. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2022-7027516 dated Feb. 3, 2023. [cited by applicant]
Foreign Response for CN Patent Appln. No. 202080026322.7 dated Feb. 9, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/316,925 dated Feb. 16, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/241,977 dated Feb. 17, 2023. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/663,792 dated Feb. 22, 2023. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/663,792 dated Jul. 24, 2023. [cited by applicant]
Extended European Search Report for EP Patent Appln. No. 23159324.5 dated Jun. 1, 2023. [cited by applicant]
Foreign Exam Report for CA Patent Appln. No. 3060209 dated Jun. 30, 2023. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-199311 dated Mar. 21, 2024. [cited by applicant]
Foreign Exam Report for EP Patent Appln. No. 19756664.9 dated Jan. 29, 2024. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 17/804,394 dated Apr. 10, 2024. [cited by applicant]
Foreign NOA for IL Patent Appln. No. 270249 dated Apr. 15, 2024. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-142067 dated Apr. 25, 2024. [cited by applicant]
Foreign Hearing Notice for IN Patent Appln. No. 201947046799 dated Apr. 26, 2024 in English. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7026917 dated Apr. 19, 2024 (with English translation). [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014588.7 dated May 13, 2024. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2023-7023782 dated May 14, 2024. [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2023-7023413 dated May 20, 2024 (with English translation). [cited by applicant]
Foreign Response for JP Patent Appln. No. 2022-117087 dated May 28, 2024. [cited by applicant]
Foreign Response for EP Patent Appln. No. 19756664.9 dated May 29, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/804,394 dated Jun. 3, 2024. [cited by applicant]
Foreign Refusal Order for IN Patent Appln. No. 201947046799 dated Jun. 6, 2024 in English. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-117087 dated Jun. 25, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014719.1 dated Jun. 24, 2024. [cited by applicant]
Foreign NOA for JP Patent Appln. No. 2022-142067 dated Jun. 26, 2024. [cited by applicant]
Foreign NOA for JP Patent AppIn No. 2023-76383 dated Jun. 12, 2024 (with English translation). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/523,763 dated Aug. 15, 2024. [cited by applicant]
Amendment After Final for U.S. Appl. No. 17/804,394 dated Aug. 5, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/804,394 dated Aug. 28, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201880088453.0 dated Jun. 28, 2024. [cited by applicant]
Foreign OA Response for KR Patent Appln. No. 10-2023-7023413 dated Jul. 22, 2024 (with English translation). [cited by applicant]
Foreign OA for KR Patent Appln. No. 10-2020-7026920 dated Jul. 28, 2024. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2023-7023413 dated Aug. 21, 2024. [cited by applicant]
Foreign Response for JP Patent Appln. No. 2023-76383 dated Aug. 27, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Aug. 15, 2024 (with English translation). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/804,394 dated Sep. 20, 2024. [cited by applicant]
Foreign Response for KR Patent Appln. No. 10-2020-7026920 dated Sep. 20, 2024. [cited by applicant]
Amendment Response to NFOA for U.S. Appl. No. 18/523.763 dated Nov. 12, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014588.7 dated Oct. 11, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201880088453.0 dated Oct. 12, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014719.1 dated Oct. 17, 2024. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2024-21089 dated Oct. 24, 2024 (with English translation). [cited by applicant]
Foreign NOA for CN Patent Appln. No. 201880088453.0 dated Nov. 6, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/523,763 dated Nov. 25, 2024. [cited by applicant]
Foreign OA for CN Patent Appln. No. 201980014588.7 dated Dec. 6, 2024. [cited by applicant]
Foreign NOA for KR Patent Appln. No. 10-2020-7026917 dated Dec. 20, 2024. [cited by applicant]
Foreign Response for CN Patent Appln. No. 201980014588.7 dated Jan. 15, 2025. [cited by applicant]
Foreign OA for JP Patent Appln. No. 2023-76383 dated Dec. 25, 2024 (with English translation). [cited by applicant]