IP Library Granted Patent US 12,315,094
Granted Patent B2
US 12,315,094 · App. 18/513,443 · Granted May 27, 2025

Session manager

Inventors: Richard St. Clair Bailey (Plantation, FL); Siddartha Pothapragada (Plantation, FL); Koichi Mori (Plantation, FL); Karen Stolzenberg (Fort Lauderdale, FL); Savannah Niles (Fort Lauderdale, FL); Domingo Noriega-Padilla (Miami, FL); Cole Parker Heiner (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/011H04L67/131G02B2027/014G02B27/0172G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,094
App. No.
18/513,443
Granted
May 27, 2025
Kind
B2
Abstract

Disclosed are systems and methods for mixed reality collaboration. A method may include receiving persistent coordinate data; presenting a first virtual session handle to a first user at a first position via a transmissive display of a wearable device, wherein the first position is based on the persistent coordinate data; presenting a virtual object to the first user at a second location via the transmissive display, wherein the second position is based on the first position; receiving location data from a second user, wherein the location data relates a position of the second user to a position of a second virtual session handle; presenting a virtual avatar to the first user at a third position via the transmissive display, wherein the virtual avatar corresponds to the second user, wherein the third position is based on the location data, and wherein the third position is further based on the first position.

Claims (36)

1. A method comprising:

providing persistent coordinate data to a first system comprising a first wearable head device, the first wearable head device comprising a transmissive display, the first system having a first user;

receiving first location data from the first system, wherein the first location data relates a position of the first user to a position of a first virtual session handle of a session;

receiving second location data from a second system comprising a second wearable head device, the second system having a second user, wherein the second location data relates a position of the second user to a position of a second virtual session handle of the session; and

providing first relational data to the first system, wherein the first relational data relates a first position of a virtual object to be presented on the transmissive display to the position of the first virtual session handle,

wherein the session comprises data associated with the first user and further comprises data associated with the second user.

2. The method of claim 1 , further comprising providing second relational data to the first system, wherein the second relational data relates a second position of the virtual object to the position of the first virtual session handle.

3. The method of claim 2 , further comprising receiving an input from the second user, wherein the second relational data is provided in response to receiving the input from the second user.

4. The method of claim 2 , wherein the second relational data is provided to the first system in response to receiving an input from the first user.

5. The method of claim 1 , further comprising:

storing, in a memory at a first time, a session instance comprising the first position of the virtual object; and

retrieving, from the memory at a second time later than the first time, the session instance.

6. The method of claim 5 , wherein a server remote to the first wearable head device comprises the memory.

7. The method of claim 5 , wherein the method further comprises encrypting the session instance prior to storing the session instance in the memory.

8. The method of claim 1 , further comprising receiving user identification data from the first system.

9. The method of claim 1 , wherein the virtual object is associated with a capability of the session.

10. The method of claim 1 , wherein providing the first relational data to the first system comprises providing the first relational data via an application connectivity platform, the application connectivity platform in communication with the first system and the second system.

11. The method of claim 10 , wherein the application connectivity platform provides a low-latency communication pathway between the first system and the second system.

12. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

providing persistent coordinate data to a first system comprising a first wearable head device, the first wearable head device comprising a transmissive display, the first system having a first user;

receiving first location data from the first system, wherein the first location data relates a position of the first user to a position of a first virtual session handle of a session;

receiving second location data from a second system comprising a second wearable head device, the second system having a second user, wherein the second location data relates a position of the second user to a position of a second virtual session handle of the session; and

providing first relational data to the first system, wherein the first relational data relates a first position of a virtual object to be presented on the transmissive display to the position of the first virtual session handle,

wherein the session comprises data associated with the first user and further comprises data associated with the second user.

13. The non-transitory computer-readable medium of claim 12 , the method further comprising:

providing second relational data to the first system, wherein the second relational data relates a second position of the virtual object to the position of the first virtual session handle.

14. The non-transitory computer-readable medium of claim 13 , the method further comprising:

receiving an input from the second user, wherein the second relational data is provided in response to receiving the input from the second user.

15. The non-transitory computer-readable medium of claim 13 , wherein the second relational data is provided to the first system in response to receiving an input from the first user.

16. The non-transitory computer-readable medium of claim 12 , the method further comprising:

storing, in a memory at a first time, a session instance comprising the first position of the virtual object; and

retrieving, from the memory at a second time later than the first time, the session instance.

17. The non-transitory computer-readable medium of claim 16 , wherein a server remote to the first wearable head device comprises the memory.

18. The non-transitory computer-readable medium of claim 16 , the method further comprising encrypting the session instance prior to storing the session instance in the memory.

19. The non-transitory computer-readable medium of claim 12 , wherein the virtual object is associated with a capability of the session.

20. The non-transitory computer-readable medium of claim 12 , wherein providing the first relational data to the first system comprises providing the first relational data via an application connectivity platform, and wherein the application connectivity platform provides a low-latency communication pathway between the first system and the second system.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073439/0168 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2025
From: BAILEY, RICHARD ST. CLAIR; POTHAPRAGADA, SIDDARTHA; MORI, KOICHI; STOLZENBERG, KAREN; NILES, SAVANNAH; NORIEGA-PADILLA, DOMINGO; HEINER, COLE PARKER
To: MAGIC LEAP, INC.
Reel/Frame 070651/0199 →
Continuity (4)
Continuation 17944079 · Sep 13, 2022
Continuation 17175547 · Feb 12, 2021
Provisional Application 62977079 · Feb 14, 2020
Related Publication 20240087261A1 · Mar 14, 2024
References Cited (293)
US 4852988A · Velez · 1989 [cited by applicant]
US 5689641A · Ludwig · 1997 [cited by applicant]
US 5956028A · Matsui · 1999 [cited by applicant]
US 6130670A · Porter · 2000 [cited by applicant]
US 6433760B1 · Vaissie · 2002 [cited by applicant]
US 6491391B1 · Blum et al. · 2002 [cited by applicant]
US 6847336B1 · Lemelson · 2005 [cited by applicant]
US 6943754B2 · Aughey · 2005 [cited by applicant]
US 6977776B2 · Volkenandt et al. · 2005 [cited by applicant]
US 7290216B1 · Kawahara et al. · 2007 [cited by applicant]
US 7347551B2 · Fergason et al. · 2008 [cited by applicant]
US 7488294B2 · Torch · 2009 [cited by applicant]
US 7800614B2 · Johnson et al. · 2010 [cited by applicant]
US 8235529B1 · Raffle · 2012 [cited by applicant]
US 8253730B1 · Carr · 2012 [cited by applicant]
US 8275031B2 · Neuman · 2012 [cited by applicant]
US 8407605B2 · Go · 2013 [cited by applicant]
US 8611015B2 · Wheeler · 2013 [cited by applicant]
US 8638498B2 · Bohn et al. · 2014 [cited by applicant]
US 8696113B2 · Lewis · 2014 [cited by applicant]
US 8929589B2 · Publicover et al. · 2015 [cited by applicant]
US 9010929B2 · Lewis · 2015 [cited by applicant]
US 9069554B2 · Lioy et al. · 2015 [cited by applicant]
US 9274338B2 · Robbins et al. · 2016 [cited by applicant]
US 9292973B2 · Bar-zeev et al. · 2016 [cited by applicant]
US 9323325B2 · Perez et al. · 2016 [cited by applicant]
US 9720505B2 · Gribetz et al. · 2017 [cited by applicant]
US 9811237B2 · Schileru · 2017 [cited by applicant]
US 10013053B2 · Cederlund et al. · 2018 [cited by applicant]
US 10025379B2 · Drake et al. · 2018 [cited by applicant]
US 10242501B1 · Pusch · 2019 [cited by examiner]
US 10403050B1 · Beall · 2019 [cited by examiner]
US 10528349B2 · Kumar · 2020 [cited by applicant]
US 10977858B2 · Babu Jd · 2021 [cited by applicant]
US 10977868B2 · Neeter · 2021 [cited by applicant]
US 11017592B2 · Babu J D · 2021 [cited by applicant]
US 11201953B2 · Babu J D et al. · 2021 [cited by applicant]
US 11295518B2 · Babu J D · 2022 [cited by applicant]
US 11315316B2 · Babu J D · 2022 [cited by applicant]
US 11335070B2 · Baier et al. · 2022 [cited by applicant]
US 11475644B2 · Bailey et al. · 2022 [cited by applicant]
US 11494528B2 · Bailey et al. · 2022 [cited by applicant]
US 11699262B2 · Babu J D · 2023 [cited by applicant]
US 11763559B2 · Wang et al. · 2023 [cited by applicant]
US 11797720B2 · Bailey et al. · 2023 [cited by applicant]
US 11861803B2 · Bailey et al. · 2024 [cited by applicant]
US 11936733B2 · Babu J D et al. · 2024 [cited by applicant]
US 12079938B2 · Baier · 2024 [cited by applicant]
US 12100207B2 · Wang · 2024 [cited by applicant]
US 12112098B2 · Bailey · 2024 [cited by applicant]
US 12211145B2 · Babu J D · 2025 [cited by applicant]
US 20010012018A1 · Hayhurst · 2001 [cited by applicant]
US 20020163515A1 · Sowizral et al. · 2002 [cited by applicant]
US 20020172328A1 · Dekel · 2002 [cited by applicant]
US 20030030597A1 · Geist · 2003 [cited by applicant]
US 20030076329A1 · Beda et al. · 2003 [cited by applicant]
US 20040130550A1 · Blanco et al. · 2004 [cited by applicant]
US 20040130552A1 · Duluk et al. · 2004 [cited by applicant]
US 20040130579A1 · Ishii · 2004 [cited by applicant]
US 20040189669A1 · David et al. · 2004 [cited by applicant]
US 20050182844A1 · Johnson · 2005 [cited by applicant]
US 20060023158A1 · Howell et al. · 2006 [cited by applicant]
US 20060122819A1 · Carmel et al. · 2006 [cited by applicant]
US 20070057952A1 · Swedberg et al. · 2007 [cited by applicant]
US 20070220168A1 · Parsons et al. · 2007 [cited by applicant]
US 20080002761A1 · Edsall et al. · 2008 [cited by applicant]
US 20080122838A1 · Hoover et al. · 2008 [cited by applicant]
US 20090278852A1 · Reese et al. · 2009 [cited by applicant]
US 20090282369A1 · Jones · 2009 [cited by applicant]
US 20110211056A1 · Publicover et al. · 2011 [cited by applicant]
US 20110213664A1 · Osterhout · 2011 [cited by applicant]
US 20120021806A1 · Maltz · 2012 [cited by applicant]
US 20120075343A1 · Chen et al. · 2012 [cited by applicant]
US 20120086631A1 · Osman · 2012 [cited by applicant]
US 20120102549A1 · Mazzaferri · 2012 [cited by applicant]
US 20120249416A1 · Maciocci et al. · 2012 [cited by applicant]
US 20130012418A1 · Tatsumi · 2013 [cited by applicant]
US 20130073707A1 · Butler et al. · 2013 [cited by applicant]
US 20130077147A1 · Efimov · 2013 [cited by applicant]
US 20130097635A1 · Yerli · 2013 [cited by applicant]
US 20130120418A1 · Green et al. · 2013 [cited by applicant]
US 20130120421A1 · Maguire · 2013 [cited by applicant]
US 20130127849A1 · Marketsmueller et al. · 2013 [cited by applicant]
US 20130293468A1 · Perez et al. · 2013 [cited by applicant]
US 20130324245A1 · Harvey et al. · 2013 [cited by applicant]
US 20140123184A1 · Reisman · 2014 [cited by applicant]
US 20140168218A1 · Mitrea et al. · 2014 [cited by applicant]
US 20140195918A1 · Friedlander · 2014 [cited by applicant]
US 20140267234A1 · Hook et al. · 2014 [cited by applicant]
US 20140267291A1 · Smyth et al. · 2014 [cited by applicant]
US 20140313197A1 · Peuhkurinen · 2014 [cited by applicant]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20150199788A1 · Wolfe · 2015 [cited by applicant]
US 20150248779A1 · Lindquist · 2015 [cited by applicant]
US 20160006800A1 · Summers · 2016 [cited by applicant]
US 20160072716A1 · Chow et al. · 2016 [cited by applicant]
US 20160093090A1 · Shin et al. · 2016 [cited by applicant]
US 20160104452A1 · Guan et al. · 2016 [cited by applicant]
US 20160293133A1 · Dutt · 2016 [cited by applicant]
US 20160343164A1 · Urbach · 2016 [cited by applicant]
US 20160361658A1 · Osman · 2016 [cited by applicant]
US 20170153926A1 · Callegari et al. · 2017 [cited by applicant]
US 20170236320A1 · Gribetz · 2017 [cited by applicant]
US 20170352196A1 · Chen · 2017 [cited by applicant]
US 20170365086A1 · Floyd et al. · 2017 [cited by applicant]
US 20180114368A1 · Marketsmueller · 2018 [cited by applicant]
US 20180181198A1 · Trotta · 2018 [cited by applicant]
US 20180197340A1 · Loberg et al. · 2018 [cited by applicant]
US 20180197341A1 · Loberg et al. · 2018 [cited by applicant]
US 20180321894A1 · Paulovich et al. · 2018 [cited by applicant]
US 20190019348A1 · Yamamoto et al. · 2019 [cited by applicant]
US 20190039316A1 · Su et al. · 2019 [cited by applicant]
US 20190114802A1 · Lazarow · 2019 [cited by applicant]
US 20190180506A1 · Gebbie · 2019 [cited by applicant]
US 20190230165A1 · Wang · 2019 [cited by applicant]
US 20190243599A1 · Rochford et al. · 2019 [cited by applicant]
US 20190244426A1 · Knoppert et al. · 2019 [cited by applicant]
US 20190272674A1 · Comer et al. · 2019 [cited by applicant]
US 20190392640A1 · Qian et al. · 2019 [cited by applicant]
US 20200005538A1 · Neeter · 2020 [cited by applicant]
US 20200051328A1 · Mohan et al. · 2020 [cited by applicant]
US 20200051337A1 · Reynolds et al. · 2020 [cited by applicant]
US 20200066049A1 · Sun · 2020 [cited by applicant]
US 20200160601A1 · Shreve et al. · 2020 [cited by applicant]
US 20200225904A1 · Cooper et al. · 2020 [cited by applicant]
US 20220070278A1 · Babu J D et al. · 2022 [cited by applicant]
US 20220245905A1 · Baier et al. · 2022 [cited by applicant]
US 20220383634A1 · Wang et al. · 2022 [cited by applicant]
US 20230360324A1 · Babu J D · 2023 [cited by applicant]
US 20240005050A1 · Bailey et al. · 2024 [cited by applicant]
US 20240187488A1 · Babu J D · 2024 [cited by applicant]
US 20240371116A1 · Baier · 2024 [cited by applicant]
US 20240395034A1 · Wang · 2024 [cited by applicant]
US 20240427949A1 · Bailey · 2024 [cited by applicant]
CA 2316473A1 · 2001 [cited by applicant]
CA 2362895A1 · 2002 [cited by applicant]
CA 2388766A1 · 2003 [cited by applicant]
CN 103023872A · 2013 [cited by applicant]
CN 104967637A · 2015 [cited by applicant]
CN 110249368A · 2019 [cited by applicant]
CN 110352085A · 2019 [cited by applicant]
CN 110476188A · 2019 [cited by applicant]
JP 2003228721A · 2003 [cited by applicant]
JP 2004272928A · 2004 [cited by applicant]
JP 2012503811A · 2012 [cited by applicant]
JP 2015519661A · 2015 [cited by applicant]
JP 2017199238A · 2017 [cited by applicant]
JP 2019031073A · 2019 [cited by applicant]
KR 20140136367A · 2014 [cited by applicant]
WO 2010035141A2 · 2010 [cited by applicant]
WO 2014169580A1 · 2014 [cited by applicant]
WO 2016028293A1 · 2016 [cited by applicant]
WO 2016198346A1 · 2016 [cited by applicant]
WO 2018106542A1 · 2018 [cited by applicant]
WO 2018106735A1 · 2018 [cited by applicant]
WO 2018165039A1 · 2018 [cited by applicant]
WO 2018175335A1 · 2018 [cited by applicant]
WO 2018183778A1 · 2018 [cited by applicant]
WO 2018224847A2 · 2018 [cited by applicant]
WO 2019074771A1 · 2019 [cited by applicant]
WO 2019199569A1 · 2019 [cited by applicant]
WO 2021163224A1 · 2021 [cited by applicant]
WO 2021163373A1 · 2021 [cited by applicant]
WO 2021163624A1 · 2021 [cited by applicant]
WO 2021163626A1 · 2021 [cited by applicant]
Japanese Notice of Allowance mailed Sep. 19, 2024, for JP Patent Application No. 2023-196665, with English translation, 6 pages. [cited by applicant]
Australian Office Action mailed Dec. 23, 2021, for AU Patent Application No. 2018243460, three pages. [cited by applicant]
Australian Office Action mailed Oct. 21, 2022, for AU Patent Application No. 2018243460, two pages. [cited by applicant]
Canadian Office Action dated Mar. 28, 2024, for CA Application No. 3,058,421, four pages. [cited by applicant]
Chinese Notice of Allowance dated Jan. 10, 2024, for CN Application No. 201880023286.1, with English translation, four pages. [cited by applicant]
Chinese Office Action dated Feb. 8, 2024, for CN Application No. 201980051078.7, with English translation, 19 pages. [cited by applicant]
Chinese Office Action dated Jul. 24, 2023, for CN Application No. 201880023286.1, with English translation, 5 pages. [cited by applicant]
Chinese Office Action dated Mar. 7, 2023, for CN Application No. 201880023286.1, with English translation, 17 pages. [cited by applicant]
Eikel, B. et al., “Preprocessed Global Visibility for Real-Time Rendering onLow-End Hardware,” Nov. 29, 2010, ICIAP: International Conference on Image Analysis and Processing, 17th International Conference, Naples, Ital… [cited by applicant]
European Office Action dated Nov. 2, 2023, for EP Application No. 18778218.0, nine pages. [cited by applicant]
European Search Report dated Aug. 23, 2021, for EP Application No. 19823464.3, twelve pages. [cited by applicant]
Final Office Action mailed Aug. 25, 2020, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 41 pages. [cited by applicant]
Final Office Action mailed Aug. 25, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 21 pages. [cited by applicant]
Final Office Action mailed Dec. 4, 2019, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 37 pages. [cited by applicant]
Final Office Action mailed Dec. 4, 2019, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 15 pages. [cited by applicant]
Indian Office Action dated Feb. 2, 2022, for IN Application No. 201947041612, with English translation, 4 pages. [cited by applicant]
International Preliminary Report on Patentability mailed Dec. 30, 2020, for PCT Application No. PCT/US2019/037811 filed on Jun. 18, 2019, eight pages. [cited by applicant]
International Search Report and Written Opinion mailed Sep. 9, 2019, for PCT Application No. PCT/US19/37811 filed on Jun. 18, 2019, fourteen pages. [cited by applicant]
International Search Report dated Jul. 30, 2018, for PCT Application No. PCT/US2018/25298 filed on Mar. 29, 2018, four pages. [cited by applicant]
Israeli Notice of Allowance dated Feb. 23, 2023, for IL Application No. 269545, with English translation, 7 pages. [cited by applicant]
Israeli Notice of Allowance dated Nov. 29, 2023, for IL Application No. 303169, four pages. [cited by applicant]
Israeli Office Acton dated Jan. 16, 2022, for IL Application No. 269545, with English translation, 9 pages. [cited by applicant]
Japanese Notice of Allowance mailed Nov. 30, 2023 for JP Application No. 2020-570684, with English translation, 7 pages. [cited by applicant]
Japanese Notice of Allowance mailed Sep. 27, 2022, for JP Application No. 2019-553094, with English translation, 6 pages. [cited by applicant]
Japanese Office Action mailed Aug. 21, 2023, for JP Application No. 2020-570684, with English translation, 5 pages. [cited by applicant]
Japanese Office Action mailed Dec. 12, 2023, for JP Application No. 2022-176196, with English translation, four pages. [cited by applicant]
Japanese Office Action mailed Feb. 14, 2022, for JP Application No. 2019553094, with English translation, 14 pages. [cited by applicant]
Korean Notice of Allowance dated Dec. 13, 2023, for KR Application No. 10-2019-7031887, with English translation, 4 pages. [cited by applicant]
Korean Office Action dated Jun. 2, 2023, for KR Application No. 10-2019-7031887, with English translation, 35 pages. [cited by applicant]
Kurillo, G. et al., “Teleimmersive 3D Collaborative Environment for Cyberarchaeology,” computer vision and pattern recognition workshops (CVPRW), 2010 IEEE computer society conference on, IEEE, Piscataway, NJ, USA, Jun.… [cited by applicant]
Non-Final Office Action mailed Dec. 18, 2023, for U.S. Appl. No. 18/314,075, filed May 8, 2023, fifteen pages. [cited by applicant]
Non-Final Office Action mailed Jun. 20, 2019, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 34 pages. [cited by applicant]
Non-Final Office Action mailed Jun. 25, 2019, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 14 pages. [cited by applicant]
Non-Final Office Action mailed Mar. 24, 2020, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 38 pages. [cited by applicant]
Non-Final Office Action mailed Mar. 24, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 18 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 15, 2021, for U.S. Appl. No. 17/236,971, filed Apr. 21, 2021, 13 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 27, 2022, for U.S. Appl. No. 17/678,332, filed Feb. 23, 2022, 12 pages. [cited by applicant]
Non-Final Office Action mailed Sep. 16, 2021, for U.S. Appl. No. 17/195,393, filed Mar. 8, 2021, fourteen pages. [cited by applicant]
Notice of Allowance mailed Dec. 9, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, nine pages. [cited by applicant]
Notice of Allowance mailed Feb. 11, 2022, for U.S. Appl. No. 17/236,971, filed Apr. 21, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 25, 2021, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 25, 2022, for U.S. Appl. No. 17/195,393, filed Mar. 8, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Mar. 22, 2023, for U.S. Appl. No. 17/678,332, filed Feb. 23, 2022, seven pages. [cited by applicant]
Notice of Allowance mailed May 1, 2024, for U.S. Appl. No. 18/314,075, filed May 8, 2023, eight pages. [cited by applicant]
Japanese Notice of Allowance mailed May 30, 2024, for JP Application No. 2021-503735, with English translation, six pages. [cited by applicant]
Japanese Notice of Allowance mailed May 30, 2024, for JP Application No. 2022-176196, with English translation, six pages. [cited by applicant]
Extended European Search Report dated Jun. 7, 2024, for EP Application No. 24165773.3, seven pages. [cited by applicant]
Japanese Office Action mailed May 2, 2024, for JP Application No. 2022-548903, with English translation, five pages. [cited by applicant]
Chinese Notice of Allowance dated Feb. 9, 2024, for CN Application No. 202180028410.5, with English translation, four pages. [cited by applicant]
Chinese Office Action dated Feb. 22, 2024, for CN Application No. 201980055804.2 with English translation, eleven pages. [cited by applicant]
Japanese Office Action mailed Jan. 12, 2024, for JP Application No. 2021-503735, with English translation, six pages. [cited by applicant]
Non-Final Office Action mailed Apr. 10, 2024, for U.S. Appl. No. 18/468,629, filed Sep. 15, 2023, thirteen pages. [cited by applicant]
Non-Final Office Action mailed Feb. 22, 2024, for U.S. Appl. No. 17/887,255, filed Aug. 12, 2022, twenty- four pages. [cited by applicant]
European Office Action dated Jul. 16, 2024, for EP Application No. 19823464.3, seven pages. [cited by applicant]
Japanese Notice of Allowance mailed Aug. 7, 2024, for JP Application No. 2022-548903, with English translation, 6 pages. [cited by applicant]
Notice of Allowance mailed Aug. 1, 2024, for U.S. Appl. No. 18/468,629, filed Sep. 15, 2023, five pages. [cited by applicant]
Chinese Notice of Allowance dated Nov. 13, 2023, for CN Application No. 202180028398.8, with English translation, 4 pages. [cited by applicant]
Chinese Office Action dated Mar. 29, 2023, for CN Application No. 202180028410.5, with English translation, 12 pages. [cited by applicant]
Chinese Office Action dated May 13, 2023, for CN Application No. 202180028398.8, with English translation, 6 pages. [cited by applicant]
Chinese Office Action dated Oct. 3, 2023, for CN Application No. 202180028410.5, with English translation, 11 pages. [cited by applicant]
European Communication dated Jan. 20, 2023, for EP Application No. 19841636.4, filed Jul. 22, 2019, six pages. [cited by applicant]
Extended European Search Report dated Jul. 26, 2021, for EP Application No. 19841636.4, filed Jul. 22, 2019, nine pages. [cited by applicant]
Extended European Search Report dated Jul. 6, 2023, for EP Application No. 21754096.2, eight pages. [cited by applicant]
Extended European Search Report dated Jun. 12, 2023, for EP Application No. 21753609.3, nine pages. [cited by applicant]
Extended European Search Report dated Jun. 30, 2023, for EP Application No. 21753304.1, nine pages. [cited by applicant]
Extended European Search Report dated Jun. 9, 2023, for EP Application No. 21753843.8, nine pages. [cited by applicant]
Final Office Action mailed Apr. 8, 2022, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, fourteen pages. [cited by applicant]
Final Office Action mailed Dec. 10, 2021, for U.S. Appl. No. 17/174,141, filed Feb. 11, 2021, 14 pages. [cited by applicant]
Final Office Action mailed Oct. 27, 2020, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, fifteen pages. [cited by applicant]
Final Office Action mailed Sep. 29, 2023, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, nineteen pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion dated Jan. 26, 2021, for PCT Application No. PCT/US2019/042881, filed Jul. 22, 2019, 16 pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/017508, filed Feb. 10, 2021, nine pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/017718, filed Feb. 11, 2021, seven pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/018035, filed Feb. 12, 2021, 8 pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/018037, filed Feb. 12, 2021, nine pages. [cited by applicant]
International Search Report and Written Opinion mailed Apr. 28, 2021, for PCT Application No. PCT/US2021/17508, filed Feb. 10, 2021, 16 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 15, 2021, for PCT Application No. PCT/US2021/18037, filed Feb. 12, 2021, 17 pages. [cited by applicant]
International Search Report and Written Opinion mailed May 3, 2021, for PCT Application No. PCT/US2021/18035, filed Feb. 12, 2021, 14 pages. [cited by applicant]
International Search Report mailed Apr. 22, 2021, for PCT Application No. PCT/US2021/017718, filed Feb. 11, 2021, two pages. [cited by applicant]
International Search Report mailed Oct. 2, 2019, for PCT Application No. PCT/US2019/042881, filed Jul. 22, 2019, three pages. [cited by applicant]
Jacob, R. “Eye Tracking in Advanced Interface Design”, Virtual Environments and Advanced Interface Design, Oxford University Press, Inc. (Jun. 1995). [cited by applicant]
Japanese Office Action mailed Jul. 27, 2023, for JP Application No. 2021-503735, with English translation, 13 pages. [cited by applicant]
Non-Final Office Action mailed Aug. 17, 2023, for U.S. Appl. No. 17/521,740, filed Nov. 8, 2021, fourteen pages. [cited by applicant]
Non-Final Office Action mailed Dec. 15, 2021, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, thirteen pages. [cited by applicant]
Non-Final Office Action mailed Feb. 17, 2022, for U.S. Appl. No. 17/175,467, filed Feb. 12, 2021, 23 pages. [cited by applicant]
Non-Final Office Action mailed Jul. 5, 2023, for U.S. Appl. No. 17/944,079, filed Sep. 13, 2022, fourteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 16, 2022, for U.S. Appl. No. 17/174,141, filed Feb. 11, 2021, eighteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 20, 2023, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, sixteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 29, 2023, for U.S. Appl. No. 17/949,989, filed Sep. 21, 2022, ten pages. [cited by applicant]
Non-Final Office Action mailed May 14, 2020, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, eighteen pages. [cited by applicant]
Non-Final Office Action mailed Sep. 1, 2021, for U.S. Appl. No. 17/174,141, filed Feb. 11, 2021, thirteen pages. [cited by applicant]
Notice of Allowance mailed Apr. 22, 2021, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, nine pages. [cited by applicant]
Notice of Allowance mailed Aug. 26, 2022, for U.S. Appl. No. 17/175,467, filed Feb. 12, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Aug. 5, 2022, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, nine pages. [cited by applicant]
Notice of Allowance mailed Aug. 9, 2021, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 20, 2022, for U.S. Appl. No. 17/173,125, filed Feb. 10, 2021, twelve pages. [cited by applicant]
Notice of Allowance mailed Jul. 11, 2022, for U.S. Appl. No. 17/174,141, filed Feb. 11, 2021, nine pages. [cited by applicant]
Notice of Allowance mailed Jul. 21, 2023, for U.S. Appl. No. 17/174,141, filed Feb. 11, 2021, seven pages. [cited by applicant]
Notice of Allowance mailed Jul. 26, 2023, for U.S. Appl. No. 17/949,989, filed Sep. 21, 2022, five pages. [cited by applicant]
Notice of Allowance mailed Nov. 23, 2021, for U.S. Appl. No. 17/173,125, filed Feb. 10, 2021, eleven pages. [cited by applicant]
Notice of Allowance mailed Oct. 16, 2023, for U.S. Appl. No. 17/944,079, filed Sep. 13, 2022, eight pages. [cited by applicant]
Rolland, J. et al., “High-resolution inset head-mounted display”, Optical Society of America, vol. 37, No. 19, Applied Optics, (Jul. 1, 1998). [cited by applicant]
Schmalstieg, D. et al. “Bridging Multiple User Interface Dimensions with Augmented Reality”, Oct. 2000, In Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000) pp. 20-29. (Year: 2000). [cited by applicant]
Schmalstieg, D. et al., (2002). “Distributed Applications for Collaborative Augmented Reality”, Proceedings IEEE Virtual Reality 2002 [online], US, IEEE, Mar. 24, 2002, pp. 1-8, URL: https://ieeexplore.ieee.org/stamp/st… [cited by applicant]
Shen, Y. et al., “Augmented Reality for Collaborative Product Design and Development”, Elsevier, 2009 (Year: 2009). [cited by applicant]
Tanriverdi, V. et al. (Apr. 2000). “Interacting With Eye Movements In Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA 02155, USA, Proceedings of the SIGCHI… [cited by applicant]
Yoshida, A. et al., “Design and Applications of a High Resolution Insert Head Mounted Display”, (Jun. 1994). [cited by applicant]
Youtube. “Augmented Reality—annotating an object” https://www.youtube.com/watch?v=ESOZndNnGh0 (Year: 2019). [cited by applicant]
Youtube. “Real Object Annotations in Augmented Reality in Product Design”, https://www.youtube.com/watch?v=cy8owOreAfl (Year: 2013). [cited by applicant]
Non-Final Office Action mailed Jan. 16, 2024, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, twenty pages. [cited by applicant]
Notice of Allowance mailed Jan. 16, 2024, for U.S. Appl. No. 17/521,740, filed Nov. 8, 2021, seven pages. [cited by applicant]
Chinese Notice of Allowance dated Jun. 14, 2024, for CN Application No. 201980051078.7, with English translation, six pages. [cited by applicant]
Notice of Allowance mailed Jun. 14, 2024, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, nine pages. [cited by applicant]
Notice of Allowance mailed Jun. 18, 2024, for U.S. Appl. No. 17/887,255, filed Aug. 12, 2022, five pages. [cited by applicant]
Bar-Zeev, A., “Scenegraphs: Past, Present, and Future.” accessed at: https://web.archive.org/web/20130216210347/www.realityprime.com/blog/2007/06/scenegraphs-past-present-and-future/ (Jun. 2012). [cited by applicant]
Chinese Office Action dated Aug. 17, 2024, for CN Application No. 201980055804.2, with English translation, 12 pages. [cited by applicant]
Declaration of Dr. Douglas A. Bowman Under 37 C.F.R. § 1.132 including Claim Charts CC-1 to CC-15, Appendix A (List of Materials Considered) and Appendix B (Curriculum Vitae). [cited by applicant]
Notice of Allowance mailed Aug. 28, 2024, for U.S. Appl. No. 18/314,075, filed May 8, 2023, five pages. [cited by applicant]
Prosecution File History of U.S. Pat. No. 11,201,953 (953 File History) Submit in 3 parts. [cited by applicant]
Chinese Office Action dated Jan. 7, 2025, for CN Application No. 201980055804.2, with English translation, 20 pages. [cited by applicant]
Chinese Office Action dated Nov. 5, 2024, for CN Application No. 202410421677.6, with English translation, 15 pages. [cited by applicant]
Japanese Office Action mailed Dec. 4, 2024, for JP Application No. 2022-548905, with English translation, 3 pages. [cited by applicant]
Japanese Office Action mailed Nov. 18, 2024, for JP Application No. 2022-548434, with English translation, 15 pages. [cited by applicant]
Notice of Allowance mailed Nov. 13, 2024, for U.S. Appl. No. 18/314,075, filed May 8, 2023, five pages. [cited by applicant]
European Office Action dated Feb. 6, 2025, for EP Application No. 21753843.8, five pages. [cited by applicant]
Ex Parte Reexamination Communication mailed Feb. 18, 2025, for U.S. Appl. No. 90/019,624, filed Aug. 16, 2024, for U.S. Pat. No. 11,201,953, 115 pages. [cited by applicant]
Japanese Office Action mailed Feb. 3, 2025, for JP Application No. 2024-037958, with English translation, 9 pages. [cited by applicant]
Japanese Office Action mailed Jan. 17, 2025, for JP Application No. 2022-548904, with English translation, 10 pages. [cited by applicant]
Cited By (1)
US 12,495,094