IP Library › Granted Patent US 12,211,145
Granted Patent B2
US 12,211,145 · App. 18/314,075 · Granted Jan 28, 2025

Centralized rendering

Inventor: Praveen Babu J D (Plantation, FL)
Assignee: Magic Leap, Inc.
G06T17/005G06T15/80G06T19/006G06T15/005G06T2210/21G06T2210/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,145
App. No.
18/314,075
Granted
Jan 28, 2025
Kind
B2
Abstract

A method is disclosed, the method comprising the steps of receiving, from a first client application, first graphical data comprising a first node; receiving, from a second client application independent of the first client application, second graphical data comprising a second node; and generating a scenegraph, wherein the scenegraph describes a hierarchical relationship between the first node and the second node according to visual occlusion relative to a perspective from a display.

Claims (42)

1. A method comprising:

communicating, from a first client application to a computer system, the computer system in communication with a second client application, a first graphical data comprising a first plurality of nodes;

receiving, from the computer system, a scenegraph, wherein:

the scenegraph describes a first occlusion relationship between at least one node of the first plurality of nodes and at least one node of a second plurality of nodes of second graphical data of the second client application,

the scenegraph further describes a second occlusion relationship between at least one node of the first plurality of nodes and at least one node of the second plurality of nodes,

the first occlusion relationship configured such that at least a first node of the second plurality of nodes occludes at least a first node of the first plurality of nodes,

the second occlusion relationship configured such that at least a second node of the first plurality of nodes occludes at least a second node of the second plurality of nodes; and

creating a rendered scene based on the first occlusion relationship, wherein the rendered scene comprises a subset of the first plurality of nodes.

2. The method of claim 1 , wherein creating the rendered scene comprises traversing the scenegraph.

3. The method of claim 1 , further comprising displaying the rendered scene, wherein displaying the rendered scene comprises displaying the at least a first node of the second plurality of nodes while forgoing displaying the at least a first node of the first plurality of nodes.

4. The method of claim 1 , wherein the first client application comprises a first application executing on the computer system and the second client application comprises a second application executing on the computer system.

5. The method of claim 4 , wherein the first client application is sandboxed on the computer system with respect to the second client application.

6. The method of claim 1 , wherein the first client application comprises an application executing on a second computer system, the second computer system in communication with the computer system via a network, and receiving the scenegraph from the computer system comprises receiving the scenegraph at the second computer system from the computer system via the network.

7. The method of claim 1 , wherein the scenegraph corresponds to a version of a versioned scenegraph.

8. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

communicating, from a first client application to a computer system, the computer system in communication with a second client application, a first graphical data comprising a plurality of first nodes;

receiving, from the computer system, a scenegraph, wherein:

the scenegraph describes a first occlusion relationship between at least one node of the first plurality of nodes and at least one node of a second plurality of nodes of second graphical data of the second client application,

the scenegraph further describes a second occlusion relationship between at least one node of the first plurality of nodes and at least one node of the second plurality of nodes,

the first occlusion relationship configured such that at least a first node of the second plurality of nodes occludes at least a first node of the first plurality of nodes,

the second occlusion relationship configured such that at least a second node of the first plurality of nodes occludes at least a second node of the second plurality of nodes; and

creating a rendered scene based on the first occlusion relationship, wherein the rendered scene comprises a subset of the plurality of first nodes.

9. The non-transitory computer-readable medium of claim 8 , wherein creating the rendered scene comprises traversing the scenegraph.

10. The non-transitory computer-readable medium of claim 8 , the method further comprising displaying the rendered scene, wherein displaying the rendered scene comprises displaying the at least a first node of the second plurality of nodes while forgoing displaying the at least a first node of the first plurality of nodes.

11. The non-transitory computer-readable medium of claim 8 , wherein the first client application comprises a first application executing on the computer system and the second client application comprises a second application executing on the computer system.

12. The non-transitory computer-readable medium of claim 11 , wherein the first client application is sandboxed on the computer system with respect to the second client application.

13. The non-transitory computer-readable medium of claim 8 , wherein the first client application comprises an application executing on a second computer system, the second computer system in communication with the computer system via a network, and receiving the scenegraph from the computer system comprises receiving the scenegraph at the second computer system from the computer system via the network.

14. The non-transitory computer-readable medium of claim 8 , wherein the scenegraph corresponds to a version of a versioned scenegraph.

15. A system comprising:

one or more processors configured to perform a method comprising:

communicating, from a first client application to a computer system, the computer system in communication with a second client application, a first graphical data comprising a plurality of first nodes;

receiving, from the computer system, a scenegraph, wherein:

the scenegraph describes a first occlusion relationship between at least one node of the first plurality of nodes and at least one node of a second plurality of nodes of second graphical data of the second client application,

the scenegraph further describes a second occlusion relationship between at least one node of the first plurality of nodes and at least one node of the second plurality of nodes,

the first occlusion relationship configured such that at least a first node of the second plurality of nodes occludes at least a first node of the first plurality of nodes,

the second occlusion relationship configured such that at least a second node of the first plurality of nodes occludes at least a second node of the second plurality of nodes; and

creating a rendered scene based on the first occlusion relationship, wherein the rendered scene comprises a subset of the plurality of first nodes.

16. The system of claim 15 , wherein creating the rendered scene comprises traversing the scenegraph.

17. The system of claim 15 , the method further comprising displaying the rendered scene, wherein displaying the rendered scene comprises displaying the at least a first node of the second plurality of nodes while forgoing displaying the at least a first node of the first plurality of nodes.

18. The system of claim 15 , wherein the first client application comprises a first application executing on the computer system and the second client application comprises a second application executing on the computer system.

19. The system of claim 18 , wherein the first client application is sandboxed on the computer system with respect to the second client application.

20. The system of claim 15 , wherein the first client application comprises an application executing on a second computer system, the second computer system in communication with the computer system via a network, and receiving the scenegraph from the computer system comprises receiving the scenegraph at the second computer system from the computer system via the network.

Assignments (4)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2024
From: BABU J D, PRAVEEN
To: MAGIC LEAP, INC.
Reel/Frame 067015/0151 →
Continuity (6)
Continuation 17678332 · Feb 23, 2022
Continuation 17195393 · Mar 8, 2021
Continuation 16011413 · Jun 18, 2018
Continuation In Part 15940892 · Mar 29, 2018
Provisional Application 62479134 · Mar 30, 2017
Related Publication 20230360324A1 · Nov 9, 2023
References Cited (272)
US 4852988A · Velez · 1989 [cited by applicant]
US 5689641A · Ludwig · 1997 [cited by applicant]
US 5956028A · Matsui · 1999 [cited by applicant]
US 6130670A · Porter · 2000 [cited by applicant]
US 6433760B1 · Vaissie · 2002 [cited by applicant]
US 6491391B1 · Blum et al. · 2002 [cited by applicant]
US 6847336B1 · Lemelson · 2005 [cited by applicant]
US 6943754B2 · Aughey · 2005 [cited by applicant]
US 6977776B2 · Volkenandt et al. · 2005 [cited by applicant]
US 7290216B1 · Kawahara et al. · 2007 [cited by applicant]
US 7347551B2 · Fergason et al. · 2008 [cited by applicant]
US 7488294B2 · Torch · 2009 [cited by applicant]
US 7800614B2 · Johnson et al. · 2010 [cited by applicant]
US 8235529B1 · Raffle · 2012 [cited by applicant]
US 8253730B1 · Carr · 2012 [cited by applicant]
US 8275031B2 · Neuman · 2012 [cited by applicant]
US 8407605B2 · Go · 2013 [cited by applicant]
US 8611015B2 · Wheeler · 2013 [cited by applicant]
US 8638498B2 · Bohn et al. · 2014 [cited by applicant]
US 8696113B2 · Lewis · 2014 [cited by applicant]
US 8929589B2 · Publicover et al. · 2015 [cited by applicant]
US 9010929B2 · Lewis · 2015 [cited by applicant]
US 9069554B2 · Lioy et al. · 2015 [cited by applicant]
US 9274338B2 · Robbins et al. · 2016 [cited by applicant]
US 9292973B2 · Bar-zeev et al. · 2016 [cited by applicant]
US 9323325B2 · Perez et al. · 2016 [cited by applicant]
US 9720505B2 · Gribetz et al. · 2017 [cited by applicant]
US 9811237B2 · Schileru · 2017 [cited by applicant]
US 10013053B2 · Cederlund et al. · 2018 [cited by applicant]
US 10025379B2 · Drake et al. · 2018 [cited by applicant]
US 10242501B1 · Pusch · 2019 [cited by applicant]
US 10403050B1 · Beall · 2019 [cited by applicant]
US 10528349B2 · Kumar · 2020 [cited by applicant]
US 10977858B2 · Babu Jd · 2021 [cited by applicant]
US 10977868B2 · Neeter · 2021 [cited by applicant]
US 11017592B2 · Babu J D · 2021 [cited by applicant]
US 11201953B2 · Babu J D et al. · 2021 [cited by applicant]
US 11295518B2 · Babu J D · 2022 [cited by applicant]
US 11315316B2 · Babu J D · 2022 [cited by applicant]
US 11335070B2 · Baier et al. · 2022 [cited by applicant]
US 11475644B2 · Bailey et al. · 2022 [cited by applicant]
US 11494528B2 · Bailey et al. · 2022 [cited by applicant]
US 11699262B2 · Babu J D · 2023 [cited by applicant]
US 11763559B2 · Wang et al. · 2023 [cited by applicant]
US 11797720B2 · Bailey et al. · 2023 [cited by applicant]
US 11861803B2 · Bailey et al. · 2024 [cited by applicant]
US 11936733B2 · Babu J D et al. · 2024 [cited by applicant]
US 12079938B2 · Baier · 2024 [cited by applicant]
US 12100207B2 · Wang · 2024 [cited by applicant]
US 12112098B2 · Bailey · 2024 [cited by applicant]
US 20010012018A1 · Hayhurst · 2001 [cited by applicant]
US 20020163515A1 · Sowizral et al. · 2002 [cited by applicant]
US 20020172328A1 · Dekel · 2002 [cited by applicant]
US 20030030597A1 · Geist · 2003 [cited by applicant]
US 20030076329A1 · Beda et al. · 2003 [cited by applicant]
US 20040130550A1 · Blanco et al. · 2004 [cited by applicant]
US 20040130552A1 · Duluk et al. · 2004 [cited by applicant]
US 20040130579A1 · Ishii · 2004 [cited by applicant]
US 20040189669A1 · David et al. · 2004 [cited by applicant]
US 20050182844A1 · Johnson et al. · 2005 [cited by applicant]
US 20060023158A1 · Howell et al. · 2006 [cited by applicant]
US 20060122819A1 · Carmel et al. · 2006 [cited by applicant]
US 20070057952A1 · Swedberg et al. · 2007 [cited by applicant]
US 20070220168A1 · Parsons et al. · 2007 [cited by applicant]
US 20080002761A1 · Edsall et al. · 2008 [cited by applicant]
US 20080122838A1 · Hoover et al. · 2008 [cited by applicant]
US 20090278852A1 · Reese et al. · 2009 [cited by applicant]
US 20090282369A1 · Jones · 2009 [cited by applicant]
US 20110211056A1 · Publicover et al. · 2011 [cited by applicant]
US 20110213664A1 · Osterhout · 2011 [cited by applicant]
US 20120021806A1 · Maltz · 2012 [cited by applicant]
US 20120075343A1 · Chen et al. · 2012 [cited by applicant]
US 20120086631A1 · Osman · 2012 [cited by applicant]
US 20120102549A1 · Mazzaferri · 2012 [cited by applicant]
US 20120249416A1 · Maciocci et al. · 2012 [cited by applicant]
US 20130012418A1 · Tatsumi · 2013 [cited by applicant]
US 20130073707A1 · Butler et al. · 2013 [cited by applicant]
US 20130077147A1 · Efimov · 2013 [cited by applicant]
US 20130097635A1 · Yerli · 2013 [cited by applicant]
US 20130120418A1 · Green et al. · 2013 [cited by applicant]
US 20130120421A1 · Maguire · 2013 [cited by examiner]
US 20130127849A1 · Marketsmueller et al. · 2013 [cited by applicant]
US 20130293468A1 · Perez et al. · 2013 [cited by applicant]
US 20130324245A1 · Harvey et al. · 2013 [cited by applicant]
US 20140123184A1 · Reisman · 2014 [cited by applicant]
US 20140168218A1 · Mitrea et al. · 2014 [cited by applicant]
US 20140195918A1 · Friedlander · 2014 [cited by applicant]
US 20140267234A1 · Hook et al. · 2014 [cited by applicant]
US 20140267291A1 · Smyth et al. · 2014 [cited by applicant]
US 20140313197A1 · Peuhkurinen · 2014 [cited by applicant]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20150199788A1 · Wolfe · 2015 [cited by applicant]
US 20150248779A1 · Lindquist · 2015 [cited by applicant]
US 20160006800A1 · Summers · 2016 [cited by applicant]
US 20160072716A1 · Chow et al. · 2016 [cited by applicant]
US 20160093090A1 · Shin et al. · 2016 [cited by applicant]
US 20160104452A1 · Guan et al. · 2016 [cited by applicant]
US 20160293133A1 · Dutt · 2016 [cited by applicant]
US 20160343164A1 · Urbach et al. · 2016 [cited by applicant]
US 20160361658A1 · Osman · 2016 [cited by applicant]
US 20170153926A1 · Callegari et al. · 2017 [cited by applicant]
US 20170236320A1 · Gribetz et al. · 2017 [cited by applicant]
US 20170352196A1 · Chen · 2017 [cited by applicant]
US 20170365086A1 · Floyd et al. · 2017 [cited by applicant]
US 20180114368A1 · Marketsmueller · 2018 [cited by applicant]
US 20180181198A1 · Trotta · 2018 [cited by applicant]
US 20180197340A1 · Loberg et al. · 2018 [cited by applicant]
US 20180197341A1 · Loberg et al. · 2018 [cited by applicant]
US 20180321894A1 · Paulovich et al. · 2018 [cited by applicant]
US 20190019348A1 · Yamamoto et al. · 2019 [cited by applicant]
US 20190114802A1 · Lazarow · 2019 [cited by applicant]
US 20190180506A1 · Gebbie · 2019 [cited by applicant]
US 20190230165A1 · Wang · 2019 [cited by applicant]
US 20190243599A1 · Rochford et al. · 2019 [cited by applicant]
US 20190244426A1 · Knoppert et al. · 2019 [cited by applicant]
US 20190272674A1 · Comer et al. · 2019 [cited by applicant]
US 20190392640A1 · Qian et al. · 2019 [cited by applicant]
US 20200005538A1 · Neeter · 2020 [cited by applicant]
US 20200051328A1 · Mohan et al. · 2020 [cited by applicant]
US 20200051337A1 · Reynolds et al. · 2020 [cited by applicant]
US 20200066049A1 · Sun · 2020 [cited by applicant]
US 20200160601A1 · Shreve et al. · 2020 [cited by applicant]
US 20200225904A1 · Cooper et al. · 2020 [cited by applicant]
US 20220180598A1 · Babu J D · 2022 [cited by applicant]
US 20220245905A1 · Baier et al. · 2022 [cited by applicant]
US 20220383634A1 · Wang et al. · 2022 [cited by applicant]
US 20240005050A1 · Bailey et al. · 2024 [cited by applicant]
US 20240087261A1 · Bailey · 2024 [cited by applicant]
US 20240187488A1 · Babu J D · 2024 [cited by applicant]
US 20240371116A1 · Baier · 2024 [cited by applicant]
CA 2316473A1 · 2001 [cited by applicant]
CA 2362895A1 · 2002 [cited by applicant]
CA 2388766A1 · 2003 [cited by applicant]
CN 103023872A · 2013 [cited by applicant]
CN 104967637A · 2015 [cited by applicant]
CN 110352085A · 2019 [cited by applicant]
CN 110476188A · 2019 [cited by applicant]
JP 2003228721A · 2003 [cited by applicant]
JP 2004272928A · 2004 [cited by applicant]
JP 2012503811A · 2012 [cited by applicant]
KR 20140136367A · 2014 [cited by applicant]
WO 2010035141A2 · 2010 [cited by applicant]
WO 2016028293A1 · 2016 [cited by applicant]
WO 2016198346A1 · 2016 [cited by applicant]
WO 2018106735A1 · 2018 [cited by applicant]
WO 2018165039A1 · 2018 [cited by applicant]
WO 2018175335A1 · 2018 [cited by applicant]
WO 2018183778A1 · 2018 [cited by applicant]
WO 2018224847A2 · 2018 [cited by applicant]
WO 2019074771A1 · 2019 [cited by applicant]
WO 2019199569A1 · 2019 [cited by applicant]
WO 2021163224A1 · 2021 [cited by applicant]
WO 2021163373A1 · 2021 [cited by applicant]
WO 2021163624A1 · 2021 [cited by applicant]
WO 2021163626A1 · 2021 [cited by applicant]
Israeli Notice of Allowance dated Feb. 23, 2023, for IL Application No. 269545, with English translation, 7 pages. [cited by applicant]
Korean Office Action dated Jun. 2, 2023, for KR Application No. 10-2019-7031887, with English translation, 35 pages. [cited by applicant]
Australian Office Action mailed Dec. 23, 2021, for AU Patent Application No. 2018243460, three pages. [cited by applicant]
Australian Office Action malled Oct. 21, 2022, for AU Patent Application No. 2018243460, two pages. [cited by applicant]
Chinese Office Action dated Mar. 7, 2023, for CN Application No. 201880023286.1, with English translation, 17 pages. [cited by applicant]
Eikel, B. et al., “Preprocessed Global Visibility for Real-Time Rendering onLow-End Hardware,” Nov. 29, 2010, ICIAP: International Conference on Image Analysis and Processing, 17th International Conference, Naples, Ital… [cited by applicant]
European Search Report dated Aug. 23, 2021, for EP Application No. 19823464.3, twelve pages. [cited by applicant]
Final Office Action mailed Aug. 25, 2020, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 41 pages. [cited by applicant]
Final Office Action mailed Aug. 25, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 21 pages. [cited by applicant]
Final Office Action mailed Dec. 4, 2019, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 37 pages. [cited by applicant]
Final Office Action mailed Dec. 4, 2019, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 15 pages. [cited by applicant]
Indian Office Action dated Feb. 2, 2022, for IN Application No. 201947041612, with English translation, 4 pages. [cited by applicant]
International Preliminary Report on Patentability mailed Dec. 30, 2020, for PCT Application No. PCT/US2019/037811 filed on Jun. 18, 2019, eight pages. [cited by applicant]
International Search Report and Written Opinion mailed Sep. 9, 2019, for PCT Application No. PCT/US19/37811 filed on Jun. 18, 2019, fourteen pages. [cited by applicant]
International Search Report dated Jul. 30, 2018, for PCT Application No. PCT/US2018/25298 filed on Mar. 29, 2018, four pages. [cited by applicant]
Israeli Office Acton dated Jan. 16, 2022, for IL Application No. 269545, with English translation, 9 pages. [cited by applicant]
Jacob, R. “Eye Tracking in Advanced Interface Design”, Virtual Environments and Advanced Interface Design, Oxford University Press, Inc. (Jun. 1995). [cited by applicant]
Japanese Notice of Allowance mailed Sep. 27, 2022, for JP Application No. 2019-553094, with English translation, 6 pages. [cited by applicant]
Japanese Office Action mailed Feb. 14, 2022, for JP Application No. 2019553094, with English translation, 14 pages. [cited by applicant]
Kurillo, G. et al., “Teleimmersive 3D Collaborative Environment for Cyberarchaeology,” computer vision and pattern recognition workshops (CVPRW), 2010 IEEE computer society conference on, IEEE, Piscataway, NJ, USA, Jun.… [cited by applicant]
Non-Final Office Action malled Jun. 20, 2019, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 34 pages. [cited by applicant]
Non-Final Office Action mailed Jun. 25, 2019, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 14 pages. [cited by applicant]
Non-Final Office Action malled Mar. 24, 2020, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, 38 pages. [cited by applicant]
Non-Final Office Action mailed Mar. 24, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, 18 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 15, 2021, for U.S. Appl. No. 17/236,971, filed Apr. 21, 2021, 13 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 27, 2022, for U.S. Appl. No. 17/678,332, filed Feb. 23, 2022, 12 pages. [cited by applicant]
Non-Final Office Action mailed Sep. 16, 2021, for U.S. Appl. No. 17/195,393, filed Mar. 8, 2021, fourteen pages. [cited by applicant]
Notice of Allowance mailed Dec. 9, 2020, for U.S. Appl. No. 16/011,413, filed Jun. 18, 2018, nine pages. [cited by applicant]
Notice of Allowance mailed Feb. 11, 2022, for U.S. Appl. No. 17/236,971, filed Apr. 21, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 25, 2021, for U.S. Appl. No. 15/940,892, filed Mar. 29, 2018, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 25, 2022, for U.S. Appl. No. 17/195,393, filed Mar. 8, 2021, eight pages. [cited by applicant]
Notice of Allowance malled Mar. 22, 2023, for U.S. Appl. No. 17/678,332, filed Feb. 23, 2022, seven pages. [cited by applicant]
Rolland, J. et al., “High-resolution inset head-mounted display”, Optical Society of America, vol. 37, No. 19, Applied Optics, (Jul. 1, 1998). [cited by applicant]
Tanriverdi, V. et al. (Apr. 2000). “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA 02155, USA, Proceedings of the SIGCHI… [cited by applicant]
Yoshida, A. et al., “Design and Applications of a High Resolution Insert Head Mounted Display”, (Jun. 1994). [cited by applicant]
Chinese Office Action dated Jul. 24, 2023, for CN Application No. 201880023286.1, with English translation, 5 pages. [cited by applicant]
Japanese Office Action mailed Aug. 21, 2023, for JP Application No. 2020-570684, with English translation, 5 pages. [cited by applicant]
Israeli Notice of Allowance dated Nov. 29, 2023, for IL Application No. 303169, four pages. [cited by applicant]
Japanese Notice of Allowance mailed Nov. 30, 2023, for JP Application No. 2020-570684, with English translation, 7 pages. [cited by applicant]
Chinese Office Action dated Feb. 8, 2024, for CN Application No. 201980051078.7, with English translation, 19 pages. [cited by applicant]
Canadian Office Action dated Mar. 28, 2024, for CA Application No. 3,058,421, four pages. [cited by applicant]
Chinese Notice of Allowance dated Jan. 10, 2024, for CN Application No. 201880023286.1, with English translation, four pages. [cited by applicant]
European Office Action dated Nov. 2, 2023, for EP Application No. 18778218.0, nine pages. [cited by applicant]
Japanese Office Action mailed Dec. 12, 2023, for JP Application No. 2022-176196, with English translation, four pages. [cited by applicant]
Korean Notice of Allowance dated Dec. 13, 2023, for KR Application No. 10-2019-7031887, with English translation, four pages. [cited by applicant]
Extended European Search Report dated Jun. 7, 2024, for EP Application No. 24165773.3, seven pages. [cited by applicant]
Japanese Office Action mailed May 2, 2024, for JP Application No. 2022-548903, with English translation, five pages. [cited by applicant]
European Office Action dated Jul. 16, 2024, for EP Application No. 19823464.3, seven pages. [cited by applicant]
Japanese Notice of Allowance mailed Aug. 7, 2024, for JP Application No. 2022-548903, with English translation, 6 pages. [cited by applicant]
Notice of Allowance mailed Aug. 1, 2024, for U.S. Appl. No. 18/468,629, filed Sep. 15, 2023, five pages. [cited by applicant]
Chinese Notice of Allowance dated Jun. 14, 2024, for CN Application No. 201980051078.7, with English translation, six pages. [cited by applicant]
Notice of Allowance mailed Jun. 14, 2024, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, nine pages. [cited by applicant]
Notice of Allowance mailed Jun. 18, 2024, for U.S. Appl. No. 17/887,255, filed Aug. 12, 2022, five pages. [cited by applicant]
Chinese Notice of Allowance dated Feb. 9, 2024, for CN Application No. 202180028410.5, with English translation, four pages. [cited by applicant]
Chinese Notice of Allowance dated Nov. 13, 2023, for CN Application No. 202180028398.8, with English translation, four pages. [cited by applicant]
Chinese Office Action dated Feb. 22, 2024, for CN Application No. 201980055804.2 with English translation, eleven pages. [cited by applicant]
Chinese Office Action dated Mar. 29, 2023, for CN Application No. 202180028410.5, with English translation, twelve pages. [cited by applicant]
Chinese Office Action dated May 13, 2023, for CN Application No. 202180028398.8, with English translation, six pages. [cited by applicant]
Chinese Office Action dated Oct. 3, 2023, for CN Application No. 202180028410.5, with English translation, eleven pages. [cited by applicant]
European Communication dated Jan. 20, 2023, for EP Application No. 19841636.4, filed Jul. 22, 2019, six pages. [cited by applicant]
Extended European Search Report dated Jul. 26, 2021, for EP Application No. 19841636.4, filed Jul. 22, 2019, nine pages. [cited by applicant]
Extended European Search Report dated Jul. 6, 2023, for EP Application No. 21754096.2, eight pages. [cited by applicant]
Extended European Search Report dated Jun. 12, 2023, for EP Application No. 21753609.3, nine pages. [cited by applicant]
Extended European Search Report dated Jun. 30, 2023, for EP Application No. 21753304.1, nine pages. [cited by applicant]
Extended European Search Report dated Jun. 9, 2023, for EP Application No. 21753843.8, nine pages. [cited by applicant]
Final Office Action mailed Apr. 8, 2022, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, fourteen pages. [cited by applicant]
Final Office Action mailed Dec. 10, 2021, for US Appl. No. 17/174, 141 filed Feb. 11, 2021, fourteen pages. [cited by applicant]
Final Office Action mailed Oct. 27, 2020, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, fifteen pages. [cited by applicant]
Final Office Action mailed Sep. 29, 2023, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, nineteen pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion dated Jan. 26, 2021, for PCT Application No. PCT/US2019/042881, filed Jul. 22, 2019, sixteen pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/017508, filed Feb. 10, 2021, nine pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/017718, filed Feb. 11, 2021, seven pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/018035, filed Feb. 12, 2021, eight pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Aug. 25, 2022, for PCT Application No. PCT/US2021/018037, filed Feb. 12, 2021, nine pages. [cited by applicant]
International Search Report and Written Opinion mailed Apr. 28, 2021, for PCT Application No. PCT/US2021/17508, filed Feb. 10, 2021, sixteen pages. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 15, 2021, for PCT Application No. PCT/US2021/18037, filed Feb. 12, 2021, 17 pages. [cited by applicant]
International Search Report and Written Opinion mailed May 3, 2021, for PCT Application No. PCT/US2021/18035, filed Feb. 12, 2021, fourteen pages. [cited by applicant]
International Search Report mailed Apr. 22, 2021, for PCT Application No. PCT/US2021/017718, filed Feb. 11, 2021, two pages. [cited by applicant]
International Search Report mailed Oct. 2, 2019, for PCT Application No. PCT/US2019/042881, filed Jul. 22, 2019, three pages. [cited by applicant]
Japanese Office Action mailed Jan. 12, 2024, for JP Application No. 2021-503735, with English translation, six pages. [cited by applicant]
Japanese Office Action mailed Jul. 27, 2023, for JP Application No. 2021-503735, with English translation, thirteen pages. [cited by applicant]
Non-Final Office Action mailed Apr. 10, 2024, for U.S. Appl. No. 18/468,629, filed Sep. 15, 2023, thirteen pages. [cited by applicant]
Non-Final Office Action mailed Aug. 17, 2023, for U.S. Appl. No. 17/521,740, filed Nov. 8, 2021, fourteen pages. [cited by applicant]
Non-Final Office Action mailed Dec. 15, 2021, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, thirteen pages. [cited by applicant]
Non-Final Office Action mailed Feb. 17, 2022, for U.S. Appl. No. 17/175,467, filed Feb. 12, 2021, twenty- three pages. [cited by applicant]
Non-Final Office Action mailed Feb. 22, 2024, for U.S. Appl. No. 17/887,255, filed Aug. 12, 2022, twenty- four pages. [cited by applicant]
Non-Final Office Action mailed Jan. 16, 2024, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, twenty pages. [cited by applicant]
Non-Final Office Action mailed Jul. 5, 2023, for U.S. Appl. No. 17/944,079, filed Sep. 13, 2022, fourteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 16, 2022, for US Appl. No. 17/174,141 filed Feb. 11, 2021, eighteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 20, 2023, for U.S. Appl. No. 17/723,245, filed Apr. 18, 2022, sixteen pages. [cited by applicant]
Non-Final Office Action mailed Mar. 29, 2023, for U.S. Appl. No. 17/949,989, filed Sep. 21, 2022, ten pages. [cited by applicant]
Non-Final Office Action mailed May 14, 2020, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, eighteen pages. [cited by applicant]
Non-Final Office Action mailed Sep. 1, 2021, for US Appl. No. 17/174, 141 filed Feb. 11, 2021, thirteen pages. [cited by applicant]
Notice of Allowance mailed Apr. 22, 2021, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, nine pages. [cited by applicant]
Notice of Allowance mailed Aug. 26, 2022, for U.S. Appl. No. 17/175,467, filed Feb. 12, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Aug. 5, 2022, for U.S. Appl. No. 17/175,547, filed Feb. 12, 2021, nine pages. [cited by applicant]
Notice of Allowance mailed Aug. 9, 2021, for U.S. Appl. No. 16/518,891, filed Jul. 22, 2019, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 16, 2024, for U.S. Appl. No. 17/521,740, filed Nov. 8, 2021, seven pages. [cited by applicant]
Notice of Allowance mailed Jan. 20, 2022, for US Application No. 17/173, 125 filed Feb. 10, 2021, twelve pages. [cited by applicant]
Notice of Allowance mailed Jul. 11, 2022, for US Application No. 17/174, 141 filed Feb. 11, 2021, nine pages. [cited by applicant]
Notice of Allowance mailed Jul. 21, 2023, for US Application No. 17/174, 141 filed Feb. 11, 2021, seven pages. [cited by applicant]
Notice of Allowance mailed Jul. 26, 2023, for U.S. Appl. No. 17/949,989, filed Sep. 21, 2022, five pages. [cited by applicant]
Notice of Allowance mailed Nov. 23, 2021, for US Appl. No. 17/173,125 filed Feb. 10, 2021, eleven pages. [cited by applicant]
Notice of Allowance mailed Oct. 16, 2023, for U.S. Appl. No. 17/944,079, filed Sep. 13, 2022, eight pages. [cited by applicant]
Schmalstieg, D. et al. “Bridging Multiple User Interface Dimensions with Augmented Reality”, Oct. 2000, In Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000) pp. 20-29. (Year: 2000). [cited by applicant]
Schmalstieg, D. et al., (2002). “Distributed Applications for Collaborative Augmented Reality”, Proceedings IEEE Virtual Reality 2002 [online], US, IEEE, Mar. 24, 2002, pp. 1-8, URL: https://ieeexplore.ieee.org/stamp/st… [cited by applicant]
Shen, Y. et al., “Augmented Reality for Collaborative Product Design and Development”, Elsevier, 2009 (Year: 2009). [cited by applicant]
YouTube. “Augmented Reality - annotating an object” https://www.youtube.com/watch?v=ESOZndNnGh0 (Year: 2019). [cited by applicant]
YouTube. “Real Object Annotations in Augmented Reality in Product Design”, https://www.youtube.com/watch?v=cy8owOreAfl (Year: 2013). [cited by applicant]
Japanese Notice of Allowance mailed May 30, 2024, for JP Application No. 2022-176196, with English translation, six pages. [cited by applicant]
Japanese Notice of Allowance mailed May 30, 2024, for JP Application No. 2021-503735, with English translation, six pages. [cited by applicant]
Bar-Zeev, A., “Scenegraphs: Past, Present, and Future.” accessed at: https://web.archive.org/web/20130216210347/www.realityprime.com/blog/2007/06/scenegraphs-past-present-and-future/ (Jun. 2012). [cited by applicant]
Chinese Office Action dated Aug. 17, 2024, for CN Application No. 201980055804.2, with English translation, 12 pages. [cited by applicant]
Declaration of Dr. Douglas A. Bowman Under 37 C.F.R. § 1.132 including Claim Charts CC-1 to CC-15, Appendix A (List of Materials Considered) and Appendix B (Curriculum Vitae). [cited by applicant]
Japanese Notice of Allowance mailed Sep. 19, 2024, for JP Patent Application No. 2023-196665, with English translation, 6 pages. [cited by applicant]
Prosecution File History of U.S. Pat. No. 11,201,953 ('953 File History). Submitted in 3 parts. [cited by applicant]
Non-Final Office Action mailed Nov. 6, 2024, for U.S. Appl. No. 18/513,443, filed Nov. 17, 2023, ten pages. [cited by applicant]
Cited By (2)
US 12,315,094 US 12,495,094