IP Library › Granted Patent US 12,254,581
Granted Patent B2
US 12,254,581 · App. 18/508,538 · Granted Mar 18, 2025

Artificial reality augments and surfaces

Inventors: James Tichenor (Seattle, WA); Arthur Zwiegincew (Medina, WA); Hayden Schoen (Evanston, IL); Alex Marcolina (Fremont, CA); Gregory Alt (Seattle, WA); Todd Harris (Woodinville, WA); Merlyn Deng (Bellevue, WA); Barrett Fox (Berkeley, CA); Michal Hlavac (Seattle, WA)
Assignee: Meta Platforms Technologies, LLC
G06T19/006G06F3/013G06T19/20G06T2200/24G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,581
App. No.
18/508,538
Granted
Mar 18, 2025
Kind
B2
Abstract

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Claims (47)

1. A method, performed by a computing system comprising one or more processors, for managing interactions between virtual containers in an artificial realty environment, the artificial realty environment provided via an artificial reality device, the method comprising:

registering, by the computing system, a relationship for sharing information between a first entity, associated with a first virtual container, and a second entity, associated with a second virtual container;

invoking, by the computing system, logic in response to a context factor associated with the first virtual container or the second virtual container; and

in response to the invoking and based on the registered relationship, causing, by the computing system, one or more interactions between the first entity and the second entity, the one or more interactions comprising one or both of:

providing a handle, from the first entity to the second entity, wherein the handle is used to invoke logic, by the second entity, associated with the first virtual container, or

transferring information associated with a content item, from the first entity to the second entity, wherein the content item is associated with the first virtual container, and wherein the information is used to update display of the second virtual container to be shown with a version of the content item.

2. The method of claim 1 , wherein the registering is performed by a shell application executing on the artificial reality device.

3. The method of claim 1 , wherein the method includes, in response to the invoking the logic in response to the context factor, one or both of:

sharing, by the first entity with the second entity, shape data for the first virtual container; or

sharing, by the first entity with the second entity, location data for the first virtual container.

4. The method of claim 1 , wherein the context factor relates to relative positions of the first virtual container and the second virtual container.

5. The method of claim 4 , wherein the context factor, that relates to the relative positions of the first virtual container and the second virtual container, includes the first virtual container and the second virtual container being within a threshold distance of each other.

6. The method of claim 1 ,

wherein the first virtual container has at least two display modes; and

wherein at least one display mode, of the at least two display modes, was inherited by the first virtual container based on the first virtual container having been created as an instance of a virtual container class that defines the at least one display mode.

7. The method of claim 1 ,

wherein a system with which the relationship is registered further has defined one or more privacy policies specifying types of virtual container data that can be shared between virtual containers; and

wherein the registering the relationship includes the system determining that the relationship conforms to the one or more privacy policies.

8. The method of claim 7 , wherein the one or more privacy policies specify types of information that can only be shared between virtual containers that have been assigned to a same real-world surface.

9. The method of claim 7 , wherein the one or more privacy policies specify types of information that can only be shared between virtual containers that were created by a same parent or ancestor entity.

10. The method of claim 7 , wherein the one or more privacy policies specify types of information that can only be shared between virtual containers in response to a user action indicating an interaction between the virtual containers.

11. The method of claim 1 , wherein the first virtual container has at least two display modes and is configured to evaluate, based on information received for the second virtual container, one or more conditions associated with the at least two display modes to enable a current display mode, of the two or more display modes, for presenting the first virtual container.

12. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for managing interactions between virtual containers in an artificial realty environment, the artificial realty environment provided via an artificial reality device, the process comprising:

registering a relationship for sharing information between a first entity, associated with a first virtual container, and a second entity, associated with a second virtual container;

invoking logic in response to a context factor associated with the first virtual container or the second virtual container; and

in response to the invoking and based on the registered relationship, causing one or more interactions between the first entity and the second entity, the one or more interactions comprising one or both of:

providing a handle, from the first entity to the second entity, wherein the handle is used to invoke logic, by the second entity, associated with the first virtual container, or

transferring information associated with a content item, from the first entity to the second entity, wherein the content item is associated with the first virtual container, and wherein the information is used to update display of the second virtual container to be shown with a version of the content item.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the registering is performed by a shell application executing on the artificial reality device.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the process includes, in response to the invoking the logic in response to the context factor, one or both of:

sharing, by the first entity with the second entity, shape data for the first virtual container; or

sharing, by the first entity with the second entity, location data for the first virtual container.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the context factor includes an identification that the first virtual container and the second virtual container are within a threshold distance of each other.

16. The non-transitory computer-readable storage medium of claim 12 , wherein the first virtual container has at least two display modes and is configured to evaluate, based on information received for the second virtual container, one or more conditions associated with the at least two display modes to enable a current display mode, of the two or more display modes, for presenting the first virtual container.

17. A computing system for managing interactions between virtual containers in an artificial realty environment, the artificial realty environment provided via an artificial reality device, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

registering a relationship for sharing information between a first entity, associated with a first virtual container, and a second entity, associated with a second virtual container;

invoking logic in response to a context factor associated with the first virtual container or the second virtual container; and

in response to the invoking and based on the registered relationship, causing one or more interactions between the first entity and the second entity, the one or more interactions comprising one or both of:

providing a handle, from the first entity to the second entity, wherein the handle is used to invoke logic, by the second entity, associated with the first virtual container, or

transferring information associated with a content item, from the first entity to the second entity, wherein the content item is associated with the first virtual container, and wherein the information is used to update display of the second virtual container to be shown with a version of the content item.

18. The computing system of claim 17 , wherein the registering is performed by a shell application executing on the artificial reality device.

19. The computing system of claim 17 , wherein the process includes, in response to the invoking the logic in response to the context factor, one or both of:

sharing, by the first entity with the second entity, shape data for the first virtual container; or

sharing, by the first entity with the second entity, location data for the first virtual container.

20. The computing system of claim 17 , wherein the context factor includes an identification that the first virtual container and the second virtual container are within a threshold distance of each other.

Continuity (4)
Continuation 18151524 · Jan 9, 2023
Continuation 17499233 · Oct 12, 2021
Continuation 17008478 · Aug 31, 2020
Related Publication 20240233292A1 · Jul 11, 2024
References Cited (398)
US 770149A · Bailey · 1904 [cited by applicant]
US 6842175B1 · Schmalstieg et al. · 2005 [cited by applicant]
US 6842877B2 · Robarts et al. · 2005 [cited by applicant]
US 7395534B2 · Alcazar et al. · 2008 [cited by applicant]
US 7650575B2 · Cummins et al. · 2010 [cited by applicant]
US 7701439B2 · Hillis et al. · 2010 [cited by applicant]
US 8335991B2 · Douceur et al. · 2012 [cited by applicant]
US 8558759B1 · Prada Gomez et al. · 2013 [cited by applicant]
US 8726233B1 · Raghavan · 2014 [cited by applicant]
US 8930940B2 · Xu et al. · 2015 [cited by applicant]
US 8947351B1 · Noble · 2015 [cited by applicant]
US 8947427B2 · Shuster et al. · 2015 [cited by applicant]
US 9055404B2 · Setlur et al. · 2015 [cited by applicant]
US 9081177B2 · Wong et al. · 2015 [cited by applicant]
US 9117274B2 · Liao et al. · 2015 [cited by applicant]
US 9129404B1 · Wagner · 2015 [cited by applicant]
US 9292089B1 · Sadek · 2016 [cited by applicant]
US 9424239B2 · Dunn et al. · 2016 [cited by applicant]
US 9443353B2 · Vaddadi et al. · 2016 [cited by applicant]
US 9477368B1 · Filip et al. · 2016 [cited by applicant]
US 9478030B1 · Lecky · 2016 [cited by applicant]
US 9530252B2 · Poulos et al. · 2016 [cited by applicant]
US 9607422B1 · Leedom · 2017 [cited by applicant]
US 9658737B2 · Rothenberger et al. · 2017 [cited by applicant]
US 9817472B2 · Lee et al. · 2017 [cited by applicant]
US 9870716B1 · Rao et al. · 2018 [cited by applicant]
US 9922462B2 · Miller · 2018 [cited by applicant]
US 10013625B1 · Ahammad et al. · 2018 [cited by applicant]
US 10015503B1 · Ahammad · 2018 [cited by applicant]
US 10220303B1 · Schmidt et al. · 2019 [cited by applicant]
US 10248284B2 · Itani et al. · 2019 [cited by applicant]
US 10319154B1 · Chakravarthula et al. · 2019 [cited by applicant]
US 10335572B1 · Kumar · 2019 [cited by applicant]
US 10473935B1 · Gribetz et al. · 2019 [cited by applicant]
US 10521944B2 · Sareen et al. · 2019 [cited by applicant]
US 10551993B1 · Sanocki et al. · 2020 [cited by applicant]
US 10715851B1 · Shankar et al. · 2020 [cited by applicant]
US 10783714B2 · Diament et al. · 2020 [cited by applicant]
US 10799792B2 · Rios · 2020 [cited by applicant]
US 10803663B2 · Wang et al. · 2020 [cited by applicant]
US 10841292B2 · Soon-Shiong · 2020 [cited by applicant]
US 10902679B2 · Molyneaux et al. · 2021 [cited by applicant]
US 10909762B2 · Karalis et al. · 2021 [cited by applicant]
US 10950034B1 · Garcia et al. · 2021 [cited by applicant]
US 10963144B2 · Fox et al. · 2021 [cited by applicant]
US 10996915B2 · Kim · 2021 [cited by applicant]
US 11009716B2 · Kiemele et al. · 2021 [cited by applicant]
US 11017609B1 · Buzzerio et al. · 2021 [cited by applicant]
US 11064047B1 · Stegall et al. · 2021 [cited by applicant]
US 11068393B2 · Mandaleeka · 2021 [cited by applicant]
US 11100812B2 · Daniel et al. · 2021 [cited by applicant]
US 11113893B1 · Ma et al. · 2021 [cited by applicant]
US 11126320B1 · Thompson et al. · 2021 [cited by applicant]
US 11170576B2 · Ravasz et al. · 2021 [cited by applicant]
US 11176755B1 · Tichenor · 2021 [cited by examiner]
US 11178376B1 · Tichenor et al. · 2021 [cited by applicant]
US 11216152B2 · Alexander · 2022 [cited by applicant]
US 11227445B1 · Tichenor et al. · 2022 [cited by applicant]
US 11238664B1 · Tavakoli et al. · 2022 [cited by applicant]
US 11270513B2 · Yerli · 2022 [cited by applicant]
US 11270522B1 · Tauber et al. · 2022 [cited by applicant]
US 11307647B2 · Bond et al. · 2022 [cited by applicant]
US 11409405B1 · Hlavac et al. · 2022 [cited by applicant]
US 11417054B1 · Tanner et al. · 2022 [cited by applicant]
US 11433304B2 · Fish et al. · 2022 [cited by applicant]
US 11521361B1 · Taguchi et al. · 2022 [cited by applicant]
US 11593997B2 · Smith et al. · 2023 [cited by applicant]
US 11636655B2 · Ma et al. · 2023 [cited by applicant]
US 11651573B2 · Tichenor · 2023 [cited by examiner]
US 11676348B2 · Simpson et al. · 2023 [cited by applicant]
US 11720167B2 · Bond et al. · 2023 [cited by applicant]
US 11748944B2 · Karadayi et al. · 2023 [cited by applicant]
US 11762952B2 · Hlavac et al. · 2023 [cited by applicant]
US 11769304B2 · Tichenor et al. · 2023 [cited by applicant]
US 11798247B2 · Karadayi et al. · 2023 [cited by applicant]
US 11847753B2 · Tichenor · 2023 [cited by examiner]
US 11928308B2 · Hlavac et al. · 2024 [cited by applicant]
US 11935208B2 · Karadayi et al. · 2024 [cited by applicant]
US 20030038805A1 · Wong et al. · 2003 [cited by applicant]
US 20030106063A1 · Guedalia · 2003 [cited by applicant]
US 20040237082A1 · Alcazar et al. · 2004 [cited by applicant]
US 20050018216A1 · Barsness et al. · 2005 [cited by applicant]
US 20080089587A1 · Kim et al. · 2008 [cited by applicant]
US 20080092111A1 · Kinnucan et al. · 2008 [cited by applicant]
US 20090006937A1 · Knapp et al. · 2009 [cited by applicant]
US 20090199128A1 · Matthews et al. · 2009 [cited by applicant]
US 20090307623A1 · Agarawala et al. · 2009 [cited by applicant]
US 20090313299A1 · Bonev et al. · 2009 [cited by applicant]
US 20100251177A1 · Geppert et al. · 2010 [cited by applicant]
US 20100306716A1 · Perez · 2010 [cited by applicant]
US 20110185043A1 · Zeller et al. · 2011 [cited by applicant]
US 20110267265A1 · Stinson · 2011 [cited by applicant]
US 20120069168A1 · Huang et al. · 2012 [cited by applicant]
US 20120143358A1 · Adams et al. · 2012 [cited by applicant]
US 20120188279A1 · Demaine · 2012 [cited by applicant]
US 20120206345A1 · Langridge · 2012 [cited by applicant]
US 20120218301A1 · Miller · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20120275686A1 · Wilson et al. · 2012 [cited by applicant]
US 20120293544A1 · Miyamoto et al. · 2012 [cited by applicant]
US 20130051615A1 · Lim et al. · 2013 [cited by applicant]
US 20130063345A1 · Maeda · 2013 [cited by applicant]
US 20130069860A1 · Davidson · 2013 [cited by applicant]
US 20130076788A1 · Ben Zvi · 2013 [cited by applicant]
US 20130083173A1 · Geisner et al. · 2013 [cited by applicant]
US 20130117688A1 · Yerli · 2013 [cited by applicant]
US 20130125066A1 · Klein et al. · 2013 [cited by applicant]
US 20130147793A1 · Jeon et al. · 2013 [cited by applicant]
US 20130169682A1 · Novak et al. · 2013 [cited by applicant]
US 20130265220A1 · Fleischmann et al. · 2013 [cited by applicant]
US 20130293468A1 · Perez et al. · 2013 [cited by applicant]
US 20130336629A1 · Mulholland et al. · 2013 [cited by applicant]
US 20140075370A1 · Guerin et al. · 2014 [cited by applicant]
US 20140114845A1 · Rogers et al. · 2014 [cited by applicant]
US 20140125598A1 · Cheng et al. · 2014 [cited by applicant]
US 20140149901A1 · Hunter · 2014 [cited by applicant]
US 20140225922A1 · Sbardella · 2014 [cited by applicant]
US 20140236996A1 · Masuko et al. · 2014 [cited by applicant]
US 20140270494A1 · Sawhney et al. · 2014 [cited by applicant]
US 20140357366A1 · Koganezawa et al. · 2014 [cited by applicant]
US 20140375683A1 · Salter et al. · 2014 [cited by applicant]
US 20140375691A1 · Kasahara · 2014 [cited by applicant]
US 20150015504A1 · Lee et al. · 2015 [cited by applicant]
US 20150035746A1 · Cockburn et al. · 2015 [cited by applicant]
US 20150054742A1 · Imoto et al. · 2015 [cited by applicant]
US 20150062160A1 · Sakamoto et al. · 2015 [cited by applicant]
US 20150074506A1 · Dunn et al. · 2015 [cited by applicant]
US 20150074742A1 · Kohno et al. · 2015 [cited by applicant]
US 20150077592A1 · Fahey · 2015 [cited by applicant]
US 20150123966A1 · Newman · 2015 [cited by applicant]
US 20150143302A1 · Chang et al. · 2015 [cited by applicant]
US 20150153833A1 · Pinault et al. · 2015 [cited by applicant]
US 20150160736A1 · Fujiwara · 2015 [cited by applicant]
US 20150169076A1 · Cohen et al. · 2015 [cited by applicant]
US 20150181679A1 · Liao et al. · 2015 [cited by applicant]
US 20150206321A1 · Scavezze et al. · 2015 [cited by applicant]
US 20150213371A1 · Nitz et al. · 2015 [cited by applicant]
US 20150220150A1 · Plagemann et al. · 2015 [cited by applicant]
US 20150253862A1 · Seo et al. · 2015 [cited by applicant]
US 20150261659A1 · Bader et al. · 2015 [cited by applicant]
US 20150269780A1 · Herman et al. · 2015 [cited by applicant]
US 20150356774A1 · Gal et al. · 2015 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160063762A1 · Heuvel et al. · 2016 [cited by applicant]
US 20160110052A1 · Kim et al. · 2016 [cited by applicant]
US 20160133170A1 · Fateh · 2016 [cited by applicant]
US 20160147308A1 · Gelman et al. · 2016 [cited by applicant]
US 20160147408A1 · Bevis et al. · 2016 [cited by applicant]
US 20160170603A1 · Bastien et al. · 2016 [cited by applicant]
US 20160180590A1 · Kamhi et al. · 2016 [cited by applicant]
US 20160189386A1 · Michaelraj et al. · 2016 [cited by applicant]
US 20160260261A1 · Hsu · 2016 [cited by applicant]
US 20160378291A1 · Pokrzywka · 2016 [cited by applicant]
US 20170041388A1 · Tal et al. · 2017 [cited by applicant]
US 20170060230A1 · Faaborg et al. · 2017 [cited by applicant]
US 20170069134A1 · Shapira et al. · 2017 [cited by applicant]
US 20170075420A1 · Yu et al. · 2017 [cited by applicant]
US 20170076500A1 · Maggiore et al. · 2017 [cited by applicant]
US 20170084051A1 · Weising et al. · 2017 [cited by applicant]
US 20170099295A1 · Ricci · 2017 [cited by applicant]
US 20170109936A1 · Powderly et al. · 2017 [cited by applicant]
US 20170124230A1 · Liu et al. · 2017 [cited by applicant]
US 20170139478A1 · Jeon et al. · 2017 [cited by applicant]
US 20170192513A1 · Karmon et al. · 2017 [cited by applicant]
US 20170237789A1 · Harner et al. · 2017 [cited by applicant]
US 20170242675A1 · Deshmukh · 2017 [cited by applicant]
US 20170243465A1 · Bourne, Jr. et al. · 2017 [cited by applicant]
US 20170258526A1 · Lang · 2017 [cited by applicant]
US 20170262063A1 · Blénessy et al. · 2017 [cited by applicant]
US 20170278304A1 · Hildreth et al. · 2017 [cited by applicant]
US 20170287225A1 · Powderly et al. · 2017 [cited by applicant]
US 20170296363A1 · Yetkin et al. · 2017 [cited by applicant]
US 20170311129A1 · Lopez-Uricoechea et al. · 2017 [cited by applicant]
US 20170323488A1 · Mott et al. · 2017 [cited by applicant]
US 20170364198A1 · Yoganandan et al. · 2017 [cited by applicant]
US 20170372225A1 · Foresti · 2017 [cited by applicant]
US 20180005429A1 · Osman et al. · 2018 [cited by applicant]
US 20180007099A1 · Ein-Gil et al. · 2018 [cited by applicant]
US 20180059901A1 · Gullicksen · 2018 [cited by applicant]
US 20180082480A1 · White et al. · 2018 [cited by applicant]
US 20180095616A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180095635A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180095636A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180096507A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180096519A1 · Tokubo · 2018 [cited by applicant]
US 20180098059A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180107278A1 · Goel et al. · 2018 [cited by applicant]
US 20180113599A1 · Yin · 2018 [cited by applicant]
US 20180158134A1 · Hassan · 2018 [cited by applicant]
US 20180189568A1 · Powderly et al. · 2018 [cited by applicant]
US 20180189647A1 · Calvo et al. · 2018 [cited by applicant]
US 20180300557A1 · Rodenas et al. · 2018 [cited by applicant]
US 20180307303A1 · Powderly et al. · 2018 [cited by applicant]
US 20180314484A1 · Pahud et al. · 2018 [cited by applicant]
US 20180315162A1 · Sturm et al. · 2018 [cited by applicant]
US 20180322701A1 · Pahud et al. · 2018 [cited by applicant]
US 20180323972A1 · Reed et al. · 2018 [cited by applicant]
US 20180335925A1 · Hsiao et al. · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20180357780A1 · Young et al. · 2018 [cited by applicant]
US 20180365897A1 · Pahud et al. · 2018 [cited by applicant]
US 20190005724A1 · Pahud et al. · 2019 [cited by applicant]
US 20190018498A1 · West et al. · 2019 [cited by applicant]
US 20190094981A1 · Bradski et al. · 2019 [cited by applicant]
US 20190096131A1 · Crews et al. · 2019 [cited by applicant]
US 20190107894A1 · Hebbalaguppe et al. · 2019 [cited by applicant]
US 20190107991A1 · Spivack et al. · 2019 [cited by applicant]
US 20190108682A1 · Spivack et al. · 2019 [cited by applicant]
US 20190114061A1 · Daniels et al. · 2019 [cited by applicant]
US 20190130656A1 · Gebbie et al. · 2019 [cited by applicant]
US 20190130788A1 · Seaton · 2019 [cited by applicant]
US 20190155481A1 · Diverdi et al. · 2019 [cited by applicant]
US 20190163700A1 · Baumgardner et al. · 2019 [cited by applicant]
US 20190172262A1 · McHugh et al. · 2019 [cited by applicant]
US 20190197785A1 · Tate-Gans et al. · 2019 [cited by applicant]
US 20190212827A1 · Kin et al. · 2019 [cited by applicant]
US 20190213792A1 · Jakubzak et al. · 2019 [cited by applicant]
US 20190221035A1 · Clark et al. · 2019 [cited by applicant]
US 20190235729A1 · Day et al. · 2019 [cited by applicant]
US 20190237044A1 · Day et al. · 2019 [cited by applicant]
US 20190258318A1 · Qin et al. · 2019 [cited by applicant]
US 20190278376A1 · Kutliroff et al. · 2019 [cited by applicant]
US 20190278432A1 · Bennett et al. · 2019 [cited by applicant]
US 20190279424A1 · Clausen et al. · 2019 [cited by applicant]
US 20190279426A1 · Musunuri et al. · 2019 [cited by applicant]
US 20190286231A1 · Burns et al. · 2019 [cited by applicant]
US 20190294721A1 · Keifer et al. · 2019 [cited by applicant]
US 20190294889A1 · Sriram et al. · 2019 [cited by applicant]
US 20190340799A1 · Dryer et al. · 2019 [cited by applicant]
US 20190340833A1 · Furtwangler et al. · 2019 [cited by applicant]
US 20190362562A1 · Benson · 2019 [cited by applicant]
US 20190369391A1 · Cordesses et al. · 2019 [cited by applicant]
US 20190371060A1 · Energin et al. · 2019 [cited by applicant]
US 20190371279A1 · Mak · 2019 [cited by applicant]
US 20190377406A1 · Steptoe et al. · 2019 [cited by applicant]
US 20190377416A1 · Alexander · 2019 [cited by applicant]
US 20190377487A1 · Bailey et al. · 2019 [cited by applicant]
US 20190385371A1 · Joyce et al. · 2019 [cited by applicant]
US 20200013211A1 · Bergen et al. · 2020 [cited by applicant]
US 20200042108A1 · Wan · 2020 [cited by applicant]
US 20200066047A1 · Karalis et al. · 2020 [cited by applicant]
US 20200082629A1 · Jones et al. · 2020 [cited by applicant]
US 20200097077A1 · Nguyen et al. · 2020 [cited by applicant]
US 20200097091A1 · Chou et al. · 2020 [cited by applicant]
US 20200111256A1 · Bleyer et al. · 2020 [cited by applicant]
US 20200151965A1 · Forbes et al. · 2020 [cited by applicant]
US 20200218423A1 · Ohashi · 2020 [cited by applicant]
US 20200219319A1 · Lashmar et al. · 2020 [cited by applicant]
US 20200225736A1 · Schwarz et al. · 2020 [cited by applicant]
US 20200225758A1 · Tang et al. · 2020 [cited by applicant]
US 20200226814A1 · Tang et al. · 2020 [cited by applicant]
US 20200226823A1 · Stachniak et al. · 2020 [cited by applicant]
US 20200241300A1 · Robinson et al. · 2020 [cited by applicant]
US 20200242842A1 · Fukazawa et al. · 2020 [cited by applicant]
US 20200279386A1 · Da Veiga · 2020 [cited by applicant]
US 20200279429A1 · Upadhyay et al. · 2020 [cited by applicant]
US 20200285761A1 · Buck et al. · 2020 [cited by applicant]
US 20200289934A1 · Azmandian et al. · 2020 [cited by applicant]
US 20200312028A1 · Charvat et al. · 2020 [cited by applicant]
US 20200334908A1 · Wilson et al. · 2020 [cited by applicant]
US 20200342673A1 · Lohr et al. · 2020 [cited by applicant]
US 20200351273A1 · Thomas · 2020 [cited by applicant]
US 20200363924A1 · Flexman et al. · 2020 [cited by applicant]
US 20200363930A1 · Srinivasan et al. · 2020 [cited by applicant]
US 20200368616A1 · Delamont · 2020 [cited by applicant]
US 20200375666A1 · Murphy · 2020 [cited by applicant]
US 20200394935A1 · Ray et al. · 2020 [cited by applicant]
US 20200402320A1 · Crews et al. · 2020 [cited by applicant]
US 20210012113A1 · Petill et al. · 2021 [cited by applicant]
US 20210014408A1 · Timonen et al. · 2021 [cited by applicant]
US 20210096726A1 · Faulkner et al. · 2021 [cited by applicant]
US 20210097768A1 · Malia et al. · 2021 [cited by applicant]
US 20210103449A1 · Terpstra et al. · 2021 [cited by applicant]
US 20210111890A1 · Reed et al. · 2021 [cited by applicant]
US 20210124821A1 · Spivak et al. · 2021 [cited by applicant]
US 20210125414A1 · Berkebile · 2021 [cited by applicant]
US 20210126823A1 · Poess et al. · 2021 [cited by applicant]
US 20210158608A1 · Boggs et al. · 2021 [cited by applicant]
US 20210183114A1 · Corson · 2021 [cited by applicant]
US 20210191600A1 · Lemay et al. · 2021 [cited by applicant]
US 20210192856A1 · Lee · 2021 [cited by applicant]
US 20210272375A1 · Lashmar et al. · 2021 [cited by applicant]
US 20210295602A1 · Scapel et al. · 2021 [cited by applicant]
US 20210306238A1 · Cheng et al. · 2021 [cited by applicant]
US 20210322856A1 · Mrkar et al. · 2021 [cited by applicant]
US 20210373741A1 · Agarawala et al. · 2021 [cited by applicant]
US 20210390765A1 · Laaksonen et al. · 2021 [cited by applicant]
US 20220038522A1 · Goolkasian et al. · 2022 [cited by applicant]
US 20220068035A1 · Tichenor et al. · 2022 [cited by applicant]
US 20220084279A1 · Lindmeier et al. · 2022 [cited by applicant]
US 20220091722A1 · Faulkner et al. · 2022 [cited by applicant]
US 20220100265A1 · Kies et al. · 2022 [cited by applicant]
US 20220100279A1 · Lee et al. · 2022 [cited by applicant]
US 20220101612A1 · Palangie et al. · 2022 [cited by applicant]
US 20220121344A1 · Pastrana Vicente et al. · 2022 [cited by applicant]
US 20220122329A1 · Tichenor et al. · 2022 [cited by applicant]
US 20220139052A1 · Tavakoli et al. · 2022 [cited by applicant]
US 20220161422A1 · Chen et al. · 2022 [cited by applicant]
US 20220211188A1 · Daub et al. · 2022 [cited by applicant]
US 20220261088A1 · Pinchon et al. · 2022 [cited by applicant]
US 20220276765A1 · Hlavac et al. · 2022 [cited by applicant]
US 20220318035A1 · Garstenauer et al. · 2022 [cited by applicant]
US 20220358715A1 · Tanner et al. · 2022 [cited by applicant]
US 20220406021A1 · LeBeau et al. · 2022 [cited by applicant]
US 20220414403A1 · Hlavac et al. · 2022 [cited by applicant]
US 20230022194A1 · Soryal · 2023 [cited by applicant]
US 20230056976A1 · Tanner et al. · 2023 [cited by applicant]
US 20230126837A1 · Karadayi et al. · 2023 [cited by applicant]
US 20230127438A1 · Karadayi et al. · 2023 [cited by applicant]
US 20230134355A1 · Lansel et al. · 2023 [cited by applicant]
US 20230152851A1 · Berliner et al. · 2023 [cited by applicant]
US 20230169737A1 · Taguchi et al. · 2023 [cited by applicant]
US 20230196766A1 · Pla, I et al. · 2023 [cited by applicant]
US 20230215120A1 · Ma et al. · 2023 [cited by applicant]
US 20230221797A1 · Louie et al. · 2023 [cited by applicant]
US 20230244755A1 · Hlavac et al. · 2023 [cited by applicant]
US 20230245386A1 · Karadayi et al. · 2023 [cited by applicant]
US 20230260000A1 · Belavy · 2023 [cited by applicant]
US 20230260233A1 · Goncalves et al. · 2023 [cited by applicant]
US 20230290089A1 · Simpson et al. · 2023 [cited by applicant]
US 20230367611A1 · Blakeley et al. · 2023 [cited by applicant]
US 20230384859A1 · Bond et al. · 2023 [cited by applicant]
US 20230410436A1 · Beauchamp et al. · 2023 [cited by applicant]
US 20230419616A1 · Dudovitch et al. · 2023 [cited by applicant]
US 20230419998A1 · Nguyen et al. · 2023 [cited by applicant]
US 20240045495A1 · Elhadad et al. · 2024 [cited by applicant]
US 20240126406A1 · Hlavac et al. · 2024 [cited by applicant]
US 20240264851A1 · Blakeley et al. · 2024 [cited by applicant]
US 20240311498A1 · Millberg et al. · 2024 [cited by applicant]
US 20240312143A1 · Millberg et al. · 2024 [cited by applicant]
US 20240331278A1 · Arora et al. · 2024 [cited by applicant]
US 20240331287A1 · Karadayi et al. · 2024 [cited by applicant]
US 20240331312A1 · Freeman et al. · 2024 [cited by applicant]
US 20240331320A1 · Taguchi et al. · 2024 [cited by applicant]
US 20240338070A1 · Tanner et al. · 2024 [cited by applicant]
US 20240361837A1 · Louie et al. · 2024 [cited by applicant]
EP 2887322B1 · 2020 [cited by applicant]
JP 2019101743A · 2019 [cited by applicant]
JP 2022147265A · 2022 [cited by applicant]
WO 2014097706A1 · 2014 [cited by applicant]
WO 2015192117A1 · 2015 [cited by applicant]
WO 2016041088A1 · 2016 [cited by applicant]
WO 2018235371A1 · 2018 [cited by applicant]
WO 2019143839A1 · 2019 [cited by applicant]
WO 2020159302A1 · 2020 [cited by applicant]
WO 2020226832A1 · 2020 [cited by applicant]
WO 2021163373A1 · 2021 [cited by applicant]
WO 2022055822A1 · 2022 [cited by applicant]
Advisory Action mailed Oct. 13, 2021 for U.S. Appl. No. 16/567,563, filed Sep. 11, 2019, 3 pages. [cited by applicant]
“App Clips,” Apple Developer, 2022, 4 pages, Retrieved from the Internet: URL: https://developer.apple.com/app-clips/. [cited by applicant]
Final Office Action mailed Aug. 5, 2021 for U.S. Appl. No. 16/567,563, filed Sep. 11, 2019, 11 Pages. [cited by applicant]
“Google Play Instant,” Retrieved on [Jan. 27, 2022], 2 pages, Retrieved from the Internet: URL: https://developer.android.com/topic/google-play-instant. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/045538, mailed Mar. 24, 2022, 9 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/032288, mailed Jan. 11, 2024, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/033338, mailed Jan. 11, 2024, 11 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/040484, mailed Feb. 29, 2024, 9 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/045538, mailed Oct. 23, 2020, 11 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/020292 mailed Aug. 17, 2022, 17 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/031840, mailed Sep. 13, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/033338 mailed Sep. 6, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/040484, mailed Nov. 25, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/054413, mailed Jul. 7, 2023, 11 pages. [cited by applicant]
Non-Final Office Action mailed Dec. 8, 2022 for U.S. Appl. No. 17/659,431, filed Apr. 15, 2022, 12 pages. [cited by applicant]
Non-Final Office Action mailed Jan. 25, 2021 for U.S. Appl. No. 16/567,563, filed Sep. 11, 2019, 10 Pages. [cited by applicant]
Notice of Allowance mailed Dec. 21, 2021 for U.S. Appl. No. 16/567,563, filed Sep. 11, 2019, 6 pages. [cited by applicant]
Notice of Allowance mailed Mar. 21, 2023 for U.S. Appl. No. 17/659,431, filed Apr. 15, 2022, 5 pages. [cited by applicant]
Office Action mailed Aug. 21, 2023 for Chinese Application No. 202080054473.3, filed Aug. 8, 2020, 7 pages. [cited by applicant]
Office Action mailed Feb. 26, 2024 for European Patent Application No. 20761419.9, filed on Aug. 8, 2020, 7 pages. [cited by applicant]
Prosecution History of U.S. Appl. No. 16/567,563 dated Jan. 25, 2021, through Dec. 21, 2021, 52 pages. [cited by applicant]
Wikipedia: “Simultaneous Localization and Mapping,” Jul. 25, 2017, 7 pages, Retrieved from the Internet: URL: https://en.wikipedia.org/w/index.php?title=Simultaneous_localization_and_mappingoldid=731478358 [Retrieved on… [cited by applicant]
Broitman A., “Learn and Do More with Lens in Google Images,” Oct. 25, 2018, Retrieved from the Internet: URL: https://www.blog.google/products/search/learn-and-do-more-lens-google-images/ , 4 pages. [cited by applicant]
Fleury C., et al., “A Generic Model for Embedding Users' Physical Workspaces into Multi-Scale Collaborative Virtual Environments,” 20th International Conference on Artificial Reality and Telexistence, Dec. 3, 2010, 8 pa… [cited by applicant]
Hincapie-Ramos J.D., et al., “GyroWand: IMU-Based Raycasting for Augmented Reality Head-Mounted Displays,” Proceedings of the 3rd Association for Computing Machinery (ACM) Symposium on Spatial User Interaction, Los Ange… [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2021/044098, mailed Mar. 9, 2023, 18 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/051763, mailed Feb. 3, 2021, 11 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/032288, mailed Sep. 16, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/045510, mailed Jan. 19, 2023, 10 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/053780, mailed Mar. 20, 2023, 10 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/021312, mailed Aug. 24, 2023, 15 pages. [cited by applicant]
Invitation to Pay Additional Fees for International Application No. PCT/US2021/044098, Nov. 3, 2021, 15 pages. [cited by applicant]
Mayer S., et al., “The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments,” Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, Ap… [cited by applicant]
Melnick K., “Google Rolls out New AR Features for Its Lens APP,” May 28, 2019, Retrieved from the Internet: URL: https://vrscout.com/news/new-ar-features-google-lens/ , 3 pages. [cited by applicant]
Olwal A., et al., “The Flexible Pointer: An Interaction Technique for Selection in Augmented and Virtual Reality,” Proceedings of ACM Symposium on User Interface Software and Technology (UIST), Vancouver, BC, Nov. 2-5, … [cited by applicant]
Renner P., et al., “Ray Casting”, Central Facility Labs [Online], [Retrieved on Apr. 7, 2020], 2 pages, Retrieved from the Internet: URL:https://www.techfak.uni-bielefeld.de/-tpfeife/lehre/VirtualReality/interaction/ray… [cited by applicant]
Schweigert R., et al., “EyePointing: A Gaze-Based Selection Technique,” Proceedings of Mensch and Computer, Hamburg, Germany, Sep. 8-11, 2019, pp. 719-723. [cited by applicant]
Unity Gets Toolkit for Common AR/VR Interactions, Unity XR interaction Toolkit Preview [Online], Dec. 19, 2019 Retrieved on Apr. 7, 2020, 1 page, Retrieved from the Internet: URL: http://youtu.be/ZPhv4qmT9EQ. [cited by applicant]
Mtzthum A., “SSIML/Behaviour: Designing Behaviour and Animation of Graphical Objects in Virtual Reality and Multimedia Applications,” Proceedings of the Seventh IEEE International Symposium on Multimedia, Dec. 12, 2005,… [cited by applicant]
Wikipedia, “Multiple-document Interface,” May 8, 2022 [retrieved on Aug. 16, 2023], 5 pages, Retrieved from the Internet: URL: https://web.archive.org/web/20220508091934/https://en.wikipedia.org/wiki/Multipledocument_in… [cited by applicant]
European Search Report for European Patent Application No. 24155099.5, dated Aug. 5, 2024, 7 pages. [cited by applicant]
European Search Report for European Patent Application No. 24155337.9, dated Jul. 2, 2024, 7 pages. [cited by applicant]
European Search Report for European Patent Application No. 24156842.7, dated Jun. 25, 2024, 6 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/045510, mailed May 10, 2024, 9 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/053780, mailed Jul. 4, 2024, 9 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/054413, mailed Jul. 25, 2024, 9 pages. [cited by applicant]
Office Action mailed Jun. 25, 2024 for Japanese Patent Application No. 2021-577408, filed on Aug. 8, 2020, 4 pages. [cited by applicant]
Tatzgern M., et al., “Adaptive Information Density for Augmented Reality Displays,” IEEE Virtual Reality Conference, Mar. 19-23, 2016, pp. 83-92. [cited by applicant]
European Search Report for European Patent Application No. 24158455.6, dated Jun. 28, 2024, 6 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2023/021312, mailed Nov. 21, 2024, 14 pages. [cited by applicant]