IP Library › Granted Patent US 12,704,936
Granted Patent B2
US 12,704,936 · App. 18/435,799 · Granted Aug 11, 2026

User interface elements for facilitating direct-touch and indirect hand interactions with a user interface presented within an artificial-reality environment, and systems and methods of use thereof

Inventors: Anastasia Victor-Faichney (San Francisco, CA); Qi Xiong (San Carlos, CA); Jennifer Morrow (Sunnyvale, CA); Miguel Angel Maya Hernández (Bellevue, WA); John Nicholas Jitkoff (Seattle, WA); Ahad Habib Basravi (Oakland, CA); Irvi Stefo (Brooklyn, NY)
Assignee: Meta Platforms Technologies, LLC
G06F3/04815G06F3/0482G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,704,936
App. No.
18/435,799
Granted
Aug 11, 2026
Kind
B2
Abstract

An example method of presenting, via an artificial-reality headset, a user interface that includes a selectable user interface element is described. The method includes that while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, a focus selector is projected within the user interface based on a position of the representation of the hand of the user. The example method also includes that upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, ceasing to display the focus selector within the user interface and allowing the representation of the hand of the user to interact directly with the selectable user interface element.

Claims (47)

1 . A method, comprising:

presenting, via an artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, projecting a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, ceasing to display the focus selector within the user interface and altering the selectable user interface element to be directly interacted by the representation of the hand of the user.

2 . The method of claim 1 , further comprising:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

presenting a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, altering a visual characteristic associated with the focus selector.

3 . The method of claim 2 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

4 . The method of claim 1 , further comprising:

determining that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjusting a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

5 . The method of claim 1 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

6 . The method of claim 1 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.

7 . A non-transitory, computer-readable storage medium storing one or more programs wherein the one or more programs are that, when executed by an extended-reality headset causes the artificial-reality headset to:

present, via the artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, project a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, cease to display the focus selector within the user interface and alter the selectable user interface element to be directly interacted by the representation of the hand of the user.

8 . The non-transitory computer readable storage medium of claim 7 , wherein the one or more programs are further configured to cause the artificial-reality headset to:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

present a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, alter a visual characteristic associated with the focus selector.

9 . The non-transitory computer readable storage medium of claim 8 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

10 . The non-transitory computer readable storage medium of claim 7 , wherein the one or more programs are further configured to cause the artificial-reality headset to:

determine that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjust a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

11 . The non-transitory computer readable storage medium of claim 7 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

12 . The non-transitory computer readable storage medium of claim 7 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.

13 . An artificial-reality headset, comprising:

one or more processors; and

memory storing one or more programs that, when executed by one or more processors, cause the artificial-reality headset to:

present, via an artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, projecting a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, cease to display the focus selector within the user interface and alter the selectable user interface element to be directly interacted by the representation of the hand of the user.

14 . The artificial-reality headset of claim 13 , wherein the one or more programs that, when executed further cause the artificial-reality headset to:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

present a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, alter a visual characteristic associated with the focus selector.

15 . The non-transitory computer readable storage medium of claim 14 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

16 . The artificial-reality headset of claim 13 , wherein the one or more programs that, when executed further cause the artificial-reality headset to:

determine that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjust a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

17 . The artificial-reality headset of claim 13 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

18 . The artificial-reality headset of claim 13 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2026
From: VICTOR-FAICHNEY, ANASTASIA; XIONG, QI; MORROW, JENNIFER; MAYA HERNANDEZ, MIGUEL ANGEL; JITKOFF, JOHN NICHOLAS; BASRAVI, AHAD HABIB; STEFO, IRVI
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 074448/0336 →
Continuity (3)
Provisional Application 63484467 · Feb 10, 2023
Provisional Application 63484190 · Feb 9, 2023
Related Publication 20240272764A1 · Aug 15, 2024
References Cited (299)
US 6842175B1 · Schmalstieg et al. · 2005 [cited by applicant]
US 7701439B2 · Hillis et al. · 2010 [cited by applicant]
US 8558759B1 · Prada Gomez et al. · 2013 [cited by applicant]
US 8836768B1 · Rafii et al. · 2014 [cited by applicant]
US 8947351B1 · Noble · 2015 [cited by applicant]
US 9117274B2 · Liao et al. · 2015 [cited by applicant]
US 9292089B1 · Sadek · 2016 [cited by applicant]
US 9406277B1 · Letourneur · 2016 [cited by applicant]
US 9477303B2 · Fleischmann et al. · 2016 [cited by applicant]
US 9477324B2 · Ajmera · 2016 [cited by examiner]
US 9477368B1 · Filip et al. · 2016 [cited by applicant]
US 9817472B2 · Lee et al. · 2017 [cited by applicant]
US 10042430B2 · Bedikian et al. · 2018 [cited by applicant]
US 10187936B1 · Letourneur · 2019 [cited by applicant]
US 10220303B1 · Schmidt et al. · 2019 [cited by applicant]
US 10248284B2 · Itani et al. · 2019 [cited by applicant]
US 10261595B1 · Kin · 2019 [cited by applicant]
US 10318100B2 · Abercrombie et al. · 2019 [cited by applicant]
US 10473935B1 · Gribetz et al. · 2019 [cited by applicant]
US 10488939B2 · Karmon et al. · 2019 [cited by applicant]
US 10515484B1 · Lucas et al. · 2019 [cited by applicant]
US 10521944B2 · Sareen et al. · 2019 [cited by applicant]
US 10536691B2 · Valdivia et al. · 2020 [cited by applicant]
US 10595011B2 · Han et al. · 2020 [cited by applicant]
US 10607413B1 · Marcolina et al. · 2020 [cited by applicant]
US 10691233B2 · Dalton et al. · 2020 [cited by applicant]
US 10890983B2 · Ravasz et al. · 2021 [cited by applicant]
US 10901506B2 · Wu et al. · 2021 [cited by applicant]
US 10956724B1 · Terrano · 2021 [cited by applicant]
US 10957059B1 · Katz et al. · 2021 [cited by applicant]
US 11079753B1 · Roy · 2021 [cited by applicant]
US 11221730B2 · Murphy et al. · 2022 [cited by applicant]
US 11278810B1 · Sarria, Jr. et al. · 2022 [cited by applicant]
US 11307671B2 · Liu et al. · 2022 [cited by applicant]
US 11514650B2 · Kim et al. · 2022 [cited by applicant]
US 11991222B1 · Walton et al. · 2024 [cited by applicant]
US 12056269B2 · Chung · 2024 [cited by applicant]
US 20040236541A1 · Kramer et al. · 2004 [cited by applicant]
US 20080030429A1 · Hailpern et al. · 2008 [cited by applicant]
US 20080089587A1 · Kim et al. · 2008 [cited by applicant]
US 20090077504A1 · Bell et al. · 2009 [cited by applicant]
US 20100306716A1 · Perez · 2010 [cited by applicant]
US 20110239155A1 · Christie · 2011 [cited by applicant]
US 20110267265A1 · Stinson · 2011 [cited by applicant]
US 20120013613A1 · Vesely · 2012 [cited by examiner]
US 20120069168A1 · Huang et al. · 2012 [cited by applicant]
US 20120071892A1 · Itkowitz et al. · 2012 [cited by applicant]
US 20120113223A1 · Hilliges et al. · 2012 [cited by applicant]
US 20120143358A1 · Adams et al. · 2012 [cited by applicant]
US 20120188279A1 · Demaine · 2012 [cited by applicant]
US 20120206345A1 · Langridge · 2012 [cited by applicant]
US 20120218183A1 · Givon et al. · 2012 [cited by applicant]
US 20120218395A1 · Andersen et al. · 2012 [cited by applicant]
US 20120249740A1 · Lee et al. · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20120275686A1 · Wilson et al. · 2012 [cited by applicant]
US 20120293544A1 · Miyamoto et al. · 2012 [cited by applicant]
US 20130063345A1 · Maeda · 2013 [cited by applicant]
US 20130125066A1 · Klein et al. · 2013 [cited by applicant]
US 20130147793A1 · Jeon et al. · 2013 [cited by applicant]
US 20130182902A1 · Holz · 2013 [cited by applicant]
US 20130265220A1 · Fleischmann et al. · 2013 [cited by applicant]
US 20140007484A1 · Erdoss et al. · 2014 [cited by applicant]
US 20140125598A1 · Cheng et al. · 2014 [cited by applicant]
US 20140204002A1 · Bennet et al. · 2014 [cited by applicant]
US 20140236996A1 · Masuko et al. · 2014 [cited by applicant]
US 20140268360A1 · Ellsworth · 2014 [cited by applicant]
US 20140306891A1 · Latta et al. · 2014 [cited by applicant]
US 20140357366A1 · Koganezawa et al. · 2014 [cited by applicant]
US 20140375691A1 · Kasahara · 2014 [cited by applicant]
US 20150035746A1 · Cockburn et al. · 2015 [cited by applicant]
US 20150040040A1 · Balan et al. · 2015 [cited by applicant]
US 20150054742A1 · Imoto et al. · 2015 [cited by applicant]
US 20150062160A1 · Sakamoto et al. · 2015 [cited by applicant]
US 20150110285A1 · Censo et al. · 2015 [cited by applicant]
US 20150153833A1 · Pinault et al. · 2015 [cited by applicant]
US 20150160736A1 · Fujiwara · 2015 [cited by applicant]
US 20150169076A1 · Cohen et al. · 2015 [cited by applicant]
US 20150178985A1 · Di Censo et al. · 2015 [cited by applicant]
US 20150181679A1 · Liao et al. · 2015 [cited by applicant]
US 20150206321A1 · Scavezze et al. · 2015 [cited by applicant]
US 20150220150A1 · Plagemann et al. · 2015 [cited by applicant]
US 20150243100A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150261659A1 · Bader et al. · 2015 [cited by applicant]
US 20150269783A1 · Yun · 2015 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160110052A1 · Kim et al. · 2016 [cited by applicant]
US 20160147308A1 · Gelman et al. · 2016 [cited by applicant]
US 20160170603A1 · Bastien et al. · 2016 [cited by applicant]
US 20160217614A1 · Kraver et al. · 2016 [cited by applicant]
US 20160335140A1 · Liu et al. · 2016 [cited by applicant]
US 20160378291A1 · Pokrzywka · 2016 [cited by applicant]
US 20160379660A1 · Wright et al. · 2016 [cited by applicant]
US 20170003784A1 · Garg et al. · 2017 [cited by applicant]
US 20170050542A1 · Shigeta et al. · 2017 [cited by applicant]
US 20170060230A1 · Faaborg et al. · 2017 [cited by applicant]
US 20170109936A1 · Powderly et al. · 2017 [cited by applicant]
US 20170139478A1 · Jeon et al. · 2017 [cited by applicant]
US 20170139481A1 · Long · 2017 [cited by applicant]
US 20170192513A1 · Karmon et al. · 2017 [cited by applicant]
US 20170206691A1 · Harrises et al. · 2017 [cited by applicant]
US 20170228130A1 · Palmaro · 2017 [cited by applicant]
US 20170262063A1 · Blénessy et al. · 2017 [cited by applicant]
US 20170263033A1 · Church · 2017 [cited by applicant]
US 20170278304A1 · Hildreth et al. · 2017 [cited by applicant]
US 20170287225A1 · Powderly et al. · 2017 [cited by applicant]
US 20170296363A1 · Yetkin et al. · 2017 [cited by applicant]
US 20170308166A1 · Mallinson · 2017 [cited by applicant]
US 20170323483A1 · Palmaro · 2017 [cited by applicant]
US 20170329515A1 · Clement et al. · 2017 [cited by applicant]
US 20170337742A1 · Powderly et al. · 2017 [cited by applicant]
US 20170364198A1 · Yoganandan et al. · 2017 [cited by applicant]
US 20180004283A1 · Mathey-Owens et al. · 2018 [cited by applicant]
US 20180033204A1 · Dimitrov et al. · 2018 [cited by applicant]
US 20180039341A1 · Du Bois et al. · 2018 [cited by applicant]
US 20180046245A1 · Schwarz et al. · 2018 [cited by applicant]
US 20180059788A1 · Noguchi et al. · 2018 [cited by applicant]
US 20180059901A1 · Gullicksen · 2018 [cited by applicant]
US 20180107278A1 · Goel et al. · 2018 [cited by applicant]
US 20180113599A1 · Yin · 2018 [cited by applicant]
US 20180157398A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180188816A1 · Liu et al. · 2018 [cited by applicant]
US 20180303446A1 · Schweizer · 2018 [cited by applicant]
US 20180307303A1 · Powderly et al. · 2018 [cited by applicant]
US 20180322701A1 · Pahud et al. · 2018 [cited by applicant]
US 20180323992A1 · Harms et al. · 2018 [cited by applicant]
US 20180329492A1 · Coppin et al. · 2018 [cited by applicant]
US 20180335925A1 · Hsiao et al. · 2018 [cited by applicant]
US 20180357780A1 · Young et al. · 2018 [cited by applicant]
US 20180361234A1 · Nietfeld et al. · 2018 [cited by applicant]
US 20190018498A1 · West et al. · 2019 [cited by applicant]
US 20190050071A1 · Liu et al. · 2019 [cited by applicant]
US 20190057531A1 · Sareen et al. · 2019 [cited by applicant]
US 20190094981A1 · Bradski et al. · 2019 [cited by applicant]
US 20190107894A1 · Hebbalaguppe et al. · 2019 [cited by applicant]
US 20190120593A1 · Randles · 2019 [cited by applicant]
US 20190129607A1 · Saurabh et al. · 2019 [cited by applicant]
US 20190130653A1 · Kuehne · 2019 [cited by applicant]
US 20190138107A1 · Nietfeld et al. · 2019 [cited by applicant]
US 20190146599A1 · Gunnarsson et al. · 2019 [cited by applicant]
US 20190213792A1 · Jakubzak et al. · 2019 [cited by applicant]
US 20190258318A1 · Qin et al. · 2019 [cited by applicant]
US 20190265828A1 · Hauenstein et al. · 2019 [cited by applicant]
US 20190278376A1 · Kutliroff et al. · 2019 [cited by applicant]
US 20190279424A1 · Clausen et al. · 2019 [cited by applicant]
US 20190286231A1 · Burns et al. · 2019 [cited by applicant]
US 20190290999A1 · Bradner et al. · 2019 [cited by applicant]
US 20190318640A1 · Goel et al. · 2019 [cited by applicant]
US 20190324549A1 · Araki · 2019 [cited by examiner]
US 20190325651A1 · Bradner et al. · 2019 [cited by applicant]
US 20190347865A1 · Hackett et al. · 2019 [cited by applicant]
US 20190361521A1 · Stellmach et al. · 2019 [cited by applicant]
US 20190362562A1 · Benson · 2019 [cited by applicant]
US 20190369391A1 · Cordesses et al. · 2019 [cited by applicant]
US 20190377416A1 · Alexander · 2019 [cited by applicant]
US 20190391710A1 · Shen · 2019 [cited by applicant]
US 20200001172A1 · Nicoli · 2020 [cited by applicant]
US 20200005026A1 · Andersen et al. · 2020 [cited by applicant]
US 20200005539A1 · Hwang et al. · 2020 [cited by applicant]
US 20200005541A1 · Preston · 2020 [cited by applicant]
US 20200012341A1 · Stellmach et al. · 2020 [cited by applicant]
US 20200074742A1 · Rogers · 2020 [cited by applicant]
US 20200082629A1 · Jones et al. · 2020 [cited by applicant]
US 20200097077A1 · Nguyen et al. · 2020 [cited by applicant]
US 20200097091A1 · Chou et al. · 2020 [cited by applicant]
US 20200129850A1 · Ohashi · 2020 [cited by applicant]
US 20200159337A1 · Kin et al. · 2020 [cited by applicant]
US 20200218423A1 · Ohashi · 2020 [cited by applicant]
US 20200225736A1 · Schwarz et al. · 2020 [cited by applicant]
US 20200225757A1 · Schwarz et al. · 2020 [cited by applicant]
US 20200225758A1 · Tang et al. · 2020 [cited by applicant]
US 20200225813A1 · Schwarz et al. · 2020 [cited by applicant]
US 20200225830A1 · Tang · 2020 [cited by examiner]
US 20200226814A1 · Tang et al. · 2020 [cited by applicant]
US 20200286299A1 · Wang et al. · 2020 [cited by applicant]
US 20200310561A1 · Connellan et al. · 2020 [cited by applicant]
US 20200379576A1 · Chen et al. · 2020 [cited by applicant]
US 20200387228A1 · Ravasz et al. · 2020 [cited by applicant]
US 20200387287A1 · Ravasz et al. · 2020 [cited by applicant]
US 20200388247A1 · Ravasz et al. · 2020 [cited by applicant]
US 20210011556A1 · Atlas et al. · 2021 [cited by applicant]
US 20210076091A1 · Shohara · 2021 [cited by applicant]
US 20210089127A1 · Wu et al. · 2021 [cited by applicant]
US 20210096726A1 · Faulkner et al. · 2021 [cited by applicant]
US 20210134065A1 · Ramani et al. · 2021 [cited by applicant]
US 20210141461A1 · Liu et al. · 2021 [cited by applicant]
US 20210183135A1 · Lin et al. · 2021 [cited by applicant]
US 20210208698A1 · Martin et al. · 2021 [cited by applicant]
US 20210373672A1 · Schwarz et al. · 2021 [cited by applicant]
US 20220084279A1 · Lindmeier et al. · 2022 [cited by applicant]
US 20220121344A1 · Pastrana Vicente et al. · 2022 [cited by applicant]
US 20220129082A1 · Schoen · 2022 [cited by applicant]
US 20220147137A1 · Johnston · 2022 [cited by examiner]
US 20220156999A1 · Assouline et al. · 2022 [cited by applicant]
US 20220163800A1 · Yokokawa · 2022 [cited by applicant]
US 20220198755A1 · Pinchon · 2022 [cited by applicant]
US 20220244834A1 · Ravasz et al. · 2022 [cited by applicant]
US 20220262080A1 · Burton et al. · 2022 [cited by applicant]
US 20220365739A1 · Chang et al. · 2022 [cited by applicant]
US 20230031913A1 · Ishikawa et al. · 2023 [cited by applicant]
US 20230040610A1 · Buerli et al. · 2023 [cited by applicant]
US 20230072423A1 · Osborn et al. · 2023 [cited by applicant]
US 20230139337A1 · Noam et al. · 2023 [cited by applicant]
US 20230252737A1 · Dreyer et al. · 2023 [cited by applicant]
US 20230274512A1 · Terre et al. · 2023 [cited by applicant]
US 20230343052A1 · Kimura et al. · 2023 [cited by applicant]
US 20230344662A1 · Banks et al. · 2023 [cited by applicant]
US 20240019938A1 · Whitmire et al. · 2024 [cited by applicant]
US 20240028129A1 · Whitmire et al. · 2024 [cited by applicant]
US 20240045509A1 · Holz · 2024 [cited by applicant]
US 20240112426A1 · Berliner et al. · 2024 [cited by applicant]
US 20240201776A1 · Jun et al. · 2024 [cited by applicant]
US 20240212302A1 · Sorg et al. · 2024 [cited by applicant]
US 20240264660A1 · Levatich et al. · 2024 [cited by applicant]
US 20240265656A1 · Victor-Faichney et al. · 2024 [cited by applicant]
US 20240281070A1 · Emami et al. · 2024 [cited by applicant]
US 20240281071A1 · Emami et al. · 2024 [cited by applicant]
US 20240346751A1 · Vizeu Oliveira et al. · 2024 [cited by applicant]
US 20240372901A1 · Walton et al. · 2024 [cited by applicant]
US 20250054243A1 · Selig et al. · 2025 [cited by applicant]
US 20250068297A1 · Selig et al. · 2025 [cited by applicant]
US 20250103636A1 · Chan et al. · 2025 [cited by applicant]
US 20250166536A1 · Wang et al. · 2025 [cited by applicant]
US 20250348151A1 · Emami et al. · 2025 [cited by applicant]
CN 106716332A · 2017 [cited by applicant]
CN 108536273A · 2018 [cited by applicant]
CN 110134234B · 2022 [cited by applicant]
CN 116339737A · 2023 [cited by applicant]
CN 118045365A · 2024 [cited by applicant]
EP 3155560A1 · 2017 [cited by applicant]
EP 3155560B1 · 2020 [cited by applicant]
EP 3188075B1 · 2023 [cited by applicant]
EP 4145397A1 · 2023 [cited by applicant]
EP 4386519A1 · 2024 [cited by applicant]
EP 4189460B1 · 2025 [cited by applicant]
JP 2015100032A · 2015 [cited by applicant]
JP 2015176439A · 2015 [cited by applicant]
JP 2015192436A · 2015 [cited by applicant]
JP 2017529635A · 2017 [cited by applicant]
JP 2023181132A · 2023 [cited by applicant]
KR 20120136719A · 2012 [cited by applicant]
TW 202313162A · 2023 [cited by applicant]
WO 2014119258A1 · 2014 [cited by applicant]
WO 2015192117A1 · 2015 [cited by applicant]
WO 2017009707A1 · 2017 [cited by applicant]
WO 2018067508A1 · 2018 [cited by applicant]
WO 2018235371A1 · 2018 [cited by applicant]
WO 2019245681A1 · 2019 [cited by applicant]
WO 2022146938A1 · 2022 [cited by applicant]
WO 2022150113A1 · 2022 [cited by applicant]
WO 2023158745A1 · 2023 [cited by applicant]
Argelaguet F., et al., A Survey of 3D Object Selection Techniques for Virtual Environments, Computers & Graphics,2013, vol. 37, No. 3, pp. 121-136. [cited by applicant]
Cardoso J., Comparison of Gesture, Gamepad, and Gaze-Based Locomotion for VR Worlds, Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, Nov. 2, 2016, pp. 319-320. [cited by applicant]
European Search Report for European Patent Application No. 24154976.5, dated Jun. 7, 2024, 8 pages. [cited by applicant]
European Search Report for European Patent Application No. 24155225.6, dated May 2, 2024, 10 pages. [cited by applicant]
Fox B., et al., “Designing Singlehanded Shortcuts for VR & AR,” May 10, 2018, Retrieved from the Internet: URL: https://www.roadtovr.com/leap-motion-designing-single-handed-shortcuts-for-vr-ar/, [Retrieved on Oct. 27, 2… [cited by applicant]
GAMESPOT: “Oculus Touch Review,” Dec. 5, 2016, Retrieved from the Internet: URL: https://www.youtube.com/watch?v=YO7Y0KEhUog, 3 pages. [cited by applicant]
Hincapie-Ramos J.D., et aL, “GyroWand: IMU-Based Raycasting for Augmented Reality Head-Mounted Displays,” Proceedings of the 3rd Association for Computing Machinery (ACM) Symposium on Spatial User Interaction, Los Angel… [cited by applicant]
Huang Y., et al., “Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality,” International Journal of Human-Computer Interaction, Aug. 26, 2020, vol. 37, No. 2, pp. 169-180. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2020/051763, mailed Mar. 31, 2022, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2024/013757, mailed Aug. 28, 2025, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2024/015076, mailed Aug. 21, 2025, 9 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2020/051763, mailed Feb. 3, 2021, 11 Pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2021/063536 mailed Mar. 22, 2022, 12 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/017990, mailed Jul. 10, 2023, 9 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/013757, mailed May 7, 2024, 14 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/015076, mailed May 7, 2024, 12 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/036906, mailed Oct. 17, 2024, 14 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/040999, mailed Dec. 2, 2024, 10 pages. [cited by applicant]
International Search Report and Written Opinion of International Application No. PCT/US2020/035998, mailed Sep. 30, 2020, 16 pages. [cited by applicant]
Lang B., “Leap Motion Virtual Wearable AR Prototype is a Potent Glimpse at the Future of Your Smartphone,” Mar. 24, 2018, Retrieved from the Internet: URL: https://www.roadtovr.com/leap-motion-virtual-wearable-ar-protot… [cited by applicant]
Lee M.S., et al., “A Computer Vision System for on-Screen Item Selection by Finger Pointing,” In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2001, vol. 1, … [cited by applicant]
Mardanbegi D., et al., “Eyesee Through: Unifying Tool Selection and Application in Virtual Environments,” In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, pp. 474-483. [cited by applicant]
Matsuda K., “Augmented City 3D [Official],” YouTube, Aug. 20, 2010, Retrieved from the Internet: URL: https://www.youtube.com/watch?v=3TL80ScTLIM, 1 page. [cited by applicant]
Mayer S., et aL, “The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments,” Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, Apr… [cited by applicant]
Meta Quest: “Oculus Touch—Hand Presence Technology,” Oct. 7, 2016, Retrieved from the Internet: URL: https://www.youtube.com/watch?v=pppkQ4jlrMU, 3 pages. [cited by applicant]
Mine M.R., et al., Moving Objects in Space: Exploiting Proprioception in Virtual-Environment Interaction, In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, 1997, pp. 19-26. [cited by applicant]
Newton A., “Immersive Menus Demo,” YouTube, Oct. 8, 2017, Retrieved from the Internet: URL: https://www.youtube.com/watch?v=_ow1RboHJDY, 1 page. [cited by applicant]
Notice of Allowance mailed May 22, 2025 for U.S. Appl. No. 18/095,946, filed Jan. 11, 2023, 5 pages. [cited by applicant]
Office Action mailed Apr. 9, 2024 for Japanese Patent Application No. 2021-555497, filed on Jun. 3, 2020, 4 pages. [cited by applicant]
Office Action mailed Sep. 19, 2023 for European Patent Application No. 20747255.6, filed on Dec. 7, 2021, 6 pages. [cited by applicant]
Office Action mailed Feb. 27, 2024 for Chinese Application No. 202080035337.X, filed Jun. 3, 2020, 8 pages. [cited by applicant]
Olwal A., et al., “The Flexible Pointer: An Interaction Technique for Selection in Augmented and Virtual Reality,” Proceedings of ACM Symposium on User Interface Software and Technology (UIST), Vancouver, BC, Nov. 2-5, … [cited by applicant]
Pfeuffer, et al., “Gaze+ Pinch Interaction in Virtual Reality,” Proceedings of the 5th Symposium on Spatial User Interaction, SUI '17, Oct. 16, 2017, pp. 99-108. [cited by applicant]
Prosecution History of U.S. Appl. No. 16/434,919, dated Apr. 2, 2020 through Dec. 15, 2020, 46 pages. [cited by applicant]
Renner P., et al., “Ray Casting”, Central Facility Labs [Online], [Retrieved on Apr. 7, 2020], 2 pages, Retrieved from the Internet: URL:https://www.techfak.uni-bielefeld.de/~tpfeiffe/lehre/VirtualReality/interaction/ra… [cited by applicant]
Schweigert R., et aL, “EyePointing: A Gaze-Based Selection Technique,” Proceedings of Mensch and Computer, Hamburg, Germany, Sep. 8-11, 2019, pp. 719-723. [cited by applicant]
Tomberlin M., et al., “Gauntlet: Travel Technique for Immersive Environments using Non-Dominant Hand,” IEEE Virtual Reality (VR), Mar. 18, 2017, pp. 299-300. [cited by applicant]
Unity Gets Toolkit for Common AR/VR Interactions, Unity XR interaction Toolkit Preview [Online], Dec. 19, 2019 Retrieved on Apr. 7, 2020], 1 page, Retrieved from the Internet: URL: http://youtu.be/ZPhv4qmT9EQ. [cited by applicant]
Discord., “How to Enable and Use the Discord Overlay,” Youtube.Com, Mar. 14, 2016, [Retrieved on May 28, 2024], 2 Pages, Retrieved from the Internet URL: https://www.youtube.com/watch?v=7xvpcXvNwJs. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2024/021541, mailed Nov. 13, 2025, 10 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/021541, mailed Jun. 10, 2024, 14 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2025/048371, mailed Jan. 5, 2026, 10 pages. [cited by applicant]
Office Action mailed Dec. 18, 2025 for European Patent Application No. 24155225.6, filed on Feb. 1, 2024, 9 pages. [cited by applicant]
Valem Tutorials., “How to Interact in VR—Oculus Interaction SDK—Part 1,” YouTube, Mar. 14, 2022, [Retrieved on Dec. 16, 2025], XP093347652, 2 pages, Retrieved from the Internet URL: https://www.youtube.com/watch?v=1FRqn… [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2024/036906, mailed Mar. 5, 2026, 12 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2024/040999, mailed Feb. 26, 2026, 8 pages. [cited by applicant]
Extended European Search Report for European Patent Application No. 26152580.2, dated Mar. 25, 2026, 9 pages. [cited by applicant]
LOLAMBEAN: “Getting around Hololens 2,” Microsoft Learn, Aug. 30, 2021, XP093333393, 11 pages, Retrieved from the Internet URL: https://learn.microsoft.com/en-US/hololens/hololens2-basic-usage. [cited by applicant]