IP Library Granted Patent US 12,405,759
Granted Patent B2
US 12,405,759 · App. 18/209,931 · Granted Sep 2, 2025

Gaze-based user interactions

Inventors: Avi Bar-Zeev (Oakland, CA); Ryan S. Burgoyne (Sunnyvale, CA); Devin W. Chalmers (Oakland, CA); Luis R. Deliz Centeno (Fremont, CA); Rahul Nair (Hayward, CA); Timothy R. Oriol (San Jose, CA); Alexis H. Palangie (Palo Alto, CA)
Assignee: Apple Inc.
G06F3/1423G02B27/0093G02B27/017G06F3/013G06F3/017G06F3/0346G06F3/04815G06F3/04842G06T7/74G06T19/006G06V20/20G06V40/20H04B5/70G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,405,759
App. No.
18/209,931
Granted
Sep 2, 2025
Kind
B2
Abstract

In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.

Claims (72)

1. An electronic device, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying an object at an initial position in a three-dimensional computer-generated reality environment;

selecting the object;

while maintaining selection of the object and display of the selected object at the initial position in the three-dimensional computer-generated reality environment:

receiving a first user input at a first time;

in response to receiving the first user input, designating a placement point at a first position in the three-dimensional computer-generated reality environment based on a gaze position at the first time, wherein the first position corresponds to the gaze position at the first time;

while maintaining designation of the placement point:

receiving a second user input;

in response to receiving the second user input, moving the placement point to a second position in the three-dimensional computer-generated reality environment different than the first position, wherein moving the placement point to the second position is not based on the gaze position; and

receiving a third user input; and

in response to receiving the third user input:

ceasing to display the selected object at the initial position in the three-dimensional computer-generated reality environment; and

placing the selected object at the second position in the three-dimensional computer-generated reality environment.

2. The electronic device of claim 1 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first position corresponds to a plurality of selectable placement positions in the three-dimensional computer-generated reality environment, and wherein the one or more programs further include instructions for:

in response to receiving the first user input:

in accordance with a determination that the first position corresponds to a single selectable placement position in the three-dimensional computer-generated reality environment, placing the selected object at the single selectable placement position.

3. The electronic device of claim 1 , wherein the first user input is received while the electronic device is in a first mode, wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the first mode, and wherein the one or more programs further include instructions for:

in response to receiving the first user input, switching the electronic device from the first mode to a second mode, wherein the second user input is received while the electronic device is in the second mode, and wherein the placement point is moved to the second position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the second mode.

4. The electronic device of claim 1 , wherein the first user input is the same type of input as the second user input or the third user input.

5. The electronic device of claim 1 , wherein the second position in the three-dimensional computer-generated reality environment is different than a gaze position associated with the second user input.

6. The electronic device of claim 1 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first user input is a first type of input, and wherein the one or more programs further include instructions for:

in response to receiving the first user input:

in accordance with a determination that the first user input is a second type of input different than the first type of input, placing the selected object at the first position in the three-dimensional computer-generated reality environment.

7. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:

displaying an object at an initial position in a three-dimensional computer-generated reality environment;

selecting the object;

while maintaining selection of the object and display of the selected object at the initial position in the three-dimensional computer-generated reality environment:

receiving a first user input at a first time;

in response to receiving the first user input, designating a placement point at a first position in the three-dimensional computer-generated reality environment based on a gaze position at the first time, wherein the first position corresponds to the gaze position at the first time;

while maintaining designation of the placement point:

receiving a second user input;

in response to receiving the second user input, moving the placement point to a second position in the three-dimensional computer-generated reality environment different than the first position, wherein moving the placement point to the second position is not based on the gaze position; and

receiving a third user input; and

in response to receiving the third user input:

ceasing to display the selected object at the initial position in the three-dimensional computer-generated reality environment; and

placing the selected object at the second position.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first position corresponds to a plurality of selectable placement positions in the three-dimensional computer-generated reality environment, and wherein the one or more programs further include instructions for:

in response to receiving the first user input:

in accordance with a determination that the first position corresponds to a single selectable placement position in the three-dimensional computer-generated reality environment, placing the selected object at the single selectable placement position.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the first user input is received while the electronic device is in a first mode, wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the first mode, and wherein the one or more programs further include instructions for:

in response to receiving the first user input, switching the electronic device from the first mode to a second mode, wherein the second user input is received while the electronic device is in the second mode, and wherein the placement point is moved to the second position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the second mode.

10. The non-transitory computer-readable storage medium of claim 7 , wherein the first user input is the same type of input as the second user input or the third user input.

11. The non-transitory computer-readable storage medium of claim 7 , wherein the second position in the three-dimensional computer-generated reality environment is different than a gaze position associated with the second user input.

12. The non-transitory computer-readable storage medium of claim 7 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first user input is a first type of input, and wherein the one or more programs further include instructions for:

in response to receiving the first user input:

in accordance with a determination that the first user input is a second type of input different than the first type of input, placing the selected object at the first position in the three-dimensional computer-generated reality environment.

13. A method, comprising:

at an electronic device:

displaying an object at an initial position in a three-dimensional computer-generated reality environment;

selecting the object;

while maintaining selection of the object and display of the selected object at the initial position in the three-dimensional computer-generated reality environment:

receiving a first user input at a first time;

in response to receiving the first user input, designating a placement point at a first position in the three-dimensional computer-generated reality environment based on a gaze position at the first time, wherein the first position corresponds to the gaze position at the first time;

while maintaining designation of the placement point:

receiving a second user input;

in response to receiving the second user input, moving the placement point to a second position in the three-dimensional computer-generated reality environment different than the first position, wherein moving the placement point to the second position is not based on the gaze position; and

receiving a third user input; and

in response to receiving the third user input:

ceasing to display the selected object at the initial position in the three-dimensional computer-generated reality environment; and

placing the selected object at the second position in the three-dimensional computer-generated reality environment.

14. The method of claim 13 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first position corresponds to a plurality of selectable placement positions in the three-dimensional computer-generated reality environment, and wherein the method further comprises:

in response to receiving the first user input:

in accordance with a determination that the first position corresponds to a single selectable placement position in the three-dimensional computer-generated reality environment, placing the selected object at the single selectable placement position.

15. The method of claim 13 , wherein the first user input is received while the electronic device is in a first mode, wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the first mode, and wherein the method further comprises:

in response to receiving the first user input, switching the electronic device from the first mode to a second mode, wherein the second user input is received while the electronic device is in the second mode, and wherein the placement point is moved to the second position in the three-dimensional computer-generated reality environment in accordance with the electronic device being in the second mode.

16. The method of claim 13 , wherein the first user input is the same type of input as the second user input or the third user input.

17. The method of claim 13 , wherein the second position in the three-dimensional computer-generated reality environment is different than a gaze position associated with the second user input.

18. The method of claim 13 , wherein the placement point is designated at the first position in the three-dimensional computer-generated reality environment in accordance with a determination that the first user input is a first type of input, and wherein the method further comprises:

in response to receiving the first user input:

in accordance with a determination that the first user input is a second type of input different than the first type of input, placing the selected object at the first position in the three-dimensional computer-generated reality environment.

Continuity (8)
Continuation 17486646 · Sep 27, 2021
Continuation 16828852 · Mar 24, 2020
Continuation PCTUS2018053428 · Sep 28, 2018
Provisional Application 62734678 · Sep 21, 2018
Provisional Application 62566073 · Sep 29, 2017
Provisional Application 62566206 · Sep 29, 2017
Provisional Application 62566080 · Sep 29, 2017
Related Publication 20230325140A1 · Oct 12, 2023
References Cited (266)
US 5664133A · Malamud · 1997 [cited by examiner]
US 5949432A · Gough · 1999 [cited by examiner]
US 8408706B2 · Yahav · 2013 [cited by examiner]
US 9007301B1 · Raffle · 2015 [cited by examiner]
US 10110678B2 · Hebsur et al. · 2018 [cited by applicant]
US 10248399B2 · Yoon · 2019 [cited by applicant]
US 10353532B1 · Holz · 2019 [cited by examiner]
US 11132162B2 · Bar-Zeev · 2021 [cited by examiner]
US 11550444B2 · Josephson · 2023 [cited by examiner]
US 11714592B2 · Bar-Zeev · 2023 [cited by examiner]
US 20020113943A1 · Trajkovic · 2002 [cited by examiner]
US 20040150584A1 · Chuman · 2004 [cited by examiner]
US 20050175218A1 · Vertegaal · 2005 [cited by examiner]
US 20070162872A1 · Hong · 2007 [cited by examiner]
US 20080154494A1 · Kato · 2008 [cited by examiner]
US 20080181452A1 · Kwon · 2008 [cited by examiner]
US 20080211766A1 · Westerman · 2008 [cited by examiner]
US 20080307360A1 · Chaudhri · 2008 [cited by examiner]
US 20110037712A1 · Kim · 2011 [cited by examiner]
US 20110161890A1 · Anderson · 2011 [cited by examiner]
US 20120249416A1 · Maciocci · 2012 [cited by examiner]
US 20130007668A1 · Liu et al. · 2013 [cited by applicant]
US 20130042296A1 · Hastings · 2013 [cited by examiner]
US 20130050258A1 · Liu · 2013 [cited by examiner]
US 20130050432A1 · Perez · 2013 [cited by examiner]
US 20130141419A1 · Mount · 2013 [cited by examiner]
US 20130241805A1 · Gomez · 2013 [cited by examiner]
US 20130283208A1 · Bychkov · 2013 [cited by examiner]
US 20130328762A1 · McCulloch · 2013 [cited by examiner]
US 20140043227A1 · Skogo · 2014 [cited by examiner]
US 20140096076A1 · Ashbrook · 2014 [cited by examiner]
US 20140160001A1 · Kinnebrew · 2014 [cited by examiner]
US 20140184550A1 · Hennessey · 2014 [cited by examiner]
US 20140201844A1 · Buck · 2014 [cited by examiner]
US 20140204002A1 · Bennet · 2014 [cited by examiner]
US 20140240471A1 · Srinivasa et al. · 2014 [cited by applicant]
US 20140253592A1 · Cho · 2014 [cited by examiner]
US 20140333666A1 · Poulos · 2014 [cited by examiner]
US 20150084857A1 · Kimura · 2015 [cited by examiner]
US 20150100803A1 · Chen · 2015 [cited by examiner]
US 20150103149A1 · McNamer et al. · 2015 [cited by applicant]
US 20150130716A1 · Sridharan · 2015 [cited by examiner]
US 20150138079A1 · Lannsjo · 2015 [cited by examiner]
US 20150199005A1 · Haddon · 2015 [cited by examiner]
US 20150205494A1 · Scott · 2015 [cited by examiner]
US 20150268821A1 · Ramsby · 2015 [cited by examiner]
US 20150293592A1 · Cheong · 2015 [cited by examiner]
US 20150317518A1 · Fujimaki · 2015 [cited by examiner]
US 20150317837A1 · Sholudko · 2015 [cited by examiner]
US 20150323990A1 · Maltz · 2015 [cited by examiner]
US 20150347114A1 · Yoon · 2015 [cited by examiner]
US 20150362729A1 · Jang · 2015 [cited by examiner]
US 20160005229A1 · Lee et al. · 2016 [cited by applicant]
US 20160018645A1 · Haddick et al. · 2016 [cited by applicant]
US 20160018654A1 · Haddick · 2016 [cited by examiner]
US 20160025981A1 · Burns · 2016 [cited by examiner]
US 20160026242A1 · Burns · 2016 [cited by examiner]
US 20160026253A1 · Bradski · 2016 [cited by examiner]
US 20160085301A1 · Lopez · 2016 [cited by examiner]
US 20160116980A1 · George-Svahn · 2016 [cited by examiner]
US 20160179336A1 · Ambrus · 2016 [cited by examiner]
US 20160182877A1 · Deluca · 2016 [cited by examiner]
US 20160241767A1 · Cho · 2016 [cited by examiner]
US 20160262614A1 · Ninomiya · 2016 [cited by examiner]
US 20160267708A1 · Nistico · 2016 [cited by examiner]
US 20160274762A1 · Lopez · 2016 [cited by examiner]
US 20160284123A1 · Hare et al. · 2016 [cited by applicant]
US 20160292759A1 · Gonzalez Miranda · 2016 [cited by examiner]
US 20160295038A1 · Rao · 2016 [cited by examiner]
US 20160313875A1 · Williams · 2016 [cited by examiner]
US 20160371888A1 · Wright · 2016 [cited by examiner]
US 20160379418A1 · Osborn · 2016 [cited by examiner]
US 20170038829A1 · Lanier · 2017 [cited by examiner]
US 20170060230A1 · Faaborg · 2017 [cited by examiner]
US 20170078825A1 · Mangiat · 2017 [cited by examiner]
US 20170090566A1 · George-Svahn · 2017 [cited by examiner]
US 20170099481A1 · Held · 2017 [cited by examiner]
US 20170134553A1 · Jeon · 2017 [cited by examiner]
US 20170153701A1 · Mahon · 2017 [cited by examiner]
US 20170185156A1 · Shotton · 2017 [cited by examiner]
US 20170185276A1 · Lee · 2017 [cited by examiner]
US 20170194768A1 · Powers · 2017 [cited by examiner]
US 20170221276A1 · Osborn et al. · 2017 [cited by applicant]
US 20170237974A1 · Samec · 2017 [cited by examiner]
US 20170318019A1 · Gordon · 2017 [cited by examiner]
US 20180004283A1 · Mathey-Owens · 2018 [cited by examiner]
US 20180054487A1 · Hebsur · 2018 [cited by examiner]
US 20180081171A1 · Park · 2018 [cited by examiner]
US 20180095635A1 · Valdivia · 2018 [cited by examiner]
US 20180096202A1 · Stathacopoulos et al. · 2018 [cited by applicant]
US 20180204385A1 · Sarangdhar · 2018 [cited by examiner]
US 20180249086A1 · Ozawa · 2018 [cited by examiner]
US 20190025910A1 · Gilra · 2019 [cited by examiner]
US 20190122420A1 · Terahata · 2019 [cited by examiner]
US 20190244416A1 · Tamaoki · 2019 [cited by examiner]
US 20190318660A1 · Kimoto · 2019 [cited by examiner]
US 20190378423A1 · Bachrach et al. · 2019 [cited by applicant]
US 20200192622A1 · Stoyles · 2020 [cited by examiner]
US 20200201444A1 · Stoyles et al. · 2020 [cited by applicant]
US 20200225746A1 · Bar-zeev et al. · 2020 [cited by applicant]
US 20200225747A1 · Bar-zeev et al. · 2020 [cited by applicant]
US 20200301553A1 · Taylor · 2020 [cited by examiner]
US 20210096726A1 · Faulkner · 2021 [cited by examiner]
US 20210097776A1 · Faulkner · 2021 [cited by examiner]
US 20210240331A1 · Olson · 2021 [cited by examiner]
US 20210365228A1 · Stoyles et al. · 2021 [cited by applicant]
US 20220012002A1 · Bar-zeev et al. · 2022 [cited by applicant]
US 20220083303A1 · Stoyles et al. · 2022 [cited by applicant]
US 20220245900A1 · Tan et al. · 2022 [cited by applicant]
US 20230376261A1 · Stoyles et al. · 2023 [cited by applicant]
US 20230393796A1 · Stoyles et al. · 2023 [cited by applicant]
US 20240103614A1 · Dryer · 2024 [cited by examiner]
US 20240104871A1 · Brewer · 2024 [cited by examiner]
US 20240411497A1 · Stoyles et al. · 2024 [cited by applicant]
US 20250103133A1 · Pastrana et al. · 2025 [cited by applicant]
US 20250190161A1 · Stoyles et al. · 2025 [cited by applicant]
CN 102843523A · 2012 [cited by applicant]
CN 103164017A · 2013 [cited by applicant]
CN 103460256A · 2013 [cited by applicant]
CN 103765346A · 2014 [cited by applicant]
CN 104516497A · 2015 [cited by applicant]
CN 105009039A · 2015 [cited by applicant]
CN 105393190A · 2016 [cited by applicant]
CN 105493501A · 2016 [cited by applicant]
CN 106164818A · 2016 [cited by applicant]
CN 106371206A · 2017 [cited by applicant]
CN 106415444A · 2017 [cited by applicant]
CN 106462231A · 2017 [cited by applicant]
CN 106462733A · 2017 [cited by applicant]
CN 106951069A · 2017 [cited by applicant]
CN 107003521A · 2017 [cited by applicant]
EP 0513584A2 · 1992 [cited by applicant]
EP 1055200B1 · 2003 [cited by applicant]
EP 2940556A1 · 2015 [cited by applicant]
EP 2947546A1 · 2015 [cited by applicant]
EP 3118722A1 · 2017 [cited by applicant]
JP 200437149A · 2004 [cited by applicant]
JP 2004513403A · 2004 [cited by applicant]
JP 2004517359A · 2004 [cited by applicant]
JP 2005157329A · 2005 [cited by applicant]
JP 2008158583A · 2008 [cited by applicant]
JP 200964395A · 2009 [cited by applicant]
JP 2012221498A · 2012 [cited by applicant]
JP 201590635A · 2015 [cited by applicant]
JP 2015126857A · 2015 [cited by applicant]
JP 2016502120A · 2016 [cited by applicant]
JP 201685588A · 2016 [cited by applicant]
JP 2016192132A · 2016 [cited by applicant]
KR 1020020086590A · 2002 [cited by applicant]
KR 1020070067332A · 2007 [cited by applicant]
KR 1020150125472A · 2015 [cited by applicant]
WO 2013144807A1 · 2013 [cited by applicant]
WO 2014033306A1 · 2014 [cited by applicant]
WO 2014204755A1 · 2014 [cited by applicant]
WO 2015110852A1 · 2015 [cited by applicant]
WO 2015140106A1 · 2015 [cited by applicant]
WO 2015142966A1 · 2015 [cited by applicant]
WO 2016045784A1 · 2016 [cited by applicant]
WO 2016099706A1 · 2016 [cited by applicant]
WO 2017031089A1 · 2017 [cited by applicant]
WO 2017096097A1 · 2017 [cited by applicant]
WO 2017112692A2 · 2017 [cited by applicant]
WO 2023049170A2 · 2023 [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/534,102, mailed on Sep. 27, 2022, 2 pages. [cited by applicant]
Brief Communication regarding Oral Proceedings received for European Patent Application No. 18786644.7, mailed on Feb. 27, 2023, 3 pages. [cited by applicant]
Businesswire, “SMI Gaze Interaction Powers Google Glass Prototype”, Online Available at: https://www.youtube.com/watch?v=R3xxqap7DmQ&t=1s, Mar. 3, 2015, 3 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 16/828,857, mailed on Sep. 1, 2021, 3 pages. [cited by applicant]
Decision to Refuse received for European Patent Application No. 18786644.7, mailed on Mar. 27, 2023, 9 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/534,102, mailed on Nov. 30, 2022, 14 pages. [cited by applicant]
Howmuchtech, “5 Best Smart Glasses of 2022”, Online Available at: https://www.youtube.com/watch?v=xll2Ycc6Fv0&t=162s, Dec. 24, 2021, 6 pages. [cited by applicant]
Kunhee et al., “Distant 3D Object Grasping with Gaze-supported Selection”, The 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI 2015), Oct. 28-30, 2015, pp. 541-544. [cited by applicant]
Liu et al., “Video avatar-based remote video collaboration”, Journal of Beijing University of Aeronautics and Astronautics, vol. 41, No. 6, Jun. 2015, pp. 1087-1094. [cited by applicant]
Minutes of the Oral Proceedings received for European Patent Application No. 18786644.7, mailed on Mar. 24, 2023, 5 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/052,081, mailed on Jul. 14, 2021, 16 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/394,114, mailed on Jul. 6, 2022, 17 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/534,102, mailed on Jul. 7, 2022, 14 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 201880051530.5, mailed on Apr. 8, 2022, 5 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 201880052303.4, mailed on Mar. 9, 2022, 4 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 201880055893.6, mailed on Mar. 30, 2022, 4 pages. [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2020-7006018, mailed on Apr. 18, 2022, 4 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/802,188, mailed on Jul. 29, 2021, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/828,857, mailed on Jul. 14, 2021, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/052,081, mailed on Jan. 14, 2022, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/394,114, mailed on Feb. 7, 2023, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/394,114, mailed on Oct. 21, 2022, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/534,102, mailed on Jan. 11, 2023, 8 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 201880051530.5, mailed on Sep. 6, 2021, 18 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 201880052303.4, mailed on Sep. 27, 2021, 20 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 201880055893.6, mailed on Sep. 6, 2021, 21 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2021-142308, mailed on Oct. 31, 2022, 10 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2020-7006018, mailed on Oct. 9, 2021, 9 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7022762, mailed on Jan. 27, 2023, 6 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7022762, mailed on Jul. 19, 2022, 9 pages. [cited by applicant]
Special Effect, “Open Drive—Eye Gaze Games | Eye Gaze Controls & Options”, Online Available at: https://www.youtube.com/watch?v=IJi2aOdSau8&t=63s, Mar. 18, 2022, 3 pages. [cited by applicant]
Summons to Attend Oral Proceedings received for European Patent Application No. 18786644.7, mailed on Nov. 10, 2022, 5 pages. [cited by applicant]
Takase et al., “Gestural Interface and the Intuitive Interaction with Virtual Objects”, ICROS-SICE International Joint Conference, 2009, pp. 3260-3263. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/229,059, mailed on Mar. 7, 2024, 15 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2023-7022376, mailed on Jan. 30, 2024, 9 pages (4 pages of English Translation and 5 pages of Official Copy). [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/394,114, mailed on Jun. 14, 2023, 2 pages. [cited by applicant]
Decision of Rejection received for Japanese Patent Application No. 2021-142308, mailed on May 15, 2023, 4 pages (2 pages of English Translation and 2 pages of Official Copy). [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/394,114, mailed on Jun. 2, 2023, 11 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/534,102, mailed on May 2, 2023, 8 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7022762, mailed on Apr. 11, 2023, 8 pages (4 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Office Action received for Korean Patent Application No. 10-2023-7022376, mailed on Jul. 26, 2023, 9 pages (4 pages of English Translation and 5 pages of Official Copy). [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/229,059, mailed on Apr. 26, 2024, 2 pages. [cited by applicant]
Chatterjee et al., “Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions”, ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, online available at: https://dl.a… [cited by applicant]
Extended European Search Report received for European Patent Application No. 23219457.1, mailed on Apr. 16, 2024, 10 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/033501, mailed on Feb. 26, 2024, 21 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/033549, mailed on Jan. 15, 2024, 15 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/033501, mailed on Jan. 5, 2024, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/235,693, mailed on Jul. 3, 2024, 25 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/229,059, mailed on Jul. 11, 2024, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/235,693, mailed on Aug. 28, 2024, 11 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 202210616910.7, mailed on Aug. 8, 2024, 19 pages (10 pages of English Translation and 9 pages of Official Copy). [cited by applicant]
Office Action received for Chinese Patent Application No. 202210618012.5, mailed on Aug. 9, 2024, 16 pages (9 pages of English Translation and 7 pages of Official Copy). [cited by applicant]
Office Action received for Japanese Patent Application No. 2023-149802, mailed on Jul. 29, 2024, 2 pages (1 page of English Translation and 1 page of Official Copy). [cited by applicant]
Extended European Search Report received for European Patent Application No. 23173161.3, mailed on Oct. 30, 2023, 9 pages. [cited by applicant]
Office Action received for Chinese Patent Application No. 201980028660.1, mailed on Oct. 18, 2023, 11 pages (5 pages of English Translation and 6 pages of Official Copy). [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 201980028660.1, mailed on Feb. 27, 2024, 2 pages (1 page of English Translation and 1 page of Official Copy). [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2023-7022376, mailed on Oct. 21, 2024, 7 pages (2 pages of English Translation and 5 pages of Official Copy). [cited by applicant]
Decision to Grant received for Japanese Patent Application No. 2023-149802, mailed on Dec. 3, 2024, 3 pages (1 page of English Translation and 2 pages of Official Copy). [cited by applicant]
Office Action received for Chinese Patent Application No. 202210616910.7, mailed on Nov. 22, 2024, 17 pages (9 pages of English Translation and 8 pages of Official Copy). [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/235,693, mailed on Feb. 20, 2025, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/235,693, mailed on Dec. 13, 2024, 10 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 202210618012.5, mailed on Jan. 1, 2025, 5 pages (1 page of English Translation and 4 pages of Official Copy). [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2024/045209, mailed on Dec. 10, 2024, 11 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2024/045209, mailed on Jan. 31, 2025, 14 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/033501, mailed on Apr. 3, 2025, 16 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/033549, mailed on Apr. 3, 2025, 10 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/802,188, mailed on Mar. 23, 2021, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/802,320, mailed on Apr. 9, 2021, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/828,852, mailed on Jan. 27, 2021, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/828,852, mailed on Jun. 8, 2021, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/828,857, mailed on Jun. 10, 2021, 3 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/486,646, mailed on Aug. 23, 2022, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/486,646, mailed on Dec. 28, 2022, 2 pages. [cited by applicant]
Decision to Grant received for Japanese Patent Application No. 2020-512573, mailed on Aug. 2, 2021, 3 pages (1 page of English Translation and 2 pages of Official Copy). [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/802,188, mailed on May 14, 2021, 18 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/828,852, mailed on Mar. 9, 2021, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/486,646, mailed on Oct. 5, 2022, 20 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/053415, mailed on Apr. 9, 2020, 10 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/053422, mailed on Apr. 9, 2020, 10 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/053427, mailed on Apr. 9, 2020, 14 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/053428, mailed on Apr. 9, 2020, 8 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2019/028980, mailed on Nov. 19, 2020, 10 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/053415, mailed on Dec. 13, 2018, 14 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/053422, mailed on Dec. 19, 2018, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/053427, mailed on Mar. 25, 2019, 18 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/053428, mailed on Jan. 25, 2019, 9 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2019/028980, mailed on Aug. 16, 2019, 14 pages. [cited by applicant]
Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2018/053427, mailed on Feb. 1, 2019, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/802,188, mailed on Dec. 16, 2020, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/802,320, mailed on Dec. 24, 2020, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/828,852, mailed on Nov. 9, 2020, 14 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/828,857, mailed on Feb. 17, 2021, 12 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/486,646, mailed on Jun. 15, 2022, 17 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/802,320, mailed on Apr. 30, 2021, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/828,852, mailed on Jul. 27, 2021, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/486,646, mailed on Mar. 22, 2023, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/370,363, mailed on May 29, 2025, 14 pages. [cited by applicant]
Office Action received for European Patent Application No. 18786644.7, mailed on Apr. 28, 2021, 6 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2020-512573, mailed on Apr. 12, 2021, 7 pages (4 pages of English Translation and 3 pages of Official Copy). [cited by applicant]
Stellmach et al., “Look & Touch: Gaze-supported Target Acquisition”, CHI'12: Proceedings of the SIGGHI Conference on Human Factors in Computing Systems; Available online at: https://dl.acm.org/doi/10.1145/2207676.220870… [cited by applicant]
Stellmach et al., “Still Looking: Investigating Seamless Gaze-supported Selection, Positioning, and Manipulation of Distant Targets”, CHI'13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; A… [cited by applicant]
Wang, Zichuan, “Transmissive smart glasses based on image recognition and gesture tracking”, Innovation Technology Frontier, pp. 26-28 (Official Copy Only). {See Communication under Rule 37 CFR § 1.98(a) (3)}. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/811,647, mailed on Jun. 30, 2025, 12 pages. [cited by applicant]