IP Library › Granted Patent US 12,287,921
Granted Patent B2
US 12,287,921 · App. 18/473,180 · Granted Apr 29, 2025

Methods for manipulating a virtual object

Inventors: William D. Lindmeier (San Francisco, CA); Tony Kobayashi (Berkley, CA); Alexis H. Palangie (Palo Alto, CA); Carmine Elvezio (San Francisco, CA); Matthew J. Sundstrom (Campbell, CA)
Assignee: Apple Inc.
G06F3/017G06F3/0346G06F3/04815G06F3/04845
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,921
App. No.
18/473,180
Granted
Apr 29, 2025
Kind
B2
Abstract

In some embodiments, a computer system performs virtual object manipulation operations using respective portions of the user's body and/or input device(s). In some embodiments, a computer system manipulates a virtual object based on input from a hand of a user and/or a handheld device. In some embodiments, a computer system manipulates a virtual object directly or indirectly.

Claims (127)

1. A method comprising:

at a computer system in communication with a display generation component and one or more input devices including a first input device:

displaying, via the display generation component, a virtual object;

while displaying the virtual object, detecting, via the one or more input devices, a first user input corresponding to manipulation of the virtual object; and

in response to detecting the first user input:

in accordance with a determination that the first user input includes an air gesture detected based on movement of a first portion of a user's body of the computer system without including input from a second portion of the user's body directed to the first input device, performing a first manipulation operation with respect to the virtual object; and

in accordance with a determination that the first user input includes an air gesture input detected based on movement of the first portion of the user's body and input from the second portion of the user's body directed to the first input device, performing a second manipulation operation, different from the first manipulation operation, with respect to the virtual object.

2. The method of claim 1 , wherein a respective magnitude of the first manipulation operation is based on a respective magnitude of the movement of the first portion of the user's body.

3. The method of claim 1 , wherein a respective direction of the first manipulation operation is based on a direction of the movement of the first portion of the user's body.

4. The method of claim 1 , wherein the first manipulation operation includes a movement of the virtual object relative to a three-dimensional environment, and the second manipulation operation includes a rotation of the virtual object relative to the three-dimensional environment.

5. The method of claim 4 , an amount of the rotation of the virtual object relative to the three-dimensional environment is based on the input from the second portion of the user's body directed to the first input device.

6. The method of claim 1 , wherein:

performing the first manipulation operation with respect to the virtual object includes:

in accordance with a determination that one or more first criteria are satisfied, moving the virtual object; and

in accordance with a determination that one or more second criteria are satisfied, rotating the virtual object, rotating the virtual object; and

performing the second manipulation operation with respect to the virtual object includes scaling the virtual object.

7. The method of claim 6 , wherein scaling the virtual object includes scaling the virtual object by a scaling magnitude, and the scaling magnitude is based on a relative movement between the first portion of the user's body and a respective portion of the first input device.

8. The method of claim 1 , further comprising:

while displaying, via the display generation component, the virtual object, detecting, via the one or more input devices, a respective location of attention of the user of the computer system in a three-dimensional environment, wherein:

in accordance with a determination that the first input device has a first pose relative to the virtual object, the respective location is a first location; and

in accordance with a determination that the first input device has a second pose, different from the first pose, relative to the virtual object, the respective location is a second location, different from the first location.

9. The method of claim 8 , further comprising:

while detecting the respective location of the attention of the user of the computer system in the three-dimensional environment:

in accordance with a determination that the respective location of the attention of the user is the first location, and in accordance with a determination that the first location corresponds to a first respective portion of the virtual object, displaying, via the display generation component, a visual indication of the attention the user at the first respective portion of the virtual object; and

in accordance with a determination that the respective location of the attention of the user is the second location, different from the first location, forgoing the displaying of the visual indication of the attention of the user at the first respective portion of the virtual object.

10. The method of claim 9 , further comprising:

while displaying, via the display generation component, the virtual object and the visual indication of the attention of the user at the first respective portion of the virtual object, wherein the visual indication of the attention of the user has a first visual appearance, detecting, via the one or more input devices, an indication of a second user input, different from the first user input, at the first input device; and

in response to detecting the indication of the second user input, updating display of the visual indication of the attention of the user to have a second visual appearance, different from the first visual appearance, while the visual indication of the attention of the user remains displayed at the first respective portion of the virtual object.

11. The method of claim 1 , further comprising:

while performing the second manipulation operation, wherein the second manipulation operation includes a rotation operation of the virtual object, displaying, via the display generation component, a visual representation of a plane of rotation corresponding to the rotation operation.

12. The method of claim 11 , wherein the visual representation of the plane of the rotation intersects with a respective portion of the virtual object.

13. The method of claim 1 , wherein:

the first manipulation operation includes one or more of a first translation operation of the virtual object, a first rotation operation of the virtual object, or a first scaling operation of the virtual object, and

the second manipulation operation includes one or more of a second translation operation of the virtual object, a second rotation operation of the virtual object, or a second scaling operation of the virtual object.

14. The method of claim 1 , further comprising:

while performing the first manipulation operation in accordance with input from the first portion of the user's body, detecting, via the one or more input devices, a second user input, different from the first user input, from the second portion of the user's body; and

in response to detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are satisfied, including a criterion that is satisfied when the second user input includes a second input from the second portion of the user's body directed to the first input device, ceasing performing the first manipulation operation and performing a third manipulation operation, different from the first manipulation operation, with respect to the virtual object.

15. The method of claim 14 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the second user input is received within a threshold amount of time from an initiation of the first manipulation operation, the method further comprising:

in response to the detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are not satisfied, forgoing the performing of the third manipulation operation with respect to the virtual object.

16. The method of claim 1 , further comprising:

in response to detecting the first user input:

in accordance with a determination that the first user input does not include the air gesture input detected based on movement of the first portion of the user's body and includes the input from the second portion of the user's body directed to the first input device, performing a third manipulation operation, different from the first manipulation operation and the second manipulation operation, with respect to the virtual object.

17. A computer system that is in communication with a display generation component and one or more input devices including a first input device, the computer system comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, a virtual object;

while displaying the virtual object, detecting, via the one or more input devices, a first user input corresponding to manipulation of the virtual object; and

in response to detecting the first user input:

in accordance with a determination that the first user input includes an air gesture detected based on movement of a first portion of a user's body of the computer system without including input from a second portion of the user's body directed to the first input device, performing a first manipulation operation with respect to the virtual object; and

in accordance with a determination that the first user input includes an air gesture input detected based on movement of the first portion of the user's body and input from the second portion of the user's body directed to the first input device, performing a second manipulation operation, different from the first manipulation operation, with respect to the virtual object.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices including a first input device, cause the computer system to perform a method comprising:

displaying, via the display generation component, a virtual object;

while displaying the virtual object, detecting, via the one or more input devices, a first user input corresponding to manipulation of the virtual object; and

in response to detecting the first user input:

in accordance with a determination that the first user input includes an air gesture detected based on movement of a first portion of a user's body of the computer system without including input from a second portion of the user's body directed to the first input device, performing a first manipulation operation with respect to the virtual object; and

in accordance with a determination that the first user input includes an air gesture input detected based on movement of the first portion of the user's body and input from the second portion of the user's body directed to the first input device, performing a second manipulation operation, different from the first manipulation operation, with respect to the virtual object.

19. The computer system of claim 17 , wherein a respective magnitude of the first manipulation operation is based on a respective magnitude of the movement of the first portion of the user's body.

20. The computer system of claim 17 , wherein a respective direction of the first manipulation operation is based on a direction of the movement of the first portion of the user's body.

21. The computer system of claim 17 , wherein the first manipulation operation includes a movement of the virtual object relative to a three-dimensional environment, and the second manipulation operation includes a rotation of the virtual object relative to the three-dimensional environment.

22. The computer system of claim 21 , an amount of the rotation of the virtual object relative to the three-dimensional environment is based on the input from the second portion of the user's body directed to the first input device.

23. The computer system of claim 17 , wherein:

performing the first manipulation operation with respect to the virtual object includes:

in accordance with a determination that one or more first criteria are satisfied, moving the virtual object; and

in accordance with a determination that one or more second criteria are satisfied, rotating the virtual object, rotating the virtual object; and

performing the second manipulation operation with respect to the virtual object includes scaling the virtual object.

24. The computer system of claim 23 , wherein scaling the virtual object includes scaling the virtual object by a scaling magnitude, and the scaling magnitude is based on a relative movement between the first portion of the user's body and a respective portion of the first input device.

25. The computer system of claim 17 , the instructions further comprising:

while displaying, via the display generation component, the virtual object, detecting, via the one or more input devices, a respective location of attention of the user of the computer system in a three-dimensional environment, wherein:

in accordance with a determination that the first input device has a first pose relative to the virtual object, the respective location is a first location; and

in accordance with a determination that the first input device has a second pose, different from the first pose, relative to the virtual object, the respective location is a second location, different from the first location.

26. The computer system of claim 25 , the instructions further comprising:

while detecting the respective location of the attention of the user of the computer system in the three-dimensional environment:

in accordance with a determination that the respective location of the attention of the user is the first location, and in accordance with a determination that the first location corresponds to a first respective portion of the virtual object, displaying, via the display generation component, a visual indication of the attention the user at the first respective portion of the virtual object; and

in accordance with a determination that the respective location of the attention of the user is the second location, different from the first location, forgoing the displaying of the visual indication of the attention of the user at the first respective portion of the virtual object.

27. The computer system of claim 26 , the instructions further comprising:

while displaying, via the display generation component, the virtual object and the visual indication of the attention of the user at the first respective portion of the virtual object, wherein the visual indication of the attention of the user has a first visual appearance, detecting, via the one or more input devices, an indication of a second user input, different from the first user input, at the first input device; and

in response to detecting the indication of the second user input, updating display of the visual indication of the attention of the user to have a second visual appearance, different from the first visual appearance, while the visual indication of the attention of the user remains displayed at the first respective portion of the virtual object.

28. The computer system of claim 17 , the instructions further comprising:

while performing the second manipulation operation, wherein the second manipulation operation includes a rotation operation of the virtual object, displaying, via the display generation component, a visual representation of a plane of rotation corresponding to the rotation operation.

29. The computer system of claim 28 , wherein the visual representation of the plane of the rotation intersects with a respective portion of the virtual object.

30. The computer system of claim 17 , wherein:

the first manipulation operation includes one or more of a first translation operation of the virtual object, a first rotation operation of the virtual object, or a first scaling operation of the virtual object, and

the second manipulation operation includes one or more of a second translation operation of the virtual object, a second rotation operation of the virtual object, or a second scaling operation of the virtual object.

31. The computer system of claim 17 , the instructions further comprising:

while performing the first manipulation operation in accordance with input from the first portion of the user's body, detecting, via the one or more input devices, a second user input, different from the first user input, from the second portion of the user's body; and

in response to detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are satisfied, including a criterion that is satisfied when the second user input includes a second input from the second portion of the user's body directed to the first input device, ceasing performing the first manipulation operation and performing a third manipulation operation, different from the first manipulation operation, with respect to the virtual object.

32. The computer system of claim 31 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the second user input is received within a threshold amount of time from an initiation of the first manipulation operation, the instructions further comprising:

in response to the detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are not satisfied, forgoing the performing of the third manipulation operation with respect to the virtual object.

33. The computer system of claim 17 , the instructions further comprising:

in response to detecting the first user input:

in accordance with a determination that the first user input does not include the air gesture input detected based on movement of the first portion of the user's body and includes the input from the second portion of the user's body directed to the first input device, performing a third manipulation operation, different from the first manipulation operation and the second manipulation operation, with respect to the virtual object.

34. The non-transitory computer readable storage medium of claim 18 , wherein a respective magnitude of the first manipulation operation is based on a respective magnitude of the movement of the first portion of the user's body.

35. The non-transitory computer readable storage medium of claim 18 , wherein a respective direction of the first manipulation operation is based on a direction of the movement of the first portion of the user's body.

36. The non-transitory computer readable storage medium of claim 18 , wherein the first manipulation operation includes a movement of the virtual object relative to a three- dimensional environment, and the second manipulation operation includes a rotation of the virtual object relative to the three-dimensional environment.

37. The non-transitory computer readable storage medium of claim 36 , an amount of the rotation of the virtual object relative to the three-dimensional environment is based on the input from the second portion of the user's body directed to the first input device.

38. The non-transitory computer readable storage medium of claim 18 , wherein:

performing the first manipulation operation with respect to the virtual object includes:

in accordance with a determination that one or more first criteria are satisfied, moving the virtual object; and

in accordance with a determination that one or more second criteria are satisfied, rotating the virtual object, rotating the virtual object; and

performing the second manipulation operation with respect to the virtual object includes scaling the virtual object.

39. The non-transitory computer readable storage medium of claim 38 , wherein scaling the virtual object includes scaling the virtual object by a scaling magnitude, and the scaling magnitude is based on a relative movement between the first portion of the user's body and a respective portion of the first input device.

40. The non-transitory computer readable storage medium of claim 18 , the method further comprising:

while displaying, via the display generation component, the virtual object, detecting, via the one or more input devices, a respective location of attention of the user of the computer system in a three-dimensional environment, wherein:

in accordance with a determination that the first input device has a first pose relative to the virtual object, the respective location is a first location; and

in accordance with a determination that the first input device has a second pose, different from the first pose, relative to the virtual object, the respective location is a second location, different from the first location.

41. The non-transitory computer readable storage medium of claim 40 , the method further comprising:

while detecting the respective location of the attention of the user of the computer system in the three-dimensional environment:

in accordance with a determination that the respective location of the attention of the user is the first location, and in accordance with a determination that the first location corresponds to a first respective portion of the virtual object, displaying, via the display generation component, a visual indication of the attention the user at the first respective portion of the virtual object; and

in accordance with a determination that the respective location of the attention of the user is the second location, different from the first location, forgoing the displaying of the visual indication of the attention of the user at the first respective portion of the virtual object.

42. The non-transitory computer readable storage medium of claim 41 , the method further comprising:

while displaying, via the display generation component, the virtual object and the visual indication of the attention of the user at the first respective portion of the virtual object, wherein the visual indication of the attention of the user has a first visual appearance, detecting, via the one or more input devices, an indication of a second user input, different from the first user input, at the first input device; and

in response to detecting the indication of the second user input, updating display of the visual indication of the attention of the user to have a second visual appearance, different from the first visual appearance, while the visual indication of the attention of the user remains displayed at the first respective portion of the virtual object.

43. The non-transitory computer readable storage medium of claim 18 , the method further comprising:

while performing the second manipulation operation, wherein the second manipulation operation includes a rotation operation of the virtual object, displaying, via the display generation component, a visual representation of a plane of rotation corresponding to the rotation operation.

44. The non-transitory computer readable storage medium of claim 43 , wherein the visual representation of the plane of the rotation intersects with a respective portion of the virtual object.

45. The non-transitory computer readable storage medium of claim 18 , wherein:

the first manipulation operation includes one or more of a first translation operation of the virtual object, a first rotation operation of the virtual object, or a first scaling operation of the virtual object, and

the second manipulation operation includes one or more of a second translation operation of the virtual object, a second rotation operation of the virtual object, or a second scaling operation of the virtual object.

46. The non-transitory computer readable storage medium of claim 18 , the method further comprising:

while performing the first manipulation operation in accordance with input from the first portion of the user's body, detecting, via the one or more input devices, a second user input, different from the first user input, from the second portion of the user's body; and

in response to detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are satisfied, including a criterion that is satisfied when the second user input includes a second input from the second portion of the user's body directed to the first input device, ceasing performing the first manipulation operation and performing a third manipulation operation, different from the first manipulation operation, with respect to the virtual object.

47. The non-transitory computer readable storage medium of claim 46 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the second user input is received within a threshold amount of time from an initiation of the first manipulation operation, the method further comprising:

in response to the detecting, via the one or more input devices, the second user input, in accordance with a determination that one or more criteria are not satisfied, forgoing the performing of the third manipulation operation with respect to the virtual object.

48. The non-transitory computer readable storage medium of claim 18 , the method further comprising:

in response to detecting the first user input:

in accordance with a determination that the first user input does not include the air gesture input detected based on movement of the first portion of the user's body and includes the input from the second portion of the user's body directed to the first input device, performing a third manipulation operation, different from the first manipulation operation and the second manipulation operation, with respect to the virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2023
From: LINDMEIER, WILLIAM D.; KOBAYASHI, TONY; PALANGIE, ALEXIS H.; ELVEZIO, CARMINE; SUNDSTROM, MATTHEW J.
To: APPLE INC.
Reel/Frame 065003/0053 →
Continuity (3)
Provisional Application 63505409 · May 31, 2023
Provisional Application 63376913 · Sep 23, 2022
Related Publication 20240103636A1 · Mar 28, 2024
References Cited (233)
US 5015188A · Pellosie et al. · 1991 [cited by applicant]
US 5809267A · Moran et al. · 1998 [cited by applicant]
US 6167433A · Maples et al. · 2000 [cited by applicant]
US 6295069B1 · Shirur · 2001 [cited by applicant]
US 6323846B1 · Westerman et al. · 2001 [cited by applicant]
US 6426745B1 · Isaacs et al. · 2002 [cited by applicant]
US 6570557B1 · Westerman et al. · 2003 [cited by applicant]
US 6677932B1 · Westerman · 2004 [cited by applicant]
US 6750873B1 · Bernardini et al. · 2004 [cited by applicant]
US 7298370B1 · Middler et al. · 2007 [cited by applicant]
US 7614008B2 · Ording · 2009 [cited by applicant]
US 7633076B2 · Huppi et al. · 2009 [cited by applicant]
US 7653883B2 · Hotelling et al. · 2010 [cited by applicant]
US 7657849B2 · Chaudhri et al. · 2010 [cited by applicant]
US 7663607B2 · Hotelling et al. · 2010 [cited by applicant]
US 7844914B2 · Andre et al. · 2010 [cited by applicant]
US 7957762B2 · Herz et al. · 2011 [cited by applicant]
US 8006002B2 · Kalayjian et al. · 2011 [cited by applicant]
US 8239784B2 · Hotelling et al. · 2012 [cited by applicant]
US 8279180B2 · Hotelling et al. · 2012 [cited by applicant]
US 8381135B2 · Hotelling et al. · 2013 [cited by applicant]
US 8479122B2 · Hotelling et al. · 2013 [cited by applicant]
US 9294757B1 · Lewis et al. · 2016 [cited by applicant]
US 9298334B1 · Zimmerman et al. · 2016 [cited by applicant]
US 9348458B2 · Hotelling et al. · 2016 [cited by applicant]
US 9383189B2 · Bridges · 2016 [cited by examiner]
US 9396580B1 · Nowrouzezahrai et al. · 2016 [cited by applicant]
US 9519371B2 · Nishida · 2016 [cited by applicant]
US 9933937B2 · Lemay et al. · 2018 [cited by applicant]
US 10488941B2 · Lam · 2019 [cited by examiner]
US 10642368B2 · Chen · 2020 [cited by examiner]
US 10664043B2 · Ikuta · 2020 [cited by examiner]
US 10671241B1 · Jia et al. · 2020 [cited by applicant]
US 10691216B2 · Geisner · 2020 [cited by examiner]
US 10762716B1 · Paul · 2020 [cited by examiner]
US 10846864B2 · Kim · 2020 [cited by examiner]
US 11138798B2 · Paul · 2021 [cited by examiner]
US 11204678B1 · Baker et al. · 2021 [cited by applicant]
US 11249556B1 · Schwarz · 2022 [cited by examiner]
US 11262885B1 · Burckel · 2022 [cited by examiner]
US 11340756B2 · Faulkner · 2022 [cited by examiner]
US 11347319B2 · Goel · 2022 [cited by examiner]
US 11409363B2 · Chen · 2022 [cited by examiner]
US 11416080B2 · Heo · 2022 [cited by examiner]
US 11531402B1 · Stolzenberg · 2022 [cited by examiner]
US 11531459B2 · Poupyrev · 2022 [cited by examiner]
US 11557102B2 · Palangie · 2023 [cited by examiner]
US 11615596B2 · Faulkner · 2023 [cited by examiner]
US 11641460B1 · Geusz et al. · 2023 [cited by applicant]
US 11669155B2 · Bowman · 2023 [cited by examiner]
US 11762473B2 · Cipoletta · 2023 [cited by examiner]
US 11768544B2 · Schwarz · 2023 [cited by examiner]
US 11847748B2 · Liu et al. · 2023 [cited by applicant]
US 11886643B2 · Irie · 2024 [cited by examiner]
US 11899845B2 · Chung · 2024 [cited by examiner]
US 11909453B2 · Javaudin · 2024 [cited by examiner]
US 11914759B2 · Klein · 2024 [cited by examiner]
US 11928263B2 · Jung · 2024 [cited by examiner]
US 11983326B2 · Lacey · 2024 [cited by examiner]
US 11989965B2 · Tarighat Mehrabani · 2024 [cited by examiner]
US 12032803B2 · Pastrana Vicente · 2024 [cited by examiner]
US 20020015024A1 · Westerman et al. · 2002 [cited by applicant]
US 20020030692A1 · Griesert · 2002 [cited by applicant]
US 20050062738A1 · Handley et al. · 2005 [cited by applicant]
US 20050190059A1 · Wehrenberg · 2005 [cited by applicant]
US 20050248299A1 · Chemel et al. · 2005 [cited by applicant]
US 20060017692A1 · Wehrenberg et al. · 2006 [cited by applicant]
US 20060033724A1 · Chaudhri et al. · 2006 [cited by applicant]
US 20060197753A1 · Hotelling · 2006 [cited by applicant]
US 20100302245A1 · Best · 2010 [cited by applicant]
US 20110142321A1 · Huffman · 2011 [cited by applicant]
US 20120113223A1 · Hilliges · 2012 [cited by examiner]
US 20120170089A1 · Kim et al. · 2012 [cited by applicant]
US 20120249741A1 · Maciocci et al. · 2012 [cited by applicant]
US 20130222227A1 · Johansson et al. · 2013 [cited by applicant]
US 20130321462A1 · Salter et al. · 2013 [cited by applicant]
US 20130332890A1 · Ramic et al. · 2013 [cited by applicant]
US 20140040832A1 · Regelous · 2014 [cited by applicant]
US 20140078176A1 · Kim et al. · 2014 [cited by applicant]
US 20140104206A1 · Anderson · 2014 [cited by applicant]
US 20140129990A1 · Xin et al. · 2014 [cited by applicant]
US 20140333666A1 · Poulos et al. · 2014 [cited by applicant]
US 20140368620A1 · Li et al. · 2014 [cited by applicant]
US 20150067580A1 · Um et al. · 2015 [cited by applicant]
US 20150121466A1 · Brands et al. · 2015 [cited by applicant]
US 20150123901A1 · Schwesinger · 2015 [cited by examiner]
US 20150153833A1 · Pinault et al. · 2015 [cited by applicant]
US 20150317831A1 · Ebstyne et al. · 2015 [cited by applicant]
US 20150331576A1 · Piya et al. · 2015 [cited by applicant]
US 20160098093A1 · Cheon et al. · 2016 [cited by applicant]
US 20160189426A1 · Thomas et al. · 2016 [cited by applicant]
US 20160225164A1 · Tomlin et al. · 2016 [cited by applicant]
US 20160291922A1 · Montgomerie et al. · 2016 [cited by applicant]
US 20170032568A1 · Gharpure et al. · 2017 [cited by applicant]
US 20170052595A1 · Poulos et al. · 2017 [cited by applicant]
US 20170053383A1 · Heo · 2017 [cited by applicant]
US 20170178392A1 · Zuccarino et al. · 2017 [cited by applicant]
US 20170213388A1 · Margolis et al. · 2017 [cited by applicant]
US 20170221264A1 · Perry · 2017 [cited by applicant]
US 20170243352A1 · Kutliroff et al. · 2017 [cited by applicant]
US 20170251143A1 · Peruch et al. · 2017 [cited by applicant]
US 20170270715A1 · Lindsay et al. · 2017 [cited by applicant]
US 20170287215A1 · Lalonde et al. · 2017 [cited by applicant]
US 20170287225A1 · Powderly et al. · 2017 [cited by applicant]
US 20170351094A1 · Poulos et al. · 2017 [cited by applicant]
US 20180005433A1 · Kohler et al. · 2018 [cited by applicant]
US 20180088787A1 · Bereza et al. · 2018 [cited by applicant]
US 20180103209A1 · Fischler et al. · 2018 [cited by applicant]
US 20180122138A1 · Piya et al. · 2018 [cited by applicant]
US 20180130255A1 · Hazeghi et al. · 2018 [cited by applicant]
US 20180143693A1 · Calabrese et al. · 2018 [cited by applicant]
US 20180173404A1 · Smith · 2018 [cited by applicant]
US 20180197341A1 · Loberg et al. · 2018 [cited by applicant]
US 20180348986A1 · Sawaki · 2018 [cited by applicant]
US 20190018479A1 · Minami · 2019 [cited by applicant]
US 20190018498A1 · West et al. · 2019 [cited by applicant]
US 20190050062A1 · Chen et al. · 2019 [cited by applicant]
US 20190130622A1 · Hoover et al. · 2019 [cited by applicant]
US 20190155495A1 · Klein et al. · 2019 [cited by applicant]
US 20190164340A1 · Pejic et al. · 2019 [cited by applicant]
US 20190228589A1 · Dascola et al. · 2019 [cited by applicant]
US 20190340832A1 · Srinivasan et al. · 2019 [cited by applicant]
US 20190349575A1 · Knepper et al. · 2019 [cited by applicant]
US 20190362557A1 · Lacey et al. · 2019 [cited by applicant]
US 20200005539A1 · Hwang et al. · 2020 [cited by applicant]
US 20200045249A1 · Francois et al. · 2020 [cited by applicant]
US 20200048825A1 · Schultz et al. · 2020 [cited by applicant]
US 20200128227A1 · Chavez et al. · 2020 [cited by applicant]
US 20200135141A1 · Day et al. · 2020 [cited by applicant]
US 20200214682A1 · Zaslavsky et al. · 2020 [cited by applicant]
US 20200286299A1 · Wang et al. · 2020 [cited by applicant]
US 20200379626A1 · Guyomard et al. · 2020 [cited by applicant]
US 20210034163A1 · Goel · 2021 [cited by examiner]
US 20210034319A1 · Wang et al. · 2021 [cited by applicant]
US 20210225043A1 · Tang et al. · 2021 [cited by applicant]
US 20210241483A1 · Dryer et al. · 2021 [cited by applicant]
US 20210279967A1 · Gernoth et al. · 2021 [cited by applicant]
US 20210295592A1 · Von Cramon · 2021 [cited by applicant]
US 20210374221A1 · Markhasin · 2021 [cited by examiner]
US 20210383097A1 · Guerard et al. · 2021 [cited by applicant]
US 20220083145A1 · Matsunaga · 2022 [cited by examiner]
US 20220084279A1 · Lindmeier et al. · 2022 [cited by applicant]
US 20220121344A1 · Pastrana Vicente · 2022 [cited by examiner]
US 20220148257A1 · Boubekeur et al. · 2022 [cited by applicant]
US 20220253136A1 · Holder · 2022 [cited by examiner]
US 20220317776A1 · Sundstrom et al. · 2022 [cited by applicant]
US 20220326837A1 · Dessero · 2022 [cited by examiner]
US 20220335697A1 · Harding et al. · 2022 [cited by applicant]
US 20220382385A1 · Chen · 2022 [cited by examiner]
US 20220397962A1 · Goel · 2022 [cited by examiner]
US 20220408164A1 · Lee · 2022 [cited by examiner]
US 20220413691A1 · Becker et al. · 2022 [cited by applicant]
US 20220414975A1 · Becker et al. · 2022 [cited by applicant]
US 20220415094A1 · Kim · 2022 [cited by examiner]
US 20230027040A1 · Wang · 2023 [cited by examiner]
US 20230030699A1 · Zion et al. · 2023 [cited by applicant]
US 20230031832A1 · Lipton et al. · 2023 [cited by applicant]
US 20230032771A1 · Zion et al. · 2023 [cited by applicant]
US 20230076326A1 · Xu et al. · 2023 [cited by applicant]
US 20230103161A1 · Li · 2023 [cited by examiner]
US 20230119162A1 · Lipton et al. · 2023 [cited by applicant]
US 20230152935A1 · Mckenzie · 2023 [cited by examiner]
US 20230168745A1 · Yoda · 2023 [cited by examiner]
US 20230290042A1 · Casella et al. · 2023 [cited by applicant]
US 20230377259A1 · Becker et al. · 2023 [cited by applicant]
US 20230377299A1 · Becker et al. · 2023 [cited by applicant]
US 20230377300A1 · Becker et al. · 2023 [cited by applicant]
US 20240037886A1 · Chiu et al. · 2024 [cited by applicant]
US 20240104875A1 · Couche et al. · 2024 [cited by applicant]
US 20240104876A1 · Couche et al. · 2024 [cited by applicant]
US 20240233097A1 · Ngo et al. · 2024 [cited by applicant]
EP 3118722A1 · 2017 [cited by applicant]
GB 2540791A · 2017 [cited by applicant]
KR 1020140097654A · 2014 [cited by applicant]
KR 1020170027240A · 2017 [cited by applicant]
KR 1020180102171A · 2018 [cited by applicant]
KR 1020200110788A · 2020 [cited by applicant]
KR 1020200135496A · 2020 [cited by applicant]
WO 2013169849A2 · 2013 [cited by applicant]
WO 2014105276A1 · 2014 [cited by applicant]
WO 2019172678A1 · 2019 [cited by applicant]
WO 2019213111A1 · 2019 [cited by applicant]
WO 2022147146A1 · 2022 [cited by applicant]
Adding Environments, Available online at: https://manual.keyshot. com/manual/environments/adding-environments/, [retrieved on Jun. 9, 2023], 2 pages. [cited by applicant]
Area Light, Available online at: https://manual.keyshot.com/manual/materials/material-types/light-sources/area-light/, [retrieved on Jun. 9,2023], 24 pages. [cited by applicant]
Artec Leo Full 3D Scanning Demo w/ Sample Data, Digitize Designs, LLC, Available online at: < https://www.youtube.com/watch?v=ecBKo_h3Pug>, [retrieved on Sep. 1, 2022], Feb. 22, 2019, 3 pages. [cited by applicant]
Ex Parte Quayle Action received for U.S. Appl. No. 17/655,347, mailed on Jul. 8, 2024, 6 pages. [cited by applicant]
Feature Highlights, Available online at: https://manual.keyshot.com/manual/whats-new/feature-highlights/, [retrieved on Jun. 9,2023], 28 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/469,788, mailed on Nov. 16, 2023, 24 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/807,226, mailed on Nov. 30, 2023, 23 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/812,965, mailed on Jan. 31, 2024, 9 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/814,462, mailed on Nov. 1, 2024, 44 pages. [cited by applicant]
International Search Report received for PCT Patent Application No. PCT/US2021/049520, mailed on Apr. 8, 2022, 8 pages. [cited by applicant]
International Search Report received for PCT Patent Application No. PCT/US2022/071208, mailed on Aug. 18, 2022, 9 pages. [cited by applicant]
International Search Report received for PCT Patent Application No. PCT/US2023/074955, mailed on Feb. 1, 2024, 6 pages. [cited by applicant]
Light Manager, Available online at: https://manual.keyshot.com/manual/lighting/lighting-manager/, [retrieved on Jun. 9,2023], 3 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/469,788, mailed on Mar. 2, 2023, 22 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/469,788, mailed on Mar. 21, 2024, 24 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/807,226, mailed on Jun. 26, 2023, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/812,965, mailed on Jun. 8, 2023, 8 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/814,455, mailed on Feb. 16, 2024, 24 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/814,462, mailed on Feb. 1, 2024, 30 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/905,483, mailed on Mar. 27, 2024, 16 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/317,893, mailed on Apr. 25, 2024, 18 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/469,788, mailed on Oct. 15, 2024, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/655,347, mailed on Oct. 9, 2024, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/807,226, mailed on Jul. 3, 2024, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/807,236, mailed on Feb. 5, 2024, 13 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/807,236, mailed on Jul. 10, 2024, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/812,965, mailed on Jul. 26, 2024, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/812,965, mailed on Nov. 15, 2024, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/814,455, mailed on Oct. 7, 2024, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/317,893, mailed on Mar. 6, 2024, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/317,893, mailed on Nov. 22, 2023, 9 pages. [cited by applicant]
Restriction Requirement received for U.S. Appl. No. 17/905,483, mailed on Dec. 7, 2023, 7 pages. [cited by applicant]
Search Report received for United Kingdom Patent Application No. GB2210885.6, mailed on Jan. 27, 2023, 1 page. [cited by applicant]
CAS and Chary XR, Oculus Go & Your Phone As 2nd Controller!! —An Inexpensive Way To Play PC VR Games, posted on Mar. 8, 2019, https://www.youtube.com/watch?v=i_iRVa0kemw, 2019, 4 pages. [cited by applicant]
Gamedbharat, I Want to Rotate a Object on Double Tap, Can Any One Help Me With This?, posted on Jul. 26, 2017, https://discussions.unity.com/t/i-want-to-rotate-a-object-on-double-tap-can-any-one-help-me-with-this/192010… [cited by applicant]
Locher, et al., Mobile Phone and Cloud—a Dream Team for 3D Reconstruction, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), 2016, pp. 1-8. [cited by applicant]
Ro, et al., AR Pointer: Advanced Ray-Casting Interface Using Laser Pointer Metaphor for Object Manipulation in 3D Augmented Reality Environment, Applied Sciences, vol. 9, No. 3078, [retrieved on Jul. 27, 2020], Jul. 30,… [cited by applicant]
Slambekova, Dana, Gaze and Gesture Based Object Interaction in Virtual World, [retrieved on Dec. 17, 2015]. Retrieved from the Internet: < URL:https://www.cs.rit.edu/˜dxs4659/Report.pdf>, May 31, 2012, 54 pages. [cited by applicant]
Artec Leo, Artec 3D [online], Artect Europe, Available Online at: <URL: https://artec3d.com/portable-3d-scanners/artec-leo>, [retrieved on Apr. 25, 2024], 2024, 39 pages. [cited by applicant]
Curious Blocks Alternatives 12, progsoft [online]. Profsoft, Available Online at: <URL: https://progsoft.net/en/software/curious-blocks>, [retrieved on Apr. 25, 2024], 2024, 7 pages. [cited by applicant]
Kitasenju Design, X [online], X Corp., Available Online at: <URL: https://twitter.com/kitasenjudesign/status/1282665402812608513>, [retrieved on Apr. 25, 2024], 2024, 1 page. [cited by applicant]
MagicaVoxel 0.99.5 Review, YouTube [online], Google LLC, Available Online at: <URL: https://www.youtube.com/watch?v=WPPFnHQWwFk>, [retrieved on Apr. 25, 2024], 2024, 2 pages. [cited by applicant]
Open Source Voxel Editor for Windows, Mac, Linux, iOS, and Android, GOXEL [online]. Goxel by Guillaume Chereau, Available Online at: < URL: https://goxel.xyz/>, [retrieved on Apr. 25, 2024], 2024, 3 pages. [cited by applicant]
POP 2 3D Scanner (Infrared Light | Precision 0.05mm), REVPOINT [online]. Revopoint 3D,, <Url: https://global.revopoint3d.com/products/face-3d-scanner-pop2?_ga=2.182721893.277596832.1650264227-586470518.1640327512&ref=dh… [cited by applicant]
Sharevox, PHORIA [online]. Phoria Pty Ltd, Available Online at: <URL: https://www.phoria.com.au/projects/sharevox/>, [retrieved on Apr. 25, 2024], 2024, 2 pages. [cited by applicant]
VoxEdit Beta Tutorial-Introduction and How To Animate Voxel Creations, YouTube [online], Google LLC, Available Online at: <URL: https://www.youtube.com/watch?v=fqcArJWtyqM>, [retrieved on Apr. 25, 2024], 2024, 2 pages. [cited by applicant]
Voxel World Lens, Snapchat [online]. Snapchat Inc., Available Online at: <URL: https://www.snapchat.com/lens/689751dd6a7d446280d903d15d79f104?locale=en-US>, [retrieved on Apr. 25, 2024], 2024, 1 page. [cited by applicant]
Voxelize, Rossiev [online]. Denis Rossiev 2018-2024, Available Online at: < URL: https://www.rossiev.pro/voxelize/>, [retrieved on Apr. 25, 2024], 2024, 16 pages. [cited by applicant]
Qi, et al., PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space, Stanford University, Jun. 7, 2017, 14 pages. [cited by applicant]
Strand, Robin, Surface Skeletons in Grids With Non-cubic Voxels, 2004 IEEE Xplore, Available Online at: <DOI: 10.1109/ICPR.2004.1334195>, Sep. 2004, 5 pages. [cited by applicant]