IP Library › Granted Patent US 12,307,613
Granted Patent B2
US 12,307,613 · App. 18/125,600 · Granted May 20, 2025

Devices, methods, and graphical user interfaces for modifying avatars in three-dimensional environments

Inventors: Benjamin H. Boesel (Sunnyvale, CA); Rupert Burton (San Francisco, CA); Jordan A. Cazamias (San Francisco, CA); Shih-Sang Chiu (Menlo Park, CA); Jason D. Rickwald (Santa Cruz, CA); William A. Sorrentino, III (Mill Valley, CA); Nicolas V. Scapel (London, GB); Giancarlo Yerkes (San Carlos, CA)
Assignee: Apple Inc.
G06T19/006G06T13/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,613
App. No.
18/125,600
Granted
May 20, 2025
Kind
B2
Abstract

The present disclosure relates to techniques for improving a user experience for modifying display of an avatar in XR environments. In some embodiments, the techniques include modifying a portion of an avatar based on one or more heuristics. In some embodiments, the techniques include modifying a portion of an avatar after tracking is lost.

Claims (126)

1. A computer system configured to communicate with a display generation component, the computer system comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

causing a representation of a first user to be displayed, via the display generation component, in an extended reality environment, wherein the representation of the first user includes a representation of at least a respective portion of the first user that is displayed in the extended reality environment having a first pose;

receiving first data that includes data indicating a change in pose of the first user from the first pose to a second pose; and

in response to receiving the first data, causing an appearance of the representation of the first user in the extended reality environment to be updated, wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes causing a pose of the representation of the first user to be changed based on a change in pose of one or more corresponding portions of the first user, including:

in accordance with a determination that the change in pose of a first portion of the first user meets respective criteria based on a first property of the pose of the first portion of the first user meeting a first set of one or more conditions based on the first property, causing an appearance of a portion of the representation of the first user, that corresponds to the first portion of the first user, to be changed in a first manner;

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a second property of the pose of the first portion of the first user meeting a second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner, wherein the second property of the pose of the first portion of the first user is different from the first property of the pose of the first portion of the first user; and

in accordance with a determination that the change in pose of the first portion of the first user does not meet the respective criteria, forgoing causing an appearance of the portion of the representation of the first user to be changed in the first manner.

2. The computer system of claim 1 , wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes:

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a change in the first property that does not meet the first set of one or more conditions and a change in the second property that does not meet the second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner.

3. The computer system of claim 1 , wherein the first set of one or more conditions is met based on overlap of the first portion of the first user with a second portion of the first user.

4. The computer system of claim 1 , wherein the first set of one or more conditions is met based on a detected location of the first portion of the first user within a field-of-view.

5. The computer system of claim 1 , wherein the first set of one or more conditions is met based on a location of the first portion of the first user relative to the first user's head.

6. The computer system of claim 1 , wherein the first set of one or more conditions is met based on an angle of flexion of the first portion of the first user relative to a predetermined reference line.

7. The computer system of claim 6 , wherein the predetermined reference line is based on a reference point.

8. The computer system of claim 1 , wherein the first portion includes a joint of the first user, and the first set of one or more conditions is met based on an amount of flexion at the joint of the first user.

9. The computer system of claim 1 , wherein the first set of one or more conditions is met based on an orientation of the first portion of the first user.

10. The computer system of claim 1 , wherein the first set of one or more conditions is met based on a detected orientation of the first portion of the first user relative to a third portion of the first user.

11. The computer system of claim 1 , wherein the first set of one or more conditions is met based on movement of the first portion of the first user.

12. The computer system of claim 11 , wherein the first set of one or more conditions is met based on the movement and a detected location of the first portion of the first user.

13. The computer system of claim 1 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of opacity while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of opacity of the portion of the representation of the first user to be changed from the first amount of opacity to a second amount of opacity different from the first amount of opacity.

14. The computer system of claim 1 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of blur while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of blur of the portion of the representation of the first user to be changed from the first amount of blur to a second amount of blur different from the first amount of blur.

15. The computer system of claim 1 , wherein causing an appearance of the portion of the representation of the first user to be changed in the first manner includes:

in accordance with a determination that the change in appearance is a first type of change, causing the appearance of the portion of the representation of the first user to be changed at a first rate of change; and

in accordance with a determination that the change in appearance is a second type of change different from the first type of change, causing the appearance of the portion of the representation of the first user to be changed at a second rate of change different from the first rate of change.

16. The computer system of claim 1 , wherein the first portion of the first user includes a hand of the first user.

17. The computer system of claim 1 , wherein the first portion of the first user includes a forearm of the first user.

18. The computer system of claim 1 , the one or more programs further including instructions for:

in response to receiving a request to display the representation of the first user in the extended reality environment with a respective feature:

in accordance with a determination that the first data indicates that the representation of the first user should be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment with the portion of the representation of the first user and the respective feature; and

in accordance with a determination that the first data indicates that the representation of the first user should not be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment without the respective feature.

19. The computer system of claim 1 , wherein:

the first portion of the first user includes a first shoulder of the first user; and

the portion of the representation of the first user includes a representation of the first shoulder.

20. The computer system of claim 19 , the one or more programs further including instructions for:

in response to detecting first update data corresponding to a request to update display of the representation of the first user, causing the display of the representation of the first user to be updated, including:

in accordance with a determination that the first update data indicates a changed appearance of the representation of the first shoulder, causing an appearance of the representation of the first shoulder to be changed without causing an appearance of a representation of a second shoulder to be changed; and

in accordance with a determination that the first update data indicates a changed appearance of a representation of a second shoulder, causing an appearance of the representation of the second shoulder to be changed without causing an appearance of the representation of the first shoulder to be changed.

21. The computer system of claim 19 , the one or more programs further including instructions for:

in response to detecting second update data corresponding to a request to update display of the representation of the first user to include a changed appearance of the representation of the first shoulder and a changed appearance of a representation of a first hand, causing the display of the representation of the first user to be updated, including:

causing the appearance of the representation of the first hand to be changed at a first point in time after detecting the second update data; and

causing the appearance of the representation of the first shoulder to be changed at a second point in time after detecting the second update data that is later than the first point in time.

22. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for:

causing a representation of a first user to be displayed, via the display generation component, in an extended reality environment, wherein the representation of the first user includes a representation of at least a respective portion of the first user that is displayed in the extended reality environment having a first pose;

receiving first data that includes data indicating a change in pose of the first user from the first pose to a second pose; and

in response to receiving the first data, causing an appearance of the representation of the first user in the extended reality environment to be updated, wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes causing a pose of the representation of the first user to be changed based on a change in pose of one or more corresponding portions of the first user, including:

in accordance with a determination that the change in pose of a first portion of the first user meets respective criteria based on a first property of the pose of the first portion of the first user meeting a first set of one or more conditions based on the first property, causing an appearance of a portion of the representation of the first user, that corresponds to the first portion of the first user, to be changed in a first manner;

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a second property of the pose of the first portion of the first user meeting a second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner, wherein the second property of the pose of the first portion of the first user is different from the first property of the pose of the first portion of the first user; and

in accordance with a determination that the change in pose of the first portion of the first user does not meet the respective criteria, forgoing causing an appearance of the portion of the representation of the first user to be changed in the first manner.

23. A method, comprising:

at a computer system that is in communication with a display generation component:

causing a representation of a first user to be displayed, via the display generation component, in an extended reality environment, wherein the representation of the first user includes a representation of at least a respective portion of the first user that is displayed in the extended reality environment having a first pose;

receiving first data that includes data indicating a change in pose of the first user from the first pose to a second pose; and

in response to receiving the first data, causing an appearance of the representation of the first user in the extended reality environment to be updated, wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes causing a pose of the representation of the first user to be changed based on a change in pose of one or more corresponding portions of the first user, including:

in accordance with a determination that the change in pose of a first portion of the first user meets respective criteria based on a first property of the pose of the first portion of the first user meeting a first set of one or more conditions based on the first property, causing an appearance of a portion of the representation of the first user, that corresponds to the first portion of the first user, to be changed in a first manner;

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a second property of the pose of the first portion of the first user meeting a second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner, wherein the second property of the pose of the first portion of the first user is different from the first property of the pose of the first portion of the first user; and

in accordance with a determination that the change in pose of the first portion of the first user does not meet the respective criteria, forgoing causing an appearance of the portion of the representation of the first user to be changed in the first manner.

24. The non-transitory computer-readable storage medium of claim 22 , wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes:

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a change in the first property that does not meet the first set of one or more conditions and a change in the second property that does not meet the second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner.

25. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on overlap of the first portion of the first user with a second portion of the first user.

26. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on a detected location of the first portion of the first user within a field-of-view.

27. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on a location of the first portion of the first user relative to the first user's head.

28. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on an angle of flexion of the first portion of the first user relative to a predetermined reference line.

29. The non-transitory computer-readable storage medium of claim 28 , wherein the predetermined reference line is based on a reference point.

30. The non-transitory computer-readable storage medium of claim 22 , wherein the first portion includes a joint of the first user, and the first set of one or more conditions is met based on an amount of flexion at the joint of the first user.

31. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on an orientation of the first portion of the first user.

32. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on a detected orientation of the first portion of the first user relative to a third portion of the first user.

33. The non-transitory computer-readable storage medium of claim 22 , wherein the first set of one or more conditions is met based on movement of the first portion of the first user.

34. The non-transitory computer-readable storage medium of claim 33 , wherein the first set of one or more conditions is met based on the movement and a detected location of the first portion of the first user.

35. The non-transitory computer-readable storage medium of claim 22 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of opacity while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of opacity of the portion of the representation of the first user to be changed from the first amount of opacity to a second amount of opacity different from the first amount of opacity.

36. The non-transitory computer-readable storage medium of claim 22 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of blur while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of blur of the portion of the representation of the first user to be changed from the first amount of blur to a second amount of blur different from the first amount of blur.

37. The non-transitory computer-readable storage medium of claim 22 , wherein causing an appearance of the portion of the representation of the first user to be changed in the first manner includes:

in accordance with a determination that the change in appearance is a first type of change, causing the appearance of the portion of the representation of the first user to be changed at a first rate of change; and

in accordance with a determination that the change in appearance is a second type of change different from the first type of change, causing the appearance of the portion of the representation of the first user to be changed at a second rate of change different from the first rate of change.

38. The non-transitory computer-readable storage medium of claim 22 , wherein the first portion of the first user includes a hand of the first user.

39. The non-transitory computer-readable storage medium of claim 22 , wherein the first portion of the first user includes a forearm of the first user.

40. The non-transitory computer-readable storage medium of claim 22 , the one or more programs further including instructions for:

in response to receiving a request to display the representation of the first user in the extended reality environment with a respective feature:

in accordance with a determination that the first data indicates that the representation of the first user should be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment with the portion of the representation of the first user and the respective feature; and

in accordance with a determination that the first data indicates that the representation of the first user should not be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment without the respective feature.

41. The non-transitory computer-readable storage medium of claim 22 , wherein:

the first portion of the first user includes a first shoulder of the first user; and

the portion of the representation of the first user includes a representation of the first shoulder.

42. The non-transitory computer-readable storage medium of claim 41 , the one or more programs further including instructions for:

in response to detecting first update data corresponding to a request to update display of the representation of the first user, causing the display of the representation of the first user to be updated, including:

in accordance with a determination that the first update data indicates a changed appearance of the representation of the first shoulder, causing an appearance of the representation of the first shoulder to be changed without causing an appearance of a representation of a second shoulder to be changed; and

in accordance with a determination that the first update data indicates a changed appearance of a representation of a second shoulder, causing an appearance of the representation of the second shoulder to be changed without causing an appearance of the representation of the first shoulder to be changed.

43. The non-transitory computer-readable storage medium of claim 41 , the one or more programs further including instructions for:

in response to detecting second update data corresponding to a request to update display of the representation of the first user to include a changed appearance of the representation of the first shoulder and a changed appearance of a representation of a first hand, causing the display of the representation of the first user to be updated, including:

causing the appearance of the representation of the first hand to be changed at a first point in time after detecting the second update data; and

causing the appearance of the representation of the first shoulder to be changed at a second point in time after detecting the second update data that is later than the first point in time.

44. The method of claim 23 , wherein causing the appearance of the representation of the first user in the extended reality environment to be updated includes:

in accordance with a determination that the change in pose of the first portion of the first user meets the respective criteria based on a change in the first property that does not meet the first set of one or more conditions and a change in the second property that does not meet the second set of one or more conditions, causing an appearance of the portion of the representation of the first user to be changed in the first manner.

45. The method of claim 23 , wherein the first set of one or more conditions is met based on overlap of the first portion of the first user with a second portion of the first user.

46. The method of claim 23 , wherein the first set of one or more conditions is met based on a detected location of the first portion of the first user within a field-of-view.

47. The method of claim 23 , wherein the first set of one or more conditions is met based on a location of the first portion of the first user relative to the first user's head.

48. The method of claim 23 , wherein the first set of one or more conditions is met based on an angle of flexion of the first portion of the first user relative to a predetermined reference line.

49. The method of claim 48 , wherein the predetermined reference line is based on a reference point.

50. The method of claim 23 , wherein the first portion includes a joint of the first user, and the first set of one or more conditions is met based on an amount of flexion at the joint of the first user.

51. The method of claim 23 , wherein the first set of one or more conditions is met based on an orientation of the first portion of the first user.

52. The method of claim 23 , wherein the first set of one or more conditions is met based on a detected orientation of the first portion of the first user relative to a third portion of the first user.

53. The method of claim 23 , wherein the first set of one or more conditions is met based on movement of the first portion of the first user.

54. The method of claim 53 , wherein the first set of one or more conditions is met based on the movement and a detected location of the first portion of the first user.

55. The method of claim 23 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of opacity while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of opacity of the portion of the representation of the first user to be changed from the first amount of opacity to a second amount of opacity different from the first amount of opacity.

56. The method of claim 23 , wherein the portion of the representation of the first user is displayed in the extended reality environment having a first amount of blur while having the first pose, and causing an appearance of the portion of the representation of the first user to be changed in the first manner includes causing an amount of blur of the portion of the representation of the first user to be changed from the first amount of blur to a second amount of blur different from the first amount of blur.

57. The method of claim 23 , wherein causing an appearance of the portion of the representation of the first user to be changed in the first manner includes:

in accordance with a determination that the change in appearance is a first type of change, causing the appearance of the portion of the representation of the first user to be changed at a first rate of change; and

in accordance with a determination that the change in appearance is a second type of change different from the first type of change, causing the appearance of the portion of the representation of the first user to be changed at a second rate of change different from the first rate of change.

58. The method of claim 23 , wherein the first portion of the first user includes a hand of the first user.

59. The method of claim 23 , wherein the first portion of the first user includes a forearm of the first user.

60. The method of claim 23 , further comprising:

in response to receiving a request to display the representation of the first user in the extended reality environment with a respective feature:

in accordance with a determination that the first data indicates that the representation of the first user should be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment with the portion of the representation of the first user and the respective feature; and

in accordance with a determination that the first data indicates that the representation of the first user should not be displayed with the portion of the representation of the first user that corresponds to the first portion of the first user, causing the representation of the first user to be displayed in the extended reality environment without the respective feature.

61. The method of claim 23 , wherein:

the first portion of the first user includes a first shoulder of the first user; and

the portion of the representation of the first user includes a representation of the first shoulder.

62. The method of claim 61 , further comprising:

in response to detecting first update data corresponding to a request to update display of the representation of the first user, causing the display of the representation of the first user to be updated, including:

in accordance with a determination that the first update data indicates a changed appearance of the representation of the first shoulder, causing an appearance of the representation of the first shoulder to be changed without causing an appearance of a representation of a second shoulder to be changed; and

in accordance with a determination that the first update data indicates a changed appearance of a representation of a second shoulder, causing an appearance of the representation of the second shoulder to be changed without causing an appearance of the representation of the first shoulder to be changed.

63. The method of claim 61 , further comprising:

in response to detecting second update data corresponding to a request to update display of the representation of the first user to include a changed appearance of the representation of the first shoulder and a changed appearance of a representation of a first hand, causing the display of the representation of the first user to be updated, including:

causing the appearance of the representation of the first hand to be changed at a first point in time after detecting the second update data; and

causing the appearance of the representation of the first shoulder to be changed at a second point in time after detecting the second update data that is later than the first point in time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: BOESEL, BENJAMIN H.; CAZAMIAS, JORDAN A.; BURTON, RUPERT; SCAPEL, NICOLAS V.; CHIU, SHIH-SANG; RICKWALD, JASON D.; SORRENTINO, WILLIAM A., III; YERKES, GIANCARLO
To: APPLE INC.
Reel/Frame 064483/0185 →
Continuity (2)
Provisional Application 63327552 · Apr 5, 2022
Related Publication 20230316674A1 · Oct 5, 2023
References Cited (101)
US 9035999B2 · Carpenter et al. · 2015 [cited by applicant]
US 9298257B2 · Hwang et al. · 2016 [cited by applicant]
US 9547763B1 · Avital · 2017 [cited by applicant]
US 9686466B1 · Billinghurst et al. · 2017 [cited by applicant]
US 10135965B2 · Woolsey et al. · 2018 [cited by applicant]
US 10176808B1 · Lovitt et al. · 2019 [cited by applicant]
US 10235408B1 · Lao et al. · 2019 [cited by applicant]
US 10811055B1 · Kimber et al. · 2020 [cited by applicant]
US 10861248B2 · Scapel · 2020 [cited by examiner]
US 11282174B1 · Demaio · 2022 [cited by applicant]
US 20020135581A1 · Russell et al. · 2002 [cited by applicant]
US 20070003915A1 · Templeman · 2007 [cited by applicant]
US 20090254843A1 · Van et al. · 2009 [cited by applicant]
US 20100035682A1 · Gentile et al. · 2010 [cited by applicant]
US 20110009241A1 · Lane et al. · 2011 [cited by applicant]
US 20110025689A1 · Perez et al. · 2011 [cited by applicant]
US 20110175809A1 · Markovic et al. · 2011 [cited by applicant]
US 20130015946A1 · Lau et al. · 2013 [cited by applicant]
US 20130227651A1 · Schultz et al. · 2013 [cited by applicant]
US 20140168217A1 · Kim et al. · 2014 [cited by applicant]
US 20140267311A1 · Evertt et al. · 2014 [cited by applicant]
US 20140270351A1 · Hoof et al. · 2014 [cited by applicant]
US 20160110593A1 · Hoof et al. · 2016 [cited by applicant]
US 20180365904A1 · Holmes · 2018 [cited by applicant]
US 20190080066A1 · Van Os et al. · 2019 [cited by applicant]
US 20190088018A1 · Shenton et al. · 2019 [cited by applicant]
US 20190094981A1 · Bradski et al. · 2019 [cited by applicant]
US 20190096106A1 · Shapiro et al. · 2019 [cited by applicant]
US 20190160378A1 · Fajt et al. · 2019 [cited by applicant]
US 20190278894A1 · Andalo et al. · 2019 [cited by applicant]
US 20200051304A1 · Choi · 2020 [cited by examiner]
US 20200082135A1 · Tagawa et al. · 2020 [cited by applicant]
US 20200110864A1 · Casado et al. · 2020 [cited by applicant]
US 20200134383A1 · Rhee et al. · 2020 [cited by applicant]
US 20200193669A1 · Churchill · 2020 [cited by examiner]
US 20210019541A1 · Wang et al. · 2021 [cited by applicant]
US 20210089136A1 · Hossain et al. · 2021 [cited by applicant]
US 20210097766A1 · Palangie et al. · 2021 [cited by applicant]
US 20210110015A1 · McCarty et al. · 2021 [cited by applicant]
US 20210312167A1 · Shirai · 2021 [cited by applicant]
US 20210382544A1 · Butcher · 2021 [cited by examiner]
US 20210407215A1 · Evangelista et al. · 2021 [cited by applicant]
US 20220012922A1 · Ishikawa · 2022 [cited by applicant]
US 20220020220A1 · Lehman · 2022 [cited by applicant]
US 20220083636A1 · Sarkis et al. · 2022 [cited by applicant]
US 20220084279A1 · Lindmeier et al. · 2022 [cited by applicant]
US 20220105389A1 · Lianides · 2022 [cited by examiner]
US 20220134234A1 · Sachson et al. · 2022 [cited by applicant]
US 20220147148A1 · Begley · 2022 [cited by applicant]
US 20220262080A1 · Burton et al. · 2022 [cited by applicant]
US 20220366626A1 · Miller et al. · 2022 [cited by applicant]
US 20230103161A1 · Li et al. · 2023 [cited by applicant]
US 20230229283A1 · Long et al. · 2023 [cited by applicant]
US 20240077937A1 · Rickwald et al. · 2024 [cited by applicant]
EP 2492873B1 · 2013 [cited by applicant]
EP 3627450A1 · 2020 [cited by applicant]
EP 3537378B1 · 2021 [cited by applicant]
JP 200827086A · 2008 [cited by applicant]
JP 2012223357A · 2012 [cited by applicant]
JP 2016528571A · 2016 [cited by applicant]
JP 2020525868A · 2020 [cited by applicant]
JP 2020156919A · 2020 [cited by applicant]
KR 1020200117685A · 2020 [cited by applicant]
WO 2015064144A1 · 2015 [cited by applicant]
WO 2017043314A1 · 2017 [cited by applicant]
WO 2018226265A1 · 2018 [cited by applicant]
WO 2020075308A1 · 2020 [cited by applicant]
WO 2020129959A1 · 2020 [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/667,350, mailed on Jan. 18, 2024, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/667,350, mailed on May 31, 2023, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/667,350, mailed on Sep. 20, 2023, 4 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/667,350, mailed on Jul. 26, 2023, 19 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/667,350, mailed on Mar. 21, 2024, 19 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/016451, mailed on Aug. 31, 2023, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/017484, mailed on Aug. 28, 2023, 28 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/031979, mailed on Mar. 12, 2024, 16 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/017484, mailed on Jul. 7, 2023, 20 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/031979, mailed on Jan. 19, 2024, 9 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/667,350, mailed on Apr. 21, 2023, 16 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/667,350, mailed on Oct. 12, 2023, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/944,911, mailed on Dec. 26, 2023, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/944,911, mailed on Mar. 26, 2024, 11 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2023-548256, mailed on Aug. 5, 2024, 8 pages (4 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/241,802, mailed on Jul. 17, 2024, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/667,350, mailed on Jul. 8, 2024, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/944,911, mailed on Jul. 9, 2024, 10 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/667,350, mailed on May 24, 2024, 4 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/241,802, mailed on May 17, 2024, 57 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/241,802, mailed on Oct. 22, 2024, 9 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/017484, mailed on Oct. 17, 2024, 21 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/241,802, mailed on Oct. 8, 2024, 11 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/016451, mailed on Aug. 25, 2022, 9 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/016451, mailed on Jun. 24, 2022, 18 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/044194, mailed on Feb. 13, 2023, 18 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2022/044194, mailed on Dec. 15, 2022, 10 pages. [cited by applicant]
Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2022/016451, mailed on Apr. 28, 2022, 11 pages. [cited by applicant]
Chan et al., “FrontFace”, Facilitating Communication Between HMD Users and Outsiders Using Front-Facing-Screen HMDs, Sep. 4-7, 2017, 5 pages. [cited by applicant]
Mai et al., “Frontal Screens on Head-Mounted Displays to Increase Awareness of the HMD Users' State in Mixed Presence Collaboration”, May 15, 2019, 10 pages. [cited by applicant]
Mai et al., “TransparentHMD”, Revealing the HMD User's Face to Bystanders, Nov. 26-29, 2017, 6 pages. [cited by applicant]
Rekimoto et al., “Behind-the-Mask”, A Face-Through Head-Mounted Display, 18, May 29-Jun. 1, 2018, 5 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/044194, mailed on Apr. 4, 2024, 12 pages. [cited by applicant]