IP Library Granted Patent US 12,045,923
Granted Patent B2
US 12,045,923 · App. 18/071,434 · Granted Jul 23, 2024

Emoji recording and sending

Inventors: Guillaume Pierre André Barlier (Sunnyvale, CA); Aurelio Guzman (San Jose, CA); Nicolas Scapel (London, GB)
Assignee: Apple Inc.
G06T13/40G06F3/012G06F3/0484G06F3/04842G06V40/166G06V40/176H04M1/72436G06F3/04886G06V40/161H04L51/04H04M1/72439H04M2250/52H04N23/611H04N23/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,045,923
App. No.
18/071,434
Granted
Jul 23, 2024
Kind
B2
Abstract

The present disclosure generally relates to generating and modifying virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.

Claims (210)

1. A method, comprising:

at an electronic device having one or more cameras and a display apparatus:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the virtual avatar is based on a first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature; and

in accordance with a determination that the virtual avatar is based on a second virtual avatar template that is different from the first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature; and

in accordance with a determination that the detected first change in the respective physical feature is a change in the second physical feature, modifying the second avatar feature to reflect the first change in the second physical feature, wherein the appearance of the second avatar feature is changed in a same manner without regard to whether the change in the second physical feature is within the first range of changes or within the second range of changes.

2. The method of claim 1 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a potential range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the first range of changes to a second portion of change within the second range of changes, and

an appearance of the second avatar feature as it is reflecting the change in the second physical feature at an end of the first portion of the change is substantially similar to an appearance of the second avatar feature as it is reflecting the change in the second physical feature at a beginning of the second portion of change.

3. The method of claim 1 , further comprising:

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is a change from the first range of changes to the second range of changes, modifying the second avatar feature based on a predetermined configuration of the second avatar feature.

4. The method of claim 1 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a possible range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the second range of changes to a second portion of change within the first range of changes, and

an appearance of the second avatar feature changes from a configuration of the second avatar feature that is based on a magnitude of a change in the second physical feature to a predetermined configuration of the second avatar feature when the change in the second physical feature transitions from the first portion of the change within the second range of changes to the second portion of the change within the first range of changes.

5. The method of claim 1 , further comprising:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature.

6. The method of claim 5 , wherein the first manner of changing the appearance of the second avatar feature is different from the second manner of changing the appearance of the second avatar feature.

7. The method of claim 5 , further comprising:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, forgoing changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature.

8. The method of claim 5 , wherein:

the second physical feature includes a user's eyelid;

the second avatar feature includes an avatar eye;

changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes decreasing a size of the avatar eye; and

changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include decreasing the size of the avatar eye.

9. The method of claim 5 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying the first avatar feature based on a magnitude of the change in the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a first magnitude of the change in the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a second magnitude of the change in the second physical feature.

10. The method of claim 5 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying a pose of at least a portion of the first avatar feature based on a direction of a change in pose of the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying a pose of at least a portion of the second avatar feature based on a direction of a change in pose of the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the pose of at least a portion of the second avatar feature based on the direction of the change in pose of the second physical feature.

11. An electronic device, comprising:

one or more cameras;

a display apparatus;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the virtual avatar is based on a first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature; and

in accordance with a determination that the virtual avatar is based on a second virtual avatar template that is different from the first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature; and

in accordance with a determination that the detected first change in the respective physical feature is a change in the second physical feature, modifying the second avatar feature to reflect the first change in the second physical feature, wherein the appearance of the second avatar feature is changed in a same manner without regard to whether the change in the second physical feature is within the first range of changes or within the second range of changes.

12. The electronic device of claim 11 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a potential range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the first range of changes to a second portion of change within the second range of changes, and

an appearance of the second avatar feature as it is reflecting the change in the second physical feature at an end of the first portion of the change is substantially similar to an appearance of the second avatar feature as it is reflecting the change in the second physical feature at a beginning of the second portion of change.

13. The electronic device of claim 11 , the one or more programs further including instructions for:

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is a change from the first range of changes to the second range of changes, modifying the second avatar feature based on a predetermined configuration of the second avatar feature.

14. The electronic device of claim 11 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a possible range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the second range of changes to a second portion of change within the first range of changes, and

an appearance of the second avatar feature changes from a configuration of the second avatar feature that is based on a magnitude of a change in the second physical feature to a predetermined configuration of the second avatar feature when the change in the second physical feature transitions from the first portion of the change within the second range of changes to the second portion of the change within the first range of changes.

15. The electronic device of claim 11 , the one or more programs further including instructions for:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature.

16. The electronic device of claim 15 , wherein the first manner of changing the appearance of the second avatar feature is different from the second manner of changing the appearance of the second avatar feature.

17. The electronic device of claim 15 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying the first avatar feature based on a magnitude of the change in the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a first magnitude of the change in the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a second magnitude of the change in the second physical feature.

18. The electronic device of claim 15 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying a pose of at least a portion of the first avatar feature based on a direction of a change in pose of the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying a pose of at least a portion of the second avatar feature based on a direction of a change in pose of the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the pose of at least a portion of the second avatar feature based on the direction of the change in pose of the second physical feature.

19. The electronic device of claim 15 , the one or more programs further including instructions for:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, forgoing changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature.

20. The electronic device of claim 19 , wherein:

the second physical feature includes a user's eyelid;

the second avatar feature includes an avatar eye;

changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes decreasing a size of the avatar eye; and

changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include decreasing the size of the avatar eye.

21. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more cameras and a display apparatus, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the virtual avatar is based on a first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature; and

in accordance with a determination that the virtual avatar is based on a second virtual avatar template that is different from the first virtual avatar template:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature; and

in accordance with a determination that the detected first change in the respective physical feature is a change in the second physical feature, modifying the second avatar feature to reflect the first change in the second physical feature, wherein the appearance of the second avatar feature is changed in a same manner without regard to whether the change in the second physical feature is within the first range of changes or within the second range of changes.

22. The non-transitory computer-readable storage medium of claim 21 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a potential range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the first range of changes to a second portion of change within the second range of changes, and

an appearance of the second avatar feature as it is reflecting the change in the second physical feature at an end of the first portion of the change is substantially similar to an appearance of the second avatar feature as it is reflecting the change in the second physical feature at a beginning of the second portion of change.

23. The non-transitory computer-readable storage medium of claim 21 , the one or more programs further including instructions for:

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is a change from the first range of changes to the second range of changes, modifying the second avatar feature based on a predetermined configuration of the second avatar feature.

24. The non-transitory computer-readable storage medium of claim 21 , wherein:

the first range of changes of the second physical feature and the second range of changes of the second physical feature are adjacent ranges in a possible range of changes of the second physical feature,

the first change in the respective physical feature includes a change in the second physical feature that includes a transition from a first portion of change within the second range of changes to a second portion of change within the first range of changes, and

an appearance of the second avatar feature changes from a configuration of the second avatar feature that is based on a magnitude of a change in the second physical feature to a predetermined configuration of the second avatar feature when the change in the second physical feature transitions from the first portion of the change within the second range of changes to the second portion of the change within the first range of changes.

25. The non-transitory computer-readable storage medium of claim 21 , the one or more programs further including instructions for:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature.

26. The non-transitory computer-readable storage medium of claim 25 , wherein the first manner of changing the appearance of the second avatar feature is different from the second manner of changing the appearance of the second avatar feature.

27. The non-transitory computer-readable storage medium of claim 25 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying the first avatar feature based on a magnitude of the change in the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a first magnitude of the change in the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the second avatar feature based on a second magnitude of the change in the second physical feature.

28. The non-transitory computer-readable storage medium of claim 25 , wherein:

modifying the first avatar feature of the virtual avatar to reflect the change in the first physical feature includes modifying a pose of at least a portion of the first avatar feature based on a direction of a change in pose of the first physical feature;

changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature includes modifying a pose of at least a portion of the second avatar feature based on a direction of a change in pose of the second physical feature; and

changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature includes modifying the pose of at least a portion of the second avatar feature based on the direction of the change in pose of the second physical feature.

29. The non-transitory computer-readable storage medium of claim 25 , the one or more programs further including instructions for:

further in response to detecting the first change in the respective physical feature:

in accordance with a determination that the virtual avatar is based on the first virtual avatar template:

in accordance with the determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, forgoing changing the appearance of the second avatar feature in the second manner to reflect the change in the second physical feature.

30. The non-transitory computer-readable storage medium of claim 29 , wherein:

the second physical feature includes a user's eyelid;

the second avatar feature includes an avatar eye;

changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes decreasing a size of the avatar eye; and

changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include decreasing the size of the avatar eye.

31. A method, comprising:

at an electronic device having one or more cameras and a display apparatus:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's cheek and the second avatar feature includes an avatar cheek;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the avatar cheek, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes includes modifying the avatar cheek based on a magnitude of change in the user's cheek.

32. An electronic device, comprising:

one or more cameras;

a display apparatus;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's cheek and the second avatar feature includes an avatar cheek;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the avatar cheek, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes includes modifying the avatar cheek based on a magnitude of change in the user's cheek.

33. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more cameras and a display apparatus, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's cheek and the second avatar feature includes an avatar cheek;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the avatar cheek, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes includes modifying the avatar cheek based on a magnitude of change in the user's cheek.

34. A method, comprising:

at an electronic device having one or more cameras and a display apparatus:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's eyebrow and the second avatar feature includes an upper portion of the avatar's head;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the upper portion of the avatar's head, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include introducing the exaggerated avatar effect at the upper portion of the avatar's head.

35. An electronic device, comprising:

one or more cameras;

a display apparatus;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's eyebrow and the second avatar feature includes an upper portion of the avatar's head;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the upper portion of the avatar's head, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include introducing the exaggerated avatar effect at the upper portion of the avatar's head.

36. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more cameras and a display apparatus, the one or more programs including instructions for:

displaying, via the display apparatus, a virtual avatar, wherein the virtual avatar includes:

a first avatar feature reactive to changes in a first physical feature of a face within a field of view of the one or more cameras;

a second avatar feature that is reactive in different manners to changes in a second physical feature of the face dependent on whether the changes in the second physical feature of the face occur in a first range of changes of the second physical feature or in a second range of changes of the second physical feature, different from the first range of changes of the second physical feature, wherein the second physical feature of the face includes a user's eyebrow and the second avatar feature includes an upper portion of the avatar's head;

while displaying the virtual avatar, detecting a first change in a respective physical feature of the face within the field of view of the one or more cameras; and

in response to detecting the first change in the respective physical feature, modifying the virtual avatar, including:

in accordance with a determination that the detected first change in the respective physical feature is a change in the first physical feature, modifying the first avatar feature to reflect the change in the first physical feature;

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the first range of changes, changing the appearance of the second avatar feature in a first manner to reflect the change in the second physical feature; and

in accordance with a determination that the detected first change is a change in the second physical feature and the change in the second physical feature is within the second range of changes, forgoing changing the appearance of the second avatar feature in the first manner to reflect the change in the second physical feature and changing the appearance of the second avatar feature in a second manner to reflect the change in the second physical feature;

wherein changing the appearance of the second avatar feature in the second manner based on the change in the second physical feature being within the second range of changes includes introducing an exaggerated avatar effect at the upper portion of the avatar's head, and changing the appearance of the second avatar feature in the first manner based on the change in the second physical feature being within the first range of changes does not include introducing the exaggerated avatar effect at the upper portion of the avatar's head.

Continuity (9)
Continuation 17220752 · Apr 1, 2021
Continuation 16896457 · Jun 9, 2020
Continuation 16676087 · Nov 6, 2019
Continuation 15981754 · May 16, 2018
Provisional Application 62671979 · May 15, 2018
Provisional Application 62557121 · Sep 11, 2017
Provisional Application 62556412 · Sep 9, 2017
Provisional Application 62507177 · May 16, 2017
Related Publication 20230090342A1 · Mar 23, 2023
Cited By (10)
US 1,061,565 US 1,061,566 US 1,061,567 US 1,061,568 US 1,061,569 US 1,061,610 US 1,061,613 US 1,061,614 US 1,061,615 US 12,367,635