IP Library › Granted Patent US 11,416,134

Granted Patent B1

US 11,416,134 · App. 17/484,321 · Granted Aug 16, 2022

User interfaces for altering visual media

Inventors: Behkish J. Manzari (San Francisco, CA); Graham R. Clarke (Scotts Valley, CA); Toke Jansen (Cupertino, CA); Joseph A. Malia (San Francisco, CA); Andre Souza Dos Santos (San Jose, CA); William A. Sorrentino, III (Mill Valley, CA); Saumitro Dasgupta (Redwood City, CA); Wayne Loofbourrow (San Jose, CA); Seyyedhossein Mousavi (Millbrae, CA); Jens Jacob Pallisgaard (Santa Clara, CA); Paul Thomas Schneider (Palo Alto, CA); Joshua Blake Shagam (Redwood City, CA); Piotr J. Stanczyk (San Francisco, CA); Hjalte Wedel Vildhoej (Sunnyvale, CA)

Assignee: Apple Inc.

G06F3/04845 G06F3/0481 G06F3/04842 G11B27/031 G11B27/102 G11B27/34

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,416,134
App. No.: 17/484,321
Filed: Sep 24, 2021
Granted: Aug 16, 2022
Kind: B1
Examiner: HUNTER, MISHAWN N
Art Unit: 2484
USPC: 386/280

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

The present disclosure generally relates to user interfaces for altering visual media. In some embodiments, user interfaces capturing visual media (e.g., via a synthetic depth-of-field effect), playing back visual media (e.g., via a synthetic depth-of-field effect), editing visual media (e.g., that has a synthetic depth-of-field effect applied), and/or managing media capture.

Claims (201)

1. A computer system configured to communicate with a display generation component, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

playing, via the display generation component, a portion of a video that includes a first subject emphasis change that occurs at a first time, wherein the first subject emphasis change includes a change in appearance of visual information captured by one or more cameras to emphasize a respective subject relative to one or more elements in the video during a first period of time that follows the first time;

after playing the portion of the video that includes the first subject emphasis change that occurs at the first time, detecting a request to change subject emphasis at a second time in the video that is different from the first time; and

in response to detecting the request to change subject emphasis at the second time in the video:

changing the subject emphasis in the video during a second period of time that follows the second time; and

changing the first subject emphasis change that occurs at the first time including changing the emphasis of the respective subject relative to the one or more elements in the video during the first period of time that follows the first time.

2. The computer system of claim 1 , wherein:

before detecting the request to change subject emphasis at the second time, the video includes a second subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes removing the second subject emphasis change that occurs at the second time.

3. The computer system of claim 2 , the one or more programs further including instructions for:

before detecting the request to change subject emphasis at the second time, displaying a first graphical user interface object indicating that the second subject emphasis change that occurs at the second time, wherein detecting the request to change subject emphasis that occurs at the second time includes:

while displaying the first graphical user interface object, detecting an input directed to the first graphical user interface object;

in response to detecting the input directed to the first graphical user interface object, displaying an option to remove the second subject emphasis change that occurs at the second time; and

while displaying the option to remove the second subject emphasis change that occurs at the second time, detecting an input directed to the option to remove the second subject emphasis change that occurs at the second time; and

in response to detecting the input directed to the option to remove the second subject emphasis change that occurs at the second time, changing the subject emphasis in the video during the second period of time that follows the second time by removing the second subject emphasis change that occurs at the second time.

4. The computer system of claim 3 , wherein:

before detecting the input directed to the first graphical user interface object, the first graphical user interface object is displayed concurrently with a video navigation user interface element with a first amount of visual emphasis; and

the option to remove the second subject emphasis change that occurs at the second time in response to detecting the input directed to the first graphical user interface object is concurrently displayed with the video navigation user interface element with a second amount of visual emphasis that is less than the first amount of visual emphasis.

5. The computer system of claim 1 , wherein:

before detecting the request to change subject emphasis at the second time, the video does not include a subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes adding a third subject emphasis change that occurs at the second time.

6. The computer system of claim 1 , wherein:

detecting the request to change subject emphasis that occurs at the second time includes detecting a first type of input that is directed to a first representation of the video, wherein the first type of input is a first input to select a first fixed focal plane in the video; and

changing the subject emphasis in the video during the second period of time that follows the second time includes applying a synthetic depth-of-field effect to the first fixed focal plane in a first plurality of frames of the video that correspond to the second period of time.

7. The computer system of claim 1 , wherein:

detecting the request to change subject emphasis that occurs at the second time includes detecting a second type of input that is directed to a second representation of the video, wherein the second type of input is an input to select a first subject to focus on in the video; and

changing the subject emphasis in the video during the second period of time that follows the second time includes applying a synthetic depth-of-field effect to emphasize the first subject relative to a second subject in a second plurality of frames of the video that correspond to the second period of time.

8. The computer system of claim 1 , wherein:

detecting the request to change subject emphasis that occurs at the second time includes detecting a third type of input that is directed to a third representation of the video, wherein the third type of input is a second input to select a second fixed focal plane in the video; and

the one or more programs further including instructions for:

in response to detecting the request to change subject emphasis at the second time in the video, displaying an indication of a distance to the second fixed focal plane.

9. The computer system of claim 1 , wherein:

the first subject emphasis change that occurs at the first time is a first type of subject emphasis change; and

changing the first subject emphasis change that occurs at the first time includes adding a fourth subject emphasis change at the first time, wherein the fourth subject emphasis change is a second type of subject emphasis change that is different from the first type of subject emphasis change.

10. The computer system of claim 1 , wherein the first time corresponds to a first subset of the video at which an emphasized subject, that was visible in a second portion of the video that preceded the first time, ceases to be visible.

11. The computer system of claim 1 , wherein changing the first subject emphasis change that occurs at the first time includes removing the first subject emphasis change that occurs at the first time.

12. The computer system of claim 1 , wherein the first subject emphasis change that occurs at the first time is an automatic change in subject emphasis.

13. The computer system of claim 1 , wherein:

before detecting the request to change subject emphasis at the second time in the video that is different from the first time, the video includes a fifth subject emphasis change that occurs at a third time; and

the one or more programs further including instructions for:

in response to detecting the request to change subject emphasis at the second time in the video and in accordance with a determination that a set of emphasis change criteria are met, the set of emphasis change criteria including a criterion that is met when the fifth subject emphasis change that occurs at the third time is a user-specified change in subject emphasis, forgoing changing the fifth subject emphasis change that occurs at the third time.

14. The computer system of claim 1 , wherein the second time occurs after the first time in the video.

15. The computer system of claim 1 , wherein the second time occurs before the first time in the video.

16. The computer system of claim 1 , wherein:

the video includes a fifth subject emphasis change that occurs at a fourth time; and

the one or more programs further including instructions for:

displaying a first selectable user interface object; and

while displaying the first selectable user interface object and while the video includes the fifth subject emphasis change that occurs at the fourth time, detecting a first input directed to the first selectable user interface object; and

in response to detecting the first input directed to the first selectable user interface object and in accordance with a determination that the fifth subject emphasis change that occurs at the fourth time is a user-specified change in subject emphasis, removing the fifth subject emphasis change that occurs at the fourth time from the video.

17. The computer system of claim 16 , the one or more programs further including instructions for:

in response to detecting the first input directed to the first selectable user interface object and in accordance with a determination that the fifth subject emphasis change that occurs at the fourth time is an automatic change in subject emphasis, forgoing removing the fifth subject emphasis change that occurs at the fourth time from the video.

18. The computer system of claim 16 , the one or more programs further including instructions for:

while displaying the first selectable user interface object and while the fifth subject emphasis change that occurs at the fourth time is removed from the video, detecting a second input directed to the first selectable user interface object; and

in response to detecting the second input directed to the first selectable user interface object, adding the fifth subject emphasis change that occurs at the fourth time to the video.

19. The computer system claim 16 , the one or more programs further including instructions for:

while the fifth subject emphasis change that occurs at the fourth time is removed from the video and while displaying the first selectable user interface object in an inactive state, detecting a request to add one or more user-specified changes in subject emphasis; and

in response to detecting the request to add one or more user-specified changes in subject emphasis, displaying the first selectable user interface object in an active state that is different from an inactive state without adding the fifth subject emphasis change that occurs at the fourth time to the video.

20. The computer system of claim 1 , the one or more programs further including instructions for:

while the video includes the first subject emphasis change that occurs at the first time:

in accordance with a determination that the first subject emphasis change is a user-specified change in subject emphasis, displaying a second graphical user interface object indicating that the first subject emphasis change that occurs at the first time with a first visual appearance; and

in accordance with a determination that the first subject emphasis change is an automatic change in subject emphasis, displaying the second graphical user interface object with a second visual appearance that is different from the first visual appearance.

21. The computer system of claim 1 , wherein:

the subject emphasis at the second time in the video is a third type of subject emphasis; and

the one or more programs further including instructions for:

after playing the portion of the video that includes the first subject emphasis change at the first time, detecting a second request to change subject emphasis at the second time; and

in response to detecting the second request to change subject emphasis at the second time and in accordance with a determination that the second request to change subject emphasis at the second time is a request to change the subject emphasis at the second time in video to the third type of subject emphasis, forgoing changing the subject emphasis in the video during the second period of time that follows the second time.

22. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for:

in response to detecting the request to change subject emphasis at the second time in the video:

changing the subject emphasis in the video during a second period of time that follows the second time; and

23. The non-transitory computer-readable storage medium of claim 22 , wherein:

before detecting the request to change subject emphasis at the second time, the video includes a second subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes removing the second subject emphasis change that occurs at the second time.

24. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

while displaying the first graphical user interface object, detecting an input directed to the first graphical user interface object;

in response to detecting the input directed to the first graphical user interface object, displaying an option to remove the second subject emphasis change that occurs at the second time; and

25. The non-transitory computer-readable storage medium of claim 24 , wherein:

26. The non-transitory computer-readable storage medium of claim 22 , wherein:

before detecting the request to change subject emphasis at the second time, the video does not include a subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes adding a third subject emphasis change that occurs at the second time.

27. The non-transitory computer-readable storage medium of claim 22 , wherein:

28. The non-transitory computer-readable storage medium of claim 22 , wherein:

29. The non-transitory computer-readable storage medium of claim 22 , wherein:

the one or more programs further including instructions for:

in response to detecting the request to change subject emphasis at the second time in the video, displaying an indication of a distance to the second fixed focal plane.

30. The non-transitory computer-readable storage medium of claim 22 , wherein:

the first subject emphasis change that occurs at the first time is a first type of subject emphasis change; and

31. The non-transitory computer-readable storage medium of claim 22 , wherein the first time corresponds to a first subset of the video at which an emphasized subject, that was visible in a second portion of the video that preceded the first time, ceases to be visible.

32. The non-transitory computer-readable storage medium of claim 22 , wherein changing the first subject emphasis change that occurs at the first time includes removing the first subject emphasis change that occurs at the first time.

33. The non-transitory computer-readable storage medium of claim 22 , wherein the first subject emphasis change that occurs at the first time is an automatic change in subject emphasis.

34. The non-transitory computer-readable storage medium of claim 22 , wherein:

the one or more programs further including instructions for:

35. The non-transitory computer-readable storage medium of claim 22 , wherein the second time occurs after the first time in the video.

36. The non-transitory computer-readable storage medium of claim 22 , wherein the second time occurs before the first time in the video.

37. The non-transitory computer-readable storage medium of claim 22 , wherein:

the video includes a fifth subject emphasis change that occurs at a fourth time; and

the one or more programs further including instructions for:

displaying a first selectable user interface object; and

38. The non-transitory computer-readable storage medium of claim 37 , the one or more programs further including instructions for:

in response to detecting the first input directed to the first selectable user interface object and in accordance with a determination that the fifth subject emphasis change that occurs at the fourth time is an automatic change in subject emphasis, forgoing removing the fifth subject emphasis change that occurs at the fourth time from the video.

39. The non-transitory computer-readable storage medium of claim 37 , the one or more programs further including instructions for:

in response to detecting the second input directed to the first selectable user interface object, adding the fifth subject emphasis change that occurs at the fourth time to the video.

40. The non-transitory computer-readable storage medium claim 37 , the one or more programs further including instructions for:

41. The non-transitory computer-readable storage medium of claim 22 , the one or more programs further including instructions for:

while the video includes the first subject emphasis change that occurs at the first time:

42. The non-transitory computer-readable storage medium of claim 22 , wherein:

the subject emphasis at the second time in the video is a third type of subject emphasis; and

the one or more programs further including instructions for:

after playing the portion of the video that includes the first subject emphasis change at the first time, detecting a second request to change subject emphasis at the second time; and

43. A method, comprising:

at a computer system that is in communication with a display generation component:

in response to detecting the request to change subject emphasis at the second time in the video:

changing the subject emphasis in the video during a second period of time that follows the second time; and

44. The method of claim 43 , wherein:

before detecting the request to change subject emphasis at the second time, the video includes a second subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes removing the second subject emphasis change that occurs at the second time.

45. The method of claim 44 , further comprising:

while displaying the first graphical user interface object, detecting an input directed to the first graphical user interface object;

in response to detecting the input directed to the first graphical user interface object, displaying an option to remove the second subject emphasis change that occurs at the second time; and

46. The method of claim 45 , wherein:

47. The method of claim 43 , wherein:

before detecting the request to change subject emphasis at the second time, the video does not include a subject emphasis change that occurs at the second time; and

changing the subject emphasis in the video during the second period of time that follows the second time includes adding a third subject emphasis change that occurs at the second time.

48. The method of claim 43 , wherein:

49. The method of claim 43 , wherein:

50. The method of claim 43 , wherein:

the one or more programs further including instructions for:

in response to detecting the request to change subject emphasis at the second time in the video, displaying an indication of a distance to the second fixed focal plane.

51. The method of claim 43 , wherein:

the first subject emphasis change that occurs at the first time is a first type of subject emphasis change; and

52. The method of claim 43 , wherein the first time corresponds to a first subset of the video at which an emphasized subject, that was visible in a second portion of the video that preceded the first time, ceases to be visible.

53. The method of claim 43 , wherein changing the first subject emphasis change that occurs at the first time includes removing the first subject emphasis change that occurs at the first time.

54. The method of claim 43 , wherein the first subject emphasis change that occurs at the first time is an automatic change in subject emphasis.

55. The method of claim 43 , wherein:

the method further comprises:

56. The method of claim 43 , wherein the second time occurs after the first time in the video.

57. The method of claim 43 , wherein the second time occurs before the first time in the video.

58. The method of claim 43 , wherein:

the video includes a fifth subject emphasis change that occurs at a fourth time; and

the method further comprises:

displaying a first selectable user interface object; and

59. The method of claim 58 , further comprising:

in response to detecting the first input directed to the first selectable user interface object and in accordance with a determination that the fifth subject emphasis change that occurs at the fourth time is an automatic change in subject emphasis, forgoing removing the fifth subject emphasis change that occurs at the fourth time from the video.

60. The method of claim 58 , further comprising:

in response to detecting the second input directed to the first selectable user interface object, adding the fifth subject emphasis change that occurs at the fourth time to the video.

61. The method claim 58 , further comprising:

62. The method of claim 43 , further comprising:

while the video includes the first subject emphasis change that occurs at the first time:

63. The method of claim 43 , wherein:

the subject emphasis at the second time in the video is a third type of subject emphasis; and

the method further comprises:

after playing the portion of the video that includes the first subject emphasis change at the first time, detecting a second request to change subject emphasis at the second time; and

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2022

From: MANZARI, BEHKISH J.; CLARKE, GRAHAM R.; JANSEN, TOKE; MALIA, JOSEPH A.; SOUZA DOS SANTOS, ANDRE; SORRENTINO, WILLIAM A., III; DASGUPTA, SAUMITRO; LOOFBOURROW, WAYNE; MOUSAVI, SEYYEDHOSSEIN; PALLISGAARD, JENS JACOB; SCHNEIDER, PAUL THOMAS; SHAGAM, JOSHUA BLAKE; STANCZYK, PIOTR J.; VILDHOEJ, HJALTE WEDEL

To: APPLE INC.

Reel/Frame 059349/0554 →

Continuity (4)

Provisional Application 63244213 · Sep 14, 2021

Provisional Application 63243724 · Sep 13, 2021

Provisional Application 63197460 · Jun 6, 2021

Provisional Application 63182751 · Apr 30, 2021

Cited By (1)

US 12,744,990