IP Library › Granted Patent US 11,687,224
Granted Patent B2
US 11,687,224 · App. 17/356,322 · Granted Jun 27, 2023

User interface camera effects

Inventors: Behkish J. Manzari (San Francisco, CA); Caroline Hermans (Oakland, CA); Emilie Kim (San Francisco, CA); Daniel Trent Preston (San Jose, CA)
Assignee: Apple Inc.
G06F3/04847G06F3/04883H04N23/611H04N23/62H04N23/63H04N23/632H04N23/64H04N23/65H04N23/651H04N23/667H04N23/67H04N23/69H04N23/90G06F3/0482G06F3/04817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,687,224
App. No.
17/356,322
Filed
Jun 23, 2021
Granted
Jun 27, 2023
Kind
B2
Art Unit
2143
USPC
715/810
Abstract

The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.

Claims (135)

1. An electronic device, comprising:

a camera;

a sensor;

a display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display, a camera viewfinder for capturing media; and

while displaying the camera viewfinder:

in accordance with a determination, based on data from the sensor, that the device meets alignment-guide display criteria, wherein the alignment-guide display criteria include a requirement that a relative difference between an orientation of a plane of focus of the camera and a predetermined orientation is within a respective alignment threshold in order for the alignment-guide display criteria to be met, displaying, via the display, an alignment guide in the camera viewfinder, wherein an appearance of the alignment guide changes as the orientation of the plane of focus of the camera changes relative to the predetermined orientation;

in accordance with a determination, based on data from the sensor, that the alignment-guide display criteria are not met, forgoing displaying the alignment guide in the camera viewfinder;

detecting a movement of the device while the alignment guide is displayed; and

in response to detecting the movement of the device:

in accordance with a second determination, based on data from the sensor, that the device meets the alignment-guide display criteria, maintain display, via the display, of the alignment guide in the camera viewfinder; and

in accordance with a second determination, based on data from the sensor, that the alignment-guide display criteria are no longer met, ceasing to display, via the display, the alignment guide in the camera viewfinder.

2. The device of claim 1 , wherein the alignment-guide display criteria include a requirement that the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold for at least a threshold amount of time in order for the alignment-guide display criteria to be met.

3. The device of claim 1 , wherein the alignment-guide display criteria include a requirement that the orientation of the device not change by more than a threshold amount in a threshold amount of time while the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold in order for the alignment-guide display criteria to be met.

4. The device of claim 1 , wherein the predetermined orientation corresponds to a horizontal orientation.

5. The device of claim 1 , wherein the predetermined orientation is a vertical orientation.

6. The device of claim 1 , wherein the alignment guide includes at least two visual indicators.

7. The device of claim 6 , wherein at least one of the at least two visual indicators remains stationary as the orientation of the plane of focus of the camera changes relative to the predetermined orientation.

8. The device of claim 6 , wherein at least one of the at least two visual indicators are displayed proximate to a center of the camera viewfinder.

9. The device of claim 6 , wherein a distance between the two visual indicators is dynamically based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

10. The device of claim 6 , the one or more programs further including instructions for:

while displaying the alignment guide and while the orientation of the plane of focus of the camera is a first orientation, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the first orientation to a second orientation; and

in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation changing a displayed position of a first visual indicator of the at least two visual indicators to an updated display position, wherein the updated display position of the first visual indicator is changed based on the relative difference between the first orientation and the second orientation.

11. The device of claim 10 , the one or more programs further including instructions for:

further in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation:

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is not within a first visual indicator alignment threshold, displaying the first visual indicator at the updated display position; and

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is within the first visual indicator alignment threshold, displaying the first visual indicator at a predetermined display position.

12. The device of claim 11 , wherein displaying the first visual indicator at the predetermined display position, includes displaying a respective animation at a location of one or more of the visual indicators.

13. The device of claim 11 , the one or more programs further including instructions for:

while the first visual indicator is displayed at the predetermined display position, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from a third orientation to a fourth orientation, wherein the third orientation has a relative difference to the predetermined orientation that is within the first visual indicator alignment threshold;

in response to detecting the change in orientation of the plane of focus of the camera from the third orientation to the fourth orientation:

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is not outside a second visual indicator alignment threshold, maintaining display of the first visual indicator at the predetermined display position; and

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is outside the second visual indicator alignment threshold, displaying the first visual indicator at a second updated display position, wherein the position of the second updated display position is based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

14. The device of claim 13 , the one or more programs further including instructions for:

while the orientation of the plane of focus of the camera is at a seventh orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a third visual indicator of the at least two visual indicator is displayed, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the seventh orientation to an eighth orientation,

in response to detecting the change in orientation of the plane of focus of the camera from the seventh orientation to the eighth orientation:

in accordance with a determination that a relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold, maintaining display of the third visual indicator; and

in accordance with a determination that the relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is not within the second visual indicator alignment threshold, ceasing display of the third visual indicator.

15. The device of claim 6 , the one or more programs further including instructions for:

while the orientation of the plane of focus of the camera is at a fifth orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a second visual indicator of the at least two visual indicator is displayed with a first value of a visual characteristic, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the fifth orientation to a sixth orientation, wherein the relative difference between the sixth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold; and

in response to detecting the change in orientation of the plane of focus of the camera from the fifth orientation to the sixth orientation, displaying the second visual indicator with a second value of the visual characteristic different than the first value.

16. The device of claim 15 , wherein:

the fifth orientation of the plane of focus of the camera has a first relative difference between an orientation of the plane of focus of the camera and a predetermined orientation,

the sixth orientation of the plane of focus of the camera has a second relative difference between an orientation of the plane of focus of the camera and a predetermined orientation, the second relative difference is greater than the first relative difference,

the visual characteristic is a display intensity, and

the first value is greater than the second value.

17. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a camera, a sensor, and a display, the one or more programs including instructions for:

displaying, via the display a camera viewfinder for capturing media; and

while displaying the camera viewfinder:

in accordance with a determination, based on data from the sensor, that the device meets alignment-guide display criteria, wherein the alignment-guide display criteria include a requirement that a relative difference between an orientation of a plane of focus of the camera and a predetermined orientation is within a respective alignment threshold in order for the alignment-guide display criteria to be met, displaying, via the display, an alignment guide in the camera viewfinder, wherein an appearance of the alignment guide changes as the orientation of the plane of focus of the camera changes relative to the predetermined orientation;

in accordance with a determination, based on data from the sensor, that the alignment-guide display criteria are not met, forgoing displaying the alignment guide in the camera viewfinder,

detecting a movement of the device while the alignment guide is displayed; and

in response to detecting the movement of the device:

in accordance with a second determination, based on data from the sensor, that the device meets the alignment-guide display criteria, maintain display, via the display, of the alignment guide in the camera viewfinder; and

in accordance with a second determination, based on data from the sensor, that the alignment-guide display criteria are no longer met, ceasing to display, via the display, the alignment guide in the camera viewfinder.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the alignment-guide display criteria include a requirement that the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold for at least a threshold amount of time in order for the alignment-guide display criteria to be met.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the alignment-guide display criteria include a requirement that the orientation of the device not change by more than a threshold amount in a threshold amount of time while the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold in order for the alignment-guide display criteria to be met.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the predetermined orientation corresponds to a horizontal orientation.

21. The non-transitory computer-readable storage medium of claim 17 , wherein the predetermined orientation is a vertical orientation.

22. The non-transitory computer-readable storage medium of claim 17 , wherein the alignment guide includes at least two visual indicators.

23. The non-transitory computer-readable storage medium of claim 22 , wherein at least one of the at least two visual indicators remains stationary as the orientation of the plane of focus of the camera changes relative to the predetermined orientation.

24. The non-transitory computer-readable storage medium of claim 22 , wherein at least one of the at least two visual indicators are displayed proximate to a center of the camera viewfinder.

25. The non-transitory computer-readable storage medium of claim 22 , wherein a distance between the two visual indicators is dynamically based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

26. The non-transitory computer-readable storage medium of claim 22 , the one or more programs further including instructions for:

while displaying the alignment guide and while the orientation of the plane of focus of the camera is a first orientation, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the first orientation to a second orientation; and

in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation changing a displayed position of a first visual indicator of the at least two visual indicators to an updated display position, wherein the updated display position of the first visual indicator is changed based on the relative difference between the first orientation and the second orientation.

27. The non-transitory computer-readable storage medium of claim 26 , the one or more programs further including instructions for:

further in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation:

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is not within a first visual indicator alignment threshold, displaying the first visual indicator at the updated display position; and

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is within the first visual indicator alignment threshold, displaying the first visual indicator at a predetermined display position.

28. The non-transitory computer-readable storage medium of claim 27 , wherein displaying the first visual indicator at the predetermined display position, includes displaying a respective animation at a location of one or more of the visual indicators.

29. The non-transitory computer-readable storage medium of claim 27 , the one or more programs further including instructions for:

while the first visual indicator is displayed at the predetermined display position, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from a third orientation to a fourth orientation, wherein the third orientation has a relative difference to the predetermined orientation that is within the first visual indicator alignment threshold;

in response to detecting the change in orientation of the plane of focus of the camera from the third orientation to the fourth orientation:

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is not outside a second visual indicator alignment threshold, maintaining display of the first visual indicator at the predetermined display position; and

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is outside the second visual indicator alignment threshold, displaying the first visual indicator at a second updated display position, wherein the position of the second updated display position is based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

30. The non-transitory computer-readable storage medium of claim 29 , the one or more programs further including instructions for:

while the orientation of the plane of focus of the camera is at a seventh orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a third visual indicator of the at least two visual indicator is displayed, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the seventh orientation to an eighth orientation,

in response to detecting the change in orientation of the plane of focus of the camera from the seventh orientation to the eighth orientation:

in accordance with a determination that a relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold, maintaining display of the third visual indicator; and

in accordance with a determination that the relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is not within the second visual indicator alignment threshold, ceasing display of the third visual indicator.

31. The non-transitory computer-readable storage medium of claim 22 , the one or more programs further including instructions for:

while the orientation of the plane of focus of the camera is at a fifth orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a second visual indicator of the at least two visual indicator is displayed with a first value of a visual characteristic, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the fifth orientation to a sixth orientation, wherein the relative difference between the sixth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold; and

in response to detecting the change in orientation of the plane of focus of the camera from the fifth orientation to the sixth orientation, displaying the second visual indicator with a second value of the visual characteristic different than the first value.

32. The non-transitory computer-readable storage medium of claim 31 , wherein:

the fifth orientation of the plane of focus of the camera has a first relative difference between an orientation of the plane of focus of the camera and a predetermined orientation,

the sixth orientation of the plane of focus of the camera has a second relative difference between an orientation of the plane of focus of the camera and a predetermined orientation, the second relative difference is greater than the first relative difference,

the visual characteristic is a display intensity, and

the first value is greater than the second value.

33. A method, comprising:

at an electronic device with a camera, a sensor, and a display:

displaying, via the display a camera viewfinder for capturing media; and

while displaying the camera viewfinder:

in accordance with a determination, based on data from the sensor, that the device meets alignment-guide display criteria, wherein the alignment-guide display criteria include a requirement that a relative difference between an orientation of a plane of focus of the camera and a predetermined orientation is within a respective alignment threshold in order for the alignment-guide display criteria to be met, displaying, via the display, an alignment guide in the camera viewfinder, wherein an appearance of the alignment guide changes as the orientation of the plane of focus of the camera changes relative to the predetermined orientation;

in accordance with a determination, based on data from the sensor, that the alignment-guide display criteria are not met, forgoing displaying the alignment guide in the camera viewfinder;

detecting a movement of the device while the alignment guide is displayed; and

in response to detecting the movement of the device:

in accordance with a second determination, based on data from the sensor, that the device meets the alignment-guide display criteria, maintain display, via the display, of the alignment guide in the camera viewfinder; and

in accordance with a second determination, based on data from the sensor, that the alignment-guide display criteria are no longer met, ceasing to display, via the display, the alignment guide in the camera viewfinder.

34. The method of claim 33 , wherein the alignment-guide display criteria include a requirement that the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold for at least a threshold amount of time in order for the alignment-guide display criteria to be met.

35. The method of claim 33 , wherein the alignment-guide display criteria include a requirement that the orientation of the device not change by more than a threshold amount in a threshold amount of time while the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation is maintained within the respective alignment threshold in order for the alignment-guide display criteria to be met.

36. The method of claim 33 , wherein the predetermined orientation corresponds to a horizontal orientation.

37. The method of claim 33 , wherein the predetermined orientation is a vertical orientation.

38. The method of claim 33 , wherein the alignment guide includes at least two visual indicators.

39. The method of claim 38 , wherein at least one of the at least two visual indicators remains stationary as the orientation of the plane of focus of the camera changes relative to the predetermined orientation.

40. The method of claim 38 , wherein at least one of the at least two visual indicators are displayed proximate to a center of the camera viewfinder.

41. The method of claim 38 , wherein a distance between the two visual indicators is dynamically based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

42. The method of claim 38 , the method further comprising:

while displaying the alignment guide and while the orientation of the plane of focus of the camera is a first orientation, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the first orientation to a second orientation; and

in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation changing a displayed position of a first visual indicator of the at least two visual indicators to an updated display position, wherein the updated display position of the first visual indicator is changed based on the relative difference between the first orientation and the second orientation.

43. The method of claim 42 , the method further comprising:

further in response to detecting the change in orientation of the plane of focus of the camera from the first orientation to the second orientation:

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is not within a first visual indicator alignment threshold, displaying the first visual indicator at the updated display position; and

in accordance with a determination that the relative difference between the second orientation of the plane of focus of the camera and the predetermined orientation is within the first visual indicator alignment threshold, displaying the first visual indicator at a predetermined display position.

44. The method of claim 43 , wherein displaying the first visual indicator at the predetermined display position, includes displaying a respective animation at a location of one or more of the visual indicators.

45. The method of claim 43 , the method further comprising:

while the first visual indicator is displayed at the predetermined display position, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from a third orientation to a fourth orientation, wherein the third orientation has a relative difference to the predetermined orientation that is within the first visual indicator alignment threshold;

in response to detecting the change in orientation of the plane of focus of the camera from the third orientation to the fourth orientation:

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is not outside a second visual indicator alignment threshold, maintaining display of the first visual indicator at the predetermined display position; and

in accordance with a determination that the relative difference between the fourth orientation of the plane of focus of the camera and the predetermined orientation is outside the second visual indicator alignment threshold, displaying the first visual indicator at a second updated display position, wherein the position of the second updated display position is based on the relative difference between the orientation of the plane of focus of the camera and the predetermined orientation.

46. The method of claim 45 , the method further comprising:

while the orientation of the plane of focus of the camera is at a seventh orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a third visual indicator of the at least two visual indicator is displayed, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the seventh orientation to an eighth orientation,

in response to detecting the change in orientation of the plane of focus of the camera from the seventh orientation to the eighth orientation:

in accordance with a determination that a relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold, maintaining display of the third visual indicator; and

in accordance with a determination that the relative difference between the eighth orientation of the plane of focus of the camera and the predetermined orientation is not within the second visual indicator alignment threshold, ceasing display of the third visual indicator.

47. The method of claim 38 , the method further comprising:

while the orientation of the plane of focus of the camera is at a fifth orientation having a relative difference to the predetermined orientation that is within the respective alignment threshold and while a second visual indicator of the at least two visual indicator is displayed with a first value of a visual characteristic, detecting, based on data from the sensor, a change in orientation of the plane of focus of the camera from the fifth orientation to a sixth orientation, wherein the relative difference between the sixth orientation of the plane of focus of the camera and the predetermined orientation is within the second visual indicator alignment threshold; and

in response to detecting the change in orientation of the plane of focus of the camera from the fifth orientation to the sixth orientation, displaying the second visual indicator with a second value of the visual characteristic different than the first value.

48. The method of claim 47 , wherein:

the fifth orientation of the plane of focus of the camera has a first relative difference between an orientation of the plane of focus of the camera and a predetermined orientation,

the sixth orientation of the plane of focus of the camera has a second relative difference between an orientation of the plane of focus of the camera and a predetermined orientation, the second relative difference is greater than the first relative difference,

the visual characteristic is a display intensity, and

the first value is greater than the second value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2022
From: HERMANS, CAROLINE; PRESTON, DANIEL TRENT
To: APPLE INC.
Reel/Frame 058745/0629 →
Continuity (5)
Continuation 16733718 · Jan 3, 2020
Continuation 15728147 · Oct 9, 2017
Provisional Application 62556414 · Sep 9, 2017
Provisional Application 62514947 · Jun 4, 2017
Related Publication 20210318798A1 · Oct 14, 2021
Cited By (11)
US 12,401,889 US 12,450,854 US 12,495,204 US 12,608,115 US 12,633,044 US 12,659,569 US 12,701,334 US 12,707,140 US 12,711,724 US 12,739,511 US 12,744,990