Granted Patent B2

US 11,240,424 · App. 17/003,869 · Granted Feb 1, 2022

Inventors: Henrique D. Penha (San Francisco, CA); Behkish J. Manzari (San Francisco, CA); Britt S. Miura (Menlo Park, CA); Justin S. Titi (Morgan Hill, CA); Paulo M. Lopez (Los Gatos, CA)

Assignee: APPLE INC.

H04N5/23216G06F3/0485G06F3/0488G06F3/04817G06F3/04842G06F3/04845G06F3/04883G11B27/005G11B27/031G11B27/034G11B27/105G11B27/34H04N5/232935H04N5/232941H04N2101/00

Abstract

Claims (102)

1. An electronic device, comprising:

a display;

a camera;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capturing media corresponding to a scene;

performing scene recognition on the scene;

in response to detecting a user input:

in accordance with a determination that the scene recognition meets first criteria, displaying the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:

a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;

a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and

a plurality of images acquired by the camera after acquiring the representative image; and,

in accordance with a determination that the scene recognition does not meet the first criteria, displaying the media as a single image in temporal proximity to the activation of the shutter button at the first time.

2. The electronic device of claim 1 , wherein the first criteria are action capture criteria.

3. The electronic device of claim 1 , wherein:

the first criteria include recognizing one or more faces in the scene.

4. The electronic device of claim 1 , wherein:

the first criteria include recognizing motion in the scene.

5. The electronic device of claim 1 , wherein:

the first criteria include detecting movement of the electronic device above a predetermined threshold value.

6. The electronic device of claim 1 , wherein:

performing scene recognition on the scene includes recognizing text in the scene; and

the first criteria include a criterion that is met when an amount of text in the scene is below a predefined threshold.

7. The electronic device of claim 1 , wherein the one or more programs further include instructions for:

in accordance with a determination that the first criteria are met, in response to detecting the single activation of the shutter button, retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button; and

in accordance with a determination that the first criteria are not met, in response to detecting the single activation of the shutter button, retaining the single image acquired by the camera in temporal proximity to the activation of the shutter button.

8. The electronic device of claim 7 , wherein:

performing scene recognition on the scene includes determining an amount of motion in the scene; and

retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button at the first time includes:

in accordance with a determination that the amount of motion is a first amount, retaining images at a first frame rate; and

in accordance with a determination that the amount of motion is a second amount that is greater than the first amount, retaining images at a second frame rate that is higher than the first frame rate.

9. The electronic device of claim 1 , wherein a number of images in the sequence of images depends on detected movement of the electronic device while the plurality of images was acquired.

10. The electronic device of claim 1 , wherein the electronic device includes default image capture parameters for acquiring images, and the one or more programs further include instructions for:

determining that the scene contains a single face in portrait orientation, the single face occupying more than a predetermined amount of the display;

in response to determining that the scene contains the single face in portrait orientation, the single face occupying more than a predetermined amount of the display:

acquiring the sequence of images with image capture parameters that are distinct from the default image capture parameters.

11. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a camera, cause the electronic device to:

while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capture media corresponding to a scene;

perform scene recognition on the scene;

in response to detecting a user input:

in accordance with a determination that the scene recognition meets first criteria, display the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:

a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;

a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and

a plurality of images acquired by the camera after acquiring the representative image; and,

in accordance with a determination that the scene recognition does not meet the first criteria, display the media as a single image in temporal proximity to the activation of the shutter button at the first time.

12. The non-transitory computer readable storage medium of claim 11 , wherein the first criteria are action capture criteria.

13. The non-transitory computer readable storage medium of claim 11 , wherein:

the first criteria include recognizing one or more faces in the scene.

14. The non-transitory computer readable storage medium of claim 11 , wherein:

the first criteria include recognizing motion in the scene.

15. The non-transitory computer readable storage medium of claim 11 , wherein:

the first criteria include detecting movement of the electronic device above a predetermined threshold value.

16. The non-transitory computer readable storage medium of claim 11 , wherein:

performing scene recognition on the scene includes recognizing text in the scene; and

the first criteria include a criterion that is met when an amount of text in the scene is below a predefined threshold.

17. The non-transitory computer readable storage medium of claim 11 , wherein the one or more programs comprise instructions that cause the electronic device to:

in accordance with a determination that the first criteria are met, in response to detecting the single activation of the shutter button, retain the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button; and

in accordance with a determination that the first criteria are not met, in response to detecting the single activation of the shutter button, retain the single image acquired by the camera in temporal proximity to the activation of the shutter button.

18. The non-transitory computer readable storage medium of claim 17 , wherein:

performing scene recognition on the scene includes determining an amount of motion in the scene; and

retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button at the first time includes:

in accordance with a determination that the amount of motion is a first amount, retaining images at a first frame rate; and

in accordance with a determination that the amount of motion is a second amount that is greater than the first amount, retaining images at a second frame rate that is higher than the first frame rate.

19. The non-transitory computer readable storage medium of claim 11 , wherein a number of images in the sequence of images depends on detected movement of the electronic device while the plurality of images was acquired.

20. The non-transitory computer readable storage medium of claim 11 , wherein the electronic device includes default image capture parameters for acquiring images, and the one or more programs comprise instructions that cause the electronic device to:

determine that the scene contains a single face in portrait orientation, the single face occupying more than a predetermined amount of the display;

in response to determining that the scene contains the single face in portrait orientation, the single face occupying more than a predetermined amount of the display:

acquire the sequence of images with image capture parameters that are distinct from the default image capture parameters.

21. A method for displaying images, comprising:

at an electronic device with a display, a camera, one or more processors, and memory:

while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capturing media corresponding to a scene;

performing scene recognition on the scene;

in response to detecting a user input:

in accordance with a determination that the scene recognition meets first criteria, displaying the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:

a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;

a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and

a plurality of images acquired by the camera after acquiring the representative image; and,

in accordance with a determination that the scene recognition does not meet the first criteria, displaying the media as a single image in temporal proximity to the activation of the shutter button at the first time.

22. The method of claim 21 , wherein the first criteria are action capture criteria.

23. The method of claim 21 , wherein:

the first criteria include recognizing one or more faces in the scene.

24. The method of claim 21 , wherein:

the first criteria include recognizing motion in the scene.

25. The method of claim 21 , wherein:

the first criteria include detecting movement of the electronic device above a predetermined threshold value.

26. The method of claim 21 , wherein:

performing scene recognition on the scene includes recognizing text in the scene; and

the first criteria include a criterion that is met when an amount of text in the scene is below a predefined threshold.

27. The method of claim 21 , including:

in accordance with a determination that the first criteria are met, in response to detecting the single activation of the shutter button, retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button; and

in accordance with a determination that the first criteria are not met, in response to detecting the single activation of the shutter button, retaining the single image acquired by the camera in temporal proximity to the activation of the shutter button.

28. The method of claim 27 , wherein:

performing scene recognition on the scene includes determining an amount of motion in the scene; and

retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button at the first time includes:

in accordance with a determination that the amount of motion is a first amount, retaining images at a first frame rate; and

in accordance with a determination that the amount of motion is a second amount that is greater than the first amount, retaining images at a second frame rate that is higher than the first frame rate.

29. The method of claim 21 , wherein a number of images in the sequence of images depends on detected movement of the electronic device while the plurality of images was acquired.

30. The method of claim 21 , wherein the electronic device includes default image capture parameters for acquiring images, and the one or more programs further include instructions for:

determining that the scene contains a single face in portrait orientation, the single face occupying more than a predetermined amount of the display;

in response to determining that the scene contains the single face in portrait orientation, the single face occupying more than a predetermined amount of the display:

acquiring the sequence of images with image capture parameters that are distinct from the default image capture parameters.

Continuity (8)