IP Library › Granted Patent US 9,591,219
Granted Patent B2
US 9,591,219 · App. 15/089,784 · Granted Mar 7, 2017

Modeless video and still frame capture

Inventors: D. Amnon Silverstein (Palo Alto, CA); Shun Wai Go (Cupertino, CA); Suk Hwan Lim (Mountain View, CA); Timothy J. Millet (Mountain View, CA); Ting Chen (Sunnyvale, CA); Bin Ni (Sunnyvale, CA)
Assignee: Apple Inc.
H04N5/23245H04N1/212H04N5/23216H04N5/23232H04N5/23293H04N7/0122H04N9/87
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,591,219
App. No.
15/089,784
Granted
Mar 7, 2017
Kind
B2
Abstract

In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

Claims (44)

1. A device comprising:

an image sensor;

a display device;

a memory; and

an integrated circuit coupled to the image sensor, the memory, and the display device, wherein:

the integrated circuit is configured to output frames of a first video sequence responsive to a first plurality of frames received from the image sensor to the memory;

the first video sequence frames have a first aspect ratio and a first resolution dependent on a display standard to which the video sequence is being generated;

the integrated circuit is configured to output a preview video sequence for display on the display device responsive to the first plurality of frames and concurrent with the first video sequence;

the preview video sequence has frames with the first aspect ratio and a second resolution that is lower than the first resolution;

responsive to a user depressing a still capture button on the device, the integrated circuit is configured to change the first aspect ratio of the preview video sequence to a second aspect ratio associated with a still frame; and

the integrated circuit is configured to capture the still frame and return to the first aspect ratio for the preview video sequence responsive to the user releasing the still capture button.

2. The device as recited in claim 1 wherein the integrated circuit is configured to retain a scale and placement of the frames at the first aspect ratio within the frames of the preview video sequence at the second aspect ratio.

3. The device as recited in claim 2 wherein the integrated circuit is configured to fade in a portion of the frames of the preview video sequence that are outside of the first aspect ratio responsive to the user depressing the still capture button.

4. The device as recited in claim 3 wherein the integrated circuit is configured to fade in the portion with a translucent letterbox effect to delineate the first aspect ratio within the frames of the preview video sequence at the second aspect ratio.

5. The device as recited in claim 3 wherein the integrated circuit is configured to fade out the portion responsive to the user releasing the still capture button.

6. The device as recited in claim 3 wherein the portion is faded in to a first brightness that is less than a second brightness of a remaining portion that is within the first aspect ratio to delineate the first aspect ratio within the frames of the preview video sequence at the second aspect ratio.

7. The device as recited in claim 1 wherein the integrated circuit is configured to continue outputting the frames of the first video sequence to the memory during a time that the still capture button is depressed.

8. The device as recited in claim 1 wherein the first video sequence has a frame rate that is higher than the preview video sequence.

9. The device as recited in claim 1 wherein the still capture button is a physical button on the device.

10. The device as recited in claim 1 wherein the still capture button is a virtual button displayed by the display device.

11. The device as recited in claim 1 wherein the integrated circuit is configured to capture the still frame at a third resolution that is greater than the first resolution.

12. In a device including an image sensor, a display device, a memory, and an integrated circuit coupled to the image sensor, the memory, and the display device, a method comprising:

outputting frames of a first video sequence from the integrated circuit to the memory responsive to a first plurality of frames received from the image sensor, wherein the first video sequence frames have a first aspect ratio and a first resolution dependent on a display standard to which the video sequence is being generated;

outputting a preview video sequence for display on the display device by the integrated circuit responsive to the first plurality of frames and concurrent with the first video sequence, wherein the preview video sequence has frames with the first aspect ratio and a second resolution that is lower than the first resolution;

responsive to a user depressing a still capture button on the device, changing the first aspect ratio of the preview video sequence to a second aspect ratio associated with a still frame by the integrated circuit; and

capturing the still frame and returning to the first aspect ratio for the preview video sequence by the integrated circuit responsive to the user releasing the still capture button.

13. The method as recited in claim 12 further comprising:

retaining a scale and placement of the frames at the first aspect ratio within the frames of the preview video sequence at the second aspect ratio by the integrated circuit.

14. The method as recited in claim 13 further comprising:

fading in a portion of the frames of the preview video sequence that are outside of the first aspect ratio by the integrated circuit responsive to the user depressing the still capture button.

15. The method as recited in claim 14 wherein the fading in comprises displaying the portion with a translucent letterbox effect to delineate the first aspect ratio within the frames of the preview video sequence at the second aspect ratio.

16. The method as recited in claim 14 further comprising:

fading out the portion by the integrated circuit responsive to the user releasing the still capture button.

17. The method as recited in claim 14 wherein the fading in comprises fading in to a first brightness that is less than a second brightness of a remaining portion that is within the first aspect ratio to delineate the first aspect ratio within the frames of the preview video sequence at the second aspect ratio.

18. The method as recited in claim 12 further comprising:

continuing to output the frames of the first video sequence to the memory during a time that the still capture button is depressed.

19. The method as recited in claim 12 wherein the first video sequence has a frame rate that is higher than the preview video sequence.

20. An integrated circuit comprising:

an image signal processor (ISP) have a sensor interface configured to receive a first plurality of frames from an image sensor and circuitry configured to output frames of a first video sequence responsive to the first plurality of frames, wherein the first video sequence frames have a first aspect ratio and a first resolution dependent on a display standard to which the video sequence is being generated;

a memory controller coupled to the ISP and configured to write the first plurality of frames to memory;

the ISP further configured to output a preview video sequence for display on a display device responsive to the first plurality of frames and concurrent with the first video sequence, wherein the preview video sequence has frames with the first aspect ratio and a second resolution that is lower than the first resolution;

a display controller configured to display the preview video sequence on the display, wherein the display controller is coupled to the ISP;

responsive to a user depressing a still capture button on the device, the ISP is configured to change the first aspect ratio of the preview video sequence to a second aspect ratio associated with a still frame; and

responsive to the user releasing the still capture button, the ISP is configured to capture the still frame by writing the still frame to the memory through the memory controller, and the ISP is further configured to return to the first aspect ratio for the preview video sequence.

Continuity (2)
Division 14082390 · Nov 18, 2013
Related Publication 20160219220A1 · Jul 28, 2016