IP Library Granted Patent US 10,313,549
Granted Patent B2
US 10,313,549 · App. 15/349,043 · Granted Jun 4, 2019

Apparatus and method for generating time lapse image

Inventors: Kai Guo (Suwon-si, KR); Nak-hoon Kim (Suwon-si, KR); Sahil Arora (Suwon-si, KR); Duck-chan Seo (Yongin-si, KR); Hyung-chul Yoo (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N1/2133H04N5/2351H04N5/23203H04N5/23216H04N5/23219H04N5/23241H04N5/23245H04N5/23251H04N5/23258H04N5/23274H04N5/23296H04N5/772H04N5/783H04N9/8042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,313,549
App. No.
15/349,043
Granted
Jun 4, 2019
Kind
B2
Abstract

A photographing apparatus is provided, including a photographing device comprising imaging circuitry configured to generate an image signal by photoelectric conversion of incident light, a processor comprising processing circuitry configured to determine a sampling interval of time lapse photographing over time based on a reference value acquired in real time while the time lapse photographing is performed, to sample a plurality of input frames generated from the image signal at the sampling interval while the time lapse photographing is performed, to stabilize a plurality of frames selected by sampling the plurality of input frames using a window determined based on the sampling interval, and to compress the plurality of selected frames at an output frame rate to generate a time lapse image file, and a storage configured to store the time lapse image file.

Claims (77)

1. A photographing apparatus comprising:

a photographing device comprising imaging circuitry configured to generate an image signal by photoelectric conversion of incident light;

a processor comprising processing circuitry configured to:

determine a sampling interval of time lapse photographing over time based on a reference value acquired in real time while the time lapse photographing is performed,

determine a window corresponding to a region of a full frame obtained from the photographing device, used for stabilizing frames, and having a size based on the sampling interval,

sample a plurality of input frames generated from the image signal at the sampling interval while the time lapse photographing is performed, to stabilize a plurality of frames selected by sampling the plurality of input frames using data of a region corresponding to the window, and

compress the plurality of selected frames at an output frame rate to generate a time lapse image file; and

a storage configured to store the time lapse image file.

2. The photographing apparatus of claim 1 , wherein the reference value includes one or more of a zooming value, a battery level, movement information of the photographing apparatus, an illumination value, an audio signal, movement information of a subject, presence of face detection, and a face size.

3. The photographing apparatus of claim 1 , wherein

the reference value includes a zooming value, and the processing circuitry is configured to decrease the sampling interval when the zooming value increases, and

the processing circuitry is configured to increase the sampling interval when the zooming value decreases.

4. The photographing apparatus of claim 1 , further comprising a battery configured to supply power to the photographing apparatus, wherein

the reference value includes a battery level, and

the processing circuitry is configured to increase the sampling interval when the battery level is less than a threshold battery reference value.

5. The photographing apparatus of claim 1 , wherein

the processing circuitry is configured to extract subject movement information from the plurality of input frames,

the reference value includes the subject movement information, and

in a tripod mode of the photographing apparatus, the processing circuitry is configured to decrease the sampling interval when a movement magnitude of the subject increases, and to increase the sampling interval when the movement magnitude of the subject decreases.

6. The photographing apparatus of claim 1 , wherein

the processing circuitry is configured to detect a face from the plurality of input frames,

the reference value includes face detection information, and

the processing circuitry is configured to decrease the sampling interval when a face that was not detected from a previous frame is detected from a current frame, and to increase the sampling interval when a face was detected from the previous frame and no face is detected in the current frame.

7. The photographing apparatus of claim 1 , wherein

the processing circuitry is configured to detect a face from the plurality of input frames,

the reference value includes face detection information, and

the processing circuitry is configured to decrease the sampling interval when a size of the detected face increases, and to increase the sampling interval when the size of the detected face decreases.

8. The photographing apparatus of claim 1 , further comprising a movement sensor configured to detect movement of the photographing apparatus, wherein

the reference value includes a movement magnitude of the photographing apparatus, and

the processing circuitry is configured to decrease the sampling interval when a movement magnitude of the photographing apparatus increases, and to increase the sampling interval when the movement magnitude of the photographing apparatus decreases.

9. The photographing apparatus of claim 1 , further comprising a movement sensor configured to detect movement of the photographing apparatus, wherein

the reference value includes movement information of the photographing apparatus,

the processing circuitry is configured to decrease the sampling interval when the photographing apparatus is detected as operating in a panning mode, and

while the photographing apparatus operates in the panning mode, the processing circuitry is configured to increase the sampling interval when a moving speed of the photographing apparatus decreases, and to decrease the sampling interval when the moving speed increases.

10. The photographing apparatus of claim 1 , further comprising a movement sensor configured to detect movement of the photographing apparatus, wherein

the reference value includes movement information of the photographing apparatus, and

the processing circuitry is configured to decrease the sampling interval when a moving speed of the photographing apparatus is equal to or greater than a reference value.

11. The photographing apparatus of claim 1 , further comprising an illumination sensor configured to detect illumination, wherein

the reference value includes an illumination value, and

the processing circuitry is configured to provide a sampling interval that is greater when the illumination value is less than a low-illumination reference value or when the illumination value is greater than a high-illumination reference value than a sampling interval when the illumination value is equal to or greater than the low-illumination reference value and equal to or less than the high-illumination reference value.

12. The photographing apparatus of claim 1 , further comprising a microphone configured to detect an audio signal, wherein

the reference value includes the audio signal detected by the microphone, and

the processing circuitry is configured to decrease the sampling interval when a predefined sound or word is detected from the audio signal.

13. A method of generating a time lapse image, the method comprising:

determining a sampling interval of time lapse photographing over time based on a reference value acquired in real time while the time lapse photographing is performed;

determining a window corresponding to a region of a full frame obtained from a photographing device, used for stabilizing frames, and having a size based on the sampling interval;

sampling a plurality of input frames generated from an image signal provided by imaging circuitry of a photographing device at the sampling interval while the time lapse photographing is performed;

stabilizing a plurality of frames selected by sampling the plurality of input frames, using data of a region corresponding to the window;

compressing the plurality of selected frames at an output frame rate to generate a time lapse image file; and

storing the time lapse image file.

14. The method of claim 13 , wherein the reference value acquired in real time includes one or more of a zooming value, a battery level, movement information of the photographing apparatus, an illumination value, an audio signal, movement information of a subject, presence of face detection, and a face size.

15. The method of claim 13 , wherein

the reference value includes a zooming value, and

the sampling interval decreases when the zooming value increases, and the sampling interval increases when the zooming value decreases.

16. The method of claim 13 , wherein

the reference value includes a battery level, and

the sampling interval increases when the battery level is less than a threshold battery reference value.

17. The method of claim 13 , further comprising extracting subject movement information from the plurality of input frames,

wherein the reference value includes the subject movement information, and

in a tripod mode of the photographing apparatus, the sampling interval decreases when a movement magnitude of the subject increases, and increases when the movement magnitude of the subject decreases.

18. The method of claim 13 , further comprising detecting a face from the plurality of input frames,

wherein the reference value includes face detection information, and

the sampling interval decreases when a face that was not detected from a previous frame is detected from a current frame, and increases when a face was detected from the previous frame and no face is detected in the current frame.

19. The method of claim 13 , further comprising detecting a face from the plurality of input frames,

wherein the reference value includes face detection information, and

the sampling interval decreases when a size of the detected face increases, and increases when the size of the detected face decreases.

20. A non-transitory computer-readable recording medium having recorded thereon computer program code for use in generating a time lapse image, which, when executed by a processor, causes the processor to perform operations comprising:

determining a sampling interval of time lapse photographing over time based on a reference value acquired in real time while the time lapse photographing is performed;

determining a window corresponding to a region of a full frame obtained from a photographing device used for stabilizing frames, and having a size based on the sampling interval;

sampling a plurality of input frames generated from an image signal provided by imaging circuitry of a photographing device at the sampling interval while the time lapse photographing is performed;

stabilizing a plurality of frames selected by sampling the plurality of input frames, using data of a region corresponding to the window;

compressing the plurality of selected frames at an output frame rate to generate a time lapse image file; and

storing the time lapse image file.

21. The photographing apparatus of claim 1 , wherein the size of the window decreases as the sampling interval increases, and increases as the sampling interval decreases.

22. The photographing apparatus of claim 1 , wherein the processor is further configured to move the window within the full frame.

23. The method of claim 13 , wherein the size of the window decreases as the sampling interval increases, and increases as the sampling interval decreases.

24. The method of claim 13 , further comprising moving the window within the full frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2016
From: GUO, KAI; KIM, NAK-HOON; ARORA, SAHIL; SEO, DUCK-CHAN; YOO, HYUNG-CHUL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 040602/0662 →
Priority Claims (1)
KR 10-2015-0183931 · Dec 22, 2015 · national
Continuity (1)
Related Publication 20170180589A1 · Jun 22, 2017