IP Library › Granted Patent US 11,930,281
Granted Patent B2
US 11,930,281 · App. 17/571,048 · Granted Mar 12, 2024

Electronic device with camera and method thereof

Inventors: Kwangyong Lim (Suwon-si, KR); Kyungheum Yi (Suwon-si, KR); Seongsin Kwak (Suwon-si, KR); Sungoh Kim (Suwon-si, KR); Daekyu Shin (Suwon-si, KR); Dasom Lee (Suwon-si, KR); Sanghun Lee (Suwon-si, KR); Seoyoung Lee (Suwon-si, KR); Daiwoong Choi (Suwon-si, KR); Jihwan Choe (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N23/80H04N1/2137H04N1/215H04N23/64H04N23/667H04N2101/00H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,930,281
App. No.
17/571,048
Granted
Mar 12, 2024
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a camera module, a sensor module, at least one processor configured to be operatively connected to the camera module and the sensor module, and a memory configured to be operatively connected to the at least one processor. The memory may be configured, when executed, to cause the at least one processor to acquire a plurality of first images having a first attribute and at least one second image having a second attribute for a designated time by controlling the camera module according to a photographing mode of the camera module determined based on at least one of illuminance detected through the sensor module and scene information detected through the camera module, extract information on an event section when the event is detected from the plurality of first images, and select and buffer at least one third image from the at least one second image according to the photographing mode, generate at least one piece of first content based on the information on the event section of the plurality of first images, and select at least one fourth image by evaluating at least some of the at least one third image, and generate at least one piece of second content based on the selected at least one fourth image.

Claims (48)

1. An electronic device comprising:

an image sensor;

an illuminance sensor, the illuminance sensor being separate from the image sensor;

a processor configured to be operatively connected to the image sensor and the illuminance sensor; and

memory configured to be operatively connected to the processor,

wherein the memory stores instructions which, when executed by the processor, cause the electronic device to:

acquire a plurality of first images having a first attribute and at least one second image having a second attribute for a designated time by controlling the image sensor according to a photographing mode of the image sensor determined based on illuminance detected through the illuminance sensor and scene information detected through the image sensor,

extract information on an event section when an event is detected from the plurality of first images, and select and buffer at least one third image from the at least one second image according to the photographing mode,

generate at least one piece of first content based on the information on the event section of the plurality of first images, and

select at least one fourth image by evaluating at least some of the at least one third image, and generate at least one piece of second content based on the selected at least one fourth image,

wherein the instructions further cause the electronic device to:

acquire the plurality of first images in a first rate for the designated time,

acquire the at least one second image in a second rate in a first photographing mode according to the determined photographing mode, and

acquire the at least one second image in a third rate in a second photographing mode, and

wherein the second rate is configured to be relatively longer than the first rate and the third rate is configured to be relatively longer than the second rate.

2. The electronic device of claim 1 , wherein the instructions further cause the electronic device to select the at least one third image based on similarity between image frames with respect to the at least one second image in the first photographing mode.

3. The electronic device of claim 1 , wherein the instructions further cause the electronic device to select the at least one third image based on image quality of the at least one second image in the second photographing mode.

4. The electronic device of claim 1 , wherein the instructions further cause the electronic device, in the first photographing mode, to: select at least one fifth image by analyzing the at least one third image; and select the at least one fourth image by evaluating the at least one fifth image.

5. The electronic device of claim 4 , wherein the analyzing of the at least one third image is configured to include at least one of blur detection, blink detection, expression-based filtering, or affine similarity with respect to the third image.

6. The electronic device of claim 1 , wherein the instructions further cause the electronic device to generate the at least one piece of second content through at least one of image effect application, image quality correction, composition change, or collage generation which changes color, transparency, style, contrast, or saturation for at least some elements in the at least one fourth image based on scene information of the at least one fourth image.

7. The electronic device of claim 1 , wherein the instructions further cause the electronic device to:

acquire motion information from the plurality of first images; and

extract the event section information based on a change in the motion information.

8. The electronic device of claim 7 , wherein the event section information includes at least one of time information, scene information, length information, or speed information for the event.

9. The electronic device of claim 8 , wherein the instructions further cause the electronic device to generate a video in which at least some of the plurality of first images are continuously reproduced by selectively changing at least one of a section length, a reproduction speed, a reproduction order, or an image effect based on the scene information based on the event section information.

10. A method of an electronic device including an illuminance sensor and an image sensor, the method comprising:

acquiring a plurality of first images having a first attribute and at least one second image having a second attribute for a designated time by controlling the image sensor according to a photographing mode of the image sensor determined based on illuminance detected through the illuminance sensor and scene information detected through the image sensor, the illuminance sensor being separate from the image sensor;

extracting information on an event section when an event is detected from the plurality of first images, and selecting and buffering at least one third image from the at least one second image according to the photographing mode;

generating at least one piece of first content based on the information on the event section of the plurality of first images; and

selecting at least one fourth image by evaluating at least some of the at least one third image, and generating at least one piece of second content based on the selected at least one fourth image,

wherein the acquiring of the plurality of first images comprises:

acquiring the plurality of first images in a first rate for the designated time,

acquiring the at least one second image in a second rate in a first photographing mode according to the determined photographing mode, and

acquiring the at least one second image in a third rate in a second photographing mode, and

wherein the second rate is configured to be relatively longer than the first rate and the third rate is configured to be relatively longer than the second rate.

11. The method of claim 10 , wherein the buffering comprises selecting the at least one third image based on similarity between image frames with respect to the at least one second image in the first photographing mode.

12. The method of claim 10 , wherein the buffering comprises selecting the at least one third image based on image quality of the at least one second image in the second photographing mode.

13. The method of claim 10 , further comprising:

selecting at least one fifth image by analyzing the at least one third image in the first photographing mode,

wherein the generating of the second content comprises selecting the at least one fourth image by evaluating the at least one fifth image.

14. The method of claim 13 , wherein the analyzing of the at least one third image includes at least one of blur detection, blink detection, expression-based filter, or affine similarity with respect to the third image.

15. The method of claim 10 , wherein the generating of the second content comprises generating the at least one piece of second content through at least one of image effect application, image quality correction, composition change, or collage generation which changes color, transparency, style, contrast, or saturation for at least some elements in the at least one fourth image based on scene information of the at least one fourth image.

16. The method of claim 10 , wherein the buffering comprises acquiring motion information from the plurality of first images and extracting the event section information based on a change in the motion information.

17. The method of claim 16 , wherein the event section information includes at least one of time information, scene information, length information, or speed information for the event.

18. The method of claim 17 , wherein the generating of the first content comprises generating a video in which at least some of the plurality of first images are continuously reproduced by selectively changing at least one of a section length, a reproduction speed, a reproduction order, or an image effect based on the scene information based on the event section information.

19. The electronic device of claim 1 ,

wherein when the illuminance is 2000 lux or more or 1800 exposure value (EV) or more, the photographing mode is a continuous photographing mode, and

wherein when the illuminance is 800 lux or less or 1000 EV or less, the photographing mode is a general photographing mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2022
From: LIM, KWANGYONG; YI, KYUNGHEUM; KWAK, SEONGSIN; KIM, SUNGOH; SHIN, DAEKYU; LEE, DASOM; LEE, SANGHUN; LEE, SEOYOUNG; CHOI, DAIWOONG; CHOE, JIHWAN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 058595/0106 →
Priority Claims (1)
KR 10-2020-0180859 · Dec 22, 2020 · national
Continuity (2)
Continuation PCTKR2021019640 · Dec 22, 2021
Related Publication 20220201203A1 · Jun 23, 2022