IP Library › Granted Patent US 12,316,977
Granted Patent B2
US 12,316,977 · App. 18/194,870 · Granted May 27, 2025

Method, apparatus, and storage medium for providing slow shutter

Inventor: Changwoo Lee (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N23/72G06T3/40G06T5/50G06T5/70G06T7/20G06T7/70H04N7/013G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,316,977
App. No.
18/194,870
Granted
May 27, 2025
Kind
B2
Abstract

An example electronic device may include a memory, an image sensor, and at least one processor operatively connected to the memory and the image sensor, wherein the memory is configured to store instructions which, when executed by the at least one processor, cause the electronic device to acquire, through the image sensor, a plurality of images including first images having a first size and at least one second image having a second size larger than the first size, acquire a first synthesis image based on the first images, acquire a first moving object portion from the first synthesis image, based on synthesis area information including at least one of moving object location information or background location information, identify a second moving object portion in the at least one second image, based on the synthesis area information, and acquire a second synthesis image by replacing the second moving object portion by the first moving object portion, and other embodiments are possible.

Claims (46)

1. An electronic device comprising:

memory;

an image sensor; and

at least one processor operatively connected to the memory and the image sensor,

wherein the memory is configured to store instructions which, when executed, configure the at least one processor to individually or collectively control the electronic device to:

acquire, through the image sensor, a plurality of images including first images having a first size and at least one second image having a second size larger than the first size,

acquire a first synthesis image by synthesizing the first images,

based on synthesis area information including at least one of moving object location information or background location information, acquire, from the first synthesis image, a first moving object portion which is an image portion including a moving object,

based on the synthesis area information, identify, in the at least one second image, a second moving object portion which is an image portion including the moving object, and

acquire a second synthesis image by replacing the second moving object portion by the first moving object portion.

2. The electronic device of claim 1 , a frame rate of the first images is higher than a frame rate of the at least one second image.

3. The electronic device of claim 1 , wherein the second synthesis image comprises the first moving object portion of the first synthesis image and a background portion of the at least one second image.

4. The electronic device of claim 3 , wherein the instructions, when executed, configure the at least one processor to individually or collectively controleause the electronic device to upscale the first synthesis image, and

acquire the first moving object portion from the upscaled first synthesis image.

5. The electronic device of claim 1 , wherein the instructions, when executed, configure the at least one processor to individually or collectively control the electronic device to identify the moving object in at least one of the plurality of images, and

determine at least one of a frame rate, a time interval, a resolution, or a number of the first images to be used for acquisition of the first synthesis image, based on at least one of a magnitude, speed, or direction of a motion of the moving object.

6. The electronic device of claim 5 , wherein the instructions, when executed, configure the at least one processor to individually or collectively control the electronic device to provide information on at least one of a frame rate, a time interval, a resolution, or the number of the first images to the image sensor.

7. The electronic device of claim 1 , wherein the image sensor provides at least a part of the first images during a duration of providing a preview image, and

the at least one second image has the same size as that of the preview image.

8. The electronic device of claim 1 , wherein the instructions, when executed, configure the at least one processor to individually or collectively control the electronic device to, while displaying a preview image, identify whether a slow shutter event requiring a change to a slow shutter mode requiring acquisition of the second synthesis image is detected, and

display, on a display, a graphical object for selecting or adjusting a value related to blur of the second synthesis image, based on the detection of the slow shutter event.

9. The electronic device of claim 8 , wherein the instructions, when executed, configure the at least one processor to individually or collectively control the electronic device to identify whether slow-shutter photographing is selected, and

acquire a plurality of images including the first images and the at least one second image, based on the selection of the slow-shutter photographing.

10. The electronic device of claim 1 , wherein the image sensor is configured to output an image frame including an image and a header or footer including information about the image,

the at least one processor comprises an image signal processor, and

the image signal processor is configured to identify whether the image corresponds to the first images or the second image based on the information about the image included in the header or footer, and

change a configuration related to processing of the image according to whether the image corresponds to the first images or the second image.

11. A method for providing a slow shutter, the method comprising:

acquiring, through an image sensor, a plurality of images including first images having a first size and at least one second image having a second size larger than the first size;

acquiring a first synthesis image by synthesizing the first images;

based on synthesis area information including at least one of moving object location information or background location information, acquiring, from the first synthesis image, a first moving object portion which is an image portion including a moving object;

based on the synthesis area information, identifying, in the at least one second image, a second moving object portion in the at least one second image which is an image portion including the moving object; and

acquiring a second synthesis image by replacing the second moving object portion by the first moving object portion.

12. The method of claim 11 , further comprising:

upscaling the first synthesis image; and

acquiring the first moving object portion from the upscaled first synthesis image.

13. The method of claim 11 , further comprising:

identifying the moving object in at least one of the plurality of images; and

determining at least one of a frame rate, a time interval, a resolution, or a number of the first images to be used for acquisition of the first synthesis image, based on at least one of a magnitude, speed, or direction of a motion of the moving object.

14. The method of claim 11 , further comprising:

while displaying a preview image, identifying whether a slow shutter event requiring a change to a slow shutter mode requiring acquisition of the second synthesis image is detected; and

displaying, on a display, a graphical object for selecting or adjusting a value related to blur of the second synthesis image, based on the detection of the slow shutter event.

15. The method of claim 11 , further comprising:

receiving an image frame including an image and a header or footer including information about the image;

identifying whether the image corresponds to the first images or the second image based on the information about the image included in the header or footer; and

changing a configuration of an image signal processor related to processing of the image according to whether the image corresponds to the first images or the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2023
From: LEE, CHANGWOO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063204/0997 →
Priority Claims (1)
KR 10-2020-0153281 · Nov 17, 2020 · national
Continuity (2)
Continuation PCTKR2021016403 · Nov 11, 2021
Related Publication 20230239576A1 · Jul 27, 2023
References Cited (31)
US 11729506B2 · Sugawara · 2023 [cited by examiner]
US 20080088711A1 · Border · 2008 [cited by examiner]
US 20090225189A1 · Morin · 2009 [cited by examiner]
US 20100271498A1 · Hwang · 2010 [cited by examiner]
US 20110122291A1 · Nakamura · 2011 [cited by examiner]
US 20130242121A1 · Kashiwagi · 2013 [cited by examiner]
US 20140325439A1 · Sohn · 2014 [cited by examiner]
US 20150022698A1 · Na et al. · 2015 [cited by applicant]
US 20150262341A1 · Nash · 2015 [cited by examiner]
US 20160366341A1 · Li et al. · 2016 [cited by applicant]
US 20170019608A1 · Ono · 2017 [cited by examiner]
US 20170237904A1 · Takahashi · 2017 [cited by applicant]
US 20180255232A1 · Takahashi et al. · 2018 [cited by applicant]
US 20200077019A1 · Kim et al. · 2020 [cited by applicant]
US 20200106945A1 · Hsieh · 2020 [cited by examiner]
US 20200228706A1 · Park et al. · 2020 [cited by applicant]
US 20210074002A1 · Yang · 2021 [cited by examiner]
JP 2014239396A · 2014 [cited by applicant]
JP 2017143492A · 2017 [cited by applicant]
JP 2017216627A · 2017 [cited by applicant]
JP 2018148272A · 2018 [cited by applicant]
JP 6624048B2 · 2019 [cited by applicant]
KR 20110005267A · 2011 [cited by applicant]
KR 101481798B1 · 2015 [cited by applicant]
KR 20150009184A · 2015 [cited by applicant]
KR 20200027276A · 2020 [cited by applicant]
KR 20200087401A · 2020 [cited by applicant]
WO 2015141487A1 · 2015 [cited by applicant]
International Search Report for PCT/KR2021/016403 mailed Feb. 17, 2022, 5 pages. [cited by applicant]
Written Opinion of the ISA for PCT/KR2021/016403 mailed Feb. 17, 2022, 4 pages. [cited by applicant]
Office Action dated Aug. 23, 2024 in Korean Patent Application No. 10-2020-0153281 and English-language translation. [cited by applicant]