IP Library › Granted Patent US 10,958,833
Granted Patent B2
US 10,958,833 · App. 16/590,858 · Granted Mar 23, 2021

Electronic device for controlling frame rate of image sensor and method thereof

Inventors: Chansik Park (Suwon-si, KR); Hyungsuk Kim (Suwon-si, KR); Jaehun Cho (Suwon-si, KR); Jungeun Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23232H04N5/2258H04N5/2353H04N5/2354H04N5/247H04N5/907
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,958,833
App. No.
16/590,858
Granted
Mar 23, 2021
Kind
B2
Abstract

An electronic device for controlling a frame rate and a method therefor are provided. The electronic device includes an image sensor, and a processor. The processor is configured to sequentially obtain a first image, a second image, and a third image through the image sensor at a first time interval, generate a synthesized image by using the first image and the third image, identify a similarity between the second image and the synthesized image, sequentially obtain a fourth image, a fifth image, and a sixth image through the image sensor, at a second time interval long than the first time interval, based on the similarity being equal to or greater than a first threshold value, and sequentially obtain the fourth image, the fifth image, and the sixth image through the image sensor, at the first time interval, based on the similarity being less than a first threshold value.

Claims (72)

1. An electronic device comprising:

an image sensor;

at least one processor; and

a memory configured to store instructions which, when executed, cause the electronic device to:

sequentially obtain a first image, a second image, and a third image through the image sensor at a first time interval,

generate a first synthesized image by using the first image and the third image,

identify a similarity between the second image and the first synthesized image, and

sequentially obtain a fourth image, a fifth image, and a sixth image through the image sensor, at a second time interval longer than the first time interval, based on the similarity being equal to or greater than a first threshold value.

2. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

generate a second synthesized image using the fourth image and the fifth image;

arrange the second synthesized image between the fourth image and the fifth image;

generate a third synthesized image using the fifth image and the sixth image;

arrange the third synthesized image between the fifth image and the sixth image.

3. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

determine whether a specified condition is less than a second threshold value before obtaining the first image, the second image, and the third image,

wherein the specified condition comprises at least one of illuminance measured by a illuminance sensor of the electronic device, a residual battery level of the electronic device, a motion extent of at least one image obtained before obtaining the first image, or brightness of the at least one image.

4. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

sequentially obtain the fourth image, the fifth image, and the sixth image through the image sensor at the first time interval or a third time interval shorter than the first time interval, based on the similarity being less than the first threshold value.

5. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

generate a moving picture based on the first synthesized image instead of the second image, based on the similarity being equal to or greater than the first threshold value.

6. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

identify the similarity between the second image and the first synthesized image, based one at least one of Sum of Absolute Difference (SAD), Magnitude of Absolute Difference (MAD), a feature, or a keypoint, by at least one of:

comparing sub-sampled images of the second image and the first synthesized image with each other, or

comparing a partial region of the second image with a partial region of the first synthesized image.

7. The electronic device of claim 1 , wherein the at least one processor comprises:

a frame rate converter (FRC) configured to generate the first synthesized image;

an encoder configured to generate a moving picture; and

a control circuitry operatively connected with the FRC and the encoder.

8. The electronic device of claim 7 , wherein the control circuitry is configured to:

obtain motion vector information for the first image, the second image, and the third image, through the FRC; and

generate the moving picture based on the motion vector information, through the encoder.

9. A method of an electronic device, the method comprising:

sequentially obtaining a first image and a second image at a first time interval;

generating a first synthesized image using the first image and the second image;

identifying a similarity between the second image and the first synthesized image; and

sequentially obtaining a third image and a fourth image at a second time interval longer than the first time interval, based on the similarity being equal to or greater than a first threshold value.

10. The method of claim 9 , further comprising:

generating a second synthesized image using the third image and the fourth image; and

arranging the second synthesized image between the third image and the fourth image.

11. The method of claim 10 , further comprising:

generating a moving picture based on the first synthesized image instead of the second image, based on the similarity being equal to or greater than the first threshold value.

12. The method of claim 9 , further comprising:

determining whether a specified condition is less than a second threshold value before obtaining the first image and the second image,

wherein the specified condition comprises at least one of illuminance, a residual battery level of the electronic device, a motion extent of at least one image obtained before obtaining the first image, or brightness of the at least one image.

13. The method of claim 9 , further comprising:

sequentially obtaining the third image and the fourth image at the first time interval or a third time interval shorter than the first time interval, based on the similarity being less than the first threshold value.

14. The method of claim 9 , wherein the identifying of the similarity includes:

identifying the similarity between the second image and the first synthesized image, based one at least one of Sum of Absolute Difference (SAD), Magnitude of Absolute Difference (MAD), a feature, or a keypoint, by at least one of:

comparing sub-sampled images of the second image and the first synthesized image with each other, or

comparing a partial region of the second image with a partial region of the first synthesized image.

15. The method of claim 9 ,

wherein the sequentially obtaining of the first image and the second image includes:

obtaining a fifth image after the second image and before the third image, and

wherein the generating of the first synthesized image includes:

generating the first synthesized image based on the first image and the fifth image.

16. An electronic device comprising:

an image sensor;

at least one processor; and

a memory configured to store instructions which, when executed, cause the electronic device to:

sequentially obtain a first image and a second image through the image sensor at a first time interval,

identify a similarity between the first image and the second image, and

sequentially obtain a third image and a fourth image through the image sensor at a second time interval longer than the first time interval, based on the similarity being equal to or greater than a first threshold value.

17. The electronic device of claim 16 , wherein the instructions cause the electronic device to:

generate one or more synthesized images using the third image and the fourth image; and

arrange the one or more synthesized images between the third image and the fourth image.

18. The electronic device of claim 17 , wherein the instructions cause the electronic device to:

generate a moving picture using the first to fourth images and the one or more synthesized images.

19. The electronic device of claim 18 , wherein the at least one processor is further configured to:

determine whether a specified condition is less than a second threshold value before obtaining the first image and the second image,

wherein the specified condition comprises at least one of illuminance measured by a illuminance sensor of the electronic device, a residual battery level of the electronic device, a motion extent of at least one image obtained before obtaining the first image, or brightness of the at least one image.

20. The electronic device of claim 16 , wherein the instructions cause the electronic device to:

sequentially obtain the third image and the fourth image through the image sensor at the first time interval or a third time interval shorter than the first time interval, based on the similarity being less than the first threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: PARK, CHANSIK; KIM, HYUNGSUK; CHO, JAEHUN; LEE, JUNGEUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 050603/0692 →
Priority Claims (1)
KR 10-2019-0003616 · Jan 11, 2019 · national
Continuity (1)
Related Publication 20200228706A1 · Jul 16, 2020
Cited By (1)
US 12,472,873