IP Library › Granted Patent US 11,223,761
Granted Patent B2
US 11,223,761 · App. 16/539,422 · Granted Jan 11, 2022

Electronic device for obtaining images by controlling frame rate for external moving object through point of interest, and operating method thereof

Inventors: Junghyung Kim (Suwon-si, KR); Jaehyoung Park (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23232G06T7/292H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,223,761
App. No.
16/539,422
Granted
Jan 11, 2022
Kind
B2
Abstract

An electronic device for obtaining a plurality of images by controlling a frame rate, and an operating method thereof is provided. The electronic device includes at least one camera, a memory, and a processor. The processor is configured to set a first point of interest and a second point of interest related to a moving image to be generated by using the camera, obtain a plurality of first images according to a first frame rate by using the camera, identify, through the first point of interest and the second point of interest by using at least a part of the plurality of first images, an external object that is being moved, in response to a motion of the external object through the first point of interest, obtain a plurality of second images regarding the external object according to a second frame rate by using the camera, in response to a motion of the external object through the second point of interest, obtain a plurality of third images regarding the external object according to the second frame rate or a third frame rate by using the camera, and generate the moving image including the plurality of first images, the plurality of second images, and the plurality of third images.

Claims (71)

1. An electronic device comprising:

at least one camera;

a memory; and

a processor,

wherein the processor is configured to:

set a first point of interest and a second point of interest related to a moving image to be generated by using the at least one camera, the first point of interest and the second point of interest being separated by a path which at least one external object is to be moved, the path separating the first point of interest and the second point of interest being set by the processor prior to movement of the at least one external object through a region of the first point of interest,

obtain a plurality of first images according to a first frame rate by using the at least one camera,

identify, through the first point of interest and the second point of interest by using at least a part of the plurality of first images, the at least one external object that is moving,

in response to a motion of the at least one external object through the first point of interest, obtain a plurality of second images regarding the at least one external object according to a second frame rate higher than the first frame rate by using the at least one camera,

in response to a motion of the at least one external object through the second point of interest, obtain a plurality of third images regarding the at least one external object according to the second frame rate or a third frame rate higher than the first frame rate by using the at least one camera, and

generate, as a part of the moving image, the moving image comprising at least one of a first section generated by using at least a part of the plurality of first images, a second section generated by using the plurality of second images, or a third section generated by using the plurality of third images.

2. The electronic device of claim 1 , wherein the processor is further configured to:

identify the path set in relation to the first point of interest and the second point of interest, and

identify the at least one external object through the first point of interest and the second point of interest based on orders of the first point of interest and the second point of interest according to the path.

3. The electronic device of claim 2 , wherein the processor is further configured to complete shooting of the moving image based on the orders or the path.

4. The electronic device of claim 2 , wherein the processor is further configured to:

monitor a motion path of the at least one external object, and

determine whether to generate the first section or the second section based on a comparison of the motion path of the at least one external object and the path.

5. The electronic device of claim 4 , wherein the processor is further configured to, in response to the at least one external object being positioned within a threshold range from a start point of the path:

determine to generate the first section, and

obtain the plurality of first images according to the first frame rate.

6. The electronic device of claim 4 , wherein the processor is further configured to, in response to the at least one external object being positioned out of a threshold range from the path, restrain from generating at least one of the second section or the third section.

7. The electronic device of claim 1 , wherein the processor is further configured to:

identify at least one of a monitoring order or a monitoring method regarding the first point of interest and the second point of interest, or a number of times of detection of an external object,

select one or more of the first point of interest and the second point of interest based on at least one of the monitoring order, the monitoring method, or the number of times of detection of the external object, and

identify the at least one external object through the selected one or more of the first point of interest and the second point of interest.

8. The electronic device of claim 1 ,

wherein the at least one external object comprises a first external object and a second external object, and

wherein the processor is further configured to:

detect a motion of the first external object through the first point of interest, and

detect a motion of the second external object through the second point of interest.

9. The electronic device of claim 1 , wherein the processor is further configured to:

determine a shooting time regarding the first point of interest, and

obtain the plurality of second images regarding the at least one external object according to the second frame rate for the determined shooting time.

10. The electronic device of claim 9 , wherein the shooting time is determined based on at least one of a user input, a size of the first point of interest, or a time during which a motion of the at least one external object is detected through the first point of interest.

11. The electronic device of claim 1 ,

wherein the at least one camera comprises a first camera and a second camera, the first camera having a first angle of view, the second camera having a second angle of view larger than or equal to the first angle of view, and

wherein the processor is further configured to:

set the first point of interest and the second point of interest in a preview region of the first camera having the first angle of view,

set a moving image shooting trigger region in a preview region of the second camera having the second angle of view, and

in response to the at least one external object being detected through the moving image shooting trigger region, control the first camera to obtain the plurality of first images according to the first frame rate.

12. A method of an electronic device, the method comprising:

setting a first point of interest and a second point of interest related to a moving image to be generated by using at least one camera, the first point of interest and the second point of interest being separated by a path which at least one external object is to be moved, the path separating the first point of interest and the second point of interest being set prior to movement of the at least one external object through a region of the first point of interest;

obtaining a plurality of first images according to a first frame rate by using the at least one camera;

identifying, through the first point of interest and the second point of interest by using at least a part of the plurality of first images, the at least one external object that is moving;

in response to a motion of the at least one external object through the first point of interest, obtaining a plurality of second images regarding the at least one external object according to a second frame rate higher than the first frame rate by using the at least one camera;

in response to a motion of the at least one external object through the second point of interest, obtaining a plurality of third images regarding the at least one external object according to the second frame rate or a third frame rate higher than the first frame rate by using the at least one camera; and

generating, as a part of the moving image, the moving image comprising at least one of a first section generated by using at least a part of the plurality of first images, a second section generated by using the plurality of second images, or a third section generated by using the plurality of third images.

13. The method of claim 12 , wherein the identifying of the at least one external object through the first point of interest and the second point of interest comprises:

identifying the path set in relation to the first point of interest and the second point of interest; and

identifying the at least one external object through the first point of interest and the second point of interest based on orders of the first point of interest and the second point of interest according to the path.

14. The method of claim 13 , further comprising completing shooting of the moving image based on the orders or the path.

15. The method of claim 13 , further comprising:

monitoring a motion path of the at least one external object; and

determining whether to generate the first section or the second section based on a comparison of the motion path of the at least one external object and the path.

16. The method of claim 15 , wherein the determining of whether to generate the first section or the second section comprises:

in response to the at least one external object being positioned within a threshold range from a start point of the path, determining to generate the first section; and

in response to the at least one external object being positioned out of the threshold range from the path, restraining from generating at least one of the second section or the third section.

17. The method of claim 12 , wherein the identifying of the at least one external object through the first point of interest and the second point of interest comprises:

identifying at least one of a monitoring order or a monitoring method regarding the first point of interest and the second point of interest, or a number of times of detection of an external object;

selecting one or more of the first point of interest and the second point of interest based on at least one of the monitoring order, the monitoring method, or the number of times of detection of the external object; and

identifying the at least one external object through the selected one or more of the first point of interest and the second point of interest.

18. The method of claim 12 ,

wherein the at least one external object comprises a first external object and a second external object, and

wherein the identifying of the at least one external object through the first point of interest and the second point of interest comprises:

detecting a motion of the first external object through the first point of interest; and

detecting a motion of the second external object through the second point of interest.

19. The method of claim 12 , wherein the obtaining of the plurality of second images by using the at least one camera comprises:

determining a shooting time regarding the first point of interest; and

obtaining the plurality of second images regarding the at least one external object according to the second frame rate for the determined shooting time.

20. The method of claim 19 , wherein the shooting time is determined based on at least one of a user input, a size of the first point of interest, or a time during which a motion of the at least one external object is detected through the first point of interest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: KIM, JUNGHYUNG; PARK, JAEHYOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 050039/0668 →
Priority Claims (1)
KR 10-2018-0105372 · Sep 4, 2018 · national
Continuity (1)
Related Publication 20200077019A1 · Mar 5, 2020
Cited By (1)
US 12,200,376