IP Library › Granted Patent US 12,309,507
Granted Patent B2
US 12,309,507 · App. 18/131,582 · Granted May 20, 2025

Electronic device and method for controlling same

Inventors: Hyunsoo Choi (Suwon-si, KR); Seungsoo Kang (Suwon-si, KR); Heeyoon Kang (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N23/951H04N23/61H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,309,507
App. No.
18/131,582
Granted
May 20, 2025
Kind
B2
Abstract

An electronic device and a method for controlling same are disclosed. The electronic device includes a first camera having a first lens with a first focal distance, a second camera including a second lens having a second focal distance different from the first focal distance, a memory, and a processor which: acquires information on a first object included in a first image acquired by capturing surroundings of the electronic device through the first camera if it is identified, based on of the acquired information on the first object, that information on a second object associated with the first object exists, acquires a second image through the second camera and based on whether the second object is included in the acquired second image, determines a point of time when high-speed image capture is to be performed using the first camera.

Claims (85)

1. An electronic device comprising:

a first camera comprising a first lens having a first focal distance;

a second camera comprising a second lens having a second focal distance different from the first focal distance;

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions to:

obtain first information corresponding to a first object included in a first image obtained by the first camera,

identify second information corresponding to a second object associated with the first object based on the first information corresponding to the first object,

obtain a second image through the second camera based on identifying the second information, and

determine a time to perform high-speed capture using the first camera based on whether the second object is included in the second image.

2. The electronic device of claim 1 , wherein the processor is further configured to:

determine information on a first region of interest (ROI) in the first image, and

obtain the first information corresponding to the first object in the first ROI by applying the information on the first ROI to a first model trained to perform object recognition.

3. The electronic device of claim 1 , wherein the memory further stores knowledge base comprising information related to a plurality of objects,

wherein the processor is further configured to:

identify whether the first object is a moving object based on the first information corresponding to the first object,

based on identifying that the first object is a non-moving object, identify whether information about a type of a second object associated with a type of the first object exists in the knowledge base, and

based on identifying that the information about the type of the second object exists in the knowledge base, obtain the second image by activating the second camera.

4. The electronic device of claim 3 , wherein the knowledge base comprises a plurality of nodes comprising types of the plurality of objects and an edge comprising direction relationship information about a direction relationship among the plurality of nodes,

wherein the processor is further configured to:

identify a first node comprising a type of the first object among the plurality of objects in the knowledge base, and

identify whether a second node connected to the identified first node exists based on the direction relationship information.

5. The electronic device of claim 4 , wherein the processor is further configured to:

based on identifying that the second node connected to the first node exists in the knowledge base, obtain the second image by activating the second camera, and

identify whether the second object exists in the second image based on the direction relationship information included in an edge connected between the first node and the second node.

6. The electronic device of claim 5 , wherein the processor is further configured to:

based on identifying that the second object exists on the second image, estimate a moving direction of the second object, and

determine a second ROI in the second image based on the estimated moving direction of the second object.

7. The electronic device of claim 6 , wherein the processor is further configured to:

identify whether the second object is present in the determined second ROI, and

determine a point of time when the second object is present in the second ROI as the time to perform the high-speed capture using the first camera.

8. The electronic device of claim 3 , wherein the processor is further configured to:

based on identifying that the first object is a moving object using the first information corresponding to the first object, estimate a moving direction of the first object,

determine a third ROI in the first image based on the estimated moving direction of the first object, and

determine a point of time when the first object appears on the third ROI as the time to perform high-speed capture using the first camera.

9. The electronic device of claim 3 , wherein the processor is further configured to:

determine information on a first region of interest (ROI) in the first image,

based on identifying that information on a type of the second object associated with a type of the first object does not exist in the knowledge base, monitor a state change of the first object in the first ROI, and

determine a point of time that the state of the first object changes as the time to perform high-speed capture using the first camera.

10. The electronic device of claim 2 , wherein the processor is further configured to:

based on identifying that the first object is not included in the first ROI based on the information on the first ROI, obtain the second image by activating the second camera,

identify a third object on a region in the second image, the region not overlapping the first image, and

determine a point of time when the third object moves in a direction of the first image as the time to perform high-speed capture using the first camera.

11. A method of controlling an electronic device including a first camera having a first lens with a first focal distance and a second camera having a second lens with a second focal distance different from the first focal distance, the method comprising:

obtaining first information corresponding to a first object included in a first image obtained by the first camera;

identifying second information corresponding to a second object associated with the first object based on the first information corresponding to the first object,

obtaining a second image through the second camera based on identifying the second information; and

determining a time to perform high-speed capture using the first camera, based on whether the second object is included in the second image.

12. The method of claim 11 , wherein the obtaining first information corresponding to the first object comprises:

determining information on a first region of interest (ROI) in the first image; and

obtaining the first information corresponding to the first object in the first ROI by applying the information on the first ROI to a first model trained to perform object recognition.

13. The method of claim 11 , wherein the obtaining the second image comprises:

identifying whether the first object is a moving object based on the first information corresponding to the first object,

based on identifying that the first object is a non-moving object, identifying whether information about a type of a second object associated with a type of the first object exists in a knowledge base stored in a memory, the knowledge base including information related to a plurality of objects; and

based on identifying that the information about the type of the second object exists in the knowledge base, obtaining the second image by activating the second camera.

14. The method of claim 13 , wherein the knowledge base includes a plurality of nodes including types of the plurality of objects and an edge including direction relationship information about a direction relationship among the plurality of nodes,

wherein the determining the time to perform high-speed capture using the first camera comprises:

identifying a first node including a type of the first object among the plurality of objects in the knowledge base, and

identifying whether a second node connected to the identified first node exists based on the direction relationship information in the knowledge base.

15. The method of claim 14 , wherein the determining the time to perform high-speed capture using the first camera further comprises:

based on identifying that the second node connected to the first node exists in the knowledge base, obtaining the second image by activating the second camera; and

identifying whether the second object exists in the second image based on the direction relationship information included in an edge connected between the first node and the second node.

16. An electronic device comprising:

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions to:

obtain first information corresponding to a first object included in a first image, the first image comprising a plurality of first frames,

identify second information corresponding to a second object associated with the first object based on the first information corresponding to the first object,

obtain a second image based on identifying the second information, the second image comprising a plurality of second frames, and

determine a time to perform high-speed capture based on whether the second object is included in the second image.

17. The electronic device of claim 16 , wherein the processor is further configured to:

determine information on a first region of interest (ROI) in the first image, and

obtain the information corresponding to the first object in the first ROI by applying the information on the first ROI to a first model trained to perform object recognition.

18. The electronic device of claim 16 , wherein the memory further stores knowledge base comprising information related to a plurality of objects,

wherein the processor is further configured to:

identify whether the first object is a moving object based on the first information corresponding to the first object,

based on identifying that the first object is a non-moving object, identify whether information about a type of a second object associated with a type of the first object exists in the knowledge base, and

based on identifying that the information about the type of the second object exists in the knowledge base, obtain the second image.

19. The electronic device of claim 18 , wherein the knowledge base comprises a plurality of nodes comprising types of the plurality of objects and an edge comprising direction relationship information about a direction relationship among the plurality of nodes,

wherein the processor is further configured to:

identify a first node comprising a type of the first object among the plurality of objects in the knowledge base, and

identify whether a second node connected to the identified first node exists based on the direction relationship information.

20. A non-transitory computer readable recording medium storing a program for executing an operating method, the operation method including:

obtaining first information corresponding to a first object included in a first image, the first image comprising a plurality of first frames,

identifying second information corresponding to a second object associated with the first object based on the first information corresponding to the first object,

obtaining a second image based on identifying the second information, the second image comprising a plurality of second frames, and

determining a time to perform high-speed capture based on whether the second object is included in the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2023
From: CHOI, HYUNSOO; KANG, SEUNGSOO; KANG, HEEYOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063246/0243 →
Priority Claims (2)
KR 10-2020-0141202 · Oct 28, 2020 · national
KR 10-2021-0003533 · Jan 11, 2021 · national
Continuity (2)
Continuation PCTKR2021012513 · Sep 14, 2021
Related Publication 20230276140A1 · Aug 31, 2023
References Cited (27)
US 10553116B2 · Yi et al. · 2020 [cited by applicant]
US 10715716B2 · Lee et al. · 2020 [cited by applicant]
US 10785387B2 · Kim et al. · 2020 [cited by applicant]
US 11102409B2 · An · 2021 [cited by applicant]
US 11290633B2 · Lee et al. · 2022 [cited by applicant]
US 11533428B2 · Sindhagatta Krishnappa et al. · 2022 [cited by applicant]
US 20150229889A1 · Boettiger · 2015 [cited by examiner]
US 20160248988A1 · Urfalioglu · 2016 [cited by examiner]
US 20180137119A1 · Li et al. · 2018 [cited by applicant]
US 20190260914A1 · Kim et al. · 2019 [cited by applicant]
US 20190281206A1 · Lee et al. · 2019 [cited by applicant]
US 20200012868A1 · Hong et al. · 2020 [cited by applicant]
US 20200077019A1 · Kim et al. · 2020 [cited by applicant]
US 20200128181A1 · An · 2020 [cited by applicant]
US 20200304704A1 · Lee et al. · 2020 [cited by applicant]
US 20220224825A1 · Lee et al. · 2022 [cited by applicant]
US 20220301351A1 · Zhao · 2022 [cited by examiner]
EP 3641294A1 · 2020 [cited by applicant]
KR 1020190101115A · 2019 [cited by applicant]
KR 1020190101706A · 2019 [cited by applicant]
KR 1020190120489A · 2019 [cited by applicant]
KR 102053940B1 · 2019 [cited by applicant]
KR 1020200043818A · 2020 [cited by applicant]
KR 1020210095547A · 2021 [cited by applicant]
Extended European Search Report dated Jan. 22, 2024 in European Application No. 21886554.1. [cited by applicant]
International Search Report (PCT/ISA/210) issued Dec. 16, 2021 by the International Searching Authority in counterpart International Patent Application No. PCT/KR2021/012513. [cited by applicant]
Written Opinion (PCT/ISA/237) issued Dec. 16, 2021 by the International Searching Authority in counterpart International Patent Application No. PCT/KR2021/012513. [cited by applicant]