IP Library › Granted Patent US 12,452,524
Granted Patent B2
US 12,452,524 · App. 18/454,064 · Granted Oct 21, 2025

Electronic device for cropping subject within image frames and method thereof

Inventors: Sungwook Youn (Suwon-si, KR); Yanggeun Oh (Suwon-si, KR); Woojhon Choi (Suwon-si, KR); Byungjun Son (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N23/632G06T7/246H04N5/2628H04N23/61H04N23/635G06T2207/20132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,452,524
App. No.
18/454,064
Granted
Oct 21, 2025
Kind
B2
Abstract

An electronic device includes a display, a camera, and a processor. The processor receives, while displaying a preview image through the display based on at least portion of image frames obtained through the camera, an input with respect to a preset button. The processor switches to an auto framing mode in response to the photographing input. The processor identifies a first area matched to a subject captured by the camera, and a second area including a preset portion of the subject in the first area. The processor, based on predicting a moving direction of the subject in the image frames by a position of the second area in the first area, displays the preview image by performing cropping with respect to at least one of the image frames.

Claims (73)

1. An electronic device, comprising:

a display;

a camera; and

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the electronic device to:

receive, while displaying a preview image through the display based on at least a portion of image frames obtained through the camera, an input with respect to a preset button;

switch to an auto framing mode in response to the input;

identify a first area matched to a subject captured by the camera, and a second area that includes a preset portion of the subject and is a portion of the first area;

identify a first coordinate value which is a center of the first area and a second coordinate value which is a center of the second area;

identify, based on the first coordinate value and the second coordinate value, a vector extended from the center of the first area to the center of the second area in a same image frame; and

based on predicting a moving direction of the subject in the image frames by the vector, display the preview image by performing cropping with respect to at least one of the image frames.

2. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

determine one point forming an edge of the image frames as an origin of coordinate system; and

identify, based on the determined point, the first coordinate value and the second coordinate value.

3. The electronic device of claim 2 , wherein the instructions cause the electronic device to:

obtain, based on the first coordinate value and the second coordinate value, a weight to be applied to the vector.

4. The electronic device of claim 1 , wherein the subject includes a first subject and a second subject different from the first subject,

wherein the instructions cause the electronic device to:

assign, based on identifying the first subject and the second subject in the image frames, a first identifier and a second identifier to the first subject and the second subject, respectively.

5. The electronic device of claim 4 , wherein the instructions cause the electronic device to:

perform, based on assigning the first and second identifiers to the first and second subjects identified in the image frames, respectively, cropping to include the first and second subjects.

6. The electronic device of claim 1 , further comprising a sensor;

wherein the instructions cause the electronic device to:

identify, based on data obtained by using the sensor, motion of the electronic device; and

obtain, based on identifying the motion of the electronic device, a video as the preview image.

7. The electronic device of claim 1 , wherein the subject includes a first subject and a second subject different from the first subject,

wherein the instructions cause the electronic device to:

identify, in the image frames, a feature point of the second subject;

identify, based on identifying the feature point, a moving direction associated with the feature point of the second subject in the image frames; and

track, based on identifying the moving direction associated with the feature point of the second subject, the first subject.

8. The electronic device of claim 1 , wherein the instructions cause the electronic device to:

based on identifying the subject classified to an animal, identify, in the first area, the second area where a head of the animal is captured.

9. A method of an electronic device, comprising:

receiving, while displaying a preview image through the display based on at least a portion of image frames obtained through the camera, an input with respect to a preset button;

switching to an auto framing mode in response to the input;

identifying a first area matched to a subject captured by the camera, and a second area that includes a preset portion of the subject and is a portion of the first area;

identifying a first coordinate value which is a center of the first area and a second coordinate value which is a center of the second area;

identifying, based on the first coordinate value and the second coordinate value, a vector extended from the center of the first area to the center of the second area in a same image frame; and

based on predicting a moving direction of the subject in the image frames by the vector, displaying the preview image by performing cropping with respect to at least one of the image frames.

10. The method of claim 9 , wherein the displaying comprises:

determining one point forming an edge of the image frames as an origin of coordinate system; and

identifying, based on the determined point, the first coordinate value and the second coordinate value.

11. The method of claim 10 , wherein the displaying comprises:

obtaining, based on the first coordinate value and the second coordinate value, a weight to be applied to the vector.

12. The method of claim 9 , wherein the displaying comprises:

assigning, based on identifying the subject that is a first subject and a second subject that is different from the first subject in the image frames, a first identifier and a second identifier to the first subject and the second subject, respectively.

13. The method of claim 12 , wherein the displaying comprises:

performing, based on assigning the first and second identifiers to the first and second subjects identified in the image frames, cropping to include the first and second subjects.

14. The method of claim 9 , further comprises:

identifying, based on data obtained by using a sensor, motion of the electronic device; and

obtaining a video as the preview image based on identifying the motion of the electronic device.

15. The method of claim 9 , wherein the subject includes a first subject and a second subject different from the first subject,

wherein the method further comprises:

identifying, in the image frames, a feature point of the second subject;

identifying, based on identifying the feature point, a moving direction associated with the feature point of the second subject in the image frames; and

tracking, based on identifying the moving direction associated with the feature point of the second subject, the first subject.

16. The method of claim 9 , further comprises:

based on identifying the subject classified to an animal, identifying, in the first area, the second area where a head of the animal is captured.

17. A computer-readable storage medium storing one or more programs, wherein the one or more programs, when executed by a processor of an electronic device, cause the processor to:

receive, while displaying a preview image through the display based on at least a portion of image frames obtained through the camera, an input with respect to a preset button;

switch to an auto framing mode in response to the input;

identify a first area matched to a subject captured by the camera, and a second area that includes a preset portion of the subject and is a subset of the first area;

identify a first coordinate value which is a center of the first area and a second coordinate value which is a center of the second area;

identify, based on the first coordinate value and the second coordinate value, a vector extended from the center of the first area to the center of the second area in a same image frame; and

based on predicting a moving direction of the subject in the image frames by the vector, display the preview image by performing cropping with respect to at least one of the image frames.

18. The computer-readable storage medium of claim 17 , wherein the one or more programs, when executed by a processor of an electronic device, cause the processor to:

determine one point forming an edge of the image frames as an origin of coordinate system; and

identify, based on the determined point, the first coordinate value and the second coordinate value.

19. The computer-readable storage medium of claim 18 , wherein the one or more programs, when executed by a processor of an electronic device, cause the processor to:

obtain, based on the first coordinate value and the second coordinate value, a weight to be applied to the vector.

20. The computer-readable storage medium of claim 17 , wherein the subject includes a first subject and a second subject different from the first subject,

wherein the one or more programs, when executed by a processor of an electronic device, cause the processor to:

assign, based on identifying the first subject and the second subject in the image frames, a first identifier and a second identifier to the first subject and the second subject, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2023
From: YOUN, SUNGWOOK; OH, YANGGEUN; CHOI, WOOJHON; SON, BYUNGJUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 064671/0024 →
Priority Claims (2)
KR 10-2022-0160963 · Nov 25, 2022 · national
KR 10-2023-0008367 · Jan 19, 2023 · national
Continuity (2)
Continuation PCTKR2023012304 · Aug 18, 2023
Related Publication 20240179399A1 · May 30, 2024
References Cited (25)
US 8421887B2 · Yokohata · 2013 [cited by applicant]
US 9736356B2 · Nonaka · 2017 [cited by applicant]
US 9781350B2 · Gao et al. · 2017 [cited by applicant]
US 10451705B2 · Irie · 2019 [cited by applicant]
US 10819911B2 · Ryu et al. · 2020 [cited by applicant]
US 11700452B2 · Xu et al. · 2023 [cited by applicant]
US 11790541B2 · Yoon et al. · 2023 [cited by applicant]
US 12118062B2 · Lee et al. · 2024 [cited by applicant]
US 20210407103A1 · Tang et al. · 2021 [cited by applicant]
US 20220138493A1 · Lee et al. · 2022 [cited by applicant]
US 20230074962A1 · Jeon et al. · 2023 [cited by applicant]
US 20230188845A1 · Youn et al. · 2023 [cited by applicant]
JP 2011048116A · 2011 [cited by applicant]
JP 2017194787A · 2017 [cited by examiner]
JP 6395381B2 · 2018 [cited by applicant]
JP 2021192498A · 2021 [cited by applicant]
KR 20050067582A · 2005 [cited by applicant]
KR 20180089976A · 2018 [cited by applicant]
KR 101983725B1 · 2019 [cited by applicant]
KR 20200050553A · 2020 [cited by applicant]
KR 20220017298A · 2022 [cited by applicant]
KR 20220059194A · 2022 [cited by applicant]
KR 20220129905A · 2022 [cited by applicant]
KR 20220151451A · 2022 [cited by applicant]
International Search Report mailed Dec. 12, 2023 and Written Opinion for PCT/KR2023/012304. [cited by applicant]