IP Library Granted Patent US 12,513,402
Granted Patent B2
US 12,513,402 · App. 18/496,325 · Granted Dec 30, 2025

Image processing method and electronic device for supporting same

Inventors: Kyungdong Yang (Suwon-si, KR); Soonae Kim (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N23/695G02B7/18G06T7/70G06V10/25H04N23/61G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,402
App. No.
18/496,325
Granted
Dec 30, 2025
Kind
B2
Abstract

An electronic device disclosed herein includes: a display, a memory, a processor, and a camera, the camera includes a lens unit including a lens, a prism rotatable in a first direction or a second direction, a driving unit including at least one coil configured to move the prism, a magnetic body coupled to the prism, a sensor unit including a sensor configured to detect a first amount of rotation of the prism in the first direction or a second amount of rotation thereof in the second direction, and an image sensor configured to generate an electrical signal using light passing through the lens unit and the prism, wherein the processor is configured to: determine a first region of interest (ROI) for execution of a specified function using the camera, determine the first amount of rotation or the second amount of rotation using a sensing value of the sensor unit, and determine a second region of interest by correcting the first region of interest of the camera using the first amount of rotation or the second amount of rotation.

Claims (47)

1 . An electronic device comprising:

a display;

memory;

a processor comprising processing circuitry; and

a camera,

wherein the camera includes:

a lens unit including a lens;

a prism rotatable in a first direction or a second direction;

a driving unit comprising at least one coil configured to move the prism;

a magnetic body coupled to the prism;

a sensor unit including a sensor configured to detect a first amount of rotation of the prism in the first direction or a second amount of rotation thereof in the second direction; and

an image sensor configured to generate an electrical signal using light passing through the lens unit and the prism, wherein

the processor is configured to:

determine a first region of interest (ROI) for execution of a specified function using the camera;

determine the first amount of rotation or the second amount of rotation using a sensing value of the sensor unit; and

determine a second region of interest by correcting the first region of interest of the camera using the first amount of rotation or the second amount of rotation,

wherein the sensor unit includes:

a first Hall sensor configured to detect the first amount of rotation; and

a second Hall sensor and a third Hall sensor configured to detect the second amount of rotation.

2 . The electronic device of claim 1 , wherein the processor is configured to:

recognize an external object; and

rotate the prism in the first direction or the second direction corresponding to a position of the external object.

3 . The electronic device of claim 1 , wherein the processor is configured to determine the first amount of rotation and the second amount of rotation by comparing first sensing data and second sensing data acquired through the sensor unit with a table stored in the memory.

4 . The electronic device of claim 1 , wherein the processor is configured to determine the first amount of rotation using first sensing data and second sensing data acquired through the sensor unit and determine the second amount of rotation using the second sensing data.

5 . The electronic device of claim 1 , wherein the processor is configured to determine the second region of interest by rotating the first region of interest corresponding to the first amount of rotation.

6 . The electronic device of claim 1 , wherein the processor is configured to determine the second region of interest by changing a length or ratio of at least one side of the first region of interest corresponding to the second amount of rotation.

7 . The electronic device of claim 1 , wherein the processor is configured to acquire data for executing the function using the second region of interest.

8 . The electronic device of claim 7 , wherein the processor is configured to move the prism by operating the driving unit based on the data.

9 . The electronic device of claim 1 , wherein the processor is configured to determine the second region of interest by background execution.

10 . The electronic device of claim 1 , wherein the specified function is one of settings related to 3A, including automatic exposure (AE), automatic focus (AF), and/or automatic white-balance (AWB), object tracking (OT), or face detection-based photographing.

11 . The electronic device of claim 1 , wherein the processor is configured to determine the second region of interest for all frames of image data acquired through the image sensor.

12 . The electronic device of claim 1 , wherein the processor is configured to determine the first region of interest by recognizing an external object.

13 . The electronic device of claim 1 , wherein the processor is configured to:

display the first region of interest on the display; and

not display the second region of interest on the display.

14 . A method of image processing performed in an electronic device, the image processing method comprising:

determining a first region of interest (ROI) for execution of a specified function using a camera of the electronic device;

determining a first amount of rotation or a second amount of rotation of the camera using a sensing value of a sensor unit of the camera; and

determining a second region of interest by correcting the first region of interest of the camera using the first amount of rotation or the second amount of rotation,

wherein the sensor unit includes:

a first Hall sensor configured to detect the first amount of rotation; and

a second Hall sensor and a third Hall sensor configured to detect the second amount of rotation.

15 . The method of claim 14 , wherein the determining of the first region of interest includes recognizing an external object and rotating a prism in a first direction or a second direction corresponding to a position of the external object.

16 . The method of claim 14 , wherein the determining of the first amount of rotation or the second amount of rotation includes determining the first amount of rotation and the second amount of rotation by comparing first sensing data and second sensing data acquired through the sensor unit with a table stored in a memory of the electronic device.

17 . The method of claim 14 , wherein the determining of the first amount of rotation or the second amount of rotation includes determining the first amount of rotation using first sensing data and second sensing data acquired through the sensor unit and determining the second amount of rotation using the second sensing data.

18 . The method of claim 14 , wherein the determining of the second region of interest includes determining the second region of interest by rotating the first region of interest corresponding to the first amount of rotation.

19 . The method of claim 14 , wherein the determining of the second region of interest includes determining the second region of interest by changing a length or ratio of at least one side of the first region of interest corresponding to the second amount of rotation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2023
From: YANG, KYUNGDONG; KIM, SOONAE
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 065374/0242 →
Priority Claims (1)
KR 10-2021-0055108 · Apr 28, 2021 · national
Continuity (2)
Continuation PCTKR2022005902 · Apr 26, 2022
Related Publication 20240056687A1 · Feb 15, 2024
References Cited (39)
US 8614743B2 · Winsor · 2013 [cited by applicant]
US 9285566B2 · Chan et al. · 2016 [cited by applicant]
US 9396529B2 · Tsubota et al. · 2016 [cited by applicant]
US 9632327B2 · Chan et al. · 2017 [cited by applicant]
US 9836829B2 · Tsubota et al. · 2017 [cited by applicant]
US 10126633B2 · Avivi et al. · 2018 [cited by applicant]
US 10162191B2 · Chan et al. · 2018 [cited by applicant]
US 10366477B2 · Tsubota et al. · 2019 [cited by applicant]
US 10372022B2 · Avivi et al. · 2019 [cited by applicant]
US 10645286B2 · Fridman et al. · 2020 [cited by applicant]
US 10712581B2 · Chan et al. · 2020 [cited by applicant]
US 10969652B2 · Miller et al. · 2021 [cited by applicant]
US 11086099B2 · Lim et al. · 2021 [cited by applicant]
US 11347076B2 · Chan et al. · 2022 [cited by applicant]
US 11609411B2 · Byon et al. · 2023 [cited by applicant]
US 11671711B2 · Fridman et al. · 2023 [cited by applicant]
US 20090079824A1 · Winsor · 2009 [cited by examiner]
US 20160292833A1 · Tsubota et al. · 2016 [cited by applicant]
US 20190212632A1 · Miller et al. · 2019 [cited by applicant]
US 20200319439A1 · Byon et al. · 2020 [cited by applicant]
US 20210048605A1 · Lim et al. · 2021 [cited by applicant]
US 20210223662A1 · Miller et al. · 2021 [cited by applicant]
US 20220004018A1 · Kang · 2022 [cited by examiner]
JP 2009077405 · 2009 [cited by applicant]
KR 1020090078463 · 2009 [cited by applicant]
KR 1020160042066 · 2016 [cited by applicant]
KR 1020180007570 · 2018 [cited by applicant]
KR 1020180031068 · 2018 [cited by applicant]
KR 1020190117644 · 2019 [cited by applicant]
KR 1020200053958 · 2020 [cited by applicant]
KR 1020200097766 · 2020 [cited by applicant]
KR 102131597 · 2020 [cited by applicant]
KR 1020200118709 · 2020 [cited by applicant]
KR 1020210019787 · 2021 [cited by applicant]
KR 1020210030230 · 2021 [cited by applicant]
YouTube video, “A Friendly SEM Who Reads Samsung Electro-Mechanics Press Realease I Dual Folded Camera Module”, Mar. 1, 2021, 10 pages. [cited by applicant]
International Search Report dated Aug. 11, 2022 in PCT/KR2022/005902, 5 pages. [cited by applicant]
Written opinion dated Aug. 11, 2022 in PCT/KR2022/005902, 3 pages. [cited by applicant]
Action dated Jun. 5, 2025 in Korean Application No. 10-2021-0055108 and English-language. [cited by applicant]