IP Library Granted Patent US 12,348,865
Granted Patent B2
US 12,348,865 · App. 17/873,468 · Granted Jul 1, 2025

Electronic device, and method for performing autofocus by rotating or reordering AF data

Inventors: Changwoo Lee (Suwon-si, KR); Dohan Kim (Suwon-si, KR); Jinmin Bang (Suwon-si, KR); Jaehun Cho (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N23/672H04N25/704H10F39/182H04N25/11H10F39/8063
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,865
App. No.
17/873,468
Filed
Jul 26, 2022
Granted
Jul 1, 2025
Kind
B2
Art Unit
2878
USPC
257/432
Abstract

An electronic device is provided. The electronic device includes an image sensor including a plurality of pixels, an AP processing unit, a memory, and a control unit. Each pixel included in the plurality of pixels includes a plurality of photodiodes and a microlens. The control unit provides at least one of a first piece of AF data and a second piece of AF data to the AF processing unit, and the AF processing unit may execute a first phase autofocus (PAF) operation based on the first piece of AF data or execute a second PAF operation based on the second piece of AF data.

Claims (47)

1. An electronic device comprising:

an image sensor including a plurality of pixels, wherein each pixel included in the plurality of pixels includes a plurality of photo diodes and a microlens configured to cover the plurality of photo diodes;

an auto focus (AF) processing unit including at least one AF circuit performing calculation for performing auto focus based on a phase difference;

memory, comprising one or more storage media, storing instructions; and

one or more processors communicatively coupled with the image sensor, the AF processing unit, and the memory,

wherein the instructions, when executed by the one or more processors individually or collectively, cause the electronic device to:

deliver data obtained by the image sensor to the AF processing unit or the memory,

provide the AF processing unit with first AF data of photo diodes arranged in a first direction among the plurality of photo diodes, and

provide the AF processing unit with second AF data of photo diodes arranged in a second direction among the plurality of photo diodes by rotating or reordering the second AF data to have a data structure in the first direction, and

wherein the AF processing unit performs first phase auto focus (PAF) calculation based on the first AF data and performs second PAF calculation based on the second AF data.

2. The electronic device of claim 1 ,

wherein the AF processing unit includes a first AF circuit and a second AF circuit, and

wherein the second AF circuit performs the second PAF calculation, while the first AF circuit performs the first PAF calculation.

3. The electronic device of claim 1 ,

wherein the AF processing unit includes one AF circuit, and

wherein the AF circuit performs the first (PAF) calculation and performs the second PAF calculation, when the first (PAF) calculation is ended.

4. The electronic device of claim 1 , wherein the AF processing unit selects one of the first direction or the second direction by means of a direction filter and performs PAF calculation for AF data corresponding to the selected direction.

5. The electronic device of claim 1 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to store the first AF data or the second AF data in the memory.

6. The electronic device of claim 1 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to provide the AF processing unit with the first AF data or the second AF data with a Bayer pattern or a processing pattern.

7. The electronic device of claim 1 ,

wherein the AF processing unit performs the first PAF calculation during a process where the first AF data and the second AF data are stored in the memory, and calculates the second PAF calculation after the process is ended.

8. The electronic device of claim 1 ,

wherein the AF processing unit performs the first PAF calculation while the first AF data and the second AF data are read out by means of the image sensor, and performs the second PAF calculation after the readout is ended.

9. The electronic device of claim 1 ,

wherein the image sensor is formed such that each microlens covers four photo diodes, and

wherein the AF processing unit compares measurement values of two photo diodes to perform PAF calculation.

10. The electronic device of claim 1 ,

wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to set priorities based on measurement values of photo diodes corresponding to a plurality of directions including the first direction and the second direction, and

wherein the AF processing unit performs PAF calculation, based on the set priorities.

11. The electronic device of claim 10 ,

wherein the AF processing unit includes a plurality of PAF circuits respectively corresponding to the plurality of directions, and

wherein each of the plurality of PAF circuits starts the PAF calculation at the same time.

12. The electronic device of claim 10 ,

wherein the AF processing unit includes one AF circuit, and

wherein the AF processing unit sequentially performs PAF calculation according to the set priorities.

13. A method for performing auto focus (AF) performed in an electronic device, the method comprising:

obtaining image data using an image sensor including a plurality of pixels;

obtaining first AF data of photo diodes arranged in a first direction among a plurality of photo diodes included in each pixel included in the plurality of pixels based on the image data;

obtaining second AF data of photo diodes arranged in a second direction among the plurality of photo diodes based on the image data by rotating or reordering the second AF data to have a data structure in the first direction; and

performing first (PAF) calculation based on the first AF data and second PAF calculation based on the second AF data.

14. The method of claim 13 , further comprising:

selecting, by the AF processing unit, one of the first direction or the second direction using a direction filter; and

performing PAF calculation for AF data corresponding to the selected direction.

15. The method of claim 13 , further comprising:

storing the first AF data or the second AF data.

16. The method of claim 13 , further comprising:

setting priorities based on measurement values of photo diodes corresponding to a plurality of directions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2022
From: LEE, CHANGWOO; KIM, DOHAN; BANG, JINMIN; CHO, JAEHUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 060623/0665 →
Priority Claims (1)
KR 10-2020-0013175 · Feb 4, 2020 · national
Continuity (2)
Continuation PCTKR2021001496 · Feb 4, 2021
Related Publication 20220359597A1 · Nov 10, 2022
References Cited (57)
US 8036521B2 · Ono et al. · 2011 [cited by applicant]
US 8749697B2 · Sakaida · 2014 [cited by applicant]
US 9270879B2 · Hamada · 2016 [cited by applicant]
US 9654681B2 · Seo · 2017 [cited by applicant]
US 9787889B2 · Johnson · 2017 [cited by applicant]
US 9794472B2 · Aoki et al. · 2017 [cited by applicant]
US 9807294B2 · Liu et al. · 2017 [cited by applicant]
US 9973678B2 · Mandelli et al. · 2018 [cited by applicant]
US 9973682B2 · Ham · 2018 [cited by applicant]
US 10015389B2 · Lu et al. · 2018 [cited by applicant]
US 10075639B2 · Jeong · 2018 [cited by applicant]
US 10387477B2 · Galor Gluskin et al. · 2019 [cited by applicant]
US 10410374B2 · Du et al. · 2019 [cited by applicant]
US 10440301B2 · Li et al. · 2019 [cited by applicant]
US 10484627B2 · Zhou · 2019 [cited by applicant]
US 10812704B2 · Kikuchi et al. · 2020 [cited by applicant]
US 10999544B2 · Wang et al. · 2021 [cited by applicant]
US 11017250B2 · Turcot et al. · 2021 [cited by applicant]
US 20100150538A1 · Ono et al. · 2010 [cited by applicant]
US 20120194721A1 · Sakaida · 2012 [cited by applicant]
US 20130188023A1 · Kuang · 2013 [cited by examiner]
US 20140347537A1 · Hamada · 2014 [cited by applicant]
US 20150156400A1 · Seo · 2015 [cited by applicant]
US 20160205311A1 · Mandelli et al. · 2016 [cited by applicant]
US 20160241772A1 · Johnson · 2016 [cited by applicant]
US 20160344922A1 · Aoki et al. · 2016 [cited by applicant]
US 20160344958A1 · Kondo · 2016 [cited by examiner]
US 20170019584A1 · Ham · 2017 [cited by applicant]
US 20170041525A1 · Liu et al. · 2017 [cited by applicant]
US 20170359516A1 · Jeong · 2017 [cited by applicant]
US 20180039156A1 · Moon et al. · 2018 [cited by applicant]
US 20180084185A1 · Lu et al. · 2018 [cited by applicant]
US 20180189581A1 · Turcot et al. · 2018 [cited by applicant]
US 20180316878A1 · Zhou · 2018 [cited by applicant]
US 20180349378A1 · Galor Gluskin et al. · 2018 [cited by applicant]
US 20190082130A1 · Li et al. · 2019 [cited by applicant]
US 20190116318A1 · Ogawa · 2019 [cited by examiner]
US 20190206086A1 · Du et al. · 2019 [cited by applicant]
US 20190281226A1 · Wang · 2019 [cited by examiner]
US 20200021744A1 · Kikuchi et al. · 2020 [cited by applicant]
US 20200320661A1 · Lin · 2020 [cited by examiner]
CN 101750847A · 2010 [cited by applicant]
CN 105247851A · 2016 [cited by applicant]
CN 105814877A · 2016 [cited by applicant]
CN 106030366A · 2016 [cited by applicant]
CN 106358026A · 2017 [cited by applicant]
CN 106449674A · 2017 [cited by applicant]
CN 109474771A · 2019 [cited by applicant]
JP 2012155221A · 2012 [cited by applicant]
KR 1020190042353A · 2019 [cited by applicant]
KR 1020190089017A · 2019 [cited by applicant]
KR 1020190106599A · 2019 [cited by applicant]
Partial Supplementary European Search Report dated May 26, 2023, issued in European Patent Application No. 21751143.5. [cited by applicant]
Chinese Office Action dated Aug. 28, 2024, issued in Chinese Patent Application No. 202180012317.5. [cited by applicant]
Extended European Search Report dated Aug. 29, 2023, issued in European Patent Application No. 21751143.5. [cited by applicant]
Chinese Notice of Allowance dated Dec. 27, 2024, issued in Chinese Application No. 202180012317.5. [cited by applicant]
Korean Office Action dated Mar. 17, 2025, issued in Korean Application No. 10-2020-0013175. [cited by applicant]