IP Library › Granted Patent US 12,356,106
Granted Patent B2
US 12,356,106 · App. 17/961,771 · Granted Jul 8, 2025

Digital photographing apparatus including a plurality of optical systems for acquiring images under different conditions and method of operating the same

Inventor: Hee-Chul Han (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/272H04N5/265H04N13/271H04N23/45H04N23/52H04N23/555H04N23/63H04N23/667H04N23/69H04N23/71H04N23/80H04N23/90H04N23/951
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,106
App. No.
17/961,771
Granted
Jul 8, 2025
Kind
B2
Abstract

A digital photographing apparatus is provided. The digital photographing apparatus includes a first optical system configured to acquire a wide-angle image including a subject, a second optical system configured to acquire a telephoto image with the subject zoomed, and a processor configured to determine whether to generate a synthesized image of the wide-angle image and the telephoto image based on one or more of an illuminance of the subject and a distance between the digital photographing apparatus and the subject.

Claims (50)

1. A photographing apparatus comprising:

a first camera, comprising a first lens, configured to obtain a first image with a first angle of view;

a second camera, comprising a second lens, configured to obtain a second image with a second angle of view narrower than the first angle of view, the first image being a wide angle image and the second image being a telephoto image; and

at least one processor, coupled with the first camera and the second camera, and individually and/or collectively configured to:

in response to receipt of an input to capture an image with a magnification less than a predetermined magnification, determine whether to synthesize the first image and the second image for an output image based on an illuminance of a region of interest so that:

(a) when the illuminance of the region of interest is less than a first illuminance value, generate the output image by magnifying the first image or the second image based on the magnification, where the first image and second images are not synthesized for the output image; and

(b) when the illuminance of the region of interest is greater than the first illuminance value, generate the output image by synthesizing the first image and the second image and digitally magnifying the synthesized image based on the magnification.

2. The photographing apparatus of claim 1 , wherein the output image generated by synthesizing the first image and the second image includes a first region corresponding to a synthesized region of the first image and the second image and a second region corresponding to a region of the first image.

3. The photographing apparatus of claim 2 , wherein the at least one processor, individually and/or collectively, is configured to:

generate the output image corresponding to the image generated by synthesizing the first image and the second image by applying a blending with respect to a boundary between the first region and the second region.

4. The photographing apparatus of claim 1 , further comprising a time-of-flight (TOF) sensor configured to obtain distance information between the photographing apparatus and a subject.

5. The photographing apparatus of claim 1 , wherein the at least one processor, individually and/or collectively, is configured to control to perform auto focusing.

6. The photographing apparatus of claim 1 , wherein the at least one processor, individually and/or collectively, is configured to: when a magnification for the output image is the same as the predetermined magnification, generate the output image corresponding to the second image regardless of the obtained illuminance of the region of interest, so that the first image and second images are not synthesized for the output image.

7. The photographing apparatus of claim 1 , wherein the at least one processor, individually and/or collectively, is configured to: when a magnification for the output image is greater than the predetermined magnification, generate the output image corresponding to the second image regardless of the obtained illuminance of the region of interest, so that the first image and second images are not synthesized for the output image.

8. The photographing apparatus of claim 1 , wherein the at least one processor, individually and/or collectively, is configured to:

when the illuminance of the region of interest is greater than the first illuminance value and a magnification of the output image is lower than the predetermined magnification, generate the output image corresponding to the image generated by synthesizing the first image and the second image based on the magnification.

9. The photographing apparatus of claim 1 , wherein the illuminance of the region of interest includes at least one of: a first illuminance corresponding to a main subject in the first image, a second illuminance corresponding to a background of the first image, a third illuminance corresponding to a main subject in the second image, or a fourth illuminance corresponding to a background of the second image.

10. The photographing apparatus of claim 1 , wherein the at least one processor, individually and/or collectively, is configured to:

determine a magnification factor to upscale the first image or the second image, and

obtain an upscaled image using the magnification factor.

11. A photographing apparatus comprising:

a first camera configured to obtain a first image with a first angle of view;

a second camera configured to obtain a second image with a second angle of view narrower than the first angle of view; and

at least one processor, coupled with the first camera and the second camera, and individually and/or collectively configured to:

in response to receipt of an input to capture an image with a magnification less than a predetermined magnification, determine whether to synthesize the first image and the second image for an output image based on an illuminance of a region of interest so that:

(a) when the illuminance of the region of interest is less than a first illuminance value, generate the output image by magnifying the first image or the second image based on the magnification, where the first image and second images are not synthesized for the output image; and

(b) when the illuminance of the region of interest is greater than the first illuminance value, generate the output image by synthesizing the first image and the second image and digitally magnifying the synthesized image based on the magnification; and

in response to a magnification for the output image being greater than the predetermined magnification, generate the output image corresponding to the second image regardless of the obtained illuminance of the region of interest, so that the first image and second images are not synthesized for the output image.

12. A method performed by a photographing apparatus, the method comprising:

obtaining a first image corresponding to a first angle of view and a second image corresponding to a second angle of view, wherein the second angle of view is narrower than the first angle of view; and

determining whether to synthesize the first image and the second image for an output image based on an illuminance of a region of interest of at least one of the first image or the second image, in response to receipt of an input to capture an image with a magnification less than a predetermined magnification, so that:

(a) when the illuminance of the region of interest is less than a first illuminance value, generating the output image by magnifying the first image or the second image based on the magnification, where the first image and second images are not synthesized for the output image; and

(b) when the illuminance of the region of interest is greater than the first illuminance value, generating the output image by synthesizing the first image and the second image and digitally magnifying the synthesized image based on the magnification.

13. The method of claim 12 , wherein the image generated by synthesizing the first image and the second image includes a first region corresponding to a synthesized region of the first image and the second image and a second region corresponding to a region of the first image.

14. The method of claim 13 , wherein the generating the output image corresponding to the image generated by synthesizing the first image and the second image comprises blending with respect to a boundary between the first region and the second region.

15. The method of claim 12 , further comprising obtaining distance information between the photographing apparatus and a main subject via a time-of-flight (TOF) sensor.

16. The method of claim 12 , further comprising controlling to perform auto focusing.

17. The method of claim 12 , further comprising:

when magnification of the output image is the same as the predetermined magnification, generating the output image corresponding to the second image regardless of the obtained illuminance without synthesizing the first and second images.

18. The method of claim 12 , wherein:

when the illuminance of the region of interest is greater than the first illuminance value and a magnification for the output image is lower than the predetermined magnification, generating the output image by synthesizing the first image and the second image based on the magnification.

19. The method of claim 12 , wherein the illuminance of the region of interest includes at least one of: a first illuminance corresponding to a main subject in the first image, a second illuminance corresponding to a background of the first image, a third illuminance corresponding to a main subject in the second image, or a fourth illuminance corresponding to a background of the second image.

20. The method of claim 12 , further comprising:

determining a magnification factor to upscale the first image or the second image, and

obtaining an upscaled image using the magnification factor.

21. A computer-readable non-transitory storage medium having stored therein instructions that, when executed by a processor of an imaging apparatus, cause the imaging apparatus to perform operations comprising:

obtaining a first image corresponding to a first angle of view and a second image corresponding to a second angle of view, wherein the second angle of view is narrower than the first angle of view; and

determining whether to synthesize the first image and the second image for an output image based on an illuminance of a region of interest of at least one of the first image or the second image, in response to receipt of an input to capture an image with a magnification less than a predetermined magnification, so that:

(a) when the illuminance of the region of interest is less than a first illuminance value, generating the output image by magnifying the first image or the second image based on the magnification, where the first image and second images are not synthesized for the output image; and

(b) when the illuminance of the region of interest is greater than the first illuminance value, generating the output image by synthesizing the first image and the second image and digitally magnifying the synthesized image based on the magnification.

Priority Claims (1)
KR 10-2015-0164841 · Nov 24, 2015 · national
Continuity (3)
Continuation 17347660 · Jun 15, 2021
Continuation 15070109 · Mar 15, 2016
Related Publication 20230037167A1 · Feb 2, 2023
References Cited (86)
US 7839446B2 · Hirano · 2010 [cited by applicant]
US 8200019B2 · Zhang et al. · 2012 [cited by applicant]
US 8619082B1 · Ciurea · 2013 [cited by applicant]
US 8878907B2 · Awazu et al. · 2014 [cited by applicant]
US 8983140B2 · Hohjoh · 2015 [cited by applicant]
US 9137511B1 · LeGrand, III · 2015 [cited by examiner]
US 9253397B2 · Lee et al. · 2016 [cited by applicant]
US 9338365B2 · Ohwa et al. · 2016 [cited by applicant]
US 9392295B2 · Bennett · 2016 [cited by applicant]
US 10291842B2 · Kim et al. · 2019 [cited by applicant]
US 20030020814A1 · Ono · 2003 [cited by examiner]
US 20080030592A1 · Border · 2008 [cited by examiner]
US 20090284618A1 · Kurahashi et al. · 2009 [cited by applicant]
US 20090322891A1 · Kondo · 2009 [cited by examiner]
US 20100238327A1 · Griffith · 2010 [cited by examiner]
US 20100245535A1 · Mauchly · 2010 [cited by applicant]
US 20110080487A1 · Verikataraman · 2011 [cited by applicant]
US 20110122252A1 · Choi · 2011 [cited by examiner]
US 20120002082A1 · Johnson · 2012 [cited by applicant]
US 20120200667A1 · Gay · 2012 [cited by applicant]
US 20120262607A1 · Shimura · 2012 [cited by examiner]
US 20120268641A1 · Kazama · 2012 [cited by examiner]
US 20130021447A1 · Brisedoux · 2013 [cited by examiner]
US 20130050426A1 · Sarmast · 2013 [cited by examiner]
US 20130058591A1 · Nishiyama · 2013 [cited by examiner]
US 20130077880A1 · Venkataraman · 2013 [cited by applicant]
US 20130114862A1 · Hohjoh · 2013 [cited by examiner]
US 20130141539A1 · Awazu et al. · 2013 [cited by applicant]
US 20130162782A1 · Kuo · 2013 [cited by examiner]
US 20130215235A1 · Russell · 2013 [cited by examiner]
US 20140092275A1 · Morihisa · 2014 [cited by applicant]
US 20140092281A1 · Nisenzon · 2014 [cited by applicant]
US 20140132735A1 · Lee · 2014 [cited by examiner]
US 20140176767A1 · Hamel · 2014 [cited by examiner]
US 20140184852A1 · Niemi · 2014 [cited by examiner]
US 20140347444A1 · Naske · 2014 [cited by applicant]
US 20150022694A1 · Jogetsu et al. · 2015 [cited by applicant]
US 20150042831A1 · Linaker · 2015 [cited by examiner]
US 20150085174A1 · Shabtay · 2015 [cited by applicant]
US 20150103200A1 · Vondran · 2015 [cited by applicant]
US 20150116529A1 · Wu · 2015 [cited by examiner]
US 20150124151A1 · Rodda · 2015 [cited by applicant]
US 20150145950A1 · Murphy · 2015 [cited by applicant]
US 20150146030A1 · Venkataraman · 2015 [cited by applicant]
US 20150163400A1 · Geiss · 2015 [cited by applicant]
US 20150172539A1 · Neglur · 2015 [cited by applicant]
US 20150222881A1 · Lee · 2015 [cited by examiner]
US 20150296148A1 · Tsuihiji · 2015 [cited by applicant]
US 20150312486A1 · Song · 2015 [cited by examiner]
US 20160057363A1 · Posa · 2016 [cited by examiner]
US 20160286120A1 · Kuo · 2016 [cited by applicant]
US 20160309084A1 · Verikataraman · 2016 [cited by applicant]
US 20160316149A1 · Chou · 2016 [cited by applicant]
US 20170026582A1 · Kim · 2017 [cited by examiner]
CN 101064773A · 2007 [cited by applicant]
CN 101582993A · 2009 [cited by applicant]
CN 102075683A · 2011 [cited by applicant]
CN 102892008A · 2013 [cited by applicant]
CN 103034020A · 2013 [cited by applicant]
CN 103098456A · 2013 [cited by applicant]
CN 103649807A · 2014 [cited by applicant]
CN 103813108A · 2014 [cited by applicant]
CN 104580878A · 2015 [cited by applicant]
EP 2549763A2 · 2013 [cited by applicant]
EP 2549763A3 · 2014 [cited by applicant]
JP 2009232118A · 2009 [cited by applicant]
KR 1020170000311 · 2017 [cited by applicant]
WO WO2008016474A2 · 2008 [cited by applicant]
WO 2012161344A1 · 2012 [cited by applicant]
WO WO2016208849 · 2016 [cited by applicant]
Korean Office Action dated Nov. 29, 2022 for KR Application No. 10-2022-0117251. [cited by applicant]
Chinese Office Action dated Jan. 19, 2023 for CN Application No. 202111364762.6. [cited by applicant]
European Notice of Allowance dated Feb. 2, 2023 for EP Application No. 21203355.9. [cited by applicant]
U.S. Appl. No. 17/347,660, filed Jun. 15, 2021; Han. [cited by applicant]
U.S. Appl. No. 15/070,109, filed Mar. 16, 2016; Han. [cited by applicant]
Search Report and Written Opinion mailed Jul. 26, 2016 in counterpart International Patent Application No. PCT/KR2016/003036. [cited by applicant]
Extended Search Report mailed Jul. 13, 2018 in counterpart European Patent Application No. 16868739.0. [cited by applicant]
European Office Action issued Mar. 27, 2019 for EP Application No. 16868739.0. [cited by applicant]
CN Office Action dated Feb. 6, 2020 for CN Application No. 2016800595368. [cited by applicant]
Chinese Office Action dated Sep. 14, 2020 for CN Application No. 201680059536.8. [cited by applicant]
European Office Action Report dated Mar. 7, 2022 for EP Application No. 21203355.9. [cited by applicant]
European Search Report dated Feb. 16, 2022 for EP Application No. 21203355.9. [cited by applicant]
European Office Action dated Aug. 17, 2022 for EP Application No. 21203355.9. [cited by applicant]
Korean Notice of Allowance dated Jun. 18, 2022 for KR Application No. 10-2015-0164841. [cited by applicant]
Chinese Office Action dated Feb. 23, 2023 for CN Application No. 202111255285.X. [cited by applicant]
IN Hearing Notice dated Mar. 6, 2025 for IN Application No. 201827007406. [cited by applicant]