IP Library › Granted Patent US 12,212,837
Granted Patent B2
US 12,212,837 · App. 18/298,020 · Granted Jan 28, 2025

Imaging apparatus, imaging method and imaging program

Inventors: Hiroshi Shimizu (Kyoto, JP); Akira Ishiyama (Kyoto, JP); Kazuhiko Yoshizawa (Kyoto, JP); Yasunobu Hashimoto (Kyoto, JP); Motoyuki Suzuki (Kyoto, JP); Mitsunobu Watanabe (Kyoto, JP)
Assignee: Maxell, Ltd.
H04N23/60G06T5/92H04N23/684H04N23/73H04N23/741G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,837
App. No.
18/298,020
Granted
Jan 28, 2025
Kind
B2
Abstract

An imaging method is provided that includes: taking an image of an object to generate an image signal of the object; generating a taken image of the object on a basis of the image signal; detecting motion information of the object on the basis of the image signal; taking an image of the object on a basis of the motion information multiple times so as to differentiate an exposure amount thereof; and generating an HDR synthetic image of the object on the basis of a plurality of image signals whose exposure amounts are different from each other.

Claims (89)

1. A smartphone comprising:

a first imaging sensor with a first lens and a second imaging sensor with a second lens for generating image signal of incident light from objects;

a light amount detector;

a GPS signal receiver;

a storage;

a wireless communication circuitry;

a touch panel display;

an imaging signal processor; and

a controller configured to:

cause the imaging signal processor to acquire the image signal via the first imaging sensor or the second imaging sensor;

based on light amount detected by the light amount detector, control a setting of exposure value of the first imaging sensor and the second imaging sensor;

cause the imaging signal processor to generate a HDR synthetic image of the objects based on a plurality of intermediate image data, the setting of exposure value for each of the plurality of intermediate image data are different;

generate a thumbnail image from the HDR synthetic image;

store the HDR synthetic image with the thumbnail image in the storage; and

display the HDR synthetic image on the touch panel display corresponding to a touch operation to the thumbnail image displayed on the touch panel display,

wherein the imaging signal processor is further configured to:

operate in either first HDR synthetic mode for generating the HDR synthetic image with first resolution or second HDR synthetic mode for generating the HDR synthetic image with second resolution based on a focal distance;

generate the plurality of intermediate image data with the first resolution by using the image signal acquired multiple times from the first imaging sensor;

generate the plurality of intermediate image data with the second resolution by using the image signal acquired multiple times from the second imaging sensor;

generate the HDR synthetic image with the first resolution by using the plurality of intermediate image data with the first resolution in the first HDR synthetic mode; and

generate the HDR synthetic image with the second resolution by using the plurality of intermediate image data with the second resolution in the second HDR synthetic mode, and

wherein the controller is further configured to:

obtain location of the smartphone using a GPS signal received by the GPS signal receiver;

store the HDR synthetic image with information relating to the location; and

transmit the HDR synthetic image stored in the storage to a network via the wireless communication circuitry.

2. The smartphone according to claim 1 ,

wherein the second resolution is smaller than the first resolution, and

wherein the imaging signal processor is further configured to:

operate in the first HDR synthetic mode when the focal distance is a first value, and

operate in the second HDR synthetic mode when the focal distance is a second value.

3. The smartphone according to claim 1 , wherein resolution of the first imaging sensor and resolution of the second imaging sensor are different from each other.

4. The smartphone according to claim 1 , wherein

the light amount detector detects at least the light amount of a periphery of the smartphone which is sensed by a light amount sensor, the light amount of the incident light from the objects which is sensed from the image signal by the imaging signal processor, or combination thereof.

5. The smartphone according to claim 1 , wherein the imaging signal processor is further configured to:

generate the intermediate image data with a third resolution by grouping a plurality of pixels included in the image signal acquired from the first imaging sensor; and

generate the intermediate image data with the first resolution by converting resolution of the intermediate image data with the third resolution.

6. The smartphone according to claim 1 , the smartphone further comprises a third imaging sensor with a third lens, wherein

the imaging signal processor is further configured to generate third intermediate image data with a third resolution by using image signal acquired from the third imaging sensor, and

the controller is further configured to store the HDR synthetic image with the third resolution in the storage.

7. The smartphone according to claim 1 ,

wherein a display panel of the touch panel display is a liquid crystal panel or an organic EL (Electro Luminescence) panel.

8. The smartphone according to claim 1 ,

wherein the first imaging sensor with the first lens and the second imaging sensor with the second lens are located side by side on a surface of the smartphone, and

wherein the touch panel display is located on an other surface of the smartphone.

9. The smartphone according to claim 6 ,

wherein the third imaging sensor with the third lens is located on an other surface of the smartphone, on which the touch panel display is located.

10. The smartphone according to claim 1 ,

wherein the storage is configured to store a camera function program which is downloaded from the network via the wireless communication circuitry.

11. An imaging control method comprising:

generating, via a first imaging sensor with a first lens and a second imaging sensor with a second lens, an image signal of incident light from objects;

causing, via a controller, an imaging signal processor to acquire the image signal via the first imaging sensor or the second imaging sensor;

based on a light amount detected by a light amount detector, controlling a setting of exposure value of the first imaging sensor and the second imaging sensor;

causing the imaging signal processor to generate a HDR synthetic image of the objects based on a plurality of intermediate image data, the setting of exposure value for each of the plurality of intermediate image data are different;

generating a thumbnail image from the HDR synthetic image;

storing the HDR synthetic image with the thumbnail image in a memory; and

displaying the HDR synthetic image on a touch panel display corresponding to a touch operation to the thumbnail image displayed on the touch panel display,

wherein the imaging signal processor is further configured to:

operate in either first HDR synthetic mode for generating the HDR synthetic image with a first resolution or second HDR synthetic mode for generating the HDR synthetic image with a second resolution based on a focal distance;

generate the plurality of intermediate image data with the first resolution by using the image signal acquired multiple times from the first imaging sensor;

generate the plurality of intermediate image data with the second resolution by using the image signal acquired multiple times from the second imaging sensor;

generate the HDR synthetic image with the first resolution by using the plurality of intermediate image data with the first resolution in the first HDR synthetic mode; and

generate the HDR synthetic image with the second resolution by using the plurality of intermediate image data with the second resolution in the second HDR synthetic mode, and

wherein the controller is further configured to:

obtain a location of a smartphone using GPS signal received by a GPS signal receiver;

store the HDR synthetic image with information relating to the location in the memory; and

transmit the HDR synthetic image stored in the memory to a network via wireless communication circuitry.

12. The imaging control method according to claim 11 , the method further comprising:

operating, via the imaging signal processor, in the first HDR synthetic mode when the focal distance is a first value; and

operating, via the imaging signal processor, in the second HDR synthetic mode when the focal distance is a second value, and

wherein the second resolution is smaller than the first resolution.

13. The imaging control method according to claim 11 , wherein

resolution of the first imaging sensor and resolution of the second imaging sensor are different from each other.

14. The imaging control method according to claim 11 , wherein

detecting, via the light amount detector, at least the light amount of a periphery of the smartphone which is sensed by a light amount sensor, the light amount of the incident light from the objects which is sensed from the image signal by the imaging signal processor, or combination thereof.

15. The imaging control method according to claim 11 , the method further comprising:

generating, via the imaging signal processor, the intermediate image data with a third resolution by grouping a plurality of pixels included in the image signal acquired from the first imaging sensor; and

generating, via the imaging signal processor, the intermediate image data with the first resolution by converting resolution of the intermediate image data with the third resolution.

16. The imaging control method according to claim 11 , the method further comprising:

generating, via the imaging signal processor, third intermediate image data with a third resolution by using image signal acquired from a third imaging sensor with a third lens, and

storing, via the controller, the HDR synthetic image with the third resolution in the memory.

17. The imaging control method according to claim 11 ,

wherein a display panel of the touch panel display is a liquid crystal panel or an organic EL (Electro Luminescence) panel.

18. The imaging control method according to claim 11 ,

wherein the first imaging sensor with the first lens and the second imaging sensor with the second lens are located side by side on a surface of the smartphone, and

wherein the touch panel display is located on an other surface of the smartphone.

19. The imaging control method according to claim 16 ,

wherein the third imaging sensor with the third lens is located on an other surface of the smartphone, on which the touch panel display is located.

20. The imaging control method according to claim 11 ,

wherein the memory is configured to store a camera function program which is downloaded from the network via the wireless communication circuitry.

Assignments (3)
CHANGE OF NAME Recorded Jul 20, 2023
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 064329/0937 →
MERGER Recorded Jun 29, 2023
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 064115/0261 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: SHIMIZU, HIROSHI; ISHIYAMA, AKIRA; YOSHIZAWA, KAZUHIKO; HASHIMOTO, YASUNOBU; SUZUKI, MOTOYUKI; WATANABE, MITSUNOBU
To: MAXELL, LTD.
Reel/Frame 063290/0188 →
Continuity (4)
Continuation 17688397 · Mar 7, 2022
Continuation 16928592 · Jul 14, 2020
Continuation 16314478
Related Publication 20230247277A1 · Aug 3, 2023
References Cited (29)
US 8493454B1 · Kohn et al. · 2013 [cited by applicant]
US 9883119B1 · Atanassov et al. · 2018 [cited by applicant]
US 10757344B2 · Shimizu et al. · 2020 [cited by applicant]
US 20070292048A1 · Choe et al. · 2007 [cited by applicant]
US 20080149812A1 · Ward et al. · 2008 [cited by applicant]
US 20090180704A1 · Wey · 2009 [cited by applicant]
US 20100259626A1 · Savidge · 2010 [cited by applicant]
US 20120201427A1 · Jasinkski et al. · 2012 [cited by applicant]
US 20120249728A1 · Kato · 2012 [cited by examiner]
US 20130135464A1 · Kuroki · 2013 [cited by examiner]
US 20140071245A1 · Zhang et al. · 2014 [cited by applicant]
US 20140071330A1 · Zhang · 2014 [cited by applicant]
US 20140152773A1 · Ohba et al. · 2014 [cited by applicant]
US 20140232929A1 · Ichikawa · 2014 [cited by applicant]
US 20150054985A1 · Baek et al. · 2015 [cited by applicant]
US 20150312463A1 · Gupta et al. · 2015 [cited by applicant]
US 20160119575A1 · Dabral · 2016 [cited by examiner]
US 20160239937A1 · Kim · 2016 [cited by examiner]
US 20170352136A1 · Uliyar et al. · 2017 [cited by applicant]
US 20190014249A1 · Zhu · 2019 [cited by applicant]
JP 2002290822A · 2002 [cited by applicant]
JP 2007336561A · 2007 [cited by applicant]
JP 2010072092A · 2010 [cited by applicant]
JP 2010512719A · 2010 [cited by applicant]
JP 2010219940A · 2010 [cited by applicant]
JP 2013026978A · 2013 [cited by applicant]
International Search Report for PCT/JP2016/069710, Sep. 27, 2016. [cited by applicant]
Japanese Office Action issued Mar. 3, 2020 for Japanese Patent Application No. 2018-524710. [cited by applicant]
Japanese Office Action Issued on Sep. 14, 2021 the Japanese Patent Application No. 2020-184969. [cited by applicant]