IP Library › Granted Patent US 11,653,081
Granted Patent B2
US 11,653,081 · App. 17/688,397 · Granted May 16, 2023

Imaging apparatus, imaging method and imaging program

Inventors: Hiroshi Shimizu (Kyoto, JP); Akira Ishiyama (Kyoto, JP); Kazuhiko Yoshizawa (Kyoto, JP); Yasunobu Hashimoto (Kyoto, JP); Motoyuki Suzuki (Kyoto, JP); Mitsunobu Watanabe (Kyoto, JP)
Assignee: MAXELL, LTD.
H04N5/232G06T5/009H04N5/2327H04N5/2353H04N5/2355G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,653,081
App. No.
17/688,397
Granted
May 16, 2023
Kind
B2
Abstract

An imaging method is provided that includes: taking an image of an object to generate an image signal of the object; generating a taken image of the object on a basis of the image signal; detecting motion information of the object on the basis of the image signal; taking an image of the object on a basis of the motion information multiple times so as to differentiate an exposure amount thereof and generating an HDR synthetic image of the object on the basis of a plurality of image signals whose exposure amounts are different from each other.

Claims (128)

1. A smartphone comprising:

a first imaging sensor and a second imaging sensor for generating image signal of incident light from objects;

a light amount detector; a GPS signal receiver; a storage; a wireless communication circuitry; a touch panel display;

an imaging signal processor; and

a controller configured to:

cause the imaging signal processor to acquire the image signal via the first imaging sensor or the second imaging sensor;

based on light amount detected by the light amount detector, control a setting of exposure value of the first imaging sensor and the second imaging sensor;

cause the imaging signal processor to generate a HDR synthetic image of the objects based on a plurality of intermediate image data that the setting of exposure value are different from each other;

generate a thumbnail image from the HDR synthetic image;

store the HDR synthetic image with the thumbnail image in the storage; and

display the HDR synthetic image on the touch panel display corresponding to a touch operation to the thumbnail image displayed on the touch panel display,

wherein the imaging signal processor is further configured to:

operate in either first HDR synthetic mode for generating the HDR synthetic image with first resolution or second HDR synthetic mode for generating the HDR synthetic image with second resolution based on a predetermined threshold value;

generate the plurality of intermediate image data with the first resolution by using the image signal acquired multiple times from the first imaging sensor;

generate the plurality of intermediate image data with the second resolution by using the image signal acquired multiple times from the second imaging sensor;

generate the HDR synthetic image with the first resolution by using the plurality of the intermediate image data with the first resolution in the first HDR synthetic mode; and

generate the HDR synthetic image with the second resolution by using the plurality of the intermediate image data with the second resolution in the second HDR synthetic mode, and

wherein the controller is further configured to:

obtain location of the smartphone using GPS signal received by the GPS signal receiver;

store the HDR synthetic image with information relating to the location; and

transmit the HDR synthetic image stored in the storage to a network via the wireless communication circuitry.

2. The smartphone according to claim 1 ,

wherein

the second resolution is smaller than the first resolution,

the predetermined threshold value used by the imaging signal processor is relating to motion of the objects detected from the image signal, and

wherein

when magnitude of the motion is less than the predetermined threshold value, the imaging signal processor operates in the first HDR synthetic mode, and

when the magnitude of the motion is equal to or more than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

3. The smartphone according to claim 1 ,

wherein

the second resolution is smaller than the first resolution,

the predetermined threshold value used by the imaging signal processor is relating to the light amount detected by the light amount detector, and

wherein

when the light amount is higher than the predetermined threshold value, the imaging signal processor operates in the first HDR synthetic mode, and

when the light amount is equal to or lower than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

4. The smartphone according to claim 1 ,

wherein

the second resolution is smaller than the first resolution,

the predetermined threshold value used by the imaging signal processor is relating to focal distance detected by the imaging signal processor, and

wherein

when the focal distance is shorter than the predetermined threshold value, the imaging signal processor operates in the first HDR synthetic mode, and

when the focal distance is equal to or longer than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

5. The smartphone according to claim 1 , wherein resolution of the first imaging sensor and resolution of the second imaging sensor are different from each other.

6. The smartphone according to claim 1 , wherein

the light amount detector detects at least the light amount of periphery of the smartphone which is sensed by a light amount sensor, the light amount of the incident light from the objects which is sensed from the image signal by the imaging signal processor, or combination thereof.

7. The smartphone according to claim 1 , wherein the imaging signal processor is further configured to:

generate the intermediate image data with third resolution by grouping a plurality of pixels included in the image signal acquired from the first imaging sensor; and

generate the intermediate image data with first resolution by converting resolution of the intermediate image data with third resolution.

8. The smartphone according to claim 1 , the smartphone is further comprising a third imaging sensor, wherein

the imaging signal processor is further configured to generate third intermediate image data by using image signal acquired from the third imaging sensor, and

the controller is further configured to store the HDR synthetic image with the third intermediate image data in the storage.

9. An imaging apparatus comprising:

a first imaging sensor and a second imaging sensor for generating image signal of incident light from objects;

an imaging signal processor;

a light amount detector which detects at least the light amount of periphery of the imaging apparatus which is sensed by a light amount sensor or the light amount of the incident light from the objects which is sensed from the image signal by the imaging signal processor; and

a controller configured to:

cause the imaging signal processor to acquire the image signal via the first imaging sensor or the second imaging sensor;

based on light amount detected by the light amount detector, control a setting of exposure value of the first imaging sensor and the second imaging sensor; cause the imaging signal processor to generate a HDR synthetic image of the objects based on a plurality of intermediate image data that the setting of exposure value are different from each other;

wherein the imaging signal processor is further configured to:

operate in first HDR synthetic mode for generating the HDR synthetic image with first resolution;

generate the intermediate image data with the first resolution by using the image signal acquired from the first imaging sensor;

generate the intermediate image data with second resolution by using the image signal acquired from the second imaging sensor and convert to the first resolution; and

generate the HDR synthetic image with the first resolution by using the intermediate image data with the first resolution and the converted intermediate image data with the second resolution.

10. The imaging apparatus according to claim 9 , wherein

the second resolution is smaller than the first resolution,

the imaging signal processor is further configured to:

generate the intermediate image data with second resolution by grouping a plurality of pixels included in the image signal acquired from the second imaging sensor.

11. The imaging apparatus according to claim 9 , wherein the imaging signal processor is further configured to:

generate the intermediate image data with the first resolution by using image signal outputted from the first imaging sensor while generating the intermediate image data with the second resolution by using image signal outputted from the second imaging sensor.

12. The imaging apparatus according to claim 9 , the imaging apparatus is further comprising a third imaging sensor, wherein

the imaging signal processor is further configured to generate another intermediate image data by using image signal acquired from the third imaging sensor, and

the controller is further configured to store the HDR synthetic image with said another intermediate image data in the storage.

13. The imaging apparatus according to claim 9 ,

wherein the imaging signal processor is further configured to:

operate in second HDR synthetic mode for generating the HDR synthetic image with third resolution; and

operate in either the first HDR synthetic mode or the second HDR synthetic mode based on a predetermined threshold value, and

wherein the third resolution is smaller than the first resolution.

14. The imaging apparatus according to claim 13 ,

wherein the predetermined threshold value used by the imaging signal processor is relating to motion of the objects detected from the image signal, and

wherein

when magnitude of the motion is less than the predetermined threshold value, the imaging signal processor operates in the first HDR synthetic mode, and

when the magnitude of the motion is equal to or more than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

15. The imaging apparatus according to claim 13 ,

wherein the predetermined threshold value used by the imaging signal processor is relating to the light amount detected by the light amount detector, and

wherein

when the light amount is higher than the predetermined threshold value, the imaging signal processor to operate in the first HDR synthetic mode, and

when the light amount is equal to or lower than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

16. The imaging apparatus according to claim 13 ,

wherein the predetermined threshold value used by the imaging signal processor is relating to focal distance detected by the imaging signal processor, and

wherein

when the focal distance is shorter than the predetermined threshold value, the imaging signal processor operates in the first HDR synthetic mode, and

when the focal distance is equal to or longer than the predetermined threshold value, the imaging signal processor operates in the second HDR synthetic mode.

17. The imaging apparatus according to claim 9 , wherein the controller is further configured to:

generate a thumbnail image from the HDR synthetic image;

store the HDR synthetic image with the thumbnail image in a storage; and

display the HDR synthetic image on a touch panel display corresponding to a touch operation to the thumbnail image displayed on the touch panel display.

18. The imaging apparatus according to claim 9 , wherein the controller is further configured to:

obtain location of the imaging apparatus using GPS signal received by a GPS signal receiver;

store the HDR synthetic image with information relating to the location in a storage; and

transmit the HDR synthetic image stored in the storage to a network via a wireless communication circuitry.

19. A smartphone comprising:

a first imaging unit and a second imaging unit for generating image signal of incident light from objects;

a light amount detecting unit; a GPS signal receiving unit; a storage unit; a wireless communication circuitry; a touch panel display unit;

an imaging signal processing unit; and

a controller unit for:

causing the imaging signal processing unit to acquire the image signal via the first imaging unit or the second imaging unit;

based on light amount detected by the light amount detecting unit, controlling a setting of exposure value of the first imaging unit and the second imaging unit;

causing the imaging signal processing unit to generate a HDR synthetic image of the objects based on a plurality of intermediate image data that the setting of exposure value are different from each other;

generating a thumbnail image from the HDR synthetic image;

storing the HDR synthetic image with the thumbnail image in the storage unit; and

displaying the HDR synthetic image on the touch panel display unit corresponding to a touch operation to the thumbnail image displayed on the touch panel display unit,

wherein the imaging signal processing unit is further configured to:

operate in either first HDR synthetic mode for generating the HDR synthetic image with first resolution or second HDR synthetic mode for generating the HDR synthetic image with second resolution based on a predetermined threshold value;

generate the plurality of intermediate image data with the first resolution by using the image signal acquired multiple times from the first imaging unit;

generate the plurality of intermediate image data with the second resolution by using the image signal acquired multiple times from the second imaging unit;

generate the HDR synthetic image with the first resolution by using the plurality of the intermediate image data with the first resolution in the first HDR synthetic mode; and

generate the HDR synthetic image with the second resolution by using a plurality of the intermediate image data with the second resolution in the second HDR synthetic mode, and

wherein the controller is further configured to:

obtain location of the smartphone using GPS signal received by the GPS signal receiving unit;

store the HDR synthetic image with information relating to the location; and

transmit the HDR synthetic image stored in the storage unit to a network via the wireless communication circuitry.

20. The smartphone according to claim 19 ,

wherein

the second resolution is smaller than the first resolution,

the predetermined threshold value used by the imaging signal processing unit is relating to focal distance detected by the imaging signal processing unit, and

wherein

when the focal distance is shorter than the predetermined threshold value, the imaging signal processing unit operates in the first HDR synthetic mode, and

when the focal distance is equal to or longer than the predetermined threshold value, the imaging signal processing unit operates in the second HDR synthetic mode.

Assignments (3)
MERGER Recorded Feb 15, 2023
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 062706/0022 →
CHANGE OF NAME Recorded Feb 15, 2023
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 062709/0675 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2023
From: SHIMIZU, HIROSHI; ISHIYAMA, AKIRA; YOSHIZAWA, KAZUHIKO; HASHIMOTO, YASUNOBU; SUZUKI, MOTOYUKI; WATANABE, MITSUNOBU
To: MAXELL, LTD.
Reel/Frame 062651/0629 →
Continuity (3)
Continuation 16928592 · Jul 14, 2020
Continuation 16314478
Related Publication 20220191371A1 · Jun 16, 2022
Cited By (1)
US 12,456,184