IP Library Granted Patent US 12671909
Granted Patent B2
US 12671909 · App. 18/256,459 · Granted Jun 30, 2026

Image generation apparatus and image generation method

Inventor: Daisuke Kawamata (Kanagawa, JP)
Assignee: Sony Group Corporation
H04N23/741G06T15/50G06T19/00H04N23/12H04N23/64H04N25/11H04N25/772
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12671909
App. No.
18/256,459
Granted
Jun 30, 2026
Kind
B2
Abstract

Provided is an image generation unit that generates a plurality of simulation images in which a plurality of images having different accumulation times is reproduced on the basis of a physical quantity corresponding to light applied to an image sensor, and an HDR synthesis unit performs HDR synthesis on a plurality of simulation images.

Claims (64)

1 . An image generation apparatus, comprising:

a central processing unit (CPU) configured to:

generate a plurality of simulation images based on a physical quantity, wherein

the plurality of simulation images includes a reproduction of a plurality of images,

the plurality of images is associated with a plurality of accumulation times, and

the physical quantity corresponds to an application of light on an image sensor; and

the physical quantity corresponds to a specific position of the image sensor;

convert the physical quantity to a number of photons;

multiply, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;

integrate, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;

convert, for each of the plurality of accumulation times, the number of photons into a respective charge amount;

integrate the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;

multiply the integrated number of photons by a quantum efficiency;

calculate, based on the multiplication, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;

perform a high dynamic range (HDR) synthesis on the plurality of simulation images;

generate an HDR image based on the HDR synthesis on the plurality of simulation images;

determine a transmission band of the HDR image based on the HDR synthesis; and

perform gradation compression on the HDR image based on the transmission band of the HDR image.

2 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to generate the plurality of simulation images based on the physical quantity corresponding to a specific frame.

3 . The image generation apparatus according to claim 1 , wherein

the CPU is further configured to generate the plurality of simulation images based on the physical quantity,

the physical quantity corresponds to a plurality of frames, and

each of the plurality of frames is at a respective timing of a plurality of timings.

4 . The image generation apparatus according to claim 1 , wherein the physical quantity is spectral irradiance.

5 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to add a specific noise component to the respective charge amount of the each of the plurality of pixels.

6 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to:

convert, for each of the plurality of accumulation times, the respective charge amount of each of the plurality of pixels into a respective voltage value;

convert, for each of the plurality of accumulation times, the respective voltage value of each of the plurality of pixels to a digital value; and

generate, for each of the plurality of accumulation times, a simulation image of the plurality of simulation images based on the conversion of the respective voltage value of each of the plurality of pixels to the digital value.

7 . The image generation apparatus according to claim 6 , wherein the CPU is further configured to add a specific noise component to the respective voltage value of each of the plurality of pixels.

8 . An image generation method, comprising:

in an image generation apparatus;

generating a plurality of simulation images based on a physical quantity, wherein the plurality of simulation images includes a reproduction of a plurality of images,

the plurality of images is associated with a plurality of accumulation times, and

the physical quantity corresponds to an application of light on an image sensor; and

the physical quantity corresponds to a specific position of the image sensor;

converting the physical quantity to a number of photons;

multiplying, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;

integrating, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;

converting, for each of the plurality of accumulation times, the number of photons into a respective charge amount;

integrating the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;

multiplying the integrated number of photons by a quantum efficiency;

calculating, based on the multiplying, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;

performing a high dynamic range (HDR) synthesis on the plurality of simulation images;

generating an HDR image based on the HDR synthesis on the plurality of simulation images;

determining a transmission band of the HDR image based on the HDR synthesis; and

performing gradation compression on the HDR image based on the transmission band of the HDR image.

9 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

generating a plurality of simulation images based on a physical quantity, wherein

the plurality of simulation images includes a reproduction of a plurality of images,

the plurality of images is associated with a plurality of accumulation times, and

the physical quantity corresponds to an application of light on an image sensor, and

the physical quantity corresponds to a specific position of the image sensor;

converting the physical quantity to a number of photons;

multiplying, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;

integrating, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;

converting, for each of the plurality of accumulation times, the number of photons into a respective charge amount;

integrating the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;

multiplying the integrated number of photons by a quantum efficiency;

calculating, based on the multiplying, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;

performing a high dynamic range (HDR) synthesis on the plurality of simulation images;

generating an HDR image based on the HDR synthesis on the plurality of simulation images;

determining a transmission band of the HDR image based on the HDR synthesis; and

performing gradation compression on the HDR image based on the transmission band of the HDR image.