IP Library Patent Application 19241473
Patent Application
App. No. 19/241,473

DERIVATION OF AN ELECTROMAGNETIC SPECTRUM FROM A MULTI-STIMULUS COLOR VALUE FOR SIMULATING A CAMERA

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/241,473
Abstract

A method for generating synthetic camera data includes: rendering an image of a virtual scene and storing color information of a surface element of the virtual scene; assigning, to the surface element, a number of base functions which each describe a relative wavelength distribution of a light component emitted from the surface element; modeling a spectral radiance of the light emitted from the surface element as a linear combination of the base functions; deriving the scaling factors of the base functions in the linear combination by arithmetically combining the spectral radiance with a color space coordinate from the color information of the surface element and a color matching function associated with the color space coordinate; calculating the spectral radiance by inserting the scaling factors; and generating the synthetic camera data by processing the spectral radiance in a camera simulation of a camera located in the virtual scene.

Claims (43)

1 . A method for generating synthetic camera data, the method comprising:

rendering, by a computer system, an image of a virtual scene and storing color information of a surface element of the virtual scene in the form of color space coordinates of a multi-stimulus color space;

assigning, by the computer system, to the surface element, a number of base functions which each describe a relative wavelength distribution of a light component emitted from the surface element;

modeling, by the computer system, a spectral radiance of the light emitted from the surface element as a linear combination of the base functions;

deriving, by the computer system, scaling factors of the base functions in the linear combination by arithmetically combining the spectral radiance with a color space coordinate from the color information of the surface element and a color matching function associated with the color space coordinate;

calculating, by the computer system, the spectral radiance by inserting the scaling factors; and

generating, by the computer system, the synthetic camera data by processing the spectral radiance in a camera simulation of a camera located in the virtual scene.

2 . The method according to claim 1 , wherein one of the base functions takes into account a spectral distribution of an illumination of the surface element and a reflection spectrum of the surface element.

3 . The method according to claim 2 , wherein a material attribute is assigned to the surface element, and the reflection spectrum is assigned to the material attribute.

4 . The method according to claim 1 , further comprising:

pre-calculating integrals to be solved to derive the scaling factors; and

starting a scene simulation of an evolution of the virtual scene over time after completion of the pre-calculation of the integrals, the scene simulation including a repetition of the rendering, the assigning, the modeling, the deriving, the calculating, and the generating;

wherein, in each cycle, the image of the virtual scene depicts a current state of the virtual scene, and the synthetic camera data is generated in each cycle using the pre-calculated integrals.

5 . The method according to claim 1 , further comprising:

calculating the color space coordinates taking into account a spatial orientation of the surface element in relation to the camera.

6 . The method according to claim 5 , wherein calculating the color space coordinates takes into account an angle between a straight line connecting the camera to the surface element and a surface normal of the surface element.

7 . The method according to claim 1 , wherein the spectral radiance is calculated in such a way that the spectral radiance includes wavelengths outside the visible spectral range.

8 . The method according to claim 7 , wherein the spectral radiance includes wavelengths below 380 nanometers or above 780 nanometers.

9 . The method according to claim 1 , wherein the synthetic camera data is generated as synthetic camera raw data, taking into account a quantum efficiency of a simulated image sensor of the camera.

10 . The method according to claim 1 , further comprising:

reading and processing, by a component of an electronic system configured for processing the camera data, the synthetic camera data for training the electronic system or for evaluating a response of the electronic system to the synthetic camera data.

11 . The method according to claim 10 , wherein the spectral radiance is calculated in such a way that the spectral radiance includes wavelengths outside the visible spectral range;

wherein the electronic system is an assistance system configured to analyze camera data from a camera directed at a person in order to monitor state of the person, the camera being capable of detecting wavelengths outside the visible spectral range; and

wherein the virtual scene includes a virtual representation of the person, and the image of the virtual scene includes an image of the person.

12 . The method according to claim 11 , wherein the camera is directed at the person while the person is operating a vehicle or a machine.

13 . The method according to claim 11 , wherein one of the base functions takes into account a spectral distribution of an illumination of the surface element and a reflection spectrum of the surface element; and

wherein the spectral distribution of the illumination simulates an infrared or ultraviolet illumination of the operating person.

14 . A non-transitory computer-readable medium having processor-executable instructions stored thereon for generating synthetic camera data, wherein the processor-executable instructions, when executed, facilitate performance of the following by a computer system:

rendering an image of a virtual scene and storing color information of a surface element of the virtual scene in the form of color space coordinates of a multi-stimulus color space;

assigning, to the surface element, a number of base functions which each describe a relative wavelength distribution of a light component emitted from the surface element;

modeling a spectral radiance of the light emitted from the surface element as a linear combination of the base functions;

deriving scaling factors of the base functions in the linear combination by arithmetically combining the spectral radiance with a color space coordinate from the color information of the surface element and a color matching function associated with the color space coordinate;

calculating the spectral radiance by inserting the scaling factors; and

generating the synthetic camera data by processing the spectral radiance in a camera simulation of a camera located in the virtual scene.

15 . A computer system, comprising:

at least one processor configured to:

render an image of a virtual scene and storing color information of a surface element of the virtual scene in the form of color space coordinates of a multi-stimulus color space;

assign, to the surface element, a number of base functions which each describe a relative wavelength distribution of a light component emitted from the surface element;

model a spectral radiance of the light emitted from the surface element as a linear combination of the base functions;

derive scaling factors of the base functions in the linear combination by arithmetically combining the spectral radiance with a color space coordinate from the color information of the surface element and a color matching function associated with the color space coordinate;

calculate the spectral radiance by inserting the scaling factors; and

generate the synthetic camera data by processing the spectral radiance in a camera simulation of a camera located in the virtual scene; and

an interface configured to provide the generated synthetic camera data to at least one component of an electronic system configured for processing camera data.

Assignments (1)
CHANGE OF NAME Recorded May 22, 2026
From: DSPACE GMBH
To: DSPACE SE & CO. KG
Reel/Frame 075622/0216 →