Granted Patent B2

US 12,430,814 · App. 18/474,189 · Granted Sep 30, 2025

Inventors: Guangliang Cheng (Hong Kong, CN); Jianping Shi (Hong Kong, CN); Yuji Yasui (Tokyo, JP); Hideki Matsunaga (Tokyo, JP); Kaname Tomite (Tokyo, JP)

Assignees: SENSETIME GROUP LIMITED; HONDA MOTOR CO., LTD.

G06T11/00G06T5/40G06T5/77G06T2207/20081G06T2207/20084

Abstract

Claims (73)

1. An image generation method, performed by an electronic device, the method comprising:

converting an original image into an image to be processed under a specific scenario;

determining, in the image to be processed, a region to be adjusted of which image rendering state does not match scenario information of the specific scenario, wherein the image rendering state of the region to be adjusted is related to light illuminated on a target object in the original image, and the target object comprises a vehicle;

determining a target rendering state in the region to be adjusted, wherein the target rendering state matches the scenario information; and

adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain a target image,

wherein the image rendering state comprises a shadow rendering state; and the determining the target rendering state in the region to be adjusted comprises:

determining, in the image to be processed, a reference region of which shadow rendering state matches the scenario information; and

determining the shadow rendering state of the reference region as the target rendering state, and

wherein the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match scenario information of the specific scenario comprises:

in a case where the scenario information indicates a night scenario without a light source or a daytime scenario without sunshine, determining a shadow region in the image to be processed as the region to be adjusted.

2. The method of claim 1 , wherein the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match scenario information of the specific scenario comprises:

in a case where the scenario information indicates a night scenario with a light source or a daytime scenario with sunshine, determining, according to a direction in which light irradiates the target object, a shadow region capable of being generated by the target object; and

determining a shadow region other than a first shadow region within the shadow region in the image to be processed as the region to be adjusted, wherein the first shadow region is an intersection of the shadow region in the image to be processed and the shadow region capable of being generated by the target object.

3. The method of claim 1 , wherein the shadow rendering state of the reference region is a shadow-free state; and the adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain the target image comprises:

adjusting, in the image to be processed, an image of the region to be adjusted to be in a shadow-free state according to an image of the reference region, to obtain the target image.

4. The method of claim 3 , wherein the adjusting, in the image to be processed, the image of the region to be adjusted to be in the shadow-free state according to the image of the reference region, to obtain the target image comprises:

adjusting a grayscale image of the region to be adjusted according to the image of the reference region, to obtain an adjusted grayscale map;

generating, based on the adjusted grayscale map, an image of a replacement region of which shadow rendering state is the shadow-free state; and

replacing, in the image to be processed, the image of the region to be adjusted with a generated image of the replacement region, to generate the target image.

5. The method of claim 4 , wherein the adjusting the grayscale image of the region to be adjusted according to the image of the reference region, to obtain the adjusted grayscale map comprises:

determining a histogram of the reference region according to the image of the reference region;

adjusting a histogram of the region to be adjusted based on the histogram of the reference region, to obtain an adjusted histogram; and

determining the adjusted grayscale map based on the adjusted histogram.

6. The method of claim 1 , wherein the image rendering state comprises a shadow rendering state, and the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match the scenario information comprises:

in a case where the scenario information indicates a night scenario with a light source or a daytime scenario with sunshine, determining, according to a direction in which light irradiates the target object, a shadow region capable of being generated by the target object; and

determining the shadow region capable of being generated by the target object as the region to be adjusted.

7. The method of claim 6 , wherein the adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain the target image comprises:

determining a light parameter in the specific scenario; and

determining, based on the light parameter, a light intensity of a surface of the target object that is able to generate the shadow region, and rendering the region to be adjusted to obtain the target image.

8. The method of claim 1 , wherein the original image is an image acquired without rain/snow, and the specific scenario is a rain/snow scenario, and

the adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain the target image comprises:

adding raindrops/snowflakes in the original image, to obtain the target image.

9. An image generation apparatus, comprising:

a memory storing processor-executable instructions; and

a processor configured to execute the stored processor-executable instructions to perform operations of:

converting an original image into an image to be processed under a specific scenario;

determining, in the image to be processed, a region to be adjusted of which image rendering state does not match scenario information of the specific scenario, wherein the image rendering state of the region to be adjusted is related to light illuminated on a target object in the original image, and the target object comprises a vehicle;

determining a target rendering state in the region to be adjusted, wherein the target rendering state matches the scenario information; and

adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain a target image,

wherein the image rendering state comprises a shadow rendering state; and the determining the target rendering state in the region to be adjusted comprises:

determining, in the image to be processed, a reference region of which shadow rendering state matches the scenario information; and

determining the shadow rendering state of the reference region as the target rendering state, and

wherein the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match scenario information of the specific scenario comprises:

in a case where the scenario information indicates a night scenario without a light source or a daytime scenario without sunshine, determining a shadow region in the image to be processed as the region to be adjusted.

10. The apparatus of claim 9 , wherein the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match scenario information of the specific scenario comprises:

in a case where the scenario information indicates a night scenario with a light source or a daytime scenario with sunshine, determining, according to a direction in which light irradiates the target object, a shadow region capable of being generated by the target object; and

determining a shadow region other than a first shadow region within the shadow region in the image to be processed as the region to be adjusted, wherein the first shadow region is an intersection of the shadow region in the image to be processed and the shadow region capable of being generated by the target object.

11. The apparatus of claim 9 , wherein the shadow rendering state of the reference region is a shadow-free state; and the adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain the target image comprises:

adjusting, in the image to be processed, an image of the region to be adjusted to be in a shadow-free state according to an image of the reference region, to obtain the target image.

12. The apparatus of claim 11 , wherein the adjusting, in the image to be processed, the image of the region to be adjusted to be in the shadow-free state according to the image of the reference region, to obtain the target image comprises:

adjusting a grayscale image of the region to be adjusted according to the image of the reference region, to obtain an adjusted grayscale map;

generating, based on the adjusted grayscale map, an image of a replacement region of which shadow rendering state is the shadow-free state; and

replacing, in the image to be processed, the image of the region to be adjusted with a generated image of the replacement region, to generate the target image.

13. The apparatus of claim 12 , wherein the adjusting the grayscale image of the region to be adjusted according to the image of the reference region, to obtain the adjusted grayscale map comprises:

determining a histogram of the reference region according to the image of the reference region;

adjusting a histogram of the region to be adjusted based on the histogram of the reference region, to obtain an adjusted histogram; and

determining the adjusted grayscale map based on the adjusted histogram.

14. The apparatus of claim 9 , wherein the image rendering state comprises a shadow rendering state, and the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match the scenario information comprises:

in a case where the scenario information indicates a night scenario with a light source or a daytime scenario with sunshine, determining, according to a direction in which light irradiates the target object, a shadow region capable of being generated by the target object; and

determining the shadow region capable of being generated by the target object as the region to be adjusted.

15. The apparatus of claim 14 , wherein the adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain the target image comprises:

determining a light parameter in the specific scenario; and

determining, based on the light parameter, a light intensity of a surface of the target object that is able to generate the shadow region, and rendering the region to be adjusted to obtain the target image.

16. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to implement operations of:

converting an original image into an image to be processed under a specific scenario;

determining, in the image to be processed, a region to be adjusted of which image rendering state does not match scenario information of the specific scenario, wherein the image rendering state of the region to be adjusted is related to light illuminated on a target object in the original image, and the target object comprises a vehicle;

determining a target rendering state in the region to be adjusted, wherein the target rendering state matches the scenario information; and

adjusting, in the image to be processed, the image rendering state of the region to be adjusted to the target rendering state, to obtain a target image,

wherein the image rendering state comprises a shadow rendering state, and the determining the target rendering state in the region to be adjusted comprises:

determining, in the image to be processed, a reference region of which shadow rendering state matches the scenario information; and

determining the shadow rendering state of the reference region as the target rendering state, and

wherein the determining, in the image to be processed, the region to be adjusted of which image rendering state does not match scenario information of the specific scenario comprises:

in a case where the scenario information indicates a night scenario without a light source or a daytime scenario without sunshine, determining a shadow region in the image to be processed as the region to be adjusted.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (33)