Granted Patent B2

US 12,400,301 · App. 18/472,702 · Granted Aug 26, 2025

Inventors: Guangliang Cheng (Hong Kong, CN); Jianping Shi (Hong Kong, CN); Yuji Yasui (Tokyo, JP); Hideki Matsunaga (Tokyo, JP); Kaname Tomite (Tokyo, JP)

Assignees: SENSETIME GROUP LIMITED; HONDA MOTOR CO., LTD.

G06T5/70G06T3/40G06T7/0002

Abstract

Claims (73)

1. A method of image generation, executed by an electronic device and comprising:

detecting illumination lamps on a target object in an original image;

converting the original image into an image to be processed that is under a specific scene;

determining, in the image to be processed, at least one illumination lamp of which operation state does not match scene information of the specific scene as an object to be replaced;

determining, according to the scene information and the object to be replaced, a replacement image comprising the object to be replaced of which operation state matches the scene information; and

replacing an image of a region occupied by the object to be replaced in the image to be processed with the replacement image to generate a target image.

2. The method of claim 1 , wherein determining, according to the scene information and the object to be replaced, the replacement image comprising the object to be replaced of which the operation state matches the scene information, comprises:

determining attribute information of the object to be replaced;

searching a preset image library for a target preset image comprising a preset object of which attribute matches the attribute information of the object to be replaced; and

determining the searched target preset image as the replacement image, wherein an operation state of the preset object in the replacement image matches the scene information.

3. The method of claim 2 , further comprising:

determining a distance between the object to be replaced and a device collecting the original image;

wherein searching the preset image library for the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced comprises:

searching, according to category information of the object to be replaced and the determined distance, the preset image library for the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced.

4. The method of claim 3 , wherein determining the distance between the object to be replaced and the device collecting the original image comprises:

determining size information of the object to be replaced according to the category information of the object to be replaced; and

determining the distance between the device collecting the original image and the object to be replaced according to the size information and a size of the object to be replaced in the image to be processed.

5. The method of claim 2 , wherein in response to the target preset image not being searched in the preset image library, the method further comprises:

generating the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced; and

determining the generated target preset image as the replacement image.

6. The method of claim 5 , wherein generating the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced comprises:

determining an operation parameter of the preset object according to the distance between the object to be replaced and the device collecting the original image; and

generating the target preset image comprising the preset object according to the determined operation parameter.

7. The method of claim 6 , wherein the operation parameter of the preset object is light intensity of the illumination lamp;

wherein determining the operation parameter of the preset object according to the distance between the object to be replaced and the device collecting the original image comprises: determining the light intensity of the illumination lamp at a turned-on state; and determining the light intensity of the illumination lamp matching the distance according to the distance and the light intensity of the illumination lamp at the turned-on state, and

wherein generating the target preset image comprising the preset object according to the determined operation parameter comprises: generating, according to the light intensity matching the distance, the target preset image comprising the preset object with the light intensity matching the distance.

8. The method of claim 5 , wherein after the target preset image is generated, the method further comprises:

storing the target preset image in the preset image library.

9. The method of claim 1 , wherein replacing the image of the region occupied by the object to be replaced in the image to be processed with the replacement image to generate the target image comprises:

determining size information of the replacement image;

determining an area of the region occupied by the object to be replaced in the image to be processed;

adjusting the size information of the replacement image according to the area to obtain an adjusted image; and

replacing the image of the region occupied by the object to be replaced with the adjusted image to generate a candidate image; and

smoothing the candidate image to generate the target image.

10. The method of claim 1 , wherein the target object comprises a traveling device and a street lamp.

11. A non-transitory computer storage medium, having a computer executable instruction stored thereon, wherein the computer executable instruction, when being executed, enables to implement the following:

detecting illumination lamps on a target object in an original image;

converting the original image into an image to be processed that is under a specific scene;

determining, in the image to be processed, at least one illumination lamp of which operation state does not match scene information of the specific scene as an object to be replaced;

determining, according to the scene information and the object to be replaced, a replacement image comprising the object to be replaced of which operation state matches the scene information; and

replacing an image of a region occupied by the object to be replaced in the image to be processed with the replacement image to generate a target image.

12. An electronic device, comprising a memory and a processor, wherein the memory stores a computer executable instruction; and the processor is configured to execute the computer executable instruction stored on the memory to:

detect illumination lamps on a target object in an original image;

convert the original image into an image to be processed that is under a specific scene;

determine, in the image to be processed, at least one illumination lamp of which operation state does not match scene information of the specific scene as an object to be replaced;

determine, according to the scene information and the object to be replaced, a replacement image comprising the object to be replaced of which operation state matches the scene information; and

replace an image of a region occupied by the object to be replaced in the image to be processed with the replacement image to generate a target image.

13. The electronic device of claim 12 , wherein the operation of determining, according to the scene information and the object to be replaced, the replacement image comprising the object to be replaced of which the operation state matches the scene information comprises:

determining attribute information of the object to be replaced;

searching a preset image library for a target preset image comprising a preset object of which attribute matches the attribute information of the object to be replaced; and

determining the searched target preset image as the replacement image, wherein an operation state of the preset object in the replacement image matches the scene information.

14. The electronic device of claim 13 , wherein the processor is further configured to execute the computer executable instruction stored on the memory to:

determine a distance between the object to be replaced and a device collecting the original image; and

search, according to category information of the object to be replaced and the determined distance, the preset image library for the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced.

15. The electronic device of claim 14 , wherein the operation of determining the distance between the object to be replaced and the device collecting the original image comprises:

determining size information of the object to be replaced according to the category information of the object to be replaced; and

determining the distance between the device collecting the original image and the object to be replaced according to the size information and a size of the object to be replaced in the image to be processed.

16. The electronic device of claim 13 , wherein the processor is further configured to execute the computer executable instruction stored on the memory to: in response to the target preset image not being searched in the preset image library,

generate the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced; and

determine the generated target preset image as the replacement image.

17. The electronic device of claim 16 , wherein the operation of generating the target preset image comprising the preset object of which the attribute matches the attribute information of the object to be replaced comprises:

determining an operation parameter of the preset object according to the distance between the object to be replaced and the device collecting the original image; and

generating the target preset image comprising the preset object according to the determined operation parameter.

18. The electronic device of claim 17 , wherein the operation parameter of the preset object is light intensity of the illumination lamp;

wherein the operation of determining the operation parameter of the preset object according to the distance between the object to be replaced and the device collecting the original image comprises: determining the light intensity of the illumination lamp at a turned-on state; and determining the light intensity of the illumination lamp matching the distance according to the distance and the light intensity of the illumination lamp at the turned-on state, and

wherein the operation of generating the target preset image comprising the preset object according to the determined operation parameter comprises: generating, according to the light intensity matching the distance, the target preset image comprising the preset object with the light intensity matching the distance.

19. The electronic device of claim 16 , wherein the processor is further configured to execute the computer executable instruction stored on the memory to: after the target preset image is generated, store the target preset image in the preset image library.

20. The electronic device of claim 12 , wherein the operation of replacing the image of the region occupied by the object to be replaced in the image to be processed with the replacement image to generate the target image comprises:

determining size information of the replacement image;

determining an area of the region occupied by the object to be replaced in the image to be processed;

adjusting the size information of the replacement image according to the area to obtain an adjusted image; and

replacing the image of the region occupied by the object to be replaced with the adjusted image to generate a candidate image; and

smoothing the candidate image to generate the target image.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (27)