Image generation system, image display system, image generation method, and moving vehicle
View Patent ↗An image generation system according to an embodiment includes an acquisition unit, a first processing unit, and a second processing unit. The acquisition unit acquires first image data. The first processing unit generates second image data by subjecting the first image data, acquired by the acquisition unit, to a predetermined type of image processing. The second processing unit performs recognition processing on the second image data. The first processing unit and the second processing unit perform their respective processing in synchronization with each other without depending on an instruction from a processor.
1. An image generation system comprising:
a memory that stores instructions, and
a processor, when executing the instructions stored in the memory, that performs operations including:
receiving a plurality of first image frames;
performing generation of a plurality of second image frames by subjecting the received plurality of first image frames to a predetermined type of image processing;
performing recognition processing on the plurality of second image frames; and
performing generation of synthetic image data by synthesizing at least two image frames of the plurality of second image frames based on a result of the recognition processing,
wherein the generation of the plurality of second image frames and the recognition processing are performed in synchronization with each other without depending on an instruction from the processor, and the generation of synthetic image data and the recognition processing are performed in synchronization with each other without depending on the instruction.
2. The image generation system of claim 1 , wherein
the recognition processing includes search processing and matching processing,
the search processing including searching the plurality of second image frames for a feature quantity,
the matching processing including matching two image frames of interest, selected from the plurality of second image frames, one against the other with respect to the feature quantity found through the search processing.
3. The image generation system of claim 2 , wherein
the search processing includes searching the two image frames of interest for the feature quantity, and
the matching processing includes detecting a feature point, commonly present in both of the two image frames of interest, by matching the two image frames of interest one against the other with respect to the feature quantity found through the search processing.
4. The image generation system of claim 3 , wherein the generation of synthetic image data includes generating, with respect to the feature point detected through the matching processing, synthetic image data by synthesizing the two image frames of interest together.
5. The image generation system of claim 3 , wherein
the two image frames of interest partially overlap with each other.
6. The image generation system of claim 1 , wherein
the plurality of first image frames are received from a plurality of cameras.
7. The image generation system of claim 6 , wherein
the plurality of cameras are provided for a moving vehicle to capture the plurality of first image frames representing outside of the moving vehicle.
8. The image generation system of claim 1 , wherein
the plurality of second image frames are generated by performing the predetermined type of the image processing in accordance with a predetermined type of setting information, and the recognition processing is performed in accordance with the predetermined type of the setting information.
9. The image generation system of claim 2 , wherein
the plurality of second image frames are generated by performing the predetermined type of the image processing in accordance with a predetermined type of setting information, and the recognition processing is performed in accordance with the predetermined type of the setting information.
10. The image generation system of claim 3 , wherein
the plurality of second image frames are generated by performing the predetermined type of the image processing in accordance with a predetermined type of setting information, and the recognition processing is performed in accordance with the predetermined type of the setting information.
11. The image generation system of claim 8 , wherein the processor further performs operations including: outputting, on receiving the predetermined type of the setting information, the predetermined type of the setting information to be used in the generation of the plurality of second image frames and in the recognition processing.
12. The image generation system of claim 11 , wherein
the processor further performs operations including: when a predetermined update condition is satisfied, updating the predetermined type of the setting information and outputting the updated predetermined type of the setting information to be used in the generation of the plurality of second image frames and in the recognition processing.
13. The image generation system of claim 12 , wherein the processor further performs operations including generating the predetermined type of the setting information.
14. An image display system comprising:
the image generation system of claim 1 ; and
a display configured to display an image generated by the image generation system.
15. The image display system of claim 14 , wherein
the plurality of first image frames are received from a plurality of cameras.
16. The image display system of claim 14 , wherein
the plurality of first image frames are received from a plurality of cameras provided for a moving vehicle,
the plurality of second image frames are generated by subjecting the received plurality of first image frames, to the predetermined type of the image processing, and
the display is configured to display the synthetic image data generated by synthesizing together the at least two image frames selected from the plurality of second image frames.
17. The image display system of claim 16 , wherein
the plurality of the cameras are configured to capture the plurality of first image frames representing outside of the moving vehicle.
18. An image generation method comprising:
acquiring a plurality of first image frames;
performing generation of a plurality of second image frames by subjecting the plurality of first image frames to a predetermined type of image processing; and
performing recognition processing on the plurality of second image frames; and
performing generation of synthetic image data by synthesizing at least two image frames of the plurality of second image frames based on a result of the recognition processing,
wherein the generation of the plurality of second image frames and the recognition processing are performed in synchronization with each other without depending on an instruction from a processor, and the generation of synthetic image data and the recognition processing are performed in synchronization with each other without depending on the instruction.
19. A moving vehicle comprising:
the image display system of claim 14 , and
a moving vehicle body configured to mount the image display system thereon.