Information processing device, information processing method, and program
Parking region analysis for display of available and potentially available parking regions is disclosed. In one example, a parking region analyzer accesses a camera-captured image and analyzes whether or not a vehicle is able to be parked. A display controller generates parking possibility identification graphic data on the basis of the analysis and superimposes and displays the data on the camera-captured image.
1 . An information processing device comprising:
a memory storing a program, and
at least one processor configured to execute the program to perform operations comprising:
analyzing a captured image of a camera mounted on a vehicle and analyzing whether or not the vehicle is able to be parked in a parking section region;
generating parking possibility identification graphic data, on a basis of analyzing the captured image, and superimposing and displaying parking possibility identification graphic data on the captured image or a combined image generated on a basis of the captured image;
calculating a ratio of an occlusion region that is not able to be confirmed from the captured image with respect to a total section region area, for a section region where a parked vehicle is not detected from the captured image;
executing determination processing for determining which one of a parkable region or a possibly available region the section region is according to a value of the calculated ratio; and
superimposing and displaying graphic data differently between the parkable region and the possibly available region, according to a result of the determination processing.
2 . The information processing device according to claim 1 , wherein the operations further comprise:
generating the parking possibility identification graphic data to include
(a) display data for parkable region identification,
(b) display data for unparkable region identification, and
(c) display data for possibly available region identification; and superimposing and displaying any one of pieces (a) to (c) of the parking possibility identification graphic data on each section region of a parking region image.
3 . The information processing device according to claim 2 , wherein the operations further comprise:
determining a section region where the parked vehicle is detected from the captured image as an unparkable region;
calculating a vacancy likelihood indicating a vacancy possibility of the section region, on a basis of the ratio of the occlusion region with respect to an entire area of the section region, for the section region where the parked vehicle is not detected from the captured image;
determining the section region as a parkable region if the calculated vacancy likelihood is equal to or more than a prescribed threshold;
determining that the section region is a possibly available region if the calculated vacancy likelihood is less than the prescribed threshold; and
superimposing and displaying any one of the pieces (a) to (c) of the parking possibility identification graphic data on each section region.
4 . The information processing device according to claim 3 , wherein the operations further comprise:
calculating the vacancy likelihood indicating the vacancy possibility of the section region where the parked vehicle is not detected from the captured image of the camera, according to (formula 1)
vacancy likelihood(vacancy possibility) (%)=(1−(occlusion region area)/(total section region area))*100(%) (formula 1),
wherein the occlusion region area is the region that is not able to be confirmed from the captured image.
5 . The information processing device according to claim 1 , wherein the operations further comprise:
generating, as the parking possibility identification graphic data, the parking possibility identification graphic data, as follows:
(a) display data for parkable region identification,
(b) display data for unparkable region identification, and
(c) display data for possibly available region identification, as graphic data with different colors.
6 . The information processing device according to claim 1 , wherein the operations further comprise:
generating frame-shaped graphic data indicating an outer shape of a section region, as the parking possibility identification graphic data.
7 . The information processing device according to claim 1 , wherein the operations further comprise:
detecting a section region clearly indicated in a parking allowable region, from the captured image; and
analyzing whether or not a vehicle is able to be parked in the detected section region.
8 . The information processing device according to claim 1 , wherein the operations further comprise:
detecting a parking allowable region from the captured image;
detecting the parked vehicle from the detected parking allowable region;
dividing a parking region of the detected parked vehicle and a vacant space and setting a set section region; and
analyzing whether or not the vehicle is able to be parked in the set section region.
9 . The information processing device according to claim 8 , wherein the operations further comprise:
detecting a parallel parking region on a road side as the parking allowable region.
10 . The information processing device according to claim 1 , wherein the operations further comprise:
estimating the section region using AI prediction data.
11 . The information processing device according to claim 10 , wherein the AI prediction data includes data generated using an AI predictor generated by a learning algorithm using a convolutional neural network (CNN).
12 . The information processing device according to claim 1 , wherein the operations further comprise:
determining the section region using received information from an external device.
13 . The information processing device according to claim 1 , wherein the operations further comprise:
generating a parking region image including a bird's-eye view in which the parking region is observed from above, on a basis of the captured image, and superimposing and displaying the parking possibility identification graphic data on each section region of the generated parking region image including the bird's-eye view.
14 . The information processing device according to claim 1 , wherein the operations further comprise:
sequentially inputting the captured image that changes along with traveling of the vehicle;
repeatedly executing processing for analyzing whether or not the vehicle is able to be parked in a section region, on a basis of a latest input image, and sequentially updating analyzed data; and
executing processing for sequentially updating the parking possibility identification graphic data, on a basis of a latest analysis result.
15 . The information processing device according to claim 14 , wherein regarding a section region determined as a possibly available region, in a case where the parked vehicle is detected from the latest captured image, changing the section region to an unparkable region.
16 . The information processing device according to claim 14 , wherein regarding a section region determined as a possibly available region, in a case where a vacancy likelihood calculated on a basis of the latest captured image of the camera is equal to or more than a prescribed threshold, changing the section region to a parkable region.
17 . The information processing device according to claim 1 , wherein the operations further comprise:
performing automated driving so as to park in a region determined as the parkable region.
18 . The information processing device according to claim 17 , wherein in a case where there is no region determined as the parkable region, travelling toward a possibly available region, and in a case where the possibly available region is changed to the parkable region, performing automated driving so as to park in the parkable region.
19 . An information processing method executed by an information processing device, comprising:
analyzing a captured image of a camera mounted on a vehicle and analyzing whether or not the vehicle is able to be parked in a parking section region;
generating parking possibility identification graphic data , on a basis of analyzing the captured image, and superimposing and displaying the data on the captured image or a combined image generated on a basis of the captured image;
calculating a ratio of an occlusion region that is not able to be confirmed from the captured image with respect to a total section region area, for a section region where a parked vehicle is not detected from the captured image;
executing determination processing for determining which one of a parkable region or a possibly available region the section region is according to a value of the calculated ratio; and
superimposing and displaying graphic data different between the parkable region and the possibly available region, according to a result of the determination processing.
20 . A non-transitory computer readable medium storing a program, the program being executable by at least one processor to perform operations comprising:
analyzing a captured image of a camera mounted on a vehicle and analyzing whether or not the vehicle is able to be parked in a parking section region;
generating parking possibility identification graphic data, on a basis of analyzing the capture image, and superimposing and displaying the data on the captured image or a combined image generated on a basis of the captured image;
executing processing for calculating a ratio of an occlusion region that is not able to be confirmed from the captured image of the camera with respect to a total section region area, for a section region where a parked vehicle is not detected from the captured image;
executing determination processing for determining which one of a parkable region or a possibly available region the section region is according to a value of the calculated ratio; and
executing processing for superimposing and displaying graphic data different between the parkable region and the possibly available region, according to a result of the determination processing.