Information processing method, information processing system, and program

1. An information processing method comprising:

acquiring event-related information to detect a particular event associated with a vehicle;

determining, using the event-related information, whether the particular event is detected or not;

acquiring direction information indicating a first direction associated with the particular event in a case where it is determined that the particular event is detected;

acquiring captured image information including a first image generated by capturing an image in the first direction and a second image generated by capturing an image in a second direction that is different from the first direction and has lower priority than priority of the first direction;

acquiring first recognition result information obtained as a result of a recognition process performed by the vehicle as to an object located outside the vehicle based on the acquired captured image information;

determining whether the first recognition result information includes a result of object recognition in the first direction;

determining, using the first recognition result information, whether there exists in the first direction a specific object that may influence driving of the vehicle;

generating process completion information indicating that the vehicle has performed the recognition process in the first direction, in response to (i) determining that the first recognition result information includes the result of object recognition in the first direction and (ii) determining that the specific object does not exist in the first direction;

outputting the generated process completion information;

displaying the first image, indicating the result of object recognition in the first direction, in a first window when the generated process completion information indicating that the vehicle has performed the recognition process in the first direction is output;

determining, using the first recognition result information, whether a specific object exists in the second direction that is different from the first direction and has the lower priority than the priority of the first direction;

in response to determining that the specific object exists in the second direction, further determining whether or not the vehicle has changed a predetermined autonomous driving control specified by the particular event because of the specific object existing in the second direction; and

in response to determining that the specific object exists in the second direction and the vehicle has changed the predetermined autonomous driving control because of the specific object existing in the second direction, displaying the second image in the second direction in a second window separate from the first window, together with the first image in the first window, the second image including the specific object existing in the second direction.

2. The information processing method according to claim 1 , further comprising:

generating the process completion information including first information indicating that the specific object is recognized in the first direction in a case where it is determined that the specific object exists in the first direction, and

generating the process completion information including second information indicating that the specific object is not recognized in the first direction in a case where it is determined that the specific object does not exist in the first direction.

3. The information processing method according to claim 1 , wherein the first recognition result information is information acquired by performing the recognition process on an image obtained by capturing an image in a particular range in the first direction from the vehicle.

4. The information processing method according to claim 3 , further comprising

acquiring driving information on the vehicle including at least one of a steering angle of the vehicle and a vehicle speed,

wherein the particular range is determined depending on the driving information on the vehicle.

5. The information processing method according to claim 4 , further comprising outputting the acquired driving information on the vehicle together with the process completion information.

6. The information processing method according to claim 1 , wherein the process completion information is further output repeatedly until the detected particular event is no longer detected or until a predetermined time has elapsed in a case where the particular event is detected.

7. The information processing method according to claim 2 , further comprising

determining whether the vehicle has made a decision to perform a driving control or has changed the driving control because of the existence of the specific object in the first direction in a case where it is determined that the specific object exists in the first direction, and

generating the first information including a result of the determination as to whether the vehicle has made the decision to perform the driving control or has changed the driving control because of the specific object existing in the first direction.

8. The information processing method according to claim 1 , further comprising

outputting the acquired first image together with the process completion information in a mode depending on the detected particular event.

9. The information processing method according to claim 1 , further comprising

generating non-execution information indicating that the recognition process in the first direction has not been performed by the vehicle and outputting the generated non-execution information in a case where it is determined that the first recognition result information does not include the result of object recognition in the first direction.

10. A non-transitory recording medium storing thereon a computer program, which when executed by a processor, causes the processor to perform operations according to claim 1 .

11. The information processing method according to claim 1 , wherein the particular event includes at least one of starting, stopping, right turning, left turning, entering an intersection, starting driving backward or changing a lane.

12. The information processing method according to claim 1 , wherein the result of object recognition in the first direction includes at least one of information indicating that the recognition process has been performed in the first direction, information indicating that the recognition process was successful in the first direction, or information indicating that there is a recognized object in the first direction.

13. The information processing method according to claim 1 , further comprising:

generating a check box to prompt a user to input an evaluation result as to whether the recognition process is properly performed by the vehicle;

displaying the generated process completion information together with the generated check box; and

receiving, from the user, an input of the evaluation result via an operation on the displayed check box.

14. The information processing method according to claim 1 , wherein

the first image in the first direction is displayed in the first window regardless of whether the specific object is recognized in the first direction, and

the second image in the second direction is not displayed when the specific object is not recognized in the second direction or when the predetermined autonomous driving control has not been changed because of the recognized specific object in the second direction.

15. The information processing method according to claim 2 , wherein

when the process completion information including first information indicating that the specific object is recognized in the first direction is generated, the first image in the first direction includes the recognized specific object in the first direction, and

when the process completion information including second information indicating that the specific object is not recognized in the first direction is generated, the first image in the first direction does not include any specific object.

16. The information processing method according to claim 1 , wherein

the first image in the first direction is displayed as a bird's-eye view image, when the detected particular event is a first event,

the first image in the first direction is displayed as a forward direction image, when the detected particular event is a second event different from the first event.

17. A system comprising:

a processor; and

a non-transitory recording medium storing a computer program, which when executed by the processor, causes the processor to perform operations including:

acquiring event-related information for detecting a particular event associated with a vehicle;

determining, using the event-related information, whether the particular event is detected;

acquiring direction information indicating a first direction associated with the particular event in a case where it is determined that the particular event is detected;

acquiring captured image information including a first image generated by capturing an image in the first direction and a second image generated by capturing an image in a second direction that is different from the first direction and has lower priority than priority of the first direction;

acquiring first recognition result information obtained as a result of a recognition process performed by the vehicle as to an object located outside the vehicle based on the acquired captured image information;

determining whether the first recognition result information includes a result of object recognition in the first direction;

determining, using the first recognition result information, whether there exists in the first direction a specific object that may influence the driving of the vehicle;

generating process completion information indicating that the vehicle has performed the recognition process in the first direction, in response to (i) determining that the first recognition result information includes the result of object recognition in the first direction and (ii) determining that the specific object does not exist;

displaying the generated process completion information on a display apparatus;

displaying the first image, indicating the result of object recognition in the first direction, in a first window when the generated process completion information indicating that the vehicle has performed the recognition process in the first direction is displayed;

determining, using the first recognition result information, whether a specific object exists in the second direction different from the first direction;

in response to determining that the specific object exists in the second direction, further determining whether or not the vehicle has changed a predetermined autonomous driving control specified by the particular event because of the specific object existing in the second direction; and

in response to determining that the specific object exists in the second direction and the vehicle has changed the predetermined autonomous driving control because of the specific object existing in the second direction, displaying the second image in the second direction in a second window separate from the first window, together with the first image in the first direction in the first window, the second image including the specific object existing in the second direction on the display apparatus.

18. The system according to claim 17 , further comprising:

generating a check box to prompt a user to input an evaluation result as to whether the recognition process is properly performed by the vehicle;

displaying the generated process completion information together with the generated check box on a display apparatus; and

receiving, from the user, an input of the evaluation result via an operation on the displayed check box.

19. The system according to claim 17 , wherein

the first image in the first direction is displayed in the first window regardless of whether the specific object is recognized in the first direction, and

the second image in the second direction is not displayed when the specific object is not recognized in the second direction or when the predetermined autonomous driving control has not been changed because of the recognized specific object in the second direction.