IP Library Granted Patent US 12,142,138
Granted Patent B2
US 12,142,138 · App. 17/905,834 · Granted Nov 12, 2024

Object detection system, information processing apparatus, and information processing method

Inventor: Keitaro Yamamoto (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G08G1/005G06V10/98G06V20/58G08G1/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,142,138
App. No.
17/905,834
Granted
Nov 12, 2024
Kind
B2
Abstract

There is provided an information processing apparatus according to the present disclosure includes a recognition processing portion that performs recognition processing of a recognition target based on a captured image of a surrounding environment of a mobile body, and an output control portion that causes, when the recognition target is not recognized, an output apparatus to output non-recognition notification information indicating that the recognition target is not recognized.

Claims (66)

1. An information processing apparatus, comprising:

a recognition processing portion configured to:

perform a recognition processing operation of a recognition target, based on a captured image of a surrounding environment of a mobile body; and

perform object detection based on the captured image; and

an output control portion configured to:

cause an output apparatus to output non-recognition notification information, based on one of:

an object of the recognition target is not detected, or

the object of an unknown type is detected by the recognition processing portion; and

modify a first parameter of the non-recognition notification information based on a value of a recognition score of the object.

2. The information processing apparatus according to claim 1 , wherein

the object of the unknown type is an object of which a recognition score is lower than a threshold.

3. The information processing apparatus according to claim 1 , wherein

the recognition processing portion is further configured to identify a state of the recognition target represented by the object, and

the output control portion is further configured to cause the output apparatus to output the non-recognition notification information using a medium, wherein the medium is used based on a state of the recognition target.

4. The information processing apparatus according to claim 3 , wherein

the medium includes at least one of light, sound, vibration, air, or radio waves.

5. The information processing apparatus according to claim 1 , wherein

the recognition processing portion is further configured to identify a state of the recognition target represented by the object, and

the output control portion is further configured to modify a second parameter of the non-recognition notification information based on the state of the recognition target.

6. The information processing apparatus according to claim 5 , wherein

the state of the recognition target includes at least one of a movement speed of the recognition target, a movement direction of the recognition target, or a distance from the mobile body.

7. The information processing apparatus according to claim 1 , wherein

the recognition processing portion is further configured to calculate a degree of risk of the recognition target represented by the object, and

the output control portion is further configured to modify a third parameter of the non-recognition notification information based on the degree of risk.

8. The information processing apparatus according to claim 1 , wherein

the output control portion is further configured to cause, when the recognition target is recognized, the output apparatus to output recognition notification information indicating that the recognition target is recognized.

9. The information processing apparatus according to claim 8 , wherein

the output control portion is further configured to cause the output apparatus to output the recognition notification information when the object of the recognition target is detected.

10. The information processing apparatus according to claim 8 , wherein

the recognition processing portion is further configured to identify one of a state or an attribute of the recognition target, and

the output control portion is further configured to cause the output apparatus to output the recognition notification information using a medium, wherein the medium is used based on one of the state or the attribute of the recognition target.

11. The information processing apparatus according to claim 9 , wherein

the output control portion is further configured to modify a fourth parameter of the non-recognition notification information based on a recognition score of the object of the recognition target.

12. The information processing apparatus according to claim 8 , wherein

the recognition processing portion is further configured to identify one of a state or an attribute of the recognition target, and

the output control portion is further configured to modify a fifth parameter of the recognition notification information based on one of the state or the attribute of the recognition target.

13. The information processing apparatus according to claim 10 , wherein

the state of the recognition target is a state related to at least one of a sense of vision, a sense of hearing, a sense of touch, a sense of smell, or a sense of taste of the recognition target.

14. The information processing apparatus according to claim 8 , wherein

the recognition processing portion is further configured to calculate a degree of risk of the recognition target, and

the output control portion is further configured to modify a sixth parameter of the recognition notification information based on the degree of risk.

15. The information processing apparatus according to claim 1 , wherein

the recognition processing portion is further configured to perform, based on the captured image, the recognition processing operation with respect to a recognition target view angle that is a part of an angle of view of the captured image, and

when the recognition target is not recognized, the output control portion is further configured to cause the output apparatus to output the non-recognition notification information in a direction corresponding to the part of the angle of view of the captured image.

16. An information processing method, comprising:

performing recognition processing of a recognition target, based on a captured image of a surrounding environment of a mobile body;

performing object detection based on the captured image;

causing an output apparatus to output non-recognition notification information, based on one of:

an object of the recognition target is not detected, or

the object of an unknown type is detected by the object detection; and

modifying a parameter of the non-recognition notification information based on a value of a recognition score of the object.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions, that when executed by a processor of an information processing apparatus, cause the processor to execute operations, the operations, comprising:

performing recognition processing of a recognition target, based on a captured image of a surrounding environment of a mobile body;

performing object detection based on the captured image;

causing an output apparatus to output non-recognition notification information, based on one of:

an object of the recognition target is not detected, and

the object of an unknown type is detected by the object detection; and

modifying a parameter of the non-recognition notification information based on a value of a recognition score of the object.

18. An information processing apparatus, comprising:

a recognition processing portion configured to:

perform a recognition processing operation of a recognition target, based on a captured image of a surrounding environment of a mobile body;

perform, based on the captured image, the recognition processing operation with respect to a recognition target view angle that is a part of an angle of view of the captured image; and

an output control portion configured to:

cause, when the recognition target is not recognized, an output apparatus to output non-recognition notification information, wherein

the non-recognition notification information indicates that the recognition target is not recognized, and

the non-recognition notification information is output in a direction corresponding to the part of the angle of view of the captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2023
From: YAMAMOTO, KEITARO
To: SONY GROUP CORPORATION
Reel/Frame 062323/0436 →
Priority Claims (1)
JP 2020-046726 · Mar 17, 2020 · national
Continuity (1)
Related Publication 20230121146A1 · Apr 20, 2023