IP Library Granted Patent US 11,850,990
Granted Patent B2
US 11,850,990 · App. 17/054,784 · Granted Dec 26, 2023

Information processing apparatus, information processing method, photographing apparatus, lighting apparatus, and mobile body

Inventor: Keitaro Yamamoto (Tokyo, JP)
Assignee: SONY CORPORATION
B60Q1/0017G06F18/2163G06F18/251G06V10/141G06V20/56G06V20/58H04N23/74B60Q1/0023B60Q1/1423B60Q2300/056H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,850,990
App. No.
17/054,784
Granted
Dec 26, 2023
Kind
B2
Abstract

The present technique relates to an information processing apparatus, an information processing method, a photographing apparatus, a lighting apparatus, and a mobile body which enable accuracy of image recognition processing to be improved. The information processing apparatus includes: a recognizing portion configured to perform image recognition processing with respect to an image photographed by a photographing portion and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result; and an irradiation control portion configured to control an irradiation pattern of visible light in a photographing direction of the photographing portion so that the reliability with respect to at least a part of the recognized areas increases. For example, the present technique can be applied to a vehicle control apparatus.

Claims (58)

1. An information processing apparatus, comprising:

circuitry configured to

perform image recognition processing with respect to an image photographed by a camera and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result, wherein the image comprises an infrared image and a visible image;

control an irradiation pattern of visible light in a photographing direction of the camera so that the reliability with respect to at least a part of the recognized areas increases; and

control the irradiation pattern based on the reliability of the image recognition processing performed with respect to the infrared image.

2. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to control light intensity of visible light with respect to a low-reliability area that is the recognized area of which the reliability is lower than a prescribed threshold so that the reliability with respect to the low-reliability area increases.

3. The information processing apparatus according to claim 2 , wherein

the circuitry is configured to control light intensity of visible light with respect to the low-reliability area based on brightness of the low-reliability area in the image.

4. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on a type of an object in the recognized area.

5. The information processing apparatus according to claim 4 , wherein

the circuitry is configured to lower light intensity of visible light with respect to the recognized area including an object that emits light and a reflective member that reflects visible light.

6. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on a distance to an object in the recognized area.

7. The information processing apparatus according to claim 6 , wherein

the circuitry is configured to set light intensity of visible light with respect to the recognized area including an object that is separated by a prescribed distance or more to 0.

8. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on the reliability of the image recognition processing performed with respect to the visible image.

9. The information processing apparatus according to claim 1 , wherein

the image is an image obtained by photographing the surroundings of a mobile body.

10. The information processing apparatus according to claim 9 , wherein

the mobile body is a vehicle, and

the circuitry is configured to control the irradiation pattern so as to irradiate the recognized area including a road surface with visible light.

11. The information processing apparatus according to claim 9 , wherein

the mobile body is a vehicle, and

the circuitry is configured to lower light intensity of visible light with respect to the recognized area including a person or another vehicle.

12. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to control the irradiation pattern by controlling light intensity of visible light in prescribed area units.

13. The information processing apparatus according to claim 1 , wherein

the irradiation pattern is a distribution of light intensity of visible light in a spatial direction.

14. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to output a control signal including the irradiation pattern.

15. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to perform semantic segmentation as image recognition processing.

16. An information processing method, comprising:

performing image recognition processing with respect to an image photographed by a camera and calculating, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result, wherein the image comprises an infrared image and a visible image;

controlling an irradiation pattern of visible light in a photographing direction of the camera so that the reliability with respect to at least a part of the recognized areas increases; and

controlling the irradiation pattern based on the reliability of the image recognition processing performed with respect to the infrared image.

17. A photographing apparatus, comprising:

an imaging element;

circuitry configured to

perform image recognition processing with respect to an image photographed by the imaging element and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result, wherein the image comprises an infrared image and a visible image;

control an irradiation pattern of visible light in a photographing direction of the imaging element so that the reliability with respect to at least a part of the recognized areas increases; and

control the irradiation pattern based on the reliability of the image recognition processing performed with respect to the infrared image.

18. Alighting apparatus, comprising:

a light source;

circuitry configured to

perform image recognition processing with respect to an image photographed by a camera and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result, wherein the image comprises an infrared image and a visible image;

control an irradiation pattern of visible light due to the light source portion in a photographing direction of the camera so that the reliability with respect to at least a part of the recognized areas increases; and

control the irradiation pattern based on the reliability of the image recognition processing performed with respect to the infrared image.

19. A mobile body comprising:

a camera;

light source configured to irradiate visible light in a photographing direction of the camera;

circuitry configured to

perform image recognition processing with respect to an image photographed by the camera and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result, wherein the image comprises an infrared image and a visible image;

control an irradiation pattern of visible light of the light source so that the reliability with respect to at least a part of the recognized areas increases; and

control the irradiation pattern based on the reliability of the image recognition processing performed with respect to the infrared image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2020
From: YAMAMOTO, KEITARO
To: SONY CORPORATION
Reel/Frame 054343/0490 →
Priority Claims (1)
JP 2018-099296 · May 24, 2018 · national
Continuity (1)
Related Publication 20210232842A1 · Jul 29, 2021