IP Library Granted Patent US 12,485,814
Granted Patent B2
US 12,485,814 · App. 18/388,863 · Granted Dec 2, 2025

Information processing apparatus, information processing method, photographing apparatus, lighting apparatus, and mobile body

Inventor: Keitaro Yamamoto (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
B60Q1/0017G06F18/2163G06F18/251G06V10/141G06V20/56G06V20/58H04N23/74B60Q1/0023B60Q1/1423B60Q2300/056H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,485,814
App. No.
18/388,863
Granted
Dec 2, 2025
Kind
B2
Abstract

The present technique relates to an information processing apparatus, an information processing method, a photographing apparatus, a lighting apparatus, and a mobile body which enable accuracy of image recognition processing to be improved. The information processing apparatus includes: a recognizing portion configured to perform image recognition processing with respect to an image photographed by a photographing portion and calculate, for each recognized area being an area based on a recognition result of an object, a reliability of the recognition result; and an irradiation control portion configured to control an irradiation pattern of visible light in a photographing direction of the photographing portion so that the reliability with respect to at least a part of the recognized areas increases. For example, the present technique can be applied to a vehicle control apparatus.

Claims (69)

1 . An information processing apparatus, comprising:

circuitry configured to

perform image recognition processing with respect to an image photographed by a camera and calculate, for each recognized area being an area based on a recognition result of an object in the image and including the object therein, a reliability of the recognition result, the recognition result including at least a type of the object;

control an irradiation pattern of visible light in a photographing direction of the camera; and

increase light intensity of the visible light only with respect to a low-reliability recognized area that is the recognized area whose reliability of the recognition result regarding the type of the object is lower than a prescribed threshold, wherein

an irradiation area of the visible light is divided into unit areas for each of which the light intensity of the visible light is controllable, and

the circuitry is further configured to increase the light intensity of the visible light only with respect to the low-reliability recognized area by increasing the light intensity of the visible light only with respect to a subset of the unit areas that corresponds to the low-reliability recognized area.

2 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to control the light intensity of the visible light with respect to the low-reliability recognized area so that the reliability of the recognition result with respect to the low-reliability recognized area increases.

3 . The information processing apparatus according to claim 2 , wherein

the circuitry is configured to control the light intensity of the visible light with respect to the low-reliability recognized area based on brightness of the low-reliability recognized area in the image.

4 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on a type of an object in a recognized area.

5 . The information processing apparatus according to claim 4 , wherein

the circuitry is configured to lower light intensity of the visible light with respect to the recognized area including an object that emits light or a reflective member that reflects visible light.

6 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on a distance to an object in a recognized area.

7 . The information processing apparatus according to claim 6 , wherein

the circuitry is configured to set light intensity of the visible light with respect to the recognized area including an object that is separated by a prescribed distance or more to 0.

8 . The information processing apparatus according to claim 1 , wherein

the image comprises an infrared image and a visible image and

the circuitry is configured to control the irradiation pattern based on the reliability of the recognition result with respect to the infrared image.

9 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to further control the irradiation pattern based on the reliability of the recognition result with respect to the visible image.

10 . The information processing apparatus according to claim 1 , wherein

the image is an image obtained by photographing the surroundings of a mobile body.

11 . The information processing apparatus according to claim 10 , wherein

the mobile body is a vehicle, and

the circuitry is configured to control the irradiation pattern so as to irradiate a recognized area including a road surface with the visible light.

12 . The information processing apparatus according to claim 10 , wherein

the mobile body is a vehicle, and

the circuitry is configured to lower light intensity of the visible light with respect to a recognized area including a person or another vehicle.

13 . The information processing apparatus according to claim 1 , wherein

the irradiation pattern is a distribution of light intensity of the visible light in a spatial direction.

14 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to output a control signal including the irradiation pattern.

15 . The information processing apparatus according to claim 1 , wherein

the circuitry is configured to perform semantic segmentation as the image recognition processing.

16 . An information processing method, comprising:

performing image recognition processing with respect to an image photographed by a camera and calculating, for each recognized area being an area based on a recognition result of an object in the image and including the object therein, a reliability of the recognition result, the recognition result including at least a type of the object;

controlling an irradiation pattern of visible light in a photographing direction of the camera; and

increasing light intensity of the visible light only with respect to a low-reliability recognized area that is the recognized area whose reliability of the recognition result regarding the type of the object is lower than a prescribed threshold, wherein

an irradiation area of the visible light is divided into unit areas for each of which the light intensity of the visible light is controllable, and

the method further comprises increasing the light intensity of the visible light only with respect to the low-reliability recognized area by increasing the light intensity of the visible light only with respect to a subset of the unit areas that corresponds to the low-reliability recognized area.

17 . A photographing apparatus, comprising:

an imaging element; and

circuitry configured to

perform image recognition processing with respect to an image photographed by the imaging element and calculate, for each recognized area being an area based on a recognition result of an object in the image and including the object therein, a reliability of the recognition result, the recognition result including at least a type of the object;

control an irradiation pattern of visible light in a photographing direction of the imaging element; and

increase light intensity of the visible light only with respect to a low-reliability recognized area that is the recognized area whose reliability of the recognition result regarding the type of the object is lower than a prescribed threshold, wherein

an irradiation area of the visible light is divided into unit areas for each of which the light intensity of the visible light is controllable, and

the circuitry is further configured to increase the light intensity of the visible light only with respect to the low-reliability recognized area by increasing the light intensity of the visible light only with respect to a subset of the unit areas that corresponds to the low-reliability recognized area.

18 . A lighting apparatus, comprising:

a light source; and

circuitry configured to

perform image recognition processing with respect to an image photographed by a camera and calculate, for each recognized area being an area based on a recognition result of an object in the image and including the object therein, a reliability of the recognition result, the recognition result including at least a type of the object;

control an irradiation pattern of visible light emitted by the light source in a photographing direction of the camera; and

increase light intensity of the visible light only with respect to a low-reliability recognized area that is the recognized area whose reliability of the recognition result regarding the type of the object is lower than a prescribed threshold, wherein

an irradiation area of the visible light is divided into unit areas for each of which the light intensity of the visible light is controllable, and

the circuitry is further configured to increase the light intensity of the visible light only with respect to the low-reliability recognized area by increasing the light intensity of the visible light only with respect to a subset of the unit areas that corresponds to the low-reliability recognized area.

19 . A mobile body comprising:

a camera;

a light source configured to irradiate visible light in a photographing direction of the camera; and

circuitry configured to

perform image recognition processing with respect to an image photographed by the camera and calculate, for each recognized area being an area based on a recognition result of an object in the image and including the object therein, a reliability of the recognition result, the recognition result including at least a type of the object;

control an irradiation pattern of the visible light of the light source; and

increase light intensity of the visible light only with respect to a low-reliability recognized area that is the recognized area whose reliability of the recognition result regarding the type of the object is lower than a prescribed threshold, wherein

an irradiation area of the visible light is divided into unit areas for each of which the light intensity of the visible light is controllable, and

the circuitry is further configured to increase the light intensity of the visible light only with respect to the low-reliability recognized area by increasing the light intensity of the visible light only with respect to a subset of the unit areas that corresponds to the low-reliability recognized area.

Assignments (1)
CHANGE OF NAME Recorded Nov 13, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 065549/0155 →
Priority Claims (1)
JP 2018-099296 · May 24, 2018 · national
Continuity (2)
Continuation 17054784
Related Publication 20240075866A1 · Mar 7, 2024
References Cited (22)
US 20070069135A1 · Kraft · 2007 [cited by examiner]
US 20120308082A1 · Murao · 2012 [cited by examiner]
US 20130258689A1 · Takahira · 2013 [cited by examiner]
US 20170083775A1 · Grauer et al. · 2017 [cited by applicant]
US 20170341645A1 · Sugita · 2017 [cited by examiner]
CN 105245790A · 2016 [cited by applicant]
CN 106161982A · 2016 [cited by applicant]
CN 106985734A · 2017 [cited by applicant]
CN 107948539A · 2018 [cited by applicant]
DE 102014108239A1 · 2015 [cited by applicant]
EP 2127944A1 · 2009 [cited by applicant]
EP 3067826A1 · 2016 [cited by examiner]
JP 2775448B2 · 1998 [cited by examiner]
JP 2008143505A · 2008 [cited by applicant]
JP 2013511418A · 2013 [cited by applicant]
JP 2013232390A · 2013 [cited by applicant]
JP 2016169001A · 2016 [cited by applicant]
JP 2017211909A · 2017 [cited by applicant]
JP 201869800A · 2018 [cited by applicant]
JP 2018069800A · 2018 [cited by examiner]
WO WO2015099463A1 · 2015 [cited by applicant]
International Search Report and Written Opinion mailed on Jul. 23, 2019 for PCT/JP2019/018676 filed on May 10, 2019, 11 pages. [cited by applicant]