IP Library › Granted Patent US 11,332,146
Granted Patent B2
US 11,332,146 · App. 16/638,140 · Granted May 17, 2022

Vehicle traveling control device, vehicle traveling control method, and program

Inventors: Takeshi Uemori (Tokyo, JP); Atsushi Ito (Kanagawa, JP); Hideki Oyaizu (Tokyo, JP); Suguru Aoki (Tokyo, JP); Ryuta Satoh (Kanagawa, JP)
Assignee: SONY CORPORATION
B60W40/068B60W60/001G01C21/3697G01J5/10B60W2420/40B60W2420/42B60W2520/10B60W2552/40B60W2554/00G01J2005/0077G01J2005/0085
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,332,146
App. No.
16/638,140
Granted
May 17, 2022
Kind
B2
Abstract

An image captured by a far-infrared camera is analyzed to analyze a distribution of a road-surface temperature, and a course of a highest road-surface temperature is determined to be a traveling route. Further, automatic driving along the course of the highest road-surface temperature is performed. Furthermore, a state of the distribution of a road-surface temperature, and a direction of the course of the highest road-surface temperature are displayed on a display section, so that a user (a driver) recognizes them. For example, a state analyzer detects a candidate course travelable for a vehicle, the state analyzer detecting a plurality of the candidate courses, calculates an average value of a road-surface temperature of each of the plurality of the candidate courses, and determines the candidate course having a largest average value of a road-surface temperature to be a traveling route.

Claims (47)

1. A vehicle traveling control device comprising:

circuitry configured to

acquire an image of a region situated in a travel direction of a vehicle, the image being captured by a far-infrared camera to analyze a distribution of a road-surface temperature;

detect two or more candidate courses of the vehicle to be safely travelable based on vehicle state information of the vehicle and surrounding information of the vehicle acquired by a sensor, the state vehicle state information including at least one of a location of the vehicle, a pose of the vehicle, and movement of the vehicle, and the surrounding information of the vehicle including at least one of a type, a location, and movement of an obstacle object around the vehicle; and

determine a course of a highest road-surface temperature to be a traveling route, based on the distribution of a road-surface temperature, the course being determined from the two or more candidate courses of the vehicle.

2. The vehicle traveling control device according to claim 1 , wherein the circuitry is further configured to

perform automatic driving of hg vehicle, the vehicle being guided to travel along the course of the highest road-surface temperature.

3. The vehicle traveling control device according to claim 1 , wherein the circuitry is further configured to

calculate an average value of the road-surface temperature of each of the plurality of the candidate courses, and

determine, to be the traveling route, the candidate course having a largest average value of the road-surface temperature.

4. The vehicle traveling control device according to claim 1 , wherein the circuitry is further configured to

calculate a maximum value or a median value of the road-surface temperature of each of the plurality of the candidate courses, and

determine, to be the traveling route, the candidate course having a largest maximum value or a largest median value of the road-surface temperature.

5. The vehicle traveling control device according to claim 3 , wherein the circuitry is further configured to determine the candidate courses which is travelable in the travel direction of the vehicle without sharp change in course from a current traveling course.

6. The vehicle traveling control device according to claim 1 , wherein the circuitry is further configured to

extract a road-surface region from the image of the region situated in the travel direction of the vehicle, the image being captured by a visible light camera, and

analyze the distribution of the temperature of the road surface included in the extracted road-surface region.

7. The vehicle traveling control device according to claim 1 , further comprising

a display that displays direction information regarding the course of the highest road-surface temperature.

8. The vehicle traveling control device according to claim 7 , wherein

the display displays information indicating a temperature distribution of a road-surface temperature.

9. The vehicle traveling control device according to claim 8 , wherein

the display displays, as the information indicating a temperature distribution of a road-surface temperature, information in which an output color depending on a temperature is set.

10. A vehicle traveling control method that is performed in a vehicle traveling control device, the method comprising:

acquiring, by a far-infrared camera, an image of a region situated in a travel direction of a vehicle, to analyze a distribution of a road-surface temperature;

detecting, by a sensor, two or more candidate courses of the vehicle to be safely travelable based on vehicle state information of the vehicle and surrounding information of the vehicle acquired by a sensor, the state vehicle state information including at least one of a location of the vehicle, a pose of the vehicle, and movement of the vehicle, and the surrounding information of the vehicle including at least one of a type, a location, and movement of an obstacle object around the vehicle; and

determining a course of a highest road-surface temperature to be a traveling route, based on the distribution of a road-surface temperature, the course being determined from the two or more candidate courses of the vehicle.

11. A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a vehicle traveling control device, cause the vehicle traveling control device to perform a method, the method comprising:

acquiring, by a far-infrared camera, an image of a region situated in a travel direction of a vehicle, to analyze a distribution of a road-surface temperature;

detecting, by a sensor, two or more candidate courses of the vehicle to be safely travelable based on vehicle state information of the vehicle and surrounding information of the vehicle acquired by a sensor, the state vehicle state information including at least one of a location of the vehicle, a pose of the vehicle, and movement of the vehicle, and the surrounding information of the vehicle including at least one of a type, a location, and movement of an obstacle object around the vehicle; and

determining a course of a highest road-surface temperature to be a traveling route, based on the distribution of a road-surface temperature, the course being determined from the two or more candidate courses of the vehicle.

12. The vehicle traveling control device according to claim 1 , wherein

the sensor includes at least one of an image-capturing device such as a time-of-flight (ToF) camera, a visible light camera, a stereo camera, a monocular camera, an environment sensor for detecting a weather condition, and a surroundings-information detection sensor for detecting the obstacle object around the vehicle.

13. The vehicle traveling control device according to claim 12 , wherein

the environment sensor for detecting the weather condition includes at least one of a raindrop sensor, a fog sensor, a sunlight sensor, and a snow sensor.

14. The vehicle traveling control device according to claim 12 , wherein

the surroundings-information detection sensor for detecting the obstacle object around the vehicle includes at least one of an ultrasonic sensor, a radar, LiDAR (light detection and ranging, laser imaging detection and ranging), and a sonar.

15. The vehicle traveling control device according to claim 14 , wherein

the surroundings-information detection sensor is configured to detect, as the obstacle object around the vehicle, at least one of other vehicle, a human being, a structure, a road, a traffic light, a traffic sign, and a road sign.

16. The vehicle traveling control device according to claim 12 , wherein

the sensor includes a global navigation satellite system (GNSS) receiver that receives a GNSS signal from a GNSS satellite to detect a current location of the vehicle.

17. The vehicle traveling control device according to claim 1 , wherein the circuitry is further configured to

analyze a location and a state of a traffic light around the vehicle, a traffic regulation around the vehicle, and a travelable lane, based on information acquired by the sensor.

18. The vehicle traveling control device according to claim 2 , wherein the circuitry is further configured to

perform the automatic driving which is a cooperative control in order to provide a function of an advanced driver assistance system (ADAS) including at least one of collision avoidance, impact relaxation of the vehicle, traveling after a leading vehicle based on a distance between the vehicles, traveling while maintaining a vehicle speed of the vehicle, a warning of a collision of the vehicle, and a warning of deviation of the vehicle from a predetermined lane.

19. The vehicle traveling control device according to claim 18 , wherein the circuitry is further configured to

perform the cooperative control in order to the achieve automatic driving which is to drive the vehicle autonomously without an operation performed by a driver of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2020
From: UEMORI, TAKESHI; ITO, ATSUSHI; OYAIZU, HIDEKI; AOKI, SUGURU; SATOH, RYUTA
To: SONY CORPORATION
Reel/Frame 053675/0842 →
Priority Claims (1)
JP JP2017-157820 · Aug 18, 2017 · national
Continuity (1)
Related Publication 20200172110A1 · Jun 4, 2020