IP Library › Granted Patent US 12,066,842
Granted Patent B2
US 12,066,842 · App. 18/202,673 · Granted Aug 20, 2024

Vehicle remote instruction system

Inventors: Sho Otaki (Yokohama, JP); Takayuki Iwamoto (Sunto-gun Shizuoka, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G05D1/2427B60W50/14B60W60/001G05D1/0011G05D1/0038G05D1/2247G08G1/096725B60W2555/00G01C21/3863G05D2101/20G08G1/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,066,842
App. No.
18/202,673
Granted
Aug 20, 2024
Kind
B2
Abstract

In a vehicle remote instruction system, a remote commander issues a remote instruction relating to travel of an autonomous driving vehicle based on sensor information from an external sensor that detects an external environment of the autonomous driving vehicle. The vehicle remote instruction system sets a range of information to be transmitted to the remote commander among the sensor information detected by the external sensor, as a limited information range, based on the external situation or an external situation obtained based on map information and a trajectory of the autonomous driving vehicle.

Claims (21)

1. A vehicle control device configured to recognize an external situation based on captured images from cameras including a front camera that captures an image in a front direction of a vehicle, a right camera that includes in an image capturing region, a region more toward a right direction than an image capturing region of the front camera, a left camera that includes in an image capturing region, a region more toward a left direction than the image capturing region of the front camera, and a rear camera that captures an image in a rear direction of the vehicle, and configured to control travel of the vehicle by a remote instruction relating to the travel of the vehicle provided from a remote commander, the vehicle control device comprising an electronic control unit configured to:

transmit to the remote commander the captured image of the front camera among the captured images captured by the cameras when an obstacle is present on a traveling route of the vehicle;

not transmit to the remote commander at least one of the captured images of the right camera, the left camera, and the rear camera; and

upon detection of the obstacle, select the image of the front camera to be transmitted as data to the remote commander and not select at least one of the images from the rear camera, the right camera, and the left camera.

2. The vehicle control device according to claim 1 , wherein the vehicle is caused to start moving when the remote instruction to drive over the obstacle or the traveling route to avoid the obstacle is received from the remote commander.

3. The vehicle control device according to claim 1 , wherein information provision relating to the travel of the vehicle or remote operation is requested from a remote controller while the vehicle is traveling.

4. The vehicle control device according to claim 1 , wherein the electronic control unit is further configured to, upon not recognizing a following vehicle behind the vehicle, not transmit the image of the rear camera.

5. A vehicle control method performed by a vehicle control device configured to recognize an external situation based on captured images from cameras including a front camera that captures an image in a front direction of a vehicle, a right camera that includes in an image capturing region, a region more toward a right direction than an image capturing region of the front camera, a left camera that includes in an image capturing region, a region more toward a left direction than the image capturing region of the front camera, and a rear camera that captures an image in a rear direction of the vehicle, and configured to control travel of the vehicle by a remote instruction relating to the travel of the vehicle provided from a remote commander, the vehicle control method comprising:

transmitting to the remote commander the captured image of the front camera among the captured images captured by the cameras when an obstacle is present on a traveling route of the vehicle;

not transmitting to the remote commander at least one of the captured images of the right camera, the left camera, and the rear camera; and

upon detection of the obstacle, selecting the image of the front camera to be transmitted as data to the remote commander and not selecting at least one of the images from the rear camera, the right camera, and the left camera.

6. The vehicle control method according to claim 5 , the vehicle is caused to start moving when the remote instruction to drive over the obstacle or the traveling route to avoid the obstacle is received from the remote commander.

7. The vehicle control method according to claim 5 , comprising:

requesting information provision relating to the travel of the vehicle or remote operation from a remote controller while the vehicle is traveling.

8. A non-transitory computer-readable storage medium configured to store a vehicle control program operating an electronic control unit of a vehicle control device configured to recognize an external situation based on captured images from cameras including a front camera that captures an image in a front direction of a vehicle, a right camera that includes in an image capturing region, a region more toward a right direction than an image capturing region of the front camera, a left camera that includes in an image capturing region, a region more toward a left direction than the image capturing region of the front camera, and a rear camera that captures an image in a rear direction of the vehicle, and configured to control travel of the vehicle by a remote instruction relating to the travel of the vehicle provided from a remote commander,

wherein the vehicle control program operates the electronic control unit as an electronic control unit configured to:

transmit to the remote commander the captured image of the front camera among the captured images captured by the cameras when an obstacle is present on a traveling route of the vehicle;

not transmit to the remote commander at least one of the captured images of the right camera, the left camera, and the rear camera; and

upon detection of the obstacle, select the image of the front camera to be transmitted as data to the remote commander and not select at least one of the images from the rear camera, the right camera, and the left camera.

9. The storage medium according to claim 8 , wherein the vehicle control program operates the electronic control unit so as to cause the vehicle to start moving when the remote instruction to drive over the obstacle or the traveling route to avoid the obstacle is received from the remote commander.

10. The storage medium according to claim 8 , wherein the vehicle control program operates the electronic control unit so as to request information provision relating to the travel of the vehicle or remote operation from a remote controller while the vehicle is traveling.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2023
From: OTAKI, SHO; IWAMOTO, TAKAYUKI
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 063776/0688 →
Priority Claims (1)
JP 2019-163066 · Sep 6, 2019 · national
Continuity (5)
Continuation 18202667 · May 26, 2023
Continuation 18202660 · May 26, 2023
Continuation 18202652 · May 26, 2023
Continuation 17004449 · Aug 27, 2020
Related Publication 20230297103A1 · Sep 21, 2023
Cited By (2)
US 12,358,520 US 12,391,271