IP Library Granted Patent US 11,181,909
Granted Patent B2
US 11,181,909 · App. 16/226,907 · Granted Nov 23, 2021

Remote vehicle control device, remote vehicle control system, and remote vehicle control method

Inventors: Fumiaki Bando (Kobe, JP); Minoru Maehata (Kobe, JP); Miki Hitotsuya (Kobe, JP)
Assignee: DENSO TEN Limited
G05D1/0044G05D1/0016G05D1/0055G06K9/00791B60R1/00G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,181,909
App. No.
16/226,907
Granted
Nov 23, 2021
Kind
B2
Abstract

A remote vehicle control device includes: a communication unit configured to receive synthetic images which show a surrounding area of a vehicle as seen from virtual viewpoints and each of which is generated on the basis of plural images acquired by plural on-board cameras mounted on the vehicle, respectively; a display unit configured to display the synthetic images; an operation unit configured for controlling the vehicle; a signal generating unit configured to generate control signals for the vehicle, based on operations on the operation unit; and a sensor unit configured to detect impacts. The control signals are transmitted to the vehicle via the communication unit, and when the sensor unit detects an impact, a control signal for stopping is transmitted to the vehicle.

Claims (47)

1. A remote vehicle control device comprising:

a hardware processor configured to

receive synthetic images which show a surrounding area of a vehicle as seen from virtual viewpoints and each of which is generated based on a plurality of images acquired by a plurality of on-board cameras mounted on the vehicle, respectively,

receive an operation for operating the vehicle, and

generate control signals for the vehicle, based on the received operation;

a display configured to display the synthetic images; and

a sensor configured to detect impact based on at least one of (1) change in acceleration of the remote vehicle control device and (2) sound, wherein

the control signals are transmitted to the vehicle, and when the sensor detects the impact, a control signal for stopping is transmitted to the vehicle,

the hardware processor receives an operation track related to a traveling route of the vehicle,

the hardware processor generates a control signal related to the traveling route of the vehicle, based on the operation track, and

the remote vehicle control device changes a traveling velocity of the vehicle based on a thickness of the operation track.

2. The remote vehicle control device according to claim 1 , wherein:

in a case of transmitting control signals related to traveling of the vehicle, any one of traveling velocity and traveling distance is constant.

3. The remote vehicle control device according to claim 1 , wherein

the hardware processor is further configured to determine whether control of the remote vehicle control device on the vehicle has been permitted.

4. The remote vehicle control device according to claim 3 , further comprising:

a camera configured to image the surrounding area of the remote vehicle control device,

wherein the hardware processor permits a user to perform the operation to operate the vehicle based on a driving license imaged by the camera.

5. The remote vehicle control device according to claim 4 , wherein:

the hardware processor discriminates the driving license based on the user's face imaged by the camera and a face photo on the driving license.

6. The remote vehicle control device according to claim 1 , wherein:

the hardware processor receives operations for the vehicle using inputting of numeric values.

7. The remote vehicle control device according to claim 1 , wherein:

the sensor detects a tilt of the remote vehicle control device, and derives a steering angle for the vehicle, based on the tilt.

8. The remote vehicle control device according to claim 1 , further comprising:

a camera configured to image the surrounding area of the remote vehicle control device; wherein

the hardware processor is further configured to discriminate operation contents for the vehicle, based on gestures of a user imaged by the camera or the on-board cameras,

wherein the hardware processor generates control signals based on operations for the vehicle related to the gestures.

9. The remote vehicle control device according to claim 1 , wherein:

the sensor acquires location information of the remote vehicle control device, and

the hardware processor generates the control signal related to the traveling route of the vehicle based on a track of movement of the remote vehicle control device.

10. The remote vehicle control device according to claim 1 , wherein the sensor detects the impact based on detected sound.

11. A remote vehicle control system comprising:

the remote vehicle control device according to claim 1 ;

an image processing device configured to generate each of the synthetic images showing the surrounding area of the vehicle as seen from the virtual viewpoints, based on a plurality of images acquired by the plurality of on-board cameras mounted on the vehicle, respectively, and transmit the synthetic images to the remote vehicle control device; and

a vehicle control device configured to receive the control signals for the vehicle from the remote vehicle control device, and control the vehicle based on the control signals.

12. A remote vehicle control method executed by a remote vehicle control device, the method comprising:

receiving synthetic images which show a surrounding area of a vehicle as seen from virtual viewpoints and each of which is generated based on a plurality of images acquired by a plurality of on-board cameras mounted on the vehicle, respectively;

displaying the synthetic images on a display of the remote vehicle control device;

receiving operations for the vehicle;

generating control signals for the vehicle, based on the operations; and

transmitting the control signals to the vehicle, wherein

when impact is detected based on at least one of (1) change in acceleration of the remote vehicle control device and (2) sound, a control signal for stopping is transmitted to the vehicle,

the remote vehicle control device receives an operation track related to a traveling route of the vehicle,

a control signal related to the traveling route of the vehicle is generated based on the operation track, and

the remote vehicle control device changes a traveling velocity of the vehicle based on a thickness of the operation track.

13. The remote vehicle control method according to claim 12 , wherein the impact is detected based on detected sound.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2018
From: BANDO, FUMIAKI; MAEHATA, MINORU; HITOTSUYA, MIKI
To: DENSO TEN LIMITED
Reel/Frame 047828/0094 →
Priority Claims (1)
JP JP2018-027159 · Feb 19, 2018 · national
Continuity (1)
Related Publication 20190258247A1 · Aug 22, 2019
Cited By (1)
US 12,515,658