IP Library Granted Patent US 12,691,900
Granted Patent B2
US 12,691,900 · App. 18/990,411 · Granted Jul 28, 2026

Remote support device, remote support method, and storage medium

Inventor: Takuya Mori (Kariya City, JP)
Assignee: DENSO CORPORATION
B60W60/001G06V20/58B60W2420/403B60W2556/45B60W2756/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,691,900
App. No.
18/990,411
Filed
Dec 20, 2024
Granted
Jul 28, 2026
Kind
B2
Art Unit
3665
USPC
701/2
Abstract

A remote support device includes a front image transmission unit that, when remote support at a support point is requested from an autonomous driving vehicle, transmits a front image including at least an area in front of the vehicle captured by the vehicle to a remote control device that performs remote control for the vehicle; a reception unit that receives an operation signal corresponding to the remote control at the support point from the remote control device; an operation signal transmission unit that transmits the received operation signal to the vehicle; and a rear image transmission unit that, after the vehicle passes through a changing point set so as to change display on the remote control device based on the support point, transmits a rear image that is captured so as to include at least an area behind the vehicle and emphasizes the rear area, to the remote control device.

Claims (36)

1 . A remote support device, comprising:

a front image transmission unit that, when remote support at a support point is requested from an autonomous driving vehicle, transmits a front image including at least an area in front of the autonomous driving vehicle captured by the autonomous driving vehicle to a remote control device that performs remote control for the autonomous driving vehicle;

a reception unit that receives an operation signal corresponding to the remote control at the support point from the remote control device;

an operation signal transmission unit that transmits the received operation signal to the autonomous driving vehicle; and

a rear image transmission unit that, after the autonomous driving vehicle passes through a changing point set so as to change display on the remote control device based on the support point, transmits a rear image that is captured so as to include at least an area behind the autonomous driving vehicle and emphasizes the rear area, to the remote control device.

2 . The remote support device according to claim 1 , wherein

the rear image transmission unit transmits a rear image of an imaging area predetermined depending on contents of the remote control.

3 . The remote support device according to claim 1 , wherein

the rear image transmission unit transmits a rear image, in which an object missed by an operator of the remote control device is emphasized, to the remote control device.

4 . The remote support device according to claim 1 , wherein

the rear image transmission unit transmits a rear image, in which a newly detected object is emphasized, to the remote control device.

5 . The remote support device according to claim 1 , wherein

the rear image transmission unit transmits a rear image, on which speed information regarding change of speed of an oncoming vehicle detected by the autonomous driving vehicle is displayed, to the remote control device.

6 . The remote support device according to claim 1 , wherein

the rear image transmission unit acquires a bird's eye image obtained by capturing an image of an area including the changing point in a bird's eye view and transmits the bird's eye image to the remote control device.

7 . The remote support device according to claim 1 , wherein

the rear image is an image in which a display area displaying the area behind the autonomous driving vehicle is larger than a display area displaying the area in front of the autonomous driving vehicle.

8 . The remote support device according to claim 1 , wherein

the reception unit receives sight line position information concerning a sight line position of an operator of the remote control device in the front image displayed on the remote control device, and

the rear image transmission unit transmits a rear image including an observation area of the operator specified based on the sight line position information, to the remote control device.

9 . The remote support device according to claim 8 , wherein

when a plurality of observation areas are present, the rear image transmission unit transmits a rear image including an observation area to the remote control device, an observation time period for the observation area being the longest among the plurality of observation areas.

10 . The remote support device according to claim 8 , wherein

when a plurality of observation areas are present, the rear image transmission unit transmits a rear image including all the plurality of observation areas to the remote control device.

11 . The remote support device according to claim 8 , wherein

the rear image transmission unit transmits a rear image in which an object missed by the operator, which is specified based on the observation area, is emphasized, to the remote control device.

12 . A remote support method performed by at least one processor that performs a process including:

when remote support at a support point is requested from an autonomous driving vehicle, transmitting a front image including at least an area in front of the autonomous driving vehicle captured by the autonomous driving vehicle to a remote control device that performs remote control for the autonomous driving vehicle;

receiving an operation signal corresponding to the remote control at the support point from the remote control device;

transmitting the received operation signal to the autonomous driving vehicle; and

after the autonomous driving vehicle passes through a changing point set so as to change display on the remote control device based on the support point, transmitting a rear image that is captured so as to include at least an area behind the autonomous driving vehicle and emphasizes the rear area, to the remote control device.

13 . A storage medium in which a remote support program is stored to cause at least one processor to perform a process including:

when remote support at a support point is requested from an autonomous driving vehicle, transmitting a front image including at least an area in front of the autonomous driving vehicle captured by the autonomous driving vehicle to a remote control device that performs remote control for the autonomous driving vehicle;

receiving an operation signal corresponding to the remote control at the support point from the remote control device;

transmitting the received operation signal to the autonomous driving vehicle; and

after the autonomous driving vehicle passes through a changing point set so as to change display on the remote control device based on the support point, transmitting a rear image that is captured so as to include at least an area behind the autonomous driving vehicle and emphasizes the rear area, to the remote control device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: MORI, TAKUYA
To: DENSO CORPORATION
Reel/Frame 069665/0937 →
Priority Claims (2)
JP 2022-100595 · Jun 22, 2022 · national
JP 2023-005386 · Jan 17, 2023 · national
Continuity (2)
Continuation PCTJP2023020885 · Jun 5, 2023
Related Publication 20250126229A1 · Apr 17, 2025
References Cited (14)
US 5130794A · Ritchey · 1992 [cited by examiner]
US 10897600B1 · Dabral · 2021 [cited by examiner]
US 20040032493A1 · Franke · 2004 [cited by examiner]
US 20170259820A1 · Takahashi · 2017 [cited by examiner]
US 20170347002A1 · Baker · 2017 [cited by examiner]
US 20180074490A1 · Park · 2018 [cited by examiner]
US 20180095457A1 · Lee · 2018 [cited by examiner]
US 20210080943A1 · Iwamoto · 2021 [cited by examiner]
US 20210287548A1 · Lai · 2021 [cited by examiner]
US 20230081876A1 · Matsumoto · 2023 [cited by applicant]
US 20230367311A1 · Itsumi · 2023 [cited by examiner]
JP 2020119380A · 2020 [cited by examiner]
JP 2020161039A · 2020 [cited by examiner]
JP 2020177292A · 2020 [cited by examiner]