IP Library Granted Patent US 10,685,247
Granted Patent B2
US 10,685,247 · App. 15/083,520 · Granted Jun 16, 2020

Infrastructure-device status-verification system for automated vehicles

Inventors: Gaurav Bhatia (Pittsburgh, PA); Jong Ho Lee (Pittsburgh, PA); Junsung Kim (Pittsburgh, PA)
Assignee: Aptiv Technologies Limited
G06K9/00825G06F11/00G08G1/09675G08G1/096725G08G1/096741G08G1/096783H04B1/38H04L63/00H04L67/00H04W4/00H04W4/40H04W84/00H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,685,247
App. No.
15/083,520
Granted
Jun 16, 2020
Kind
B2
Abstract

An infrastructure-device status-verification system suitable for use by an automated vehicle includes a transceiver, an object-detector, and a controller. The transceiver is suitable to install on a host-vehicle. The transceiver is used to receive an indicated-status of an infrastructure-device. The object-detector is suitable to install on the host-vehicle. The object-detector is used to determine a detected-status of the infrastructure-device. The controller is in communication with the transceiver and the object-detector. The controller determines a confirmed-status of the infrastructure-device based on the indicated-status and the detected-status. The system provides for increased confidence and security regarding information about the status of an infrastructure-device such as the traffic-signal (e.g. red, yellow, and green), thereby avoid miss-information caused by, for example, hacking or spoofing of V2I communications from the infrastructure-device, and overcome instances when the field-of-view between the object-detector and the infrastructure-device 26 becomes occluded after the confirmed-status has been established or determined.

Claims (61)

1. An infrastructure-device status-verification system, comprising:

a transceiver installed on a host-vehicle, said transceiver used to receive an indicated-status of an infrastructure-device proximate to the host-vehicle;

an object-detector installed on the host-vehicle, said object-detector used to determine a detected-status of the infrastructure-device;

a controller in communication with the transceiver and the object-detector, wherein the controller:

compares the indicated-status and detected-status;

determines, based on the comparing, whether the indicated-status and detected-status match;

in accordance with determining that the indicated-status and the detected-status match;

establishes a confirmed-status;

determines whether a change in the indicated-status or the detected-status has occurred;

in accordance with determining a change in the detected-status due to a field-of-view between the object-detector and infrastructure-device being occluded,

maintains the confirmed-status based on the indicated-status for an occlusion-time so long as the indicated-status remains unchanged; and

in accordance with determining a change in the indicated-status due to a wireless transmission used to determine the indicated-status being interrupted,

maintains the confirmed-status based on the detected-status for an interruption-time so long as the detected-status remaings unchanged, wherein the interruption-time is different than the occlusion-time.

2. The system in accordance with claim 1 , wherein the object-detector is a camera, the infrastructure-device is a traffic-signal operable to selectively emit a light characterized by a color, and the detected-status and the indicated-status are indicative of the color emitted by the traffic signal.

3. The system in accordance with claim 1 , wherein the infrastructure-device is a gate operable to a state including an open-state that allows traffic to pass by the gate and a closed-state that prevents traffic from passing by the gate, and the detected-status and the indicated-status are indicative of the state of the gate.

4. The system in accordance with claim 1 , wherein the innfrastructure-device is a reconfigurable-sign proximate to the host-vehicle and operable to broadcast sign-content from which the indicated-status is determined, and the object-detector is operable to detect the sign-content from which the detected-status is determined.

5. The system in accordance with claim 4 , wherein object-detector is a camera and the detected-status is determined using character-recognition of a camera image.

6. The system in accordance with claim 1 , wherein the infrastructure-device is a walk/don't walk sign operable to broadcast a signal from which the indicated-status is determined, and the object-detector is operable to detect a pedestrian proximate to the host-vehicle from which the detected-status is determined.

7. The system in accordance with claim 3 , wherein the gate controls access to a parking garage.

8. The system in accordance with claim 3 , wherein the gate state is broadcast to the host-vehicle in a wireless-transmission, and the wireless-transmission includes information about where vacant parking-spots are located within a parking garage.

9. A method comprising:

receiving, using a transceiver installed on a host-vehicle, an indicated-status of an infrastructure-device proximate to the host-vehicle;

determining, using an object-detector installed on the host-vehicle, a detected-status of the infrastructure-device;

using a controller of the host-vehicle to:

compare the indicated-status and detected-status;

determine, based on the comparing, whether the indicated-status and detected-status match;

in accordance with determining that the indicated-status and the detected-status match,

establish a establish a confirmed-status;

determine whether a change in the indicated-status or the detected-status has occurred;

in accordance with determining a change in the detected-status due to a field-of-view between the object-detector and infrastructure-device being occluded,

maintain the confirmed-status based on the indicated-status for an occlusion-time so long as the indicated-status remains unchanged; and

in accordance with determining a change in the indicated-status due to a wireless transmission used to determine the indicated-status being interrupted,

maintain the confirmed-status based on the detected-status for an interruption-time so long as the detected-status remains unchanged, wherein the interruption-time is different than the occlusion-time.

10. The method in accordance with claim 9 , wherein the object-detector is a camera, the infrastructure-device is a traffic-signal operable to selectively emit a light characterized by a color, and the detected-status and the indicated-status are indivcative of the color emitted by the traffic signal.

11. The method in accordance with claim 9 , wherein the infrastructure-device is a gate operable to a state including an open-state that allows traffic to pass by the gate and a closed-state that prevents traffic from passing by the gate, and the detected-status and indicated-status are indicative of the state of the gate.

12. The method in accordance with claim 9 , wherein the infrastructure-device is a walk/don't walk sign operable to broadcast a signal from which the indicated-status is determined, and the object-detector is operable to detect a pedestrian proximate to the host-vehicle from which the detected-status is determined.

13. The method in accordance with claim 9 , wherein the infrastructure-device is a reconfigurable-sign proximate to the host-vehicle and operable to broadcast sign-content from which the indicated-status is determined, and the object-detector is operable to detect the sign-content from which the detected-status is determined.

14. The method in accordance with claim 13 , whererin object-detector is a camera and the detected-status is determined using character-recognition of a camera image.

15. The method in accordance with claim 11 , wherein the gate controls access to a parking garage.

16. The method in accordance with claim 11 , wherein the gate state is broadcast to the host-vehicle in a wireless-transmission, and the wireless-transmission includes information about where vacant parking-spots are located within a parking garage.

17. A non-transitory, compter-readable storage medium having instructions stored thereon, that when executed by controller in a host-vehicle, cause the controller to perform operations comprising:

receiving, using a transceiver installed on the host-vehicle, an indicated-status of an infrastructure-device proximate to the host-vehicle;

determining, using an object-detector installed on the host-vehicle, a detected-status of the infrastructure-device;

compare the indicate-status and detected-status;

determine, based on the comparing, whether the indicated-status and detected-status match;

in accordance with determining that the indicated-status and the detected-status match,

establish a confirmed-status;

determine whether a change in the indicated-status or the detected-status has occurred;

in accordance with determining a change in the detected-status due to a field-of-view between the object-detector and infrastructure-device being occluded,

maintain the confirmed-status based on the indicated-status for an occlusion-time so long as the indicated-status remains unchanged; and

in accordance with determining a change in the indicated-status due to a wireless transmission used to determine the indicated-status being interruped,

maintain the confirmed-status based on the detected-status for an interruption-time so long as the detected-status remains unchanged, wherein the interruption-time is different than the occlusion-time.

18. The system in accordance with claim 1 , wherein the controller is configured to:

determine whether the occlusion-time or the interruption-time has ended; and

in accordance with the occlusion-time or the interruption-time ending, stop maintaining the confirmed status.

19. The method in accordance with claim 9 , further comprising:

determine whether the occlusion-time or the interruption-time has ended; and

in accordance with the occlusion-time or the interruption-time ending, stop maintaining the configured status.

20. The non-transitory, computer-readable storage medium of claim 17 , wherein the operations further comprise

determining whether the occlusion-time or the interruption-time has ended; and

in accordance with the occlusion-time or the interruption-time ending, stop maintaining the configured status.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: APTIV TECHNOLOGIES LIMITED
To: MOTIONAL AD LLC
Reel/Frame 053863/0399 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2018
From: DELPHI TECHNOLOGIES INC.
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 047153/0902 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2016
From: BHATIA, GAURAV; LEE, JONG HO; KIM, JUNSUNG
To: DELPHI TECHNOLOGIES, INC.
Reel/Frame 038282/0175 →