IP Library › Granted Patent US 11,964,675
Granted Patent B2
US 11,964,675 · App. 17/430,724 · Granted Apr 23, 2024

System and method for the safe operation of an automated vehicle

Inventors: Marcus Hiemer (Meckenbeuren, DE); Sascha Heinrichs-Bartscher (Koblenz, DE); Mark Mohr (Tettnang, DE)
Assignee: ZF FRIEDRICHSHAFEN AG
B60W60/00186B60W10/18B60W10/20B60W30/09B60W50/029B60W50/14G05D1/0077B60W2050/0006B60W2050/0292B60W2050/146B60W2300/15B60W2554/4041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,964,675
App. No.
17/430,724
Granted
Apr 23, 2024
Kind
B2
Abstract

A system for safely operating an automated vehicle includes a first network including a sensor set comprising a plurality of sensors configured to detect the surroundings of the vehicle. The sensor set is coupled to a high-performance electronic control unit (ECU) configured to process the signals of the sensors for orientation, control, and collision avoidance. The system further includes a secure motion-control ECU redundantly coupled to at least one drive element via at least two control signals for controlling the vehicle. The high-performance ECU is configured to output an object recognition indicator signal for orientation, control, and collision avoidance to the motion-control ECU. The system also includes a second, hierarchical, redundant network for safely operating the vehicle. The motion-control ECU is designed to securely evaluate the signals of a human/remote-machine interface (HMI/RMI), a ground truth sensing device, and a perception-safety ECU for the recognition of an emergency state.

Claims (40)

1. A system for safely operating an automated vehicle, comprising:

a first network comprising

a sensor set comprising a plurality of sensors configured to detect the surroundings of the vehicle, wherein the sensor set is coupled to a high-performance electronic control unit (ECU) configured to process signals of the sensors for orientation, control, and collision avoidance; and

a secure motion-control ECU redundantly coupled to at least one drive element via at least two control signals for controlling the vehicle,

wherein the high-performance ECU is configured to output an object recognition indicator signal for orientation, control, and collision avoidance to the secure motion-control ECU;

a second, hierarchical, redundant network for safely operating the vehicle, comprising:

a human machine interface (HMI) and/or a remote machine interface (RMI) comprising at least one emergency shut-off switching device;

a ground truth sensing device configured to determine the position of objects relative to the vehicle; and

a perception-safety ECU coupled via a plurality of secure connections to the HMI and/or the RMI, the ground truth sensing device, and at least one radar sensor in order to derive from transmitted signals a secure collision notification signal, which is supplied to the secure motion-control ECU via a first further secure connection; and

wherein the secure motion-control ECU is designed to securely evaluate signals of the HMI and/or the RMI, the ground truth sensing device, and the perception-safety ECU for recognition of an emergency state in order to control the vehicle redundantly into a safe state via at least two control signals in an event of the recognition of the emergency state; and

a human control branch, a level 2 driver assistance perception branch, and a level 4 autonomous driving perception branch,

wherein the human control branch has the HMI and/or the RMI, which is coupled to the perception-safety ECU and the secure motion-control ECU via one of the plurality of secure connections,

wherein the level 2 driver assistance perception branch has the perception-safety ECU and at least one radar sensor and at least one camera, wherein a signal of the radar sensor and a signal of the camera are supplied via a second further secure connection to a secure fusion unit, which outputs a secure fused signal, which is supplied to the perception-safety ECU via one of the plurality of secure connections in order to derive therefrom in the perception-safety ECU a secure collision notification signal, which is supplied to the secure motion-control ECU via the first further secure connection,

wherein the level 4 autonomous driving perception branch has the high-performance ECU, which is coupled to the sensor set and is designed to derive from the signals of the sensors an object recognition indicator signal, which is supplied to the secure motion-control ECU, and

wherein the level 2 driver assistance perception branch is designed to control the vehicle via the secure motion-control ECU into a safe state by means of the secure fused signal in an event of the recognition of the emergency state or of a failure of the level 4 autonomous driving perception branch.

2. The system according to claim 1 , wherein the secure motion-control ECU is further respectively coupled via a-one of the plurality of secure connections to the HMI and/or the RMI and to the ground truth sensing device.

3. The system according to claim 1 , wherein the HMI and/or the RMI has at least one emergency shut-off switch provided on the vehicle and at least one remotely controlled emergency shut-off switching device.

4. The system according to claim 1 , wherein the high-performance ECU is designed to recognize one or more objects in the surroundings of the vehicle from the signals of the sensors, to classify them, to determine positions and movement information of the objects, and to transmit them to the secure motion-control ECU as unsafe object recognition indicator signal, and wherein the secure motion-control ECU is designed to evaluate the object recognition indicator signal and to compare it to the secure collision notification signals of the HMI and/or the RMI, of the ground truth sensing device, and of the perception-safety ECU in order to control the vehicle in accordance with a specified driving task in an event that no emergency state is recognized.

5. The system according to claim 4 , wherein the high-performance ECU has an interface configured to output an output signal.

6. The system according to claim 1 , wherein the plurality of sensors includes at least one radar sensor, at least one camera sensor, at least one lidar sensor, and an ultrasonic sensor or infrared sensor.

7. The system according to claim 1 , wherein the ground truth sensing device has a time-of-flight camera, and/or a lidar system and/or a bumper configured to trigger a signal upon contact with an object.

8. The system according to claim 1 , wherein the signal of the ground truth sensing device and/or of the perception-safety ECU and/or of the HMI and/or the RMI and/or of the secure motion-control ECU is transmitted redundantly by wire or in a secured manner via a bus system.

9. The system according to claim 1 , wherein the perception-safety ECU is designed as a control device that is controlled with software that evaluates input signals based on rules, without the use of artificial intelligence (AI) algorithms, in order to determine therefrom a secure signal of higher quality with safe position information.

10. The system according to claim 1 , in which the signal of the HMI and/or the RMI and the signal of the fusion unit are also supplied via two or more of the plurality of secure connections to the secure motion-control ECU in addition to the signal of the perception-safety ECU.

11. A method for safely operating an automated vehicle, in which

processing signals of a sensor set, in a first network, comprising a plurality of sensors configured to detect surroundings of the vehicle for orientation, control, and collision avoidance in order to generate an object recognition indicator signal for orientation, control, and collision avoidance, wherein the sensor set is coupled to a high-performance electronic control unit (ECU);

transmitting the object recognition indicator signal to a secure motion-control ECU, which redundantly safely controls via at least two control signals at least one actuator for controlling the vehicle;

coupling, in a second, hierarchical, redundant network for safely operating the vehicle, a human machine interface (HMI) and/or a remote-machine interface (RMI) comprising at least one emergency shut-off switching device and a ground truth sensing device for determining a position of objects relative to the vehicle via a plurality of secure connections to a perception-safety ECU in the form of a control device,

supplying the perception-safety ECU with a signal of at least one radar sensor in order to derive from the transmitted signals a secure collision notification signal, which is supplied to the secure motion-control ECU via a first further secure connection;

respectively coupling the secure motion-control ECU, via one or more of the plurality of secure connections to the HMI and/or the RMI and to the ground truth sensing device;

evaluating, by the secure motion-control ECU, the signals of the HMI and/or the RMI, of the ground truth sensing device, and of the perception-safety ECU in order to safely recognize an emergency state in which the vehicle is redundantly controlled into a safe state via at least two control signals;

coupling a human control branch having the HMI and/or the RMI to the perception-safety ECU and the secure motion-control ECU via one of the plurality of secure connections;

supplying a signal of at least one radar sensor and at least one camera via a second further secure connection to a secure fusion unit,

wherein a level 2 driver assistance perception branch has the perception-safety ECU and the at least one radar sensor and the at least one camera, and

wherein the secure fusion unit outputs a secure fused signal, which his supplied to the perception-safety ECU via one of the plurality of secure connections in order to derive therefrom in the perception-safety ECU a secure collision notification signal, which his supplied to the secure motion-control ECU via the first further secure connection;

deriving from signals of the sensors an object recognition indicator signal, which is supplied to the secure motion-control ECU,

wherein a level 4 autonomous driving perception branch has the high-performance ECU, which his coupled to the sensor set and

controlling the vehicle via the secure motion-control ECU uinto a safe state by the secure fused signal in an event of the recognition of an emergency state or of a failure of the level 4 autonomous driving percepton branch.

12. The system according to claim 11 , wherein the secure motion-control ECU is furthermore respectively coupled via a secure connection to the HMI and/or the RMI and to the ground truth sensing device.

13. The method according to claim 11 , wherein the high-performance ECU recognizes from the signals of the sensors one or more objects in the surroundings of the vehicle, classifies them, determines positions and movement information of the one or more objects, and transmits them as unsafe object recognition indicator signal to the secure motion-control ECU, and wherein the secure motion-control ECU evaluates the object recognition indicator signal and compares it to the secure signals of the HMI and/or the RMI, of the ground truth sensing device, and of the perception-safety ECU in order to recognize an emergency state, and in order to control the vehicle in accordance with a specified driving task in an event that no emergency state is recognized.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2021
From: HIERMER, MARCUS; HEINRICHS-BARTSCHER, SASCHA; MOHR, MARK
To: ZF FRIEDRICHSHAFEN AG
Reel/Frame 057167/0437 →
Priority Claims (1)
DE 10 2019 202 025.9 · Feb 15, 2019 · national
Continuity (1)
Related Publication 20220144313A1 · May 12, 2022
Cited By (2)
US 12,304,509 US 12,454,214