IP Library › Granted Patent US 11,163,317
Granted Patent B2
US 11,163,317 · App. 16/415,379 · Granted Nov 2, 2021

System and method for shared autonomy through cooperative sensing

Inventors: Paritosh Kelkar (Dearborn, MI); Xue Bai (Novi, MI); Samer Rajab (Novi, MI); Hasan Tafish (Farmington Hills, MI)
Assignee: HONDA MOTOR CO., LTD.
G05D1/0295B60W30/165G01S5/0072G01S5/0284G08G1/22G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,163,317
App. No.
16/415,379
Granted
Nov 2, 2021
Kind
B2
Abstract

Systems and methods for shared autonomy through cooperative sensing are described. According to one embodiment, a cooperative sensing system includes a rendezvous module that receives broadcast messages from a plurality of cooperating vehicles on the roadway. The rendezvous module also selects a subordinate vehicle from the plurality of cooperating vehicles based on the autonomy level of the subordinate vehicle as compared to an autonomy level of a principal vehicle. The cooperative sensing system also includes a positioning module that determines a cooperative position of the principal vehicle and the subordinate vehicle. The cooperative sensing system further includes a negotiation module that receives at least one cooperating parameter from the subordinate vehicle. The cooperative sensing system includes a perception module that initiates cooperative automation the subordinate vehicle according to the at least one cooperating parameter when the principal vehicle and the subordinate vehicle are positioned in the cooperative position.

Claims (48)

1. A cooperative sensing system of a principal vehicle for providing enhanced autonomy to a subordinate vehicle having a vehicle occupant on a roadway, the cooperative sensing system comprising:

a rendezvous module configured to:

receive broadcast messages from a plurality of cooperating vehicles on the roadway, wherein a broadcast message received from a cooperating vehicle of the plurality of cooperating vehicles includes a vehicle identifier and an autonomy level of the cooperating vehicle, wherein the autonomy level is selected from a set of autonomy levels; and

select the subordinate vehicle from the plurality of cooperating vehicles based on a differential autonomy based on a comparison of the autonomy level from the set of autonomy levels associated with the subordinate vehicle with the autonomy level from the set of autonomy levels associated with the principal vehicle;

a positioning module configured to determine a cooperative position of the principal vehicle and the subordinate vehicle;

a negotiation module configured to receive at least one cooperating parameter from the subordinate vehicle, wherein the parameter defines a behavioral aspect of the subordinate vehicle; and

a perception module configured to:

initiate cooperative automation with the subordinate vehicle according to the at least one cooperating parameter when the principal vehicle and the subordinate vehicle are positioned in the cooperative position, and

initiate a hand off procedure, by the principal vehicle, based on monitoring of the vehicle occupant of the subordinate vehicle.

2. The cooperative sensing system of claim 1 , wherein the differential autonomy is based on the subordinate vehicle having a lower autonomy level from the set of autonomy levels of the subordinate vehicle as compared to the principal vehicle.

3. The cooperative sensing system of claim 1 , wherein the cooperative position defines the subordinate vehicle being inline and directly behind the principal vehicle.

4. The cooperative sensing system of claim 1 , wherein the positioning module further comprises sending a position message to the subordinate vehicle that provides vectoring instructions for the subordinate vehicle to assume the cooperative position.

5. The cooperative sensing system of claim 1 , wherein the at least one cooperating parameter is a kinematic parameter that defines kinematic operation of the subordinate vehicle.

6. The cooperative sensing system of claim 1 , wherein the at least one cooperating parameter is a relative parameter that defines relative behavior between the principal vehicle and the subordinate vehicle.

7. The cooperative sensing system of claim 1 , wherein the negotiation module is further configured to send a cooperative proposal to the subordinate vehicle.

8. The cooperative sensing system of claim 7 , wherein the cooperative proposal includes a pecuniary arrangement for the cooperative automation.

9. The cooperative sensing system of claim 1 , wherein the perception module is further configured to receive subordinate sensor data from the subordinate vehicle and send navigation data to the subordinate vehicle based on the subordinate sensor data.

10. The cooperative sensing system of claim 9 , wherein the navigation data is also based on principal sensor data from sensors of the principal vehicle.

11. The cooperative sensing system of claim 1 , wherein the subordinate vehicle participates in cooperative automation with the principal vehicle until the principal vehicle reaches a geofence.

12. The cooperative sensing system of claim 11 , wherein to initiate the hand off procedure the perception module is configured to send a handoff message to the subordinate vehicle.

13. A computer-implemented method for a principal vehicle to provide enhanced autonomy to a subordinate vehicle on a roadway, comprising:

receiving broadcast messages from a plurality of cooperating vehicles on the roadway, wherein a broadcast message received from a cooperating vehicle of the plurality of cooperating vehicles includes an autonomy level of the cooperating vehicle, wherein the autonomy level is selected from a set of autonomy levels;

selecting the subordinate vehicle, from the plurality of cooperating vehicles, by the principal vehicle, based on a differential autonomy based on a comparison of the autonomy level from the set of autonomy levels associated with the subordinate vehicle with the autonomy level from the set of autonomy levels associated with the principal vehicle;

determining a cooperative position of the principal vehicle and the subordinate vehicle;

sending a cooperative proposal to the subordinate vehicle, wherein the cooperative proposal includes a pecuniary arrangement for the cooperative automation;

receiving acceptance of the cooperative proposal;

receiving at least one cooperating parameter from the subordinate vehicle, wherein the cooperating parameter defines a behavioral aspect of the subordinate vehicle;

controlling the subordinate vehicle according to the at least one cooperating parameter when the principal vehicle and the subordinate vehicle are positioned in the cooperative position; and

initiating a hand off procedure, by the principal vehicle, based on monitoring of the vehicle occupant of the subordinate vehicle.

14. The computer-implemented method of claim 13 , further comprising:

receiving rearward subordinate sensor data from the subordinate vehicle;

combining the rearward subordinate sensor data with principal sensor data from the principal vehicle to generate combined sensor data; and

planning a path for the cooperative automation based on the combined sensor data.

15. The computer-implemented method of claim 14 , wherein controlling the subordinate vehicle includes sending navigation data, based on the planned path, to the subordinate vehicle.

16. The computer-implemented method of claim 15 , wherein the navigation data includes steering information for the subordinate vehicle based on the cooperative position.

17. A non-transitory computer-readable storage medium including instructions for a principal vehicle to provide enhanced autonomy to a subordinate vehicle on a roadway, that when executed by a processor cause the processor to:

receive broadcast messages from a plurality of cooperating vehicles on the roadway, wherein a broadcast message received from a cooperating vehicle of the plurality of cooperating vehicles includes an autonomy level of the cooperating vehicle;

select the subordinate vehicle from the plurality of cooperating vehicles based on a differential autonomy based on a comparison of the autonomy level from the set of autonomy levels associated with the subordinate vehicle with the autonomy level from the set of autonomy levels associated with the principal vehicle;

determine a cooperative position of the principal vehicle and the subordinate vehicle;

receive at least one cooperating parameter from the subordinate vehicle, wherein the cooperating parameter defines a behavioral aspect of the subordinate vehicle;

receive subordinate sensor data from the subordinate vehicle;

combine the subordinate sensor data with principal sensor data from the principal vehicle to generate combined sensor data;

plan a path based on the combined sensor data;

control the subordinate vehicle on the planned path according to the at least one cooperating parameter when the principal vehicle and the subordinate vehicle are positioned in the cooperative position; and

initiating a hand off procedure, by the principal vehicle, based on monitoring of the vehicle occupant of the subordinate vehicle.

18. The non-transitory computer-readable storage medium of claim 17 , wherein initiating the hand off procedure includes sending a handoff message to the subordinate vehicle in response to determining a vehicle occupant state.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the vehicle occupant state is based on vehicle occupant data from monitoring the vehicle occupant of the subordinate vehicle.

20. The non-transitory computer-readable storage medium of claim 18 , wherein the vehicle occupant state is assigned a value that indicates an intensity of the vehicle occupant state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2019
From: KELKAR, PARITOSH; BAI, XUE; RAJAB, SAMER; TAFISH, HASAN
To: HONDA MOTOR CO., LTD.
Reel/Frame 049211/0807 →
Continuity (2)
Continuation In Part 16050158 · Jul 31, 2018
Related Publication 20200042017A1 · Feb 6, 2020
Cited By (1)
US 12,597,344