IP Library Granted Patent US 11,623,654
Granted Patent B2
US 11,623,654 · App. 17/308,818 · Granted Apr 11, 2023

Systems and methods of assisting vehicle navigation

Inventor: Luis Bill-Clark (San Francisco, CA)
Assignee: NISSAN NORTH AMERICA, INC.
B60W50/14B60W40/08G06V20/582G06V40/103B60W2050/143B60W2050/146B60W2420/42B60W2540/225B60W2554/4029B60W2554/4041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,623,654
App. No.
17/308,818
Granted
Apr 11, 2023
Kind
B2
Abstract

Systems and methods for assisting navigation of a vehicle are disclosed. In one embodiment, a method of assisting navigation of a vehicle includes receiving navigational data relating to an intended route of the vehicle, receiving object data relating to at least one external object detected within a vicinity of a current position of the vehicle, determining whether the at least one external object affects an ability of the vehicle to proceed along the intended route, and generating at least one instruction relating to the ability of the vehicle to proceed along the intended route.

Claims (56)

1. A method of assisting a driver with navigation of a vehicle, the method comprising:

receiving navigational data relating to an intended route of the vehicle;

receiving object data relating to at least one external object detected within a vicinity of a current position of the vehicle;

determining whether the at least one external object affects an ability of the vehicle to proceed along the intended route;

generating at least one instruction for the driver of the vehicle relating to the ability of the vehicle to proceed along the intended route; and

providing the at least one instruction to the driver of the vehicle to cause an action to be taken by the driver.

2. The method of claim 1 , wherein

the at least one external object includes at least one of (i) a traffic light, (ii) a traffic sign, (iii) a lane marking, (iv) a lane boundary, (v) a curb boundary, (vi) a crosswalk, (vii) a pedestrian, and (viii) another vehicle.

3. The method of claim 1 , comprising

determining a shape or location of the at least one external object based on the object data.

4. The method of claim 1 , comprising

determining that the at least one external object is a pedestrian with an intended path that interferes with the intended route of the vehicle.

5. The method of claim 1 , comprising

determining that the at least one external object is a traffic sign or lane marking which indicates that the vehicle is located within a wrong lane to proceed along the intended route.

6. The method of claim 5 , comprising

alerting the driver of the vehicle to change lanes based on the at least one instruction.

7. A system configured to perform the method of claim 1 , the system comprising:

a first image sensor configured to generate at least a portion of the object data; and

a processor and a memory programmed to execute the method of claim 1 using the object data generated by the first image sensor.

8. A method of assisting a driver with navigation of a vehicle, the method comprising:

receiving pedestrian data regarding a pedestrian detected within a vicinity of a current position of the vehicle;

determining an intended path of the pedestrian;

determining whether the intended path of the pedestrian interferes with an intended route of the vehicle;

generating at least one instruction for the driver of the vehicle when the intended path of the pedestrian is determined to interfere with the intended route of the vehicle; and

providing the at least one instruction to the driver of the vehicle to cause an action to be taken by the driver.

9. The method of claim 8 , wherein

determining the intended path of the pedestrian includes determining an intended walking direction of the pedestrian.

10. The method of claim 8 , wherein

determining the intended path of the pedestrian includes analyzing a detected pose of the pedestrian.

11. The method of claim 8 , comprising

receiving crosswalk data relating to a crosswalk detected within the vicinity of the current position of the vehicle,

wherein determining the intended path of the pedestrian includes determining a proximity of the pedestrian to the crosswalk.

12. The method of claim 11 , wherein

determining the intended path of the pedestrian includes determining a direction that the pedestrian is facing at the crosswalk.

13. The method of claim 8 , comprising

alerting the driver of the vehicle of the intended path of the pedestrian based on the at least one instruction.

14. A system configured to perform the method of claim 8 , the system comprising:

a first image sensor configured to generate at least a portion of the pedestrian data; and

a processor and a memory programmed to execute the method of claim 8 using the pedestrian data generated by the first image sensor.

15. A method of assisting navigation of a vehicle, the method comprising:

receiving driver data relating to a current line of sight detected for a driver of the vehicle, the driver data including head pose data regarding a direction that the driver's head is turned;

receiving object data relating to at least one external object detected within a vicinity of a current position of the vehicle;

determining that the at least one external object is outside of the current line of sight of the driver based at least in part on the direction that the driver's head is turned; and

generating at least one instruction relating to the at least one external object.

16. The method of claim 15 , wherein

the at least one external object includes at least one of (i) a traffic light, (ii) a traffic sign, (iii) a lane marking, (iv) a lane boundary, (v) a curb boundary, (vi) a crosswalk, (vii) a pedestrian, and (viii) another vehicle.

17. The method of claim 15 , comprising

alerting the driver of the presence of the at least one external object based on the at least one instruction.

18. The method of claim 15 , comprising

determining that the at least one external object is a pedestrian with an intended path that interferes with an intended route of the vehicle.

19. The method of claim 18 , comprising

determining the intended path of the pedestrian based on at least one of a pose of the pedestrian or a proximity of the pedestrian to a crosswalk.

20. A system configured to perform the method of claim 15 , the system comprising:

a first image sensor configured to generate at least a portion of the object data;

a second image sensor configured to generate at least a portion of the driver data; and

a processor and a memory programmed to execute the method of claim 15 using the object data generated by the first image sensor and the driver data generated by the second image sensor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2023
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 065083/0338 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2021
From: BILL-CLARK, LUIS
To: NISSAN NORTH AMERICA, INC.
Reel/Frame 056148/0223 →
Continuity (1)
Related Publication 20220355815A1 · Nov 10, 2022