IP Library Granted Patent US 11,085,787
Granted Patent B2
US 11,085,787 · App. 16/999,058 · Granted Aug 10, 2021

Augmented reality interface for navigation assistance

Inventors: Chen-Ping Yu (Santa Clara, CA); Myvictor Tran (Vancouver, CA)
Assignee: PHIAR TECHNOLOGIES, INC.
G01C21/365G01C21/3632G01C21/3638G01C21/3647G06K9/00805G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,085,787
App. No.
16/999,058
Granted
Aug 10, 2021
Kind
B2
Abstract

Navigation assistance is provided to a user of a vehicle. A live view shows a scene of the roadway and navigation indicators may be superimposed on to the scene of the roadway using augmented reality. Interface elements on the live view provide additional information related to navigation. A map view may also be provided and be toggled from the live view by a toggle interaction. In addition, a hazard detection system may be provided to detect hazards and display indicators of the hazards to the user.

Claims (42)

1. A navigation system for displaying real-time navigation assistance to a user in a vehicle, the system comprising a display screen and one or more processors configured to perform the operations of:

displaying on the display screen, a live view from a video feed depicting a real-time view of a roadway;

displaying on the display screen, an augmented reality user interface, the user interface configured to display a route overlay to indicate a route and the user interface configured to display a maneuver indicator to indicate a location of a maneuver to be performed along the route;

wherein the maneuver indicator is displayed over a portion of the live view near the location of the maneuver and is updated in real time to visually represent the distance between the user and the location of the maneuver as the user approaches a fixed object located at or near the location of the maneuver; and

wherein the route overlay is displayed as a graphical path representing at least an intended path of travel along the route, the graphical path superimposed over a lane or multiple lanes of the roadway of the live view.

2. The navigation system of claim 1 , wherein the fixed object is a real-world location, and wherein the maneuver indicator becomes larger when the vehicle approaches the real-world location and smaller when the vehicle moves farther away from the real-world location.

3. The navigation system of claim 1 , wherein the route overlay is displayed over the ground of the roadway in the augmented reality display.

4. The navigation system of claim 1 , wherein the route overlay becomes smaller at points farther from the vehicle.

5. The navigation system of claim 1 , wherein a graphical element is displayed connecting the maneuver indicator to the ground in the augmented reality user interface.

6. The navigation system of claim 1 , wherein the user interface comprises a section for displaying a textual description of the maneuver, the section being separate from the maneuver indicator.

7. The navigation system of claim 1 , wherein the user interface further comprises:

a mini-map displayed over a portion of the live view, wherein the mini-map depicts an overhead view of a map and a graphical indication of a current location of the vehicle.

8. The navigation system of claim 1 , wherein the maneuver indicator includes a graphical element indicating the direction of the maneuver.

9. The navigation system of claim 1 , wherein the user interface is configured to display the name of the roadway corresponding to the maneuver indicator, the name being displayed adjacent to the maneuver indicator.

10. A computer-implemented method for displaying real-time navigation assistance to a user in a vehicle comprising:

displaying on the display screen, a live view from a video feed depicting a real-time view of a roadway;

displaying on the display screen, an augmented reality user interface, the user interface configured to display a route overlay to indicate a route and the user interface configured to display a maneuver indicator to indicate a location of a maneuver to be performed along the route;

wherein the maneuver indicator is displayed over a portion of the live view near the location of the maneuver and is updated in real time to visually represent the distance between the user and the location of the maneuver as the user approaches a fixed object located at or near the location of the maneuver; and

wherein the route overlay is displayed as a graphical path representing at least an intended path of travel along the route, the graphical path superimposed over a lane or multiple lanes of the roadway of the live view.

11. The method of claim 10 , wherein the fixed object is a real-world intersection, and wherein the maneuver indicator becomes larger when the vehicle approaches the real-world intersection and smaller when the vehicle moves farther away from the real-world intersection.

12. The method of claim 10 , wherein the route overlay is displayed over the ground of the roadway in the augmented reality display.

13. The method of claim 10 , wherein the route overlay becomes smaller at points farther from the vehicle.

14. The method of claim 10 , wherein a graphical element is displayed connecting the maneuver indicator to the ground in the augmented reality user interface.

15. The method of claim 10 , wherein the user interface comprises a section for displaying a textual description of the maneuver, the section being separate from the maneuver indicator.

16. The method of claim 10 , wherein the user interface further comprises:

a mini-map displayed over a portion of the live view, wherein the mini-map depicts an overhead view of a map and a graphical indication of a current location of the vehicle.

17. The method of claim 10 , wherein the maneuver indicator includes a graphical element indicating the direction of the maneuver.

18. The method of claim 10 , wherein the user interface is configured to display the name of the roadway corresponding to the maneuver indicator, the name being displayed adjacent to the maneuver indicator.

19. A non-transitory computer readable medium comprising instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations for displaying real-time navigation assistance to a user in a vehicle comprising:

displaying on the display screen, a live view from a video feed depicting a real-time view of a roadway;

displaying on the display screen, an augmented reality user interface, the user interface configured to display a route overlay to indicate a route and the user interface configured to display a maneuver indicator to indicate a location of a maneuver to be performed along the route;

wherein the maneuver indicator is displayed over a portion of the live view near the location of the maneuver and is updated in real time to visually represent the distance between the user and the location of the maneuver as the user approaches a fixed object located at or near the location of the maneuver; and

wherein the route overlay is displayed as a graphical path representing at least an intended path of travel along the route, the graphical path superimposed over a lane or multiple lanes of the roadway of the live view.

20. The non-transitory computer readable medium of claim 19 , wherein the fixed object is a real-world location, and wherein the maneuver indicator becomes larger when the vehicle approaches the real-world location and smaller when the vehicle moves farther away from the real-world location.

21. The non-transitory computer readable medium of claim 19 , wherein the route overlay is displayed over the ground of the roadway in the augmented reality display.

22. The non-transitory computer readable medium of claim 19 , wherein the route overlay becomes smaller at points farther from the vehicle.

23. The non-transitory computer readable medium of claim 19 , wherein a graphical element is displayed connecting the maneuver indicator to the ground in the augmented reality user interface.

24. The non-transitory computer readable medium of claim 19 , wherein the user interface comprises a section for displaying a textual description of the maneuver, the section being separate from the maneuver indicator.

25. The non-transitory computer readable medium of claim 19 , wherein the user interface further comprises:

a mini-map displayed over a portion of the live view, wherein the mini-map depicts an overhead view of a map and a graphical indication of a current location of the vehicle.

26. The non-transitory computer readable medium of claim 19 , wherein the maneuver indicator includes a graphical element indicating the direction of the maneuver.

27. The non-transitory computer readable medium of claim 19 , wherein the user interface is configured to display the name of the roadway corresponding to the maneuver indicator, the name being displayed adjacent to the maneuver indicator.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2022
From: PHIAR TECHNOLOGIES, INC.
To: GOOGLE LLC
Reel/Frame 061919/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: TRAN, MYVICTOR
To: PHIAR TECHNOLOGIES, INC.
Reel/Frame 056164/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2020
From: YU, CHEN-PING
To: PHIAR TECHNOLOGIES, INC.
Reel/Frame 053557/0464 →
Continuity (4)
Continuation 16569633 · Sep 12, 2019
Continuation 16224677 · Dec 18, 2018
Provisional Application 62751512 · Oct 26, 2018
Related Publication 20200378779A1 · Dec 3, 2020
Cited By (2)
US 12,502,609 US 12,644,721