IP Library Granted Patent US 10,488,215
Granted Patent B1
US 10,488,215 · App. 16/224,677 · Granted Nov 26, 2019

Augmented reality interface for navigation assistance

Inventor: Chen-Ping Yu (Santa Clara, CA)
Assignee: Phiar Technologies, Inc.
G01C21/365G01C21/3632G01C21/3638G01C21/3647G06K9/00805G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,488,215
App. No.
16/224,677
Granted
Nov 26, 2019
Kind
B1
Abstract

Navigation assistance is provided to a user of a vehicle. A live view shows a scene of the roadway and navigation indicators may be superimposed on to the scene of the roadway using augmented reality. Interface elements on the live view provide additional information related to navigation. A map view may also be provided and be toggled from the live view by a toggle interaction. In addition, a hazard detection system may be provided to detect hazards and display indicators of the hazards to the user.

Claims (38)

1. A computer-implemented method for displaying real-time navigation assistance to a user in a vehicle comprising:

displaying, on a display of an electronic device, a live view, the live view comprising a view of a roadway with an augmented reality display of a route overlay to indicate a route and a maneuver indicator to indicate the location of the next maneuver;

wherein the maneuver indicator is displayed in the augmented reality display near the location of the next maneuver; and

the maneuver indicator becomes larger when the vehicle approaches it and smaller when the vehicle moves farther away from it.

2. The computer-implemented method of claim 1 , wherein the route overlay is displayed on the ground of the roadway in the augmented reality display.

3. The computer-implemented method of claim 1 , wherein the route overlay becomes smaller at points farther from the vehicle.

4. The computer-implemented method of claim 1 , wherein a line is displayed connecting the maneuver indicator to the ground in the augmented reality display.

5. The computer-implemented method of claim 1 , further comprising displaying a maneuver panel for displaying a textual description of the next maneuver, the maneuver panel being separate from the maneuver indicator.

6. The computer-implemented method of claim 1 , further comprising:

displaying in the live view a mini-map;

receiving a toggle interaction from the user and, in response, toggling the display from the live view to a map view, the map view displaying a map of a locality around the vehicle.

7. A computer-implemented method for displaying real-time navigation assistance to a user in a vehicle comprising:

displaying, on a display of an electronic device, a live view, the live view comprising a view of a roadway with an augmented reality display of a route overlay to indicate a route and a maneuver indicator to indicate the location of the next maneuver;

displaying in the live view a mini-map with a circular exterior surface and having a destination pin;

wherein the destination pin represents a map destination, and the destination pin is visible on a portion of the circular exterior surface to indicate a direction of the destination pin relative to the vehicle on the mini-map;

wherein the destination pin remains on the portion of the circular exterior surface until a region surrounding the destination pin falls within a bounds of the circular exterior surface; and

receiving a toggle interaction from the user and, in response, toggling the display from the live view to a map view, the map view displaying a map of a locality around the vehicle.

8. The computer-implemented method of claim 7 , wherein the route overlay is displayed on the ground of the roadway in the augmented reality display.

9. The computer-implemented method of claim 7 , wherein the route overlay becomes smaller at points farther from the vehicle.

10. The computer-implemented method of claim 7 , wherein a line is displayed connecting the maneuver indicator to the ground in the augmented reality display.

11. The computer-implemented method of claim 7 , further comprising displaying a maneuver panel for displaying a textual description of the next maneuver, the maneuver panel being separate from the maneuver indicator.

12. The computer-implemented method of claim 7 , wherein the toggle interaction is a user interaction on the mini-map.

13. The computer-implemented method of claim 7 , further comprising:

displaying a mini-feed in the map view, the mini-feed displaying a live view of the roadway, the mini-view including the augmented reality display of the route overlay and maneuver indicator.

14. The computer-implemented method of claim 13 , further comprising:

receiving a second toggle interaction from the user and, in response, toggling the display from the map view to the live view, wherein the second toggle interaction is a user interaction on the mini-feed.

15. A computer-implemented method for displaying real-time navigation assistance to a user in a vehicle comprising:

displaying, on a display of an electronic device, a live view, the live view comprising a view of a roadway with an augmented reality display of a route overlay to indicate the route;

detecting, by a hazard detection system, a hazardous object on the roadway and displaying on the augmented reality display a hazard indicator near the hazardous object and a hazard marker, wherein the hazard indicator is placed near the hazardous object on the display, and the hazard indicator tracks the hazardous object on the display.

16. The computer-implemented method of claim 15 , wherein the route overlay is changed to a hazard overlay when the hazardous object is detected.

17. The computer-implemented method of claim 15 , further comprising:

displaying a hazard marker to identify the location of the hazardous object.

18. The computer-implemented method of claim 15 , wherein the hazard frame comprises a bar shown on at least one edge of the display.

19. The computer-implemented method of claim 15 , further comprising:

receiving a dismiss user interaction and dismissing the display of the hazard indicator and hazard frame.

20. The computer-implemented method of claim 15 , further comprising:

displaying in the live view a mini-map;

receiving a toggle interaction from the user and, in response, toggling the display from the live view to a map view, the map view displaying a map of a locality around the vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2022
From: PHIAR TECHNOLOGIES, INC.
To: GOOGLE LLC
Reel/Frame 061919/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2018
From: YU, CHEN-PING
To: PHIAR TECHNOLOGIES, INC.
Reel/Frame 047822/0407 →
Continuity (1)
Provisional Application 62751512 · Oct 26, 2018
Cited By (13)
US 1,056,938 US 1,056,941 US 1,058,586 US 1,132,947 US 12,187,197 US 12,196,568 US 12,207,099 US 12,236,535 US 12,281,912 US 12,306,005 US 12,313,419 US 12,387,384 US 12,492,103