IP Library Patent Application 17123753
Patent Application
App. No. 17/123,753

AR NAVIGATION METHOD AND APPARATUS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/123,753
Abstract

The present application discloses an AR navigation method and apparatus, relating to the field of intelligent transportation technologies. The solution is as follows: acquiring a calibration parameter of a camera on a vehicle and information of a maneuvering point on a navigation route that the vehicle is about to pass through as well as information of an actual location point of the vehicle; in response to receiving a signal of the vehicle entering a turning status, determining a first turning guidance track of the vehicle according to information of a current actual location point of the vehicle and the information of the maneuvering point; and converting the first turning guidance track according to the calibration parameter to obtain a second turning guidance track.

Claims (71)

1 . An Augment Reality (AR) navigation method, comprising:

acquiring a calibration parameter of a camera on a vehicle;

acquiring information of a maneuvering point that the vehicle is about to pass through on a navigation route and information of an actual location point of the vehicle, wherein the vehicle makes a turning at the maneuvering point, the information of the maneuvering point comprises a coordinate of the maneuvering point and a navigation direction of the vehicle at the maneuvering point, and the information of the actual location point of the vehicle comprises a coordinate of the actual location point and an actual traveling direction of the vehicle at the actual location point;

in response to receiving a signal of the vehicle entering a turning status, determining a first turning guidance track of the vehicle according to information of a current actual location point of the vehicle and the information of the maneuvering point; and

converting the first turning guidance track according to the calibration parameter of the camera, to obtain a second turning guidance track in a coordinate system of the camera corresponding to the first turning guidance track.

2 . The AR navigation method according to claim 1 , further comprising:

superimposing the second turning guidance track to a real road scene image captured by the camera for display.

3 . The AR navigation method according to claim 1 , wherein the determining the first turning guidance track of the vehicle according to the information of the current actual location point of the vehicle and the information of the maneuvering point comprises:

taking the current actual location point P as an endpoint to make a ray along the actual traveling direction of the vehicle at the point P, wherein the ray intersects with a line segment BC at a point D, the line segment BC is formed by the maneuvering point B and a shape point C located behind the maneuvering point B on the navigation route;

making an angle bisector for an angle PDC, and making a vertical line for PD through the point P, wherein the vertical line for PD intersects with the angle bisector for the angle PDC at a point O; and making an arc with the point O as a circle center and OP as a radius, wherein the arc is tangent to the line segment BC at a point E;

obtaining a curve between the point C and the point E by using a curve fitting method; and

connecting the arc and the curve to form the first turning guidance track.

4 . The AR navigation method according to claim 1 , wherein the converting the first turning guidance track according to the calibration parameter of the camera, to obtain the second turning guidance track in the coordinate system of the camera corresponding to the first turning guidance track comprises:

sampling the first turning guidance track to obtain multiple sampling points;

converting coordinate values of the multiple sampling points to coordinate values in the coordinate system of the camera according to the calibration parameter of the camera; and

drawing the second turning guidance track according to the coordinate values of the multiple sampling points in the coordinate system of the camera.

5 . The AR navigation method according to claim 1 , further comprising:

determining, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determining, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

6 . The AR navigation method according to claim 3 , further comprising:

determining, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determining, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

7 . The AR navigation method according to claim 4 , further comprising:

determining, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determining, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

8 . The AR navigation method according to claim 5 , wherein the determining, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point comprises:

determining an actual distance between the vehicle and the maneuvering point according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle; and

determining that the vehicle is about to enter the turning status under a condition that the actual distance between the vehicle and the maneuvering point is smaller than a preset distance threshold.

9 . The AR navigation method according to claim 5 , wherein the determining, according to the information of the current actual location point of the vehicle, the information of the current positioning point corresponding to the current actual location point, the information of the multiple continuous historical positioning points ahead of the current positioning point, and the information of the actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status comprises:

determining, according to coordinates of the multiple continuous historical positioning points and coordinates of the actual location points corresponding to the historical positioning points, distances between each of the historical positioning points and the actual location point corresponding to each of the historical positioning points;

determining an included angle between an actual traveling direction of the vehicle at the current actual location point and a navigation direction of the vehicle at the current positioning point corresponding to the current actual location point; and

determining that the vehicle has entered the turning status under a condition that the distances between each of the historical positioning points and the actual location point corresponding to each of the historical positioning points increase continuously, and the included angle is greater than a preset angle.

10 . An Augment Reality (AR) navigation apparatus, comprising:

at least one processor; and

a memory, in a communicational connection with the at least one processor; wherein,

the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor is configured to:

acquire a calibration parameter of a camera installed on a vehicle;

acquire information of a maneuvering point that the vehicle is about to pass through on the navigation route and information of an actual location point of the vehicle, wherein the vehicle makes a turning at the maneuvering point, the information of the maneuvering point comprises a coordinate of the maneuvering point and a navigation direction of the vehicle at the maneuvering point, and the information of the actual location point of the vehicle comprises a coordinate of the actual location point and an actual traveling direction of the vehicle at the actual location point;

determine, in response to receiving a signal of the vehicle entering a turning status, a first turning guidance track of the vehicle according to information of a current actual location point of the vehicle and the information of the maneuvering point; and

convert the first turning guidance track according to the calibration parameter of the camera, to obtain a second turning guidance track in a coordinate system of the camera corresponding to the first turning guidance track.

11 . The AR navigation apparatus according to claim 10 , wherein,

the at least one processor is further configured to superimpose the second turning guidance track to a real road scene image captured by the camera for display.

12 . The AR navigation apparatus according to claim 10 , wherein the at least one processor is configured to:

take the current actual location point P as an endpoint to make a ray along the actual traveling direction of the vehicle at the point P, wherein the ray intersects with a line segment BC at a point D, the line segment BC is formed by the maneuvering point B and a shape point C located behind the maneuvering point B on the navigation route;

make an angle bisector for an angle PDC, and make a vertical line for PD through the point P, wherein the vertical line for PD intersects with the angle bisector for the angle PDC at a point O; and make an arc with the point O as a circle center and OP as a radius, wherein the arc is tangent to the line segment BC at a point E;

obtain a curve between the point C and the point E by using a curve fitting method; and

connect the arc and the curve to form the first turning guidance track.

13 . The AR navigation apparatus according to claim 10 , wherein the at least one processor is configured to:

sample the first turning guidance track to obtain multiple sampling points;

convert coordinate values of the multiple sampling points to coordinate values in the coordinate system of the camera according to the calibration parameter of the camera; and

draw the second turning guidance track according to the coordinate values of the multiple sampling points in the coordinate system of the camera.

14 . The AR navigation apparatus according to claim 10 , wherein the at least one processor is further configured to:

determine, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determine, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

15 . The AR navigation apparatus according to claim 11 , wherein the at least one processor is further configured to:

determine, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determine, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

16 . The AR navigation apparatus according to claim 12 , wherein the at least one processor is further configured to:

determine, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determine, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

17 . The AR navigation apparatus according to claim 13 , wherein the at least one processor is further configured to:

determine, according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle, that the vehicle is about to enter the turning status at the maneuvering point; and

determine, according to the information of the current actual location point of the vehicle, information of a current positioning point corresponding to the current actual location point, information of multiple continuous historical positioning points ahead of the current positioning point, and information of actual location points corresponding to the historical positioning points, that the vehicle has entered the turning status, wherein the positioning point is a point corresponding to the actual location point of the vehicle on the navigation route.

18 . The AR navigation apparatus according to claim 14 , wherein the at least one processor is further configured to:

determine an actual distance between the vehicle and the maneuvering point according to the coordinate of the maneuvering point and the coordinate of the actual location point of the vehicle; and

determine that the vehicle is about to enter the turning status under a condition that the actual distance between the vehicle and the maneuvering point is smaller than a preset distance threshold.

19 . The AR navigation apparatus according to claim 14 , wherein the at least one processor is further configured to:

determine, according to coordinates of the multiple continuous historical positioning points and coordinates of the actual location points corresponding to the historical positioning points, distances between each of the historical positioning points and the actual location point corresponding to each of the historical positioning points;

determine an included angle between an actual traveling direction of the vehicle at the current actual location point and a navigation direction of the vehicle at the current positioning point corresponding to the current actual location point; and

determine that the vehicle has entered the turning status under a condition that the distances between each of the historical positioning points and the actual location point corresponding to each of the historical positioning points increase continuously, and the included angle is greater than a preset angle.

20 . A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are configured to cause a computer to perform the method according to claim 1 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057789/0357 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2021
From: LI, YINGHUI
To: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
Reel/Frame 054815/0744 →