IP Library Granted Patent US 11,460,709
Granted Patent B2
US 11,460,709 · App. 16/817,512 · Granted Oct 4, 2022

Method and apparatus for adjusting on-vehicle projection

Inventors: Yi Liu (Beijing, CN); Zhipeng Zhou (Beijing, CN)
Assignee: Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd.
G02B27/0179G06F3/013G06T11/00B60K35/00B60K2370/1529B60K2370/177B60K2370/736G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,460,709
App. No.
16/817,512
Granted
Oct 4, 2022
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and an apparatus for adjusting on-vehicle projection, a device, and a storage medium. The method includes the following features. A face image of the driver captured by the on-vehicle imager is obtained. A projection position of an on-vehicle projection device is determined based on the face image of the driver, a parameter of the on-vehicle imager and an installation position of the on-vehicle projection device.

Claims (51)

1. A method for adjusting on-vehicle projection, executed by a vehicle disposed with an on-vehicle imager, and a capturing direction of the on-vehicle imager facing toward a driver seat; wherein the method comprises:

obtaining a face image of a driver captured by the on-vehicle imager;

determining an eye position of the driver based on the face image and a-parameters of the on-vehicle imager;

determining image coordinates of facial feature points of the driver based on the face image of the driver;

converting the image coordinates into three-dimension coordinates based on the parameters of the on-vehicle imager;

determining three-dimension directional vectors of a head posture based on the three-dimension coordinates;

determining a straight line starting from the eye position along the three-dimension directional vectors of the head posture, as a head posture direction;

determining a target intersection position between the head posture direction and an on-vehicle front windshield; and

determining the projection position of the on-vehicle projection device based on the target intersection position.

2. The method of claim 1 , wherein determining the projection position of the on-vehicle projection device based on the target intersection position comprises:

selecting the projection position of the on-vehicle projection device based on a relationship between a candidate intersection position and a candidate projection height and/or a candidate projection angle of the on-vehicle projection device and based on the target intersection position.

3. The method of claim 1 , further comprising:

sending a vision determination request of the driver to a server, the vision determination request of the driver comprising the face image of the driver and the parameter of the on-vehicle imager and being configured to instruct the server to determine the eye position and the head posture direction of the driver; and

determining the projection position of the on-vehicle projection device based on the eye position and the head posture direction returned by the server and the installation position of the on-vehicle projection device.

4. The method of claim 1 , wherein determining the projection position of the on-vehicle projection device based on the target intersection position comprises:

sending a projection direction determination request to the on-vehicle projection device, the projection direction determination request comprising the target intersection position and being configured to instruct the on-vehicle projection device to determine the projection position; and

obtaining the projection position returned by the on-vehicle projection device.

5. A device for adjusting on-vehicle projection, arranged in a vehicle disposed with an on-vehicle imager, and a capturing direction of the on-vehicle imager facing toward a driver seat; wherein the device comprises:

one or more processors; and

a storage device, configured to store one or more programs,

wherein when the one or more programs are executed by the one or more processors, the one or more processors are configured to:

obtain a face image of a driver captured by the on-vehicle imager;

determine an eye position of the driver based on the face image and a parameter of the on-vehicle imager;

determine image coordinates of facial feature points of the driver based on the face image of the driver;

convert the image coordinates into three-dimension coordinates based on the parameters of the on-vehicle imager;

determine three-dimension directional vectors of a head posture based on the three-dimension coordinates;

determine a straight line starting from the eye position along the three-dimension directional vectors of the head posture, as a head posture direction;

determine a target intersection position between the head posture direction and an on-vehicle front windshield; and

determine the projection position of the on-vehicle projection device based on the target intersection position.

6. The device of claim 5 , wherein the one or more processors are further configured to:

select the projection position of the on-vehicle projection device based on a relationship between a candidate intersection position and a candidate projection height and/or a candidate projection angle of the on-vehicle projection device and based on the target intersection position.

7. The device of claim 5 , wherein the one or more processors are further configured to:

send a vision determination request of the driver to a server, the vision determination request of the driver comprising the face image of the driver and the parameter of the on-vehicle imager and being configured to instruct the server to determine the eye position and the head posture direction of the driver; and

determine the projection position of the on-vehicle projection device based on the eye position and the head posture direction of the driver returned by the server and the installation position of the on-vehicle projection device.

8. The device of claim 5 , wherein the one or more processors are further configured to:

send a projection direction determination request to the on-vehicle projection device, the projection direction determination request comprising the target intersection position and being configured to instruct the on-vehicle projection device to determine the projection position; and

obtain the projection position returned by the on-vehicle projection device.

9. A non-transitory computer readable storage medium, having a computer program stored thereon, wherein when the computer program is executed by a processor, the method for adjusting on-vehicle projection is executed, the method comprising:

obtaining a face image of a driver captured by an on-vehicle imager, a capturing direction of the on-vehicle imager facing toward a driver seat;

determining an eye position of the driver based on the face image and a parameter of the on-vehicle imager;

determining image coordinates of facial feature points of the driver based on the face image of the driver;

converting the image coordinates into three-dimension coordinates based on the parameters of the on-vehicle imager;

determining three-dimension directional vectors of a head posture based on the three-dimension coordinates;

determining a straight line starting from the eye position along the three-dimension directional vectors of the head posture, as a head posture direction;

determining a target intersection position between the head posture direction and an on-vehicle front windshield; and

determining the projection position of the on-vehicle projection device based on the target intersection position.

10. The non-transitory computer readable storage medium of claim 9 , wherein determining the projection position of the on-vehicle projection device based on the target intersection position comprises:

selecting the projection position of the on-vehicle projection device based on a relationship between a candidate intersection position and a candidate projection height and/or a candidate projection angle of the on-vehicle projection device and based on the target intersection position.

11. The non-transitory computer readable storage medium of claim 9 , wherein determining the projection position of the on-vehicle projection device based on the eye position, the head posture direction of the driver and the installation position of the on-vehicle projection device comprises:

sending a vision determination request of the driver to a server, the vision determination request of the driver comprising the face image of the driver and the parameter of the on-vehicle imager and being configured to instruct the server to determine the eye position and the head posture direction of the driver; and

determining the projection position of the on-vehicle projection device based on the eye position and the head posture direction of the driver returned by the server and the installation position of the on-vehicle projection device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057779/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2020
From: LIU, YI; ZHOU, ZHIPENG
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 052103/0155 →
Priority Claims (1)
CN 201910194154.1 · Mar 14, 2019 · national
Continuity (1)
Related Publication 20200292832A1 · Sep 17, 2020