IP Library Granted Patent US 11,216,977
Granted Patent B2
US 11,216,977 · App. 16/912,360 · Granted Jan 4, 2022

Methods and apparatuses for outputting information and calibrating camera

Inventors: Xiang Liu (Beijing, CN); Shuang Zhang (Beijing, CN); Bin Gao (Beijing, CN); Xiaoxing Zhu (Beijing, CN); Fan Yang (Beijing, CN)
Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
G06T7/80G06T5/50H04N17/002G06T2200/24G06T2207/20216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,216,977
App. No.
16/912,360
Granted
Jan 4, 2022
Kind
B2
Abstract

Embodiments of the present disclosure relate to methods and apparatuses for outputting information and calibrating a camera. The method may include: acquiring a first image, a second image, and a third image, the first image being an image photographed by a to-be-calibrated camera, the second image being a high-precision map image including a target area indicated by the first image, and the third image being a reflectance image including the target area; fusing the second image and the third image to obtain a fused image; determining a matching point pair based on points selected by a user in the first image and the fused image; and calibrating the to-be-calibrated camera based on coordinates of the matching point pair.

Claims (50)

1. A method for outputting information, comprising:

displaying, in response to a first image input operation of a user, a first image selected by the user, the first image being an image photographed by a to-be-calibrated camera;

fusing, in response to a second image input operation of the user, a second image and a third image selected by the user, and displaying an obtained fused image, the second image being a high-precision map image comprising a target area indicated by the first image, and the third image being a reflectance image comprising the target area;

in response to a first point selection operation for the first image and a second point selection operation for the fused image after the first point selection operation, using a first point indicated by the first point selection operation and a second point indicated by the second point selection operation as a matching point pair;

displaying the matching point pair in association on the first image and the fused image; and

outputting coordinates of the selected points.

2. The method according to claim 1 , wherein the fusing a second image and a third image selected by the user comprises:

fusing the second image and the third image based on coordinates of a pixel point in the high-precision map image and coordinates of a pixel point in the reflectance image.

3. The method according to claim 1 , wherein the method further comprises:

adding, in response to an adding operation for the matching point pair, the matching point pair to a preset matching point pair set; and

storing, in response to a storage operation for the matching point pair set, the matching point pair set locally.

4. The method according to claim 3 , wherein the point selection operation comprises a third point selection operation and a fourth point selection operation for the first image or the fused image; and

the displaying, in response to a point selection operation of the user on the first image and/or the fused image, a point selected by the user in the first image and/or the fused image comprises:

using, in response to the third point selection operation, a third point indicated by the third point selection operation as a starting point of an auxiliary line;

using, in response to the fourth point selection operation, a fourth point indicated by the fourth point selection operation as an ending point of the auxiliary line;

connecting, in response to a line drawing operation for the starting point and the ending point, the starting point and the ending point; and

displaying the starting point, the ending point, and a straight line obtained by the connecting the starting point and the ending point in the first image or the fused image.

5. The method according to claim 1 , wherein the method further comprises:

no longer displaying, in response to a cancel operation of the user on the selected point, the selected point on which the cancel operation is performed.

6. The method according to claim 1 , wherein the method further comprises:

calibrating the to-be-calibrated camera based on coordinates of the matching point pair.

7. The method according to claim 6 , wherein the method further comprises:

adding the matching point pair to a preset matching point pair set; and

storing the matching point pair set locally.

8. An apparatus for outputting information, comprising:

at least one processor; and

a memory storing instructions, the instructions when executed by the at least one processor, causing the at least one processor to perform operations, the operations comprising:

displaying, in response to a first image input operation of a user, a first image selected by the user, the first image being an image photographed by a to-be-calibrated camera;

fusing, in response to a second image input operation of the user, a second image and a third image selected by the user, and displaying an obtained fused image, the second image being a high-precision map image comprising a target area indicated by the first image, and the third image being a reflectance image comprising the target area;

in response to a first point selection operation for the first image and a second point selection operation for the fused image after the first point selection operation, using a first point indicated by the first point selection operation and a second point indicated by the second point selection operation as a matching point pair;

displaying the matching point pair in association on the first image and the fused image; and

outputting coordinates of the selected points.

9. The apparatus according to claim 8 , wherein the fusing a second image and a third image selected by the user comprises:

fusing the second image and the third image based on coordinates of a pixel point in the high-precision map image and coordinates of a pixel point in the reflectance image.

10. The apparatus according to claim 8 , wherein the operations further comprise:

adding, in response to an adding operation for the matching point pair, the matching point pair to a preset matching point pair set; and

storing, in response to a storage operation for the matching point pair set, the matching point pair set locally.

11. The apparatus according to claim 10 , wherein the point selection operation comprises a third point selection operation and a fourth point selection operation for the first image or the fused image; and

the displaying, in response to a point selection operation of the user on the first image and/or the fused image, a point selected by the user in the first image and/or the fused image comprises:

using, in response to the third point selection operation, a third point indicated by the third point selection operation as a starting point of an auxiliary line;

using, in response to the fourth point selection operation, a fourth point indicated by the fourth point selection operation as an ending point of the auxiliary line;

connecting, in response to a line drawing operation for the starting point and the ending point, the starting point and the ending point; and

displaying the starting point, the ending point, and a straight line obtained by the connecting the starting point and the ending point in the first image or the fused image.

12. The apparatus according to claim 8 , wherein the operations further comprise:

no longer displaying, in response to a cancel operation of the user on the selected point, the selected point on which the cancel operation is performed.

13. An apparatus for calibrating a camera, comprising:

at least one processor; and

a memory storing instructions, the instructions when executed by the at least one processor, causing the at least one processor to perform the method according to claim 6 .

14. A non-transitory computer readable medium, storing a computer program thereon, wherein the computer program, when executed by a processor, causes the processor to implement the method according to claim 1 .

15. A non-transitory computer readable medium, storing a computer program thereon, wherein the computer program, when executed by a processor, causes the processor to implement the method according to claim 6 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2020
From: LIU, XIANG; ZHANG, SHUANG; GAO, BIN; ZHU, XIAOXING; YANG, FAN
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 053059/0265 →
Priority Claims (1)
CN 201910907183.8 · Sep 24, 2019 · national
Continuity (1)
Related Publication 20210090295A1 · Mar 25, 2021