IP Library Granted Patent US 10,824,885
Granted Patent B2
US 10,824,885 · App. 16/049,152 · Granted Nov 3, 2020

Method and apparatus for detecting braking behavior of front vehicle of autonomous vehicle

Inventors: Han Gao (Beijing, CN); Tian Xia (Beijing, CN)
Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
G06K9/00825G06K9/3233G06K9/4652G06K9/6281G06T5/00G06T7/62G06T2207/10024G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,824,885
App. No.
16/049,152
Granted
Nov 3, 2020
Kind
B2
Abstract

Embodiments of the present disclosure disclose a method and apparatus for detecting a braking behavior of a front vehicle of an autonomous vehicle. A specific implementation of the method comprises: extracting a vehicle image from a vehicle area in an image acquired by the image acquisition device; converting a color space of the vehicle image to generate a first vehicle image; setting a pixel value of a pixel point in the first vehicle image meeting any condition in a preset condition group to a first preset value to generate a second vehicle image; analyzing the second vehicle image to determine a candidate vehicle light area group; and detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking, and generating a detection result. The implementation improves the detection efficiency for the braking behavior of the front vehicle.

Claims (44)

1. A method for detecting a braking behavior of a front vehicle of an autonomous vehicle, an image acquisition device being mounted on the autonomous vehicle, the method comprising:

extracting a vehicle image from a vehicle area in an image captured by the image acquisition device mounted on the autonomous vehicle;

converting a color space of the vehicle image to generate a first vehicle image;

setting a pixel value of a pixel point in the first vehicle image meeting any condition in a preset condition group to a first preset value to generate a second vehicle image;

analyzing the second vehicle image to determine a candidate vehicle light area group; and

detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking, and generating a detection result.

2. The method according to claim 1 , wherein the converting a color space of the vehicle image comprises:

converting the color space of the vehicle image into a Hue-Saturation-Value color space.

3. The method according to claim 2 , wherein the pixel value of the pixel point comprises a hue, a saturation, and a value, and the preset condition group comprises at least one of: the hue is not within a preset interval, the saturation is less than a first threshold, or the value is less than a second threshold.

4. The method according to claim 1 , wherein the analyzing the second vehicle image to determine a candidate vehicle light area group comprises:

analyzing a connected area of the second vehicle image to obtain the candidate vehicle light area group.

5. The method according to claim 1 , wherein the detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking comprises:

for each candidate vehicle light area in the candidate vehicle light area group, determining a coordinate of a center point of the candidate vehicle light area and a size of the candidate vehicle light area on the basis of the coordinate of the pixel point included in the candidate vehicle light area, and classifying the candidate vehicle light area into a vehicle light area set if the candidate vehicle light area meets a first preset condition, wherein the coordinate of the pixel point includes an X coordinate value and a Y coordinate value, and the first preset condition comprises that the Y coordinate value of the center point is not lower than a product of a height value of the vehicle image and a second preset value, and a ratio of the size of the candidate vehicle light area to the size of the vehicle image is greater than a third threshold;

determining whether a first target vehicle light area and a second target vehicle light area exist in the vehicle light area set, wherein both the ratio of the size of the first target vehicle light area to the size of the vehicle image and the ratio of the size of the second target vehicle light area to the size of the vehicle image are greater than a fourth threshold, an absolute value of a difference between the Y coordinate value of the center point of the first target vehicle light area and the Y coordinate value of the center point of the second target vehicle light area is less than a fifth threshold, and the X coordinate value of the center point of the first target vehicle light area and the X coordinate value of the center point of the second target vehicle light area meet one, but a different one of: not greater than a product of a width value of the vehicle image and a third preset value, or not less than a product of the width value and a fourth preset value; and

determining that the vehicle is not braking if the first target vehicle light area and the second target vehicle light area do not exist in the vehicle light area set.

6. The method according to claim 5 , wherein the detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking further comprises:

determining a midpoint of a line connecting the center point of the first target vehicle light area and the center point of the second target vehicle light area if the first target vehicle light area and the second target vehicle light area exist in the vehicle light area set; and

searching for a third target vehicle light area vertically upward from the midpoint in the second vehicle image, and determining that the vehicle is braking if the third target vehicle light area is found.

7. An apparatus for detecting a braking behavior of a front vehicle of an autonomous vehicle, an image acquisition device being mounted on the autonomous vehicle, the apparatus comprising:

at least one processor; and

a memory storing instructions, the instructions when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

extracting a vehicle image from a vehicle area in an image captured by the image acquisition device mounted on the autonomous vehicle;

converting a color space of the vehicle image to generate a first vehicle image;

setting a pixel value of a pixel point in the first vehicle image meeting any condition in a preset condition group to a first preset value to generate a second vehicle image;

analyzing the second vehicle image to determine a candidate vehicle light area group; and

detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking, and generating a detection result.

8. The apparatus according to claim 7 , wherein the converting a color space of the vehicle image comprises:

converting the color space of the vehicle image into a Hue-Saturation-Value color space.

9. The apparatus according to claim 8 , wherein the pixel value of the pixel point comprises a hue, a saturation, and a value, and the preset condition group comprises at least one of: the hue is not within a preset interval, the saturation is less than a first threshold, or the value is less than a second threshold.

10. The apparatus according to claim 7 , wherein the analyzing the second vehicle image to determine a candidate vehicle light area group comprises:

analyzing a connected area of the second vehicle image to obtain the candidate vehicle light area group.

11. The apparatus according to claim 7 , wherein the detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking comprises:

for each candidate vehicle light area in the candidate vehicle light area group, determining a coordinate of a center point of the candidate vehicle light area and a size of the candidate vehicle light area on the basis of the coordinate of the pixel point included in the candidate vehicle light area, and classifying the candidate vehicle light area into a vehicle light area set if the candidate vehicle light area meets a first preset condition, wherein the coordinate of the pixel point includes an X coordinate value and a Y coordinate value, and the first preset condition comprises that the Y coordinate value of the center point is not lower than a product of a height value of the vehicle image and a second preset value, and a ratio of the size of the candidate vehicle light area to the size of the vehicle image is greater than a third threshold;

determining whether a first target vehicle light area and a second target vehicle light area exist in the vehicle light area set, wherein both the ratio of the size of the first target vehicle light area to the size of the vehicle image and the ratio of the size of the second target vehicle light area to the size of the vehicle image are greater than a fourth threshold, an absolute value of a difference between the Y coordinate value of the center point of the first target vehicle light area and the Y coordinate value of the center point of the second target vehicle light area is less than a fifth threshold, and the X coordinate value of the center point of the first target vehicle light area and the X coordinate value of the center point of the second target vehicle light area meet one, but a different one of: not greater than a product of a width value of the vehicle image and a third preset value, or not less than a product of the width value and a fourth preset value; and

determining that the vehicle is not braking if the first target vehicle light area and the second target vehicle light area do not exist in the vehicle light area set.

12. The apparatus according to claim 11 , wherein the detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking further comprises:

determining a midpoint of a line connecting the center point of the first target vehicle light area and the center point of the second target vehicle light area if the first target vehicle light area and the second target vehicle light area exist in the vehicle light area set; and

searching for a third target vehicle light area vertically upward from the midpoint in the second vehicle image, and determining that the vehicle is braking if the third target vehicle light area is found.

13. A non-transitory computer-readable storage medium storing a computer program, the computer program when executed by one or more processors, causes the one or more processors to perform operations, the operations comprising:

extracting a vehicle image from a vehicle area in an image captured by the image acquisition device mounted on the autonomous vehicle;

converting a color space of the vehicle image to generate a first vehicle image;

setting a pixel value of a pixel point in the first vehicle image meeting any condition in a preset condition group to a first preset value to generate a second vehicle image;

analyzing the second vehicle image to determine a candidate vehicle light area group; and

detecting, based on the candidate vehicle light area group, whether a vehicle indicated by the vehicle image is braking, and generating a detection result.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NAME PREVIOUSLY RECORDED AT REEL: 057933 FRAME: 0812. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058594/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057933/0812 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2018
From: GAO, HAN; XIA, TIAN
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 046503/0032 →
Priority Claims (1)
CN 2017 1 0842627 · Sep 18, 2017 · national
Continuity (1)
Related Publication 20190087674A1 · Mar 21, 2019