IP Library Granted Patent US 11,113,836
Granted Patent B2
US 11,113,836 · App. 16/512,249 · Granted Sep 7, 2021

Object detection method, device, apparatus and computer-readable storage medium

Inventors: Xuehui Wang (Beijing, CN); Ming Li (Beijing, CN); Tian Xia (Beijing, CN)
Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
G06T7/62G06K9/4604G06K9/4642G06K2209/21G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,113,836
App. No.
16/512,249
Granted
Sep 7, 2021
Kind
B2
Abstract

Embodiments of object detection method, device, apparatus and a computer-readable storage medium are provided. The method can include: obtaining an enclosing frame of a target object in an input image; according to the enclosing frame, determining a reference frame from a predetermined candidate frame set comprising a plurality of candidate frames; generating a size-related feature according to a size of the reference frame and a size of the enclosing frame; and detecting an object in the input image by applying the size-related feature in a machine learning model. In an embodiment of the present application, the object detection is performed by using a feature related to an object size, that is, the prediction criterion related to the object size is added to an original feature in a machine learning model, thereby further improving the accuracy of the object detection.

Claims (41)

1. An object detection method, comprising:

obtaining an enclosing frame of a target object in an input image;

according to the enclosing frame, calculating respective overlap degrees of the enclosing frame of the target object with respective candidate frames in a candidate frame set, the candidate frame set is a predetermined frame set associated with the category of the target object in the input image and each target object in the input image has one corresponding candidate frame set;

determining a predetermined number of candidate frames with overlap degrees thereof ranked in the top as reference frames;

generating a size-related feature according to respective sizes of the reference frames and a size of the enclosing frame; and

detecting an object in the input image by applying the size-related feature in a machine learning model.

2. The object detection method according to claim 1 , wherein each of the enclosing frame and the candidate frames is of a polygon shape, and the calculating respective overlap degrees of the enclosing frame of the target object with respective candidate frames in the candidate frame set comprises:

for each candidate frame,

aligning the enclosing frame with the candidate frame at one vertex;

calculating an intersection-over-union of the enclosing frame with the candidate frame; and

determining the calculated intersection-over-union as the overlap degree of the enclosing frame with the candidate frame.

3. The object detection method according to claim 1 , wherein the determining a predetermined number of candidate frames with overlap degrees thereof ranked in the top as reference frames comprises:

in a case that the overlap degree of the enclosing frame with the candidate frame is greater than an overlap threshold, determining the candidate frame as the reference frame.

4. The object detection method according to claim 1 , wherein the generating a size-related feature according to respective sizes of the reference frames and a size of the enclosing frame comprises:

determining a width ratio and a height ratio of the enclosing frame with the reference frame as the size-related feature, or determining a natural logarithm of the width ratio and a natural logarithm of the height ratio as the size-related feature.

5. The object detection method according to claim 1 , wherein the method further comprises:

predetermining a relationship between respective candidate frame sets and respective object categories;

determining an object category to which the object to be detected belongs; and

selecting a candidate frame set according to the determined object category.

6. An object detection device, comprising:

one or more processors; and

a storage device configured for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to:

obtain an enclosing frame of a target object in an input image;

according to the enclosing frame, calculate respective overlap degrees of the enclosing frame of the target object with respective candidate frames in a candidate frame set, the candidate frame set is a predetermined frame set associated with the category of the target object in the input image and each target object in the input image has one corresponding candidate frame set;

determine a predetermined number of candidate frames with overlap degrees thereof ranked in the top as reference frames;

generating a size-related feature according to respective sizes of the reference frames and a size of the enclosing frame; and

detect an object in the input image by applying the size-related feature in a machine learning model.

7. The object detection device according to claim 6 , wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:

for each candidate frame,

align the enclosing frame with the candidate frame at one vertex;

calculate an intersection-over-union of the enclosing frame with the candidate frame; and

determine the calculated intersection-over-union as the overlap degree of the enclosing frame with the candidate frame.

8. The object detection device according to claim 6 , wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:

in a case that the overlap degree of the enclosing frame with the candidate frame is greater than an overlap threshold, determine the candidate frame as the reference frame.

9. The object detection device according to claim 6 , wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:

determine a width ratio and a height ratio of the enclosing frame with the reference frame as the size-related feature, or determine a natural logarithm of the width ratio and a natural logarithm of the height ratio as the size-related feature.

10. The object detection device according to claim 6 , wherein the one or more programs are executed by the one or more processors to enable the one or more processors to:

predetermine a relationship between respective candidate frame sets and respective object categories;

determine an object category to which the object to be detected belongs; and

select a candidate frame set according to the determined object category.

11. A non-transitory computer-readable storage medium, in which a computer program is stored, wherein the computer program, when executed by a processor, causes the processor to implement the method of claim 1 .

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NAME PREVIOUSLY RECORDED AT REEL: 057933 FRAME: 0812. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058594/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057933/0812 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2019
From: WANG, XUEHUI; LI, MING; XIA, TIAN
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 049837/0201 →
Priority Claims (1)
CN 201811018729.6 · Sep 3, 2018 · national
Continuity (1)
Related Publication 20200074665A1 · Mar 5, 2020
Cited By (1)
US 12,676,023