IP Library Granted Patent US 10,740,927
Granted Patent B2
US 10,740,927 · App. 16/092,746 · Granted Aug 11, 2020

Method and device for vehicle identification

Inventors: Jianzong Wang (Shenzhen, CN); Jing Xiao (Shenzhen, CN)
Assignee: Ping An Technology (Shenzhen) Co., Ltd.
G06T7/90G06K9/00771G06K9/00825G06K9/6247G06K9/6271G06K9/6296G06N3/04G06Q40/08G06K2209/23G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,927
App. No.
16/092,746
Granted
Aug 11, 2020
Kind
B2
Abstract

The present application provides a method and device for vehicle identification, the method comprises: obtaining a first vehicle image and a second vehicle image, wherein the first vehicle image comprises a first vehicle, and the second vehicle image comprises a second vehicle; extracting a first color feature and a first vehicle type feature of the first vehicle, and extracting a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model; combining the first color feature and the first vehicle type feature into a first vehicle feature, and combining the second color feature and the second vehicle type feature into a second vehicle feature; calculating a similarity parameter between the first vehicle feature and the second vehicle feature; and determining whether the first vehicle is the same one as the second vehicle according to the similarity parameter.

Claims (48)

1. A vehicle identification method, comprising:

obtaining a first vehicle image and a second vehicle image, wherein the first vehicle image comprises a first vehicle, and the second vehicle image comprises a second vehicle;

extracting a first color feature and a first vehicle type feature of the first vehicle, and extracting a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model;

combining the first color feature and the first vehicle type feature into a first vehicle feature, and combining the second color feature and the second vehicle type feature into a second vehicle feature;

calculating a similarity parameter between the first vehicle feature and the second vehicle feature; and

determining whether the first vehicle is the same one as the second vehicle according to the similarity parameter;

wherein the step of extracting a first color feature and a first vehicle type feature of the first vehicle, and a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model, comprises:

pre-training a first convolutional neural network model through a preset image database;

training the first convolution neural network model through vehicle images of a plurality of colors;

inputting the first vehicle image and the second vehicle image into the first convolution neural network model respectively, wherein the first convolution neural network model comprises a multi-layer convolution layer and a multi-layer full-connection layer, wherein an output of a previous layer is an input of a current layer; and

extracting the first color feature from the first vehicle image and extracting the second color feature from the second vehicle image, after the processing through the convolution layer and the full-connection layer.

2. The method according to claim 1 , wherein the step of extracting a first color feature and a first vehicle type feature of the first vehicle and a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model further comprises:

pre-training a second convolutional neural network model through a preset image database;

training the second convolution neural network model through vehicle images of a plurality of visual angles;

inputting the first vehicle image and the second vehicle image into the second convolution neural network model respectively, wherein the second convolution neural network model comprises a multi-layer convolution layer and a multi-layer full-connection layer, and an output of a previous layer is an input of a current layer; and

extracting the first vehicle type feature from the first vehicle image, and extracting the second vehicle type feature from the second vehicle image after the processing through the convolution layer and the full-connection layer.

3. The method according to claim 1 , wherein the step of combining the first color feature and the first vehicle type feature into a first vehicle feature and combining the second color feature and the second vehicle type feature into a second vehicle feature comprises:

obtaining a color weight of the first color feature and the second color feature, and obtaining a vehicle type weight of the first vehicle type feature and the second vehicle type feature, wherein the vehicle type weight is larger than the color weight;

summating a multiplication of the first color feature and the color weight with a multiplication of the first vehicle type feature and the vehicle type weight to obtain the first vehicle feature; and

summating a multiplication of the second color feature and the color weight with a multiplication of the second vehicle type feature and the vehicle type weight to obtain the second vehicle feature.

4. The method according to claim 1 , wherein the step of determining whether the first vehicle is the same one as the second vehicle according to the similarity parameter comprises:

obtaining a preset threshold value;

determining that the first vehicle is the same one as the second vehicle when the similarity parameter is larger than or equal to the preset threshold value; or

determining that the first vehicle is not the same one as the second vehicle when the similarity parameter is smaller than the preset threshold value.

5. A terminal device comprising a memory, a processor, and a computer readable instruction stored in the memory and executable by the processor, wherein when executing the computer readable instruction, the processor implements following steps of:

obtaining a first vehicle image and a second vehicle image, wherein the first vehicle image comprises a first vehicle, and the second vehicle image comprises a second vehicle;

extracting a first color feature and a first vehicle type feature of the first vehicle, and extracting a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model;

combining the first color feature and the first vehicle type feature into a first vehicle feature, and combining the second color feature and the second vehicle type feature into a second vehicle feature;

calculating a similarity parameter between the first vehicle feature and the second vehicle feature; and

determining whether the first vehicle is the same one as the second vehicle according to the similarity parameter;

wherein the step of extracting a first color feature and a first vehicle type feature of the first vehicle and a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model comprises:

pre-training a first convolutional neural network model through a preset image database;

training the first convolution neural network model through vehicle images of a plurality of colors;

inputting the first vehicle image and the second vehicle image into the first convolution neural network model respectively, wherein the first convolution neural network model comprises a multi-layer convolution layer and a multi-layer full-connection layer, and an output of a previous layer is an input of a current layer; and

extracting the first color feature from the first vehicle image, and extracting the second color feature from the second vehicle image after the processing through the convolution layer and the full-connection layer.

6. The terminal device according to claim 5 , wherein the step of extracting a first color feature and a first vehicle type feature of the first vehicle and a second color feature and a second vehicle type feature of the second vehicle based on a convolutional neural network model further comprises:

pre-training a second convolutional neural network model through a preset image database;

training the second convolution neural network model through vehicle images of a plurality of visual angles;

inputting the first vehicle image and the second vehicle image into the second convolution neural network model respectively, wherein the second convolution neural network model comprises a multi-layer convolution layer and a multi-layer full-connection layer, and an output of a previous layer is an input of a current layer; and

extracting the first vehicle type feature from the first vehicle image, and extracting the second vehicle type feature from the second vehicle image after the processing through the convolution layer and the full-connection layer.

7. The terminal device according to claim 5 , wherein the step of combining the first color feature and the first vehicle type feature into a first vehicle feature and combining the second color feature and the second vehicle type feature into a second vehicle feature comprises:

obtaining a color weight of the first color feature and the second color feature, and obtaining a vehicle type weight of the first vehicle type feature and the second vehicle type feature, wherein the vehicle type weight is larger than the color weight;

summating a multiplication of the first color feature and the color weight with a multiplication of the first vehicle type feature and the vehicle type weight to obtain the first vehicle feature; and

summating a multiplication of the second color feature and the color weight with a multiplication of the second vehicle type feature and the vehicle type weight to obtain the second vehicle feature.

8. The terminal device according to claim 5 , wherein the step of determining whether the first vehicle is the same one as the second vehicle according to the similarity parameter comprises:

obtaining a preset threshold value;

determining that the first vehicle is the same one as the second vehicle when the similarity parameter is larger than or equal to the preset threshold value; or

determining that the first vehicle is not the same one as the second vehicle when the similarity parameter is smaller than the preset threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2018
From: WANG, JIANZONG; XIAO, JING
To: PING AN TECHNOLOGY (SHENZHEN) CO., LTD.
Reel/Frame 047144/0605 →
Priority Claims (1)
CN 2017 1 0083593 · Feb 16, 2017 · national
Continuity (1)
Related Publication 20190139262A1 · May 9, 2019
Cited By (1)
US 12,505,646