IP Library Granted Patent US 9,465,992
Granted Patent B2
US 9,465,992 · App. 14/657,121 · Granted Oct 11, 2016

Scene recognition method and apparatus

Inventors: Yugang Jiang (Shanghai, CN); Jie Liu (Shenzhen, CN); Dong Wang (Shenzhen, CN); Yingbin Zheng (Shanghai, CN); Xiangyang Xue (Shanghai, CN)
Assignee: Huawei Technologies Co., Ltd.
G06K9/00624G06K9/00684G06K9/629
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,465,992
App. No.
14/657,121
Granted
Oct 11, 2016
Kind
B2
Abstract

A scene recognition method and apparatus are provided. The method includes obtaining multiple local detectors by training a training image set, where one local detector in the multiple local detectors corresponds to one local area of a type of target, and the type of target includes at least two local areas; detecting a to-be-recognized scene by using the multiple local detectors, and acquiring a feature, which is based on a local area of the target, of the to-be-recognized scene; and recognizing the to-be-recognized scene according to the feature, which is based on the local area of the target, of the to-be-recognized scene.

Claims (52)

1. A scene recognition apparatus, comprising:

a non-transitory computer-readable medium having instructions stored thereon; and

a computer processor coupled to the non-transitory computer-readable medium and configured to execute the instructions to:

obtain multiple local detectors by training a training image set, wherein one local detector in the multiple local detectors corresponds to one local area of a type of target, and wherein the type of target comprises at least two local areas;

detect a to-be-recognized scene by using the multiple local detectors;

acquire a feature, which is based on a local area of the target, of the to-be-recognized scene, wherein the feature is acquired by selecting a maximum response value from a grid of multiple response values; and

recognize the to-be-recognized scene according to the feature, which is based on the local area of the target, of the to-be-recognized scene.

2. The apparatus according to claim 1 , wherein the computer processor is configured to execute the instruction to:

combine local detectors whose similarity is higher than a predetermined threshold in the multiple local detectors, to obtain a set in which the local detectors are combined;

detect the to-be-recognized scene by using the multiple local detectors;

acquire the feature, which is based on the local area of the target, of the to-be-recognized scene comprises detecting the to-be-recognized scene by using a local detector in the set in which the local detectors are combined; and

acquire the feature, which is based on the local area of the target, of the to-be-recognized scene.

3. The apparatus according to claim 2 , wherein the similarity comprises a similarity degree between features of local areas of training images corresponding to the multiple local detectors.

4. The apparatus according to claim 1 , wherein the computer processor is configured to execute the instructions to recognize the to-be-recognized scene according to the feature, which is based on the local area of the target, of the to-be-recognized scene comprises the computer processor being configured to execute the instructions to classify the feature, which is based on the local area of the target, of the to-be-recognized scene by using a classifier, and acquire a scene recognition result.

5. The apparatus according to claim 1 , wherein the computer processor is configured to execute the instructions to acquire the feature, which is based on the local area of the target, of the to-be-recognized scene comprises the computer processor being configured to:

acquire a response diagram of the to-be-recognized scene by using each local detector that detects the to-be-recognized scene;

divide the response diagram into multiple grids, using a maximum response value in each grid as a feature of each grid, using features of all grids of the response diagram as features corresponding to the response diagram; and

use features that correspond to the response diagram and are acquired by all local detectors that detect the to-be-recognized scene as the feature, which is based on the local area of the target, of the to-be-recognized scene.

6. A scene recognition apparatus, comprising:

a non-transitory computer-readable medium having instructions stored thereon; and

a computer processor coupled to the non-transitory computer-readable medium and configured to execute the instructions to:

obtain multiple local detectors by training a training image set, wherein one local detector in the multiple local detectors corresponds to one local area of a type of target, and wherein the type of target comprises at least two local areas;

detect a to-be-recognized scene by using the multiple local detectors;

acquire a feature, which is based on a local area of the target, of the to-be-recognized scene;

recognize the to-be-recognized scene according to the feature, which is based on the local area of the target, of the to-be-recognized scene;

combine local detectors whose similarity is higher than a predetermined threshold in the multiple local detectors, to obtain a set in which the local detectors are combined; and

detect the to-be-recognized scene by using a local detector in the set in which the local detectors are combined.

7. The apparatus according to claim 6 , wherein the similarity comprises a similarity degree between features of local areas of training images corresponding to the multiple local detectors.

8. The apparatus according to claim 6 , wherein the computer processor is configured to execute the instructions to classify the feature, which is based on the local area of the target, of the to-be-recognized scene by using a classifier, and acquire a scene recognition result.

9. The apparatus according to claim 6 , wherein the computer processor is configured to execute the instructions to:

acquire a response diagram of the to-be-recognized scene by using each local detector that detects the to-be-recognized scene;

divide the response diagram into multiple grids, use a maximum response value in each grid as a feature of each grid;

use features of all grids of the response diagram as features corresponding to the response diagram; and

use features that correspond to the response diagram and are acquired by all the local detectors that detect the to-be-recognized scene as the feature, which is based on the local area of the target, of the to-be-recognized scene.

10. A scene recognition apparatus, comprising:

a non-transitory computer-readable medium having instructions stored thereon; and

a computer processor coupled to the non-transitory computer-readable medium and configured to execute the instructions to:

obtain multiple local detectors by training a training image set, wherein one local detector in the multiple local detectors corresponds to one local area of a type of target, and wherein the type of target comprises at least two local areas;

detect a to-be-recognized scene by using the multiple local detectors;

acquire a feature, which is based on a local area of the target, of the to-be-recognized scene;

recognize the to-be-recognized scene according to the feature, which is based on the local area of the target, of the to-be-recognized scene;

acquire a response diagram of the to-be-recognized scene by using each local detector that detects the to-be-recognized scene;

divide the response diagram into multiple grids;

use a maximum response value in each grid as a feature of each grid;

use features of all the grids of the response diagram as features corresponding to the response diagram; and

use features that correspond to the response diagram and are acquired by all local detectors that detect the to-be-recognized scene as the feature, which is based on the local area of the target, of the to-be-recognized scene.

11. The apparatus according to claim 10 , wherein the response diagram is divided into a 1 by 1 grid, a 2 by 2 grid, and a 3 by 1 grid.

12. The apparatus according to claim 10 , wherein the computer processor is configured to:

execute the instruction to combine local detectors whose similarity is higher than a predetermined threshold in the multiple local detectors, to obtain a set in which the local detectors are combined;

execute the instructions to detect the to-be-recognized scene by using the multiple local detectors; and

acquire the feature, which is based on the local area of the target, of the to-be-recognized scene comprises detecting the to-be-recognized scene by using a local detector in the set in which the local detectors are combined.

13. The apparatus according to claim 12 , wherein the local detectors are combined using an upper left corner alignment and averaging manner, wherein averaging is performed after filtering matrices corresponding to the local detectors are combined and aligned along an upper left corner.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: HUAWEI TECHNOLOGIES CO., LTD.
To: MASON LICENSING LLC
Reel/Frame 058044/0443 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2016
From: JIANG, YUGANG; LIU, JIE; WANG, DONG; ZHENG, YINGBIN; XUE, XIANGYANG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 039119/0602 →
Priority Claims (1)
CN 2012 1 0341511 · Sep 14, 2012 · national
Continuity (2)
Continuation PCTCN2013083501 · Sep 13, 2013
Related Publication 20150186726A1 · Jul 2, 2015