IP Library Granted Patent US 6,917,703
Granted Patent B1
US 6,917,703 · App. 09/795,665 · Granted Jul 12, 2005

Method and apparatus for image analysis of a gabor-wavelet transformed image using a neural network

Assignee: Nevengineering, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 6,917,703
App. No.
09/795,665
Granted
Jul 12, 2005
Kind
B1
Abstract

The present invention may be embodied in a method, and in a related apparatus, for classifying a feature in an image frame. In the method, an original image frame having an array of pixels is transformed using Gabor-wavelet transformations to generate a transformed image frame. Each pixel of the transformed image is associated with a respective pixel of the original image frame and is represented by a predetermined number of wavelet component values. A pixel of the transformed image frame associated with the feature is selected for analysis. A neural network is provided that has an output and a predetermined number of inputs. Each input of the neural network is associated with a respective wavelet component value of the selected pixel. The neural network classifies the local feature based on the wavelet component values, and indicates a class of the feature at an output of the neural network.

Claims (39)

1. A method for classifying a feature in an image frame, comprising:

transforming an original image frame having an array of pixels using wavelet transformations to generate a transformed image frame having an array of pixels, each pixel of the transformed image being associated with a respective pixel of the original image frame and being represented by a predetermined number of wavelet component values;

selecting a pixel of the transformed image frame associated with the feature;

providing a neural network having an output and a predetermined number of inputs, each input being associated with a respective wavelet component value of the predetermined number of wavelet component values of the selected pixel, wherein the neural network is trained to classify the feature in a transformed image frame; and

classifying, using the neural network, the local feature based on the wavelet component values provided at the neural network inputs, and indicating a class of the feature at the neural network output.

2. A method for classifying a feature in an image frame as defined in claim 1 , wherein the wavelet transformations use Gabor wavelets.

3. A method for classifying a feature in an image frame as defined in claim 1 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.

4. A method for classifying a feature in an image frame as defined in claim 1 , wherein the feature in the image frame is a facial feature.

5. A method for classifying a feature in an image frame as defined in claim 1 , wherein the predetermined number of wavelet component values and the predetermined number of neural network inputs is 12.

6. A method for classifying a feature in an image frame as defined in claim 1 , wherein the wavelet component values are magnitudes of complex numbers.

7. A method for analyzing an object image in an image frame, comprising:

transforming an original image frame having an array of pixels using wavelet transformations to generate a transformed image frame having an array of pixels, each pixel of the transformed image being associated with a respective pixel of the original image frame and being represented by a predetermined number of wavelet component values;

selecting pixels of the transformed image frame corresponding to sensing nodes of a label graph, each sensing node for analyzing a local feature of the object image in the original image frame;

providing a plurality of neural networks, each neural network being associated with a sensing node of the label graph and having an output and a predetermined number of inputs, each input being associated with a respective wavelet component value of the predetermined number of wavelet component values of the respective selected pixel, wherein each neural network is trained to analyze the respective local feature of the object image in a transformed image frame;

analyzing, using the neural networks, the local features based on the wavelet component values provided at the neural network inputs, and indicating a characteristic of the object image based on the neural network outputs.

8. A method for classifying a feature in an image frame as defined in claim 7 , wherein the wavelet transformations use Gabor wavelets.

9. A method for classifying a feature in an image frame as defined in claim 7 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.

10. A method for classifying a feature in an image frame as defined in claim 7 , wherein the object image is a facial image.

11. A method for classifying a feature in an image frame as defined in claim 7 , wherein the predetermined number of wavelet component values is 40 and the predetermined number of neural network inputs is 12.

12. A method for classifying a feature in an image frame as defined in claim 7 , wherein the wavelet component values are magnitudes of complex numbers.

13. Apparatus for classifying a feature in an image frame, comprising:

means for transforming an original image frame having an array of pixels using wavelet transformations to generate a transformed image frame having an array of pixels, each pixel of the transformed image being associated with a respective pixel of the original image frame and being represented by a predetermined number of wavelet component values;

means for selecting a pixel of the transformed image frame associated with the feature;

a neural network having an output and a predetermined number of inputs, each input being associated with a respective wavelet component value of the predetermined number of wavelet component values of the selected pixel, wherein the neural network is trained to classify the feature in a transformed image frame and classifies the local feature based on the wavelet component values provided at the neural network inputs, and indicating a class of the feature at the neural network output.

14. Apparatus for classifying a feature in an image frame as defined in claim 13 , wherein the wavelet transformations use Gabor wavelets.

15. Apparatus for classifying a feature in an image frame as defined in claim 13 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.

16. Apparatus for classifying a feature in an image frame as defined in claim 13 , wherein the feature in the image frame is a facial feature.

17. Apparatus for classifying a feature in an image frame as defined in claim 13 , wherein the predetermined number of wavelet component values and the predetermined number of neural network inputs is 12.

18. Apparatus for classifying a feature in an image frame as defined in claim 13 , wherein the wavelet component values are magnitudes of complex numbers.

19. Apparatus for analyzing an object image in an image frame, comprising:

means for transforming an original image frame having an array of pixels using wavelet transformations to generate a transformed image frame having an array of pixels, each pixel of the transformed image being associated with a respective pixel of the original image frame and being represented by a predetermined number of wavelet component values;

means for selecting pixels of the transformed image frame corresponding to sensing nodes of a label graph, each sensing node for analyzing a local features of the object image in the original image frame;

a plurality of neural networks, each neural network being associated with a sensing node of the label graph and having an output and a predetermined number of inputs, each input associated with a respective wavelet component value of the predetermined number of wavelet component values of the respective selected pixel, wherein each neural network is trained to analyze the respective local feature of the object image in a transformed image frame;

means for analyzing, using the neural networks, the local features based on the wavelet component values provided at the neural network inputs, and indicating a characteristic of the object image based on the neural network outputs.

20. Apparatus for classifying a feature in an image frame as defined in claim 19 , wherein the wavelet transformations use Gabor wavelets.

21. Apparatus for classifying a feature in an image frame as defined in claim 19 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.

22. Apparatus for classifying a feature in an image frame as defined in claim 19 , wherein the object image is a facial image.

23. Apparatus for classifying a feature in an image frame as defined in claim 19 , wherein the predetermined number of wavelet component values is 40 and the predetermined number of neural network inputs is 40.

24. Apparatus for classifying a feature in an image frame as defined in claim 19 , wherein the wavelet component values are complex numbers.

Assignments (5)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044127/0735 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2006
From: NEVENGINEERING, INC.
To: GOOGLE INC.
Reel/Frame 018616/0814 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2004
From: EYEMATIC INTERFACES, INC.
To: NEVENGINEERING, INC.
Reel/Frame 015032/0710 →
SECURITY INTEREST Recorded Oct 9, 2003
From: NEVENGINEERING, INC.
To: EYEMATIC INTERFACES, INC.
Reel/Frame 014572/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2001
From: STEFFENS, JOHANNES B.; ADAM, HARTWIG; NEVEN, HARTMUT
To: EYEMATIC INTERFACES, INC.
Reel/Frame 012108/0055 →