Visual detection system for identifying objects within region of interest
According to one embodiment, a visual detection system includes an image processing unit coupled to a display and one or more neuro-physiological sensors. The display generates an image that may be viewed by a user. The neuro-physiological sensors generate neuro-physiological signals representing neuro-physiological characteristics of the user while viewing the display. The image processing unit receives the neuro-physiological signals from the neuro-physiological sensors, determines a region of interest in the image according to the neuro-physiological signals, and provides an indication of the presence of the region of interest in the image.
1. A visual detection system comprising:
an image processing unit coupled to a display operable to generate an image of a scene being viewed and a neuro-physiological sensor configured to generate a neuro-physiological signal representing a neuro-physiological characteristic of a user viewing the display, the image processing unit operable to:
receive the neuro-physiological signal from the neuro-physiological sensor;
capture and classify episodic events in the neuro-physiological signal, in multi-channel neuronal paths;
determine a region of interest in the scene according to information in the neuronal paths;
provide, using an indicator, an indication of the presence of the region of interest in the scene;
extract visual features from within the region of interest; and
identify an object within the region of interest by analyzing the visual features.
2. The visual detection system of claim 1 , wherein the neuro-physiological sensor comprises an eye tracker camera operable to generate the neuro-physiological signal that is indicative of an orientation of an eye of the user, the image processing unit operable to:
associate the orientation of the eye with the region of interest;
associate a dilation of a pupil of the eye with the user's focus and attention; and
display the indicator on the display proximate the region of interest.
3. The visual detection system of claim 1 , wherein the image processing unit comprises a storage device operable to store a plurality of image features that are each associated with an object of interest, the image processing unit operable to identify the object within the region of interest by comparing the visual features with the plurality of image features.
4. The visual detection system of claim 1 , wherein the neuro-physiological sensor comprises an electro-encephalogram sensor.
5. The visual detection system of claim 1 , wherein the neuro-physiological sensor is selected from the group consisting of a heart rate monitor, a respiration monitor, a perspiration monitor, a posture monitor, or a thermometer.
6. The visual detection system of claim 1 , wherein the indicator comprises a pixel pattern that is displayed proximate the region of interest on the display.
7. The visual detection system of claim 1 , wherein the indicator comprises a caption portion including information associated with the region of interest.
8. The visual detection system of claim 7 , further comprising a hand-held housing that houses the video camera, the display, and the image processing unit, the hand-held housing operable to be handled by the hands of the user.
9. A visual detection method comprising:
receiving a neuro-physiological signal from a neuro-physiological sensor, the neuro-physiological signal representing a neuro-physiological characteristic of a user viewing an image of a visual scene on a display;
capturing and classifying episodic events in the neuro-physiological signal, in multi-channel neuronal paths;
determining a region of interest in the visual scene according to information in the neuronal paths;
providing, using an indicator, an indication of the presence of the region of interest in the scene;
extract visual features from within the region of interest; and
identifying an object within the region of interest by analyzing the visual features.
10. The method of claim 9 , further comprising:
associating an orientation of the eye with the region of interest in the image using a neuro-physiological sensor comprising an eye tracker camera;
associating a dilation of a pupil of the eye with the user's focus and attention using the eye tracker camera; and
displaying the indicator on the display proximate the region of interest.
11. The method of claim 9 , wherein identifying the object comprises comparing the visual features with a plurality of image features stored in a mass storage device.
12. The method of claim 9 , wherein determining the region of interest comprises determining the region of interest according to a neuro-physiological sensor comprising an EEG sensor.
13. The method of claim 9 , wherein the neuro-physiological sensor is selected from the group consisting of a heart rate monitor, a respiration monitor, a perspiration monitor, a posture monitor, or a thermometer.
14. The method of claim 9 , wherein displaying the indicator on the display comprises displaying a pixel pattern proximate the region of interest on the display.
15. The method of claim 9 , wherein displaying the indicator on the display comprises displaying a caption portion including information associated with the region of interest on the display.
16. The method of claim 15 , wherein the video camera, display, and a processing system that determines the region of interest are housed in a housing.
17. A non-transitory computer-readable medium, storing code executable by a processor, the code being operable to perform at least the following:
receive a neuro-physiological signal from a neuro-physiological sensor, the neuro-physiological signal representing a neuro-physiological characteristic of a user viewing an image of a visual scene on a display;
capture and classify episodic events in the neuro-physiological signal, in multi-channel neuronal paths;
determine a region of interest in the visual scene according to information in the neuronal paths;
provide, using an indicator, an indication of the presence of the region of interest in the scene;
extract visual features from within the region of interest; and
identify an object within the region of interest by analyzing the visual features.
18. The non-transitory computer-readable medium of claim 17 , wherein the code is further operable to:
associate the orientation of the eye with the region of interest using a neuro-physiological sensor comprising an eye tracker camera;
associate a dilation of a pupil of the eye with the user's focus and attention using the eye tracker camera; and
display the indicator on the display proximate the region of interest.
19. The non-transitory computer-readable medium of claim 17 , wherein identifying the object comprises comparing the visual features with a plurality of image features stored in a mass storage device.
20. The non-transitory computer-readable medium of claim 17 , wherein determining the region of interest comprises determining the region of interest according to a neuro-physiological sensor comprising an electro-encephalogram sensor.
21. The non-transitory computer-readable medium of claim 17 , wherein the neuro-physiological sensor is selected from the group consisting of a heart rate monitor, a respiration monitor, a perspiration monitor, a posture monitor, or a thermometer.
22. The non-transitory computer-readable medium of claim 17 , wherein displaying the indicator on the display comprises displaying a pixel pattern proximate the region of interest on the display.
23. The non-transitory computer-readable medium of claim 17 , wherein displaying the indicator on the display comprises displaying a caption portion including information associated with the region of interest on the display.
24. The non-transitory computer-readable medium of claim 23 , wherein the video camera, display, and a processing system that determines the region of interest are housed in a housing.