Surveillance process and apparatus
A method and apparatus for performing surveillance comprising: imaging, at a first frame rate, an area ( 4 ) to produce images; detecting, using the images, a feature of interest ( 22 ) within the area ( 4 ); determining a region of interest ( 24 ), the region of interest ( 24 ) corresponding to a region within the area ( 4 ) in which the feature of interest ( 22 ) will be located at a later time-step; and, at the later time-step, using the region of interest ( 24 ), imaging the area ( 4 ) such that images of the region within the area ( 4 ) in which the feature of interest ( 22 ) is located are produced at a second frame rate, while images of the rest of the area ( 4 ) are produced at a third frame rate, the second rate being different to the third rate.
1. A surveillance process comprising:
capturing, using a first plurality of pixel sensors in a sensor array, a first plurality of images of an area under surveillance at a first frame rate;
detecting, by at least one processor, a feature of interest within the area under surveillance within at least one of the first plurality of images captured at the first frame rate;
determining, by the at least one processor, a region of interest corresponding to the detected feature of interest, the region of interest being at least one of:
a region within the area under surveillance in which the feature of interest will be located at a later time-step; and
a region within at least one of the first plurality of images of the area under surveillance corresponding to a region within the area under surveillance in which the feature of interest will be located at the later time-step; and
at the later time-step and using the determined region of interest, capturing, using a second plurality of pixel sensors in the sensor array, a second plurality of images of a portion of the area under surveillance including the determined region of interest at a second frame rate, the second frame rate being different than the first frame rate.
2. A surveillance process according to claim 1 , further comprising performing a tracking process to track at least one of the detected feature of interest and the determined region of interest over a period of time.
3. A surveillance process according to claim 2 , wherein the tracking process is performed automatically by the at least one processor according to a tracking algorithm, and wherein the size of the region of interest is dependent upon how confident the tracking algorithm is about the position of the feature of interest at the next time step.
4. A surveillance process according to claim 1 , wherein detecting the feature of interest comprises performing a change detection algorithm to detect a change between one of the first plurality of images captured at the first frame rate and another one of the first plurality of images subsequently captured at the first frame rate.
5. A surveillance process according to claim 1 , wherein:
the first and second pluralities of pixel sensors comprise the sensor array; and
a rate at which each pixel sensor in the sensor array captures images may be changed independently from that of each of the other pixel sensors.
6. A surveillance process according to claim 5 , wherein the sensor array includes a Complementary Metal Oxide Semiconductor sensor.
7. A surveillance process according to claim 1 , further comprising contemporaneously capturing, using a third plurality of pixel sensors in the sensor array, a third plurality of images of a different portion of the area under surveillance not including the determined region of interest at a third frame rate, the third frame rate being different than the second frame rate.
8. A surveillance process according to claim 7 , wherein the second frame rate is a higher frame rate than the third frame rate.
9. A surveillance process according claim 7 , wherein, at the later time-step, the second plurality of images captured at the second frame rate have a first resolution, and wherein the third plurality of images captured at the third frame rate have a second resolution that is different than the first resolution.
10. A surveillance process according to claim 9 , wherein the first resolution is higher than the second resolution.
11. Surveillance apparatus comprising:
a first plurality of pixel sensors in a sensor array configured to capture a first plurality of images of an area under surveillance at a first frame rate;
at least one computer processor operatively coupled to the sensor array and configured to:
detect a feature of interest within the area under surveillance within at least one of the first plurality of images captured at the first frame rate; and
determine a region of interest corresponding to the detected feature of interest, the region of interest being at least one of:
a region within the area under surveillance in which the feature of interest will be located at a later time-step; and
a region within at least one of the first plurality of images of the area under surveillance corresponding to a region within the area under surveillance in which the feature of interest will be located at the later time-step; and
a second plurality of pixel sensors in the sensor array configured to, at the later time-step, capture a second plurality of images of a portion of the area under surveillance including the determined region of interest at a second frame rate, the second frame rate being different than the first frame rate.
12. An aircraft comprising surveillance apparatus according to claim 11 .
13. An aircraft according to claim 12 , wherein the surveillance apparatus further comprises a transmitter operatively coupled to the first and second pluralities of pixel sensors and configured to transmit, for use by an entity remote from the aircraft, at least one of the second plurality of images produced at the later time-step.
14. A surveillance apparatus according to claim 11 , wherein the feature of interest is detected by performing a change detection algorithm to detect a change between one of the first plurality of images captured at the first frame rate and another one of the first plurality of images subsequently captured at the first frame rate.
15. A surveillance apparatus according to claim 11 , wherein, at the later time-step, the second plurality of images captured at the second frame rate have a first resolution, and wherein the first plurality of images captured at the first frame rate have a second resolution that is different than the first resolution, and wherein at least one of:
the second frame rate is a higher frame rate than the first frame rate; and
the first resolution is higher than the second resolution.
16. A surveillance apparatus according to claim 11 , wherein:
the first and second pluralities of pixel sensors comprise the sensor array; and
a rate at which each pixel sensor in the sensor array captures images may be changed independently from that of each of the other pixel sensors.
17. A non-transitory machine readable storage medium storing a program or plurality of programs arranged such that when executed by at least one processor cause the at least one processor to perform a surveillance process comprising:
capturing, using a first plurality of pixel sensors in a sensor array, a first plurality of images of an area under surveillance at a first frame rate;
detecting a feature of interest within the area under surveillance within at least one of the first plurality of images captured at the first frame rate;
determining a region of interest corresponding to the detected feature of interest, the region of interest being at least one of:
a region within the area under surveillance in which the feature of interest will be located at a later time-step; and
a region within at least one of the first plurality of images of the area under surveillance corresponding to a region within the area under surveillance in which the feature of interest will be located at the later time-step; and
at the later time-step and using the determined region of interest, capturing, using a second plurality of pixel sensors in the sensor array, a second plurality of images of a portion of the area under surveillance including the determined region of interest at a second frame rate, the second frame rate being different than the first frame rate.
18. A non-transitory machine readable storage medium according to claim 17 , wherein detecting the feature of interest includes performing a change detection algorithm to detect a change between one of the first plurality of images captured at the first frame rate and another one of the first plurality of images subsequently captured at the first frame rate.
19. A non-transitory machine readable storage medium according to claim 17 , wherein, at the later time-step, the second plurality of images captured at the second frame rate have a first resolution, and wherein the first plurality of images captured at the first frame rate have a second resolution that is different than the first resolution.
20. A non-transitory machine readable storage medium according to claim 17 , wherein:
the plurality of pixel sensors comprises a sensor array; and
a rate at which each pixel sensor in the sensor array captures images may be changed independently from that of each of the other pixel sensors.