Systems and methods for ultra-low-power, high-speed sensors using optical filters
Systems and methods are described herein that use passive metasurfaces for optical domain image processing, reducing power consumption, latency, and/or computational load in computer vision. As an example, an optical detection device may include an optical assembly that generates multiple copies of an image, which are processed by an array of metasurface filters. Each metasurface filter applies a predefined pattern to a specific image copy. The filtered image copies are used to identify features of interest with reduced computational demands. For example, a first filter may target a first feature, while a second filter targets a second feature. The intensity of the optical radiation output by each filter is used to determine a confidence level that each respective feature is present in the image.
1. A feature detection system, comprising:
a lens assembly to focus light of an optical image onto a microlens array that replicates the optical image to form a plurality of optical image replicas;
a plurality of optical filters, wherein each optical filter is placed within an optical path of one of the optical image replicas, each optical filter configured to selectively filter one of the optical image replicas, wherein the plurality of optical filters comprises a plurality of binary optical filter masks; and
a multipixel image sensor comprising:
a segmented detection region of pixels to receive each of the filtered optical image replicas from the plurality of optical filters for feature detection, and
an image capture region of pixels to capture a high-resolution image of the optical image.
2. The feature detection system of claim 1 , further comprising an illumination source configured to emit infrared light to enhance contrast within the optical image replicas.
3. The feature detection system of claim 1 , wherein the segmented detection region of pixels includes dedicated detection pixels that provide intensity-based feature detection data in real-time.
4. The feature detection system of claim 1 , wherein one of the binary optical filter masks is configured to selectively attenuate specific portions of the optical image replicas for orientation-specific feature detection within the segmented detection region.
5. A feature detection system, comprising:
a lens assembly to focus light of an optical image onto a microlens array that replicates the optical image to form a plurality of optical image replicas;
a plurality of optical filters, wherein each optical filter is placed within an optical path of one of the optical image replicas, each optical filter configured to selectively filter one of the optical image replicas, wherein the plurality of optical filters comprises a plurality of metasurface optical filters; and
a multipixel image sensor comprising:
a segmented detection region of pixels to receive each of the filtered optical image replicas from the plurality of optical filters for feature detection, and
an image capture region of pixels to capture a high-resolution image of the optical image.
6. A feature detection system, comprising:
a lens assembly to focus light of an optical image onto a microlens array that replicates the optical image to form a plurality of optical image replicas;
a plurality of optical filters, wherein each optical filter is placed within an optical path of one of the optical image replicas, each optical filter configured to selectively filter one of the optical image replicas, wherein each optical filter in the plurality of optical filters is configured to filter a specific spatial frequency of the optical image for detection of features based on spatial frequency variations within the optical image replicas; and
a multipixel image sensor comprising:
a segmented detection region of pixels to receive each of the filtered optical image replicas from the plurality of optical filters for feature detection, and
an image capture region of pixels to capture a high-resolution image of the optical image.
7. A feature detection system, comprising:
a lens assembly to focus light of an optical image onto a microlens array that replicates the optical image to form a plurality of optical image replicas;
a plurality of optical filters, wherein each optical filter is placed within an optical path of one of the optical image replicas, each optical filter configured to selectively filter one of the optical image replicas;
a multipixel image sensor comprising:
a segmented detection region of pixels to receive each of the filtered optical image replicas from the plurality of optical filters for feature detection, and
an image capture region of pixels to capture a high-resolution image of the optical image; and
a signal processing module configured to:
analyze the intensity variations within the segmented detection region of pixels, and
generate a feature detection signal based on the intensity patterns identified across the optical image replicas.