Electronic devices with camera-based user interfaces
View Patent ↗Electronic devices may include touch-free user input components that include camera modules having overlapping fields-of-view. The overlapping fields-of-view may form a gesture tracking volume in which multi-dimensional user gestures can be tracked using images captured with the camera modules. A camera module may include an image sensor having an array of image pixels and a diffractive element that redirects light onto the array of image pixels. The diffractive element may re-orient the field-of-view of each camera module so that an outer edge of the field-of-view runs along an outer surface of a display for the device. The device may include processing circuitry that operates the device using user input data based on the user gestures in the gesture tracking volume. The processing circuitry may operate the display based on the user gestures by displaying regional markers having a size and a location that depend on the user gestures.
1. An electronic device, comprising:
a first camera module having a first field-of-view;
a second camera module having a second field-of-view that at least partially overlaps the first field-of-view;
processing circuitry configured to operate the device based on user gestures performed in a portion of the second field-of-view that overlaps the first field-of-view; and
a display, wherein the processing circuitry is configured to operate the device based on the user gestures performed in the portion of the second field-of-view that overlaps the first field-of-view by altering display content on the display based on the user gestures performed in the portion of the second field-of-view that overlaps the first field-of-view, wherein the display has a planar outer surface and wherein the first field-of-view has an extreme edge that runs along the planar outer surface of the display.
2. The electronic device defined in claim 1 wherein the second field-of-view has an extreme edge that runs along the planar outer surface of the display.
3. The electronic device defined in claim 1 wherein the first camera module has an outer surface that is parallel to the planar outer surface of the display.
4. The electronic device defined in claim 1 wherein the first camera module has an outer surface that is mounted at an angle other than 180 degrees with respect to the planar outer surface of the display.
5. The electronic device defined in claim 1 , further comprising:
a housing structure, wherein the first camera module and the second camera module are mounted within the housing structure.
6. The electronic device defined in claim 1 , further comprising:
a third camera module having a third field-of-view that at least partially overlaps the first field-of-view and the second field-of-view, wherein the processing circuitry is configured to operate the device based on user gestures performed in a portion of the third field-of-view that overlaps the second field-of-view and the first field-of-view.
7. The electronic device defined in claim 6 , further comprising:
a fourth camera module having a fourth field-of-view that at least partially overlaps the first field-of-view, the second field-of-view, and the third field-of-view, wherein the processing circuitry is configured to operate the device based on user gestures performed in a portion of the fourth field-of-view that overlaps the third field-of-view, the second field-of-view, and the first field-of-view.
8. An electronic device, comprising:
a first camera module having a first field-of-view;
a second camera module having a second field-of-view that at least partially overlaps the first field-of-view;
processing circuitry configured to operate the device based on user gestures performed in a portion of the second field-of-view that overlaps the first field-of-view; and
a display, wherein the processing circuitry is configured to operate the device based on the user gestures performed in the portion of the second field-of-view that overlaps the first field-of-view by altering display content on the display based on the user gestures performed in the portion of the second field-of-view that overlaps the first field-of-view, wherein the first camera module comprises:
an image sensor for capturing images of objects in the first field-of-view; and
a diffractive element that redirects the first field-of-view so that an outer edge of the first field-of-view runs along a surface of the display.
9. A system, comprising:
a central processing unit;
memory;
input-output circuitry; and
a touch-free user input device, wherein the touch-free user input device comprises:
a first camera module having a first field-of-view;
a second camera module having a second field-of-view that at least partially overlaps the first field-of-view;
processing circuitry configured to operate the system based on user gestures performed in a portion of the second field-of-view that overlaps the first field-of-view; and
a display having corners, wherein the first camera module and the second camera module are each mounted adjacent to a selected one of the corners of the display, and wherein each camera module includes an image sensor having an array of image pixels and a diffractive element that redirects light onto the array of image pixels.
10. The electronic device defined in claim 1 wherein the extreme edge of the first field-of-view is parallel to the outer surface of the display.