Radar gesture input methods for mobile devices
This document describes techniques and systems that enable input methods for mobile devices. A radar field enables an electronic device to accurately determine that a part of a user is within a gesture zone around the device. Further, the device can determine whether an application configured to receive input through radar-based gestures (radar gestures) is operating on the device. Using these techniques, the device can present a feedback indicator on a display when the user's hand is within a gesture zone around the device. The feedback indicator alerts the user that the user's hand is close enough to the device to make specific radar gestures. This allows the device to provide the user with feedback, which can educate the user about the device's capabilities and allow the user to take advantage of additional functionality and features provided by the availability of the radar gestures.
1. A method implemented in an electronic device that includes a display and a radar system, the method comprising:
determining available input modes for a plurality of applications stored on the electronic device, the input modes including at least two of touch input, voice input, or radar-gesture input;
determining whether or not an application of the plurality of applications configured to receive the radar-gesture input is currently operating on the electronic device;
responsive to a determination that an application configured to receive the radar-gesture input is currently operating on the electronic device, presenting a visual element on the display, the visual element appearing at an edge of an active area of the display and indicating that the application configured to receive the radar-gesture input is operating on the electronic device;
determining, based on radar data received through the radar system, whether or not a portion of a user is within a gesture zone of the electronic device;
responsive to a determination that the portion of the user is within the gesture zone of the electronic device and before receiving a radar-gesture input, enlarging an area of the visual element that was previously presented on the display, the enlarged visual element indicating that the portion of the user is within the gesture zone;
responsive to a determination that the portion of the user is no longer within the gesture zone, ceasing to enlarge the area of the visual element; and
responsive to a determination that the application configured to receive the radar-gesture input is no longer operating on the electronic device, ceasing to present the visual element on the display.
2. The method of claim 1 , wherein the visual element includes:
an area that comprises a portion of the active area of the display;
a visual property, the visual property comprising a luminosity, a color, a contrast, a shape, a saturation, or an opaqueness that is different from the visual property of another portion of the display that is adjacent to the visual element; and
a segment of an exterior border of the active area that is within three millimeters of the edge of the active area of the display.
3. The method of claim 2 , wherein the visual property of the visual element varies across the area of the visual element.
4. The method of claim 1 , wherein:
the portion of the user that is within the gesture zone is a hand of the user; and
determining whether or not the portion of the user is within the gesture zone of the electronic device comprises detecting a reach, by the hand of the user, toward the electronic device.
5. The method of claim 1 , wherein enlarging the area of the visual element comprises at least one of:
extending the visual element in a direction parallel to the edge of the active area of the display; or
extending the visual element in a direction away from the edge of the active area of the display.
6. The method of claim 1 , further comprising:
dynamically adjusting a visual property of the visual element corresponding to a distance of the portion of the user in the gesture zone from the electronic device or a movement of the portion of the user in the gesture zone.
7. The method of claim 6 , wherein:
the visual property is at least one of a luminosity, a brightness, or a color of the visual element;
a measurement of the visual property of the visual element increases as the distance approaches an amount corresponding to an improved radar-gesture-recognition efficacy of the radar system; and
a measurement of the visual property of the visual element decreases as the distance approaches an amount corresponding to a reduced radar-gesture-recognition efficacy of the radar system.
8. The method of claim 1 , further comprising:
dynamically adjusting a position of the visual element on the display, the dynamic adjustment of the visual element corresponding to movement of the portion of the user that is within the gesture zone of the electronic device, the movement of the portion of the user that is within the gesture zone of the electronic device based on a first subset of the radar data on which the determination of whether or not the portion of the user is within the gesture zone of the electronic device was based or on a second subset of the radar data, the second subset of the radar data received, by the radar system, after reception of the first subset of the radar data.
9. The method of claim 1 , further comprising:
determining, based on a first subset of the radar data on which the determination of whether or not the portion of the user is within the gesture zone of the electronic device was based or on a second subset of the radar data, the second subset of the radar data received, by the radar system, after reception of the first subset of the radar data, that the portion of the user is no longer within the gesture zone; and
responsive to the determination that the portion of the user is no longer within the gesture zone, ceasing to enlarge the area of the visual element.
10. The method of claim 1 , further comprising:
determining a background color of a region of the display on which the visual element is displayed; and
responsive to determining the background color of the region of the display on which the visual element is displayed, causing the display to provide the visual element in another color that is different from the background color, the different color effective to provide contrast between the visual element and the region of the display on which the visual element is displayed.
11. An electronic device comprising:
a display;
a radar system, implemented at least partially in hardware, configured to:
provide a radar field;
sense reflections from a user in the radar field;
analyze the reflections from the user in the radar field; and
provide, based on the analysis of the reflections, radar data;
a computer processor; and
a computer-readable media having instructions stored thereon that, responsive to execution by the computer processor, implement a radar-based interaction manager configured to:
determine available input modes for a plurality of applications stored on the electronic device, the input modes including at least two of touch input, voice input, or radar-gesture input;
determine whether or not an application of the plurality of applications configured to receive the radar-gesture input is currently operating on the electronic device;
responsive to a determination that an application configured to receive the radar-gesture input is currently operating on the electronic device, cause the display to present a visual element on the display, the visual element appearing at an edge of an active area of the display and indicating that the application configured to receive the radar-gesture input is operating on the electronic device;
determine, based on the radar data, whether or not a portion of the user is within a gesture zone of the electronic device;
responsive to a determination that the application configured to receive radar-gesture input is operating on the electronic device and before receiving a radar-gesture input, cause the display to enlarge an area of the visual element that was previously presented on the display, the enlarged visual element indicating that the portion of the user is within the gesture zone;
responsive to a determination that the portion of the user is no longer within the gesture zone, cease to cause the display to enlarge the area of the visual element; and
responsive to a determination that the application configured to receive the radar-gesture input is no longer operating on the electronic device, cease to cause the display to present the visual element on the display.
12. The electronic device of claim 11 , wherein the visual element includes:
an area that comprises a portion of the active area of the display;
a visual property, the visual property comprising a luminosity, a color, a contrast, a shape, a saturation, or an opaqueness that is different from the visual property of another portion of the display that is adjacent to the visual element; and
a segment of an exterior border of the active area that is within three millimeters of the edge of the active area of the display.
13. The electronic device of claim 12 , wherein the visual property of the visual element varies across the area of the visual element.
14. The electronic device of claim 11 , wherein:
the portion of the user that is within the gesture zone is a hand of the user; and
the determination of whether or not the portion of the user is within the gesture zone of the electronic device is a determination of a reach, by the hand of the user, toward the electronic device.
15. The electronic device of claim 11 , wherein enlarging the area of the visual element comprises at least one of:
extending the visual element in a direction parallel to the edge of the active area of the display; or
extending the visual element in a direction away from the edge of the active area of the display.
16. The electronic device of claim 11 , wherein the radar-based interaction manager is further configured to dynamically adjust a visual property of the visual element corresponding to a distance of the portion of the user in the gesture zone from the electronic device or a movement of the portion of the user in the gesture zone.
17. The electronic device of claim 16 , wherein:
the visual property is at least one of a luminosity, a brightness, or a color of the visual element;
a measurement of the visual property of the visual element increases as the distance approaches an amount corresponding to an improved radar-gesture-recognition efficacy of the radar system; and
a measurement of the visual property of the visual element decreases as the distance approaches an amount corresponding to a reduced radar-gesture-recognition efficacy of the radar system.
18. The electronic device of claim 11 , wherein the radar-based interaction manager is further configured to dynamically adjust a position of the visual element on the display, the dynamic adjustment of the visual element corresponding to movement of the portion of the user that is within the gesture zone of the electronic device, the movement of the portion of the user that is within the gesture zone of the electronic device based on a first subset of the radar data on which the determination of whether or not the portion of the user is within the gesture zone of the electronic device was based or a second subset of the radar data, the second subset of the radar data received, by the radar system, after reception of the first subset of the radar data.
19. The electronic device of claim 11 , wherein the radar-based interaction manager is further configured to:
determine, based on a first subset of the radar data on which the determination of whether or not the portion of the user is within the gesture zone of the electronic device was based or on a second subset of the radar data, the second subset of the radar data received, by the radar system, after reception of the first subset of the radar data, that the portion of the user is no longer within the gesture zone; and
responsive to the determination that the portion of the user is no longer within the gesture zone, cause the display to cease to enlarge the area of the visual element.
20. The electronic device of claim 11 , wherein the radar-based interaction manager is further configured to:
determine a background color of a region of the display on which the visual element is presented; and
responsive to the determination of the background color of the region of the display on which the visual element is displayed, cause the display to present the visual element in another color that is different from the background color, the different color effective to provide contrast between the visual element and the region of the display on which the visual element is displayed.