Method for interacting with virtual keyboard, electrode device, and storage medium

1 . An interaction method, the method comprising:

presenting a virtual keyboard in an extended reality space;

detecting a position and an action of a user finger relative to the virtual keyboard; and

outputting a vibration signal based on the position and the action of the user finger relative to the virtual keyboard, wherein the vibration signal is used for prompting the position of the user finger in the virtual keyboard and an operation action of the user finger on a virtual key in the virtual keyboard,

wherein the virtual keyboard comprises a plurality of virtual keys and a non-key area surrounding the virtual keys and located between adjacent virtual keys,

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard comprises at least one of:

outputting a first vibration signal in response to the user finger hovering over the virtual key; or

outputting a second vibration signal in response to the user finger clicking the virtual key, and

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises: outputting a third vibration signal in response to the user finger hovering over the non-key area, and

wherein the third vibration signal output in response to the user finger hovering over the non-key area is different from the first vibration signal output in response to the user finger hovering over the virtual key or the second vibration signal output in response to the user finger clicking the virtual key, so as to enable a user to discriminate whether a position where the user finger is currently located is appropriate.

2 . The method according to claim 1 , wherein the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises:

outputting a fourth vibration signal in response to the user finger moving in a first direction and passing the non-key area in a process of the moving, wherein the first direction is parallel to a plane where the virtual keyboard is located, and

wherein a number of times the fourth vibration signal is output is consistent with a number of times the non-key area is passed in the process of the moving of the user finger, so as to assist the user in estimating a finger moving distance and further judging which virtual key the user finger has currently moved to.

3 . The method according to claim 1 , wherein the vibration signal is formed by a vibration motor; and wherein the vibration motor is provided in at least one of an extended reality device or a haptic feedback device in communication connection with an extended reality device.

4 . The method according to claim 3 , wherein the extended reality device is a head mounted extended reality device, and the extended reality device comprises an extended reality device body and a head band; and in response to the vibration motor being provided in the extended reality device, the vibration motor is fixed in at least one of foam which is in contact with face of the extended reality device body or the head band.

5 . The method according to claim 3 , wherein the vibration motor is re-used as a focusing motor of a camera.

6 . The method according to claim 1 , further comprising:

outputting visual prompt information based on the position and the action of the user finger relative to the virtual keyboard, wherein the visual prompt information is used for prompting the position of the user finger in the virtual keyboard and the operation action of the user finger on the virtual key in the virtual keyboard.

7 . The method according to claim 6 , wherein the outputting the visual prompt information based on the position and the action of the user finger relative to the virtual keyboard comprises at least one of:

in response to the user finger hovering over the virtual key, setting a presentation state of the virtual key hovered as a first highlight state;

in response to the user finger clicking the virtual key, setting a presentation state of the virtual key clicked as a second highlight state; or

in response to the user finger moving in a first direction, setting a presentation state of the virtual key currently passed in a process of the moving of the user finger as a third highlight state,

wherein the first highlight state has the same display effect as the third highlight state, and the first highlight state has a different display effect from the second highlight state.

8 . The method according to claim 1 , wherein the user finger hovering over the non-key area refers to the user finger making the hovering action, and an area of overlap between a vertical projection of a fingertip of the user finger on a plane where the virtual keyboard is located and a triggerable range of any virtual key being less than or equal to a set threshold.

9 . An electronic device, the electronic device comprising:

one or more processors; and

a storage device configured to store one or more programs,

wherein the one or more programs, when executed by the one or more processors, causes the one or more processors to perform the following operations:

presenting a virtual keyboard in an extended reality space;

detecting a position and an action of a user finger relative to the virtual keyboard; and

outputting a vibration signal based on the position and the action of the user finger relative to the virtual keyboard, wherein the vibration signal is used for prompting the position of the user finger in the virtual keyboard and an operation action of the user finger on a virtual key in the virtual keyboard,

wherein the virtual keyboard comprises a plurality of virtual keys and a non-key area surrounding the virtual keys and located between adjacent virtual keys;

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard comprises at least one of:

outputting a first vibration signal in response to the user finger hovering over the virtual key; or

outputting a second vibration signal in response to the user finger clicking the virtual key, and

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises: outputting a third vibration signal in response to the user finger hovering over the non-key area, and

wherein the third vibration signal output in response to the user finger hovering over the non-key area is different from the first vibration signal output in response to the user finger hovering over the virtual key or the second vibration signal output in response to the user finger clicking the virtual key, so as to enable a user to discriminate whether a position where the user finger is currently located is appropriate.

10 . The electronic device according to claim 9 , wherein the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises:

outputting a fourth vibration signal in response to the user finger moving in a first direction and passing the non-key area in a process of the moving, wherein the first direction is parallel to a plane where the virtual keyboard is located, and

wherein a number of times the fourth vibration signal is output is consistent with a number of times the non-key area is passed in the process of the moving of the user finger, so as to assist the user in estimating a finger moving distance and further judging which virtual key the user finger has currently moved to.

11 . The electronic device according to claim 9 , wherein the user finger hovering over the non-key area refers to the user finger making the hovering action, and an area of overlap between a vertical projection of a fingertip of the user finger on a plane where the virtual keyboard is located and a triggerable range of any virtual key being less than or equal to a set threshold.

12 . A non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, causes the processor to perform the following operations:

presenting a virtual keyboard in an extended reality space;

detecting a position and an action of a user finger relative to the virtual keyboard; and

outputting a vibration signal based on the position and the action of the user finger relative to the virtual keyboard, wherein the vibration signal is used for prompting the position of the user finger in the virtual keyboard and an operation action of the user finger on a virtual key in the virtual keyboard,

wherein the virtual keyboard comprises a plurality of virtual keys and a non-key area surrounding the virtual keys and located between adjacent virtual keys,

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard comprises at least one of:

outputting a first vibration signal in response to the user finger hovering over the virtual key; or

outputting a second vibration signal in response to the user finger clicking the virtual key, and

the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises: outputting a third vibration signal in response to the user finger hovering over the non-key area, and

wherein the third vibration signal output in response to the user finger hovering over the non-key area is different from the first vibration signal output in response to the user finger hovering over the virtual key or the second vibration signal output in response to the user finger clicking the virtual key, so as to enable a user to discriminate whether a position where the user finger is currently located is appropriate.

13 . The computer-readable storage medium according to claim 12 , wherein the outputting the vibration signal based on the position and the action of the user finger relative to the virtual keyboard further comprises:

outputting a fourth vibration signal in response to the user finger moving in a first direction and passing the non-key area in a process of the moving, wherein the first direction is parallel to a plane where the virtual keyboard is located, and

wherein a number of times the fourth vibration signal is output is consistent with a number of times the non-key area is passed in the process of the moving of the user finger, so as to assist the user in estimating a finger moving distance and further judging which virtual key the user finger has currently moved to.

14 . The computer-readable storage medium according to claim 12 , wherein the user finger hovering over the non-key area refers to the user finger making the hovering action, and an area of overlap between a vertical projection of a fingertip of the user finger on a plane where the virtual keyboard is located and a triggerable range of any virtual key being less than or equal to a set threshold.