Method and device for enabling virtual reality interaction with gesture control
View Patent ↗The present invention is a method for enabling virtual reality interaction with gesture control, comprising the following steps: displaying a photographed second image in response to a gesture detecting signal; recognizing an actual gesture action in the second image and converting the same into a graphic pointer; and displaying a first image and displaying the graphic pointer at a position corresponding to the first image for interaction. A user may conduct control directly with a gesture to enable virtual reality, thereby solving the problem where the user cannot see an actual scenario as well as increasing the ease of use for virtual reality.
1. A method for enabling virtual reality interaction with gesture control, comprising the following steps:
displaying a photographed second image in response to a gesture detecting signal;
recognizing an actual gesture action in the second image and converting the actual gesture action into a graphic pointer; and
displaying a first image and displaying the graphic pointer at a position corresponding to the first image for interactions;
wherein recognizing the actual gesture action in the second image and converting the actual gesture action into the graphic pointer comprises the following steps
capturing moving block masses appearing in the second image, analyzing the moving block masses to obtain a plurality of block masses approximate to a hand, and selecting all the block masses approximate to the hand as candidate hand regions;
determining a hand shape in each candidate hand region, and if a plurality of the candidate hand regions pass verification, selecting a sum of the candidate hand regions passing the verification as a particular region; and
converting the actual gesture action in the particular region into a graphic pointer.
2. The method for enabling virtual reality interaction with gesture control according to claim 1 , wherein the first image is presented before the gesture detecting signal is detected.
3. The method for enabling virtual reality interaction with gesture control according to claim 2 , wherein the displayed photographed second image contains the first image.
4. The method for enabling virtual reality interaction with gesture control according to claim 3 , wherein that the displayed photographed second image contains the first image refers that the first image and the second image are superimposed with an Alpha Blending algorithm.
5. The method for enabling virtual reality interaction with gesture control according to claim 4 , wherein the second image is preprocessed as the second image is photographed.
6. The method for enabling virtual reality interaction with gesture control according to claim 5 , wherein the preprocessing performed on the second image comprises at least one of zooming, white balance adjusting, exposure adjusting, and image de-noising.
7. A device for enabling virtual reality interaction with gesture control, comprising a second image displaying module, a pointer recognizing module, and an interaction displaying module;
wherein the second image displaying module is used for displaying a photographed second image in response to a gesture detecting signal;
the pointer recognizing module is used for recognizing an actual gesture action in the second image and converting the actual gesture action into a graphic pointer; and
the interaction displaying module is used for displaying a first image and displaying the graphic pointer at a position corresponding to the first image for interaction;
wherein recognizing the actual gesture action in the second image and converting the actual gesture action into the graphic pointer comprises the following steps:
capturing moving block masses appearing in the second image, analyzing the moving block masses to obtain a plurality of block masses approximate to a hand, and selecting all the block masses approximate to the hand as candidate hand regions;
determining a hand shape in each candidate hand region, and if a plurality of the candidate hand regions pass verification, selecting a sum of the candidate hand regions passing the verification as a particular region; and
converting the actual gesture action in the particular region into a graphic pointer.
8. The device for enabling virtual reality interaction with gesture control according to claim 7 , wherein the interaction displaying module is configured so that the first image is presented before the gesture detecting signal is detected.
9. The device for enabling virtual reality interaction with gesture control according to claim 8 , wherein the interaction displaying module is configured so that the displayed photographed second image contains the first image.
10. The device for enabling virtual reality interaction with gesture control according to claim 9 , wherein the interaction displaying module is configured so that the displayed photographed second image contains the first image refers that the first image and the second image are superimposed with an Alpha Blending algorithm.
11. The device for enabling virtual reality interaction with gesture control according to claim 10 , wherein the interaction displaying module is configured so that the second image is preprocessed as the second image is photographed.
12. The device for enabling virtual reality interaction with gesture control according to claim 11 , wherein the interaction displaying module is configured so that the preprocessing performed on the second image comprises at least one of zooming, white balance adjusting, exposure adjusting, and image de-noising.