Interactive control method, terminal device and storage medium

1 . An interactive control method applied to a terminal device, wherein the terminal device comprises a camera, and when the terminal device is controlled by a control gesture, the interactive control method comprises the steps of:

acquiring image data collected by the camera;

identifying whether an electronic device other than the terminal device is included in the image data;

determining whether a current scene is the control scene according to an identification result, wherein the current scene is an active scene presently being displayed;

when the electronic device is included in the image data, determining whether a hand part in the image data overlaps with the electronic device;

when the hand part overlaps with the electronic device, defining the current scene as a scene other than the control scene, when the current scene is the scene other than the control scene, the terminal device ignores the control gesture;

determining the control gesture according to the image data; and

when the current scene is a control scene corresponding to the terminal device, executing a control instruction corresponding to the control gesture, the control scene is used to control the terminal device to execute corresponding control instructions,

wherein the step of identifying whether the electronic device is included in the image data comprises:

acquiring brightness values corresponding to every pixel in the image data:

acquiring a contour corresponding to a display region in which the brightness values satisfy a luminance characteristic of a light source; and

when the contour is of a regular shape, determining that the electronic device is included in the image data.

2 . The interactive control method according to claim 1 , wherein, after the step of determining the current scene and the control gesture according to the image data, the method further comprises:

when the current scene is a scene other than the control scene, the terminal device ignores the control gesture, or performs at least one of the following:

displaying a prompt interface, wherein the prompt interface is used to set a type of the control gesture; and

outputting a prompt message prompting a type of the control gesture.

3 . A terminal device, comprising: a memory, a processor, and an interactive control program stored on the memory and operable on the processor, wherein when the interactive control program is executed by the processor, the steps of the interactive control method according to claim 2 is realized.

4 . The interactive control method according to claim 1 , wherein the terminal device is an augmented reality device, and the step of executing the control instruction corresponding to the control gesture comprises:

collecting posture information and hand part information corresponding to the image data;

performing three-dimensional dense modeling according to the posture information and the hand part information to acquire three-dimensional point cloud information of the hand part in a reference coordinate system;

acquiring pose information of a virtual object in the image data in the reference coordinate system; and

rendering the hand part and the virtual object based on the three-dimensional point cloud information of the hand part in the reference coordinate system and the pose information of the virtual object in the reference coordinate system, so as to execute the control instruction corresponding to the control gesture.

5 . The interactive control method according to claim 4 , wherein the step of collecting the posture information and the hand part information corresponding to the image data comprises:

collecting an RGB image, a depth image and IMU data of the image data; and

processing the RGB image, depth image and IMU data to acquire the posture information and the hand part information corresponding to the image data.

6 . A terminal device, comprising: a memory, a processor, and an interactive control program stored on the memory and operable on the processor, wherein when the interactive control program is executed by the processor, the steps of the interactive control method according to claim 5 is realized.

7 . A terminal device, comprising: a memory, a processor, and an interactive control program stored on the memory and operable on the processor, wherein when the interactive control program is executed by the processor, the steps of the interactive control method according to claim 6 is realized.

8 . The interactive control method according to claim 1 , wherein the terminal device is a smart earphone, and the step of executing the control instruction corresponding to the control gesture comprises:

acquiring a hand part contour corresponding to the control gesture; and

acquiring and executing a control instruction associated with the hand part contour.

9 . A terminal device, comprising: a memory, a processor, and an interactive control program stored on the memory and operable on the processor, wherein when the interactive control program is executed by the processor, the steps of the interactive control method according to claim 8 is realized.

10 . A terminal device, comprising: a memory, a processor, and an interactive control program stored on the memory and operable on the processor, wherein when the interactive control program is executed by the processor, the steps of the interactive control method according to claim 1 is realized.