In-vehicle mid-air gesture-based interaction method, electronic apparatus, and system

1 . An in-vehicle mid-air gesture-based interaction method comprising:

obtaining a first mid-air gesture initiated by a first user that is detected by a camera;

obtaining a second mid-air gesture initiated by a second user that is detected by the camera; and

starting a first response operation, corresponding to the first mid-air gesture, in accordance with the first response operation matching the first user,

wherein the starting is performed after the obtaining the first mid-air gesture and the obtaining the second mid-air gesture, and

wherein the starting the first response operation in accordance with the first response operation matching the first user includes determining, in accordance with a duration between an initiation time of the second mid-air gesture and an initiation time of the first mid-air gesture being less than a first preset threshold, a user permission of the first user is higher than a user permission of the second user.

2 . The method according to claim 1 , wherein before the starting, the first response operation, the method further comprises:

obtaining a response attribute of the first response operation corresponding to the first mid-air gesture;

obtaining a user attribute of the first user; and

determining, based on the response attribute of the first response operation and the user attribute of the first user, the first response operation matches the first user,

wherein the response attribute comprises one or more of the group consisting of:

a response type,

a response level,

a response priority, and

a response location, and

wherein the user attribute of the first user comprises one or more of the group consisting of: a user identity, a user location, and a user permission.

3 . The method according to claim 2 , wherein the obtaining a user attribute of the first user comprises:

determining a user location of the first user based on a picture that corresponds to the first mid-air gesture and that is detected by the camera; and

determining the user identity of the first user based on the user location of the first user.

4 . The method according to claim 2 , wherein in accordance with the response attribute of the first response operation being a driving operation and the user identity being a driver, the first response operation is determined to be matching the first user.

5 . The method according to claim 2 , wherein the obtaining a user attribute of the first user comprises:

determining a user location of the first user based on a picture that corresponds to the first mid-air gesture and that is detected by the camera; and

wherein the starting the first response operation comprises:

starting, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user, the first response operation based on the user location of the first user in response to the first mid-air gesture.

6 . The method according to claim 5 , wherein the starting the first response operation based on the user location of the first user in response to the first mid-air gesture comprises:

starting, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user who initiates the first mid-air gesture, the first response operation in a region corresponding to the user location of the first user in response to the first mid-air gesture.

7 . The method according to claim 5 , wherein before the starting the first response operation in response to the first mid-air gesture, the method further comprises:

displaying a first display interface on a first display in a vehicle; and

wherein the starting the first response operation based on the user location of the first user in response to the first mid-air gesture specifically comprises:

displaying, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user and the first display not being a display in front of the first user, a first display interface on a second display in the vehicle in response to the first mid-air gesture, and

moving an indication icon on the first display interface based on a moving trajectory of the first mid-air gesture in a preset direction.

8 . The method according to claim 1 , wherein the starting the first response operation in response to the first mid-air gesture comprises:

starting, in accordance with a user permission threshold required for the first response operation corresponding to the first mid-air gesture being less than or equal to the user permission of the first user, the first response operation in response to the first mid-air gesture.

9 . The method according to claim 8 , wherein a control permission of the driver is higher than a control permission of another passenger.

10 . The method according to claim 1 , wherein before the starting the first response operation in response to the first mid-air gesture, the method further comprises:

displaying, in accordance with a distance between a location of the first mid-air gesture and the camera-is being greater than a second preset threshold, a prompt message on a display in the vehicle, wherein the prompt message is used to prompt the first user to initiate a mid-air gesture to another camera.

11 . The method according to claim 1 , wherein before the starting the first response operation in response to the first mid-air gesture, the method further comprises:

displaying, in accordance with a projection ratio of the first mid-air gesture relative to a reference plane of a first camera is less than a third preset threshold, a prompt message on a display in the vehicle, wherein the prompt message is used to prompt the first user to initiate a mid-air gesture to another camera.

12 . An electronic apparatus, comprising:

an interface circuit; and

a processor,

wherein the interface circuit is configured to carry out:

obtaining a first mid-air gesture initiated by a first user that is detected by a camera; and

obtaining a second mid-air gesture initiated by a second user that is detected by the camera; and

wherein the processor is configured to carry out:

starting a first response operation, corresponding to the first mid-air gesture, in accordance with the first response operation matching the first user,

wherein the starting is performed after the obtaining the first mid-air gesture and the obtaining the second mid-air gesture, and

wherein the starting the first response operation in accordance with the first response operation matching the first user includes determining, in accordance with a duration between an initiation time of the second mid-air gesture and an initiation time of the first mid-air gesture being less than a first preset threshold, a user permission of the first user is higher than a user permission of the second user.

13 . The electronic apparatus according to claim 12 , wherein before the starting the first response operation, the interface circuit is further configured to carry out:

obtaining a response attribute of the first response operation corresponding to the first mid-air gesture;

obtaining a user attribute of the first user; and

wherein the processor is further configured to carry out:

determining, based on the response attribute of the first response operation and the user attribute of the first user, the first response operation matches the first user,

wherein the response attribute comprises one or more of the group consisting of:

a response type,

a response level,

a response priority, and

a response location; and

wherein the user attribute of the first user comprises one or more of the group consisting of:

a user identity,

a user location, and

a user permission.

14 . The electronic apparatus according to claim 13 , wherein the obtaining a user attribute of the first user comprises:

determining a user location of the first user based on a picture that corresponds to the first mid-air gesture and that is detected by the camera; and

determining the user identity of the first user based on the user location of the first user.

15 . The electronic apparatus according to claim 13 , wherein in accordance with the response attribute of the first response operation is being a driving operation and the user identity being a driver, the first response operation is determined to be matching the first user.

16 . The electronic apparatus according to claim 13 , wherein the obtaining a user attribute of the first user comprises:

determining a user location of the first user based on a picture that corresponds to the first mid-air gesture and that is detected by the camera; and

wherein the starting the first response operation comprises:

starting, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user, the first response operation based on the user location of the first user in response to the first mid-air gesture.

17 . The electronic apparatus according to claim 16 , wherein the starting the first response operation based on the user location of the first user in response to the first mid-air gesture comprises:

starting, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user who initiates the first mid-air gesture, the first response operation in a region corresponding to the user location of the first user in response to the first mid-air gesture.

18 . The electronic apparatus according to claim 16 , wherein the starting processor is further configured to carry out:

displaying a first display interface on a first display in a vehicle; and

wherein the starting the first response operation based on the user location of the first user in response to the first mid-air gesture comprises:

displaying, in accordance with the first response operation corresponding to the first mid-air gesture matching the first user and the first display not being a display in front of the first user, a first display interface on a second display in the vehicle in response to the first mid-air gesture, and

moving an indication icon on the first display interface based on a moving trajectory of the first mid-air gesture in a preset direction.