Augment reality techniques for controlling smart devices

1. A device control method, applied to a terminal provided with a camera, comprising:

acquiring an AR anchor in an image captured by the camera, wherein the AR anchor is created in advance according to a spatial location of a target device by: acquiring multiple spatial feature points via the camera, determining the spatial location of the target device according to a display location and a positional relationship among the multiple spatial feature points;

determining the target device bound to the spatial location anchored by the AR anchor;

displaying a control menu of the target device;

generating a control instruction in response to an operation on the control menu, and controlling the target device according to the control instruction.

2. The method of claim 1 , wherein the acquiring an AR anchor in the image captured by the camera comprises:

performing AR anchor recognition on the image captured by the camera;

acquiring anchor identification information of the AR anchor in a case that the AR anchor is recognized from the image captured by the camera;

wherein determining the target device bound to the spatial location anchored by the AR anchor comprises:

determining the target device bound to the spatial location anchored by the AR anchor according to the anchor identification information of the AR anchor, and a corresponding relationship between pre-stored anchor identification information and target device identification information.

3. The method of claim 2 , wherein, in a case that the AR anchor is recognized from the image captured by the camera, the method further comprises:

determining whether the target device corresponding to the AR anchor exists in the image;

issuing a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

4. The method of claim 2 , wherein after controlling the target device according to the control instruction, the method comprises:

determining whether the target device corresponding to the AR anchor exists in the image in a case that a control response of the target device is not received within a preset time period;

issuing a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

5. The method of claim 1 , wherein the AR anchor is created by:

acquiring the spatial location of the target device through the camera, and acquiring a display location of the image of the target device in a preview interface of the terminal;

creating the AR anchor corresponding to the target device according to the spatial location and the display location;

generating anchor identification information according to the AR anchor, binding the anchor identification information and device identification information to acquire a binding relationship, and sending the binding relationship to a server for storage, wherein the server stores a corresponding relationship between the device identification information of the target device and a control menu of the target device.

6. The method of claim 5 , wherein acquiring the spatial location of the target device through the camera comprises:

performing spatial feature recognition through the camera to acquire of the multiple spatial feature points;

wherein creating the AR anchor corresponding to the target device according to the spatial location and the display location comprises:

creating the AR anchor according to a positional relationship between a target display location and the multiple spatial feature points.

7. The method of claim 1 , wherein displaying the control menu of the target device comprises at least one of:

displaying the control menu of the target device within a preset range of the position according to a location of the AR anchor in the image; and

displaying the control menu of the target device corresponding to the AR anchor closest to a user according to a distance of each AR anchor relative to the user in a case that there are a plurality of AR anchors.

8. A device control apparatus, applied to a terminal provided with a camera, comprising:

one or more processors;

a memory storing instructions executable by the one or more processors;

wherein the one or more processors are configured to:

acquire an AR anchor in an image captured by the camera, wherein the AR anchor is created in advance according to a spatial location of a target device by: acquiring multiple spatial feature points via the camera, determining the spatial location of the target device according to a display location and a positional relationship among the multiple spatial feature points;

determine the target device bound to the spatial location anchored by the AR anchor;

display a control menu of the target device;

generate a control instruction in response to an operation on the control menu, and control the target device according to the control instruction.

9. The apparatus of claim 8 , wherein the one or more processors are configured to:

perform AR anchor recognition on the image captured by the camera;

acquire anchor identification information of the AR anchor in a case that the AR anchor is recognized from the image captured by the camera;

determine the target device bound to the spatial location anchored by the AR anchor according to the anchor identification information of the AR anchor, and a corresponding relationship between pre-stored anchor identification information and target device identification information.

10. The apparatus of claim 8 , wherein the one or more processors are configured to:

determine whether a target device corresponding to the AR anchor exists in the image; and

to issue a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

11. The apparatus of claim 8 , wherein the one or more processors are configured to:

determine whether the target device corresponding to the AR anchor exists in the image in a case that a control response of the target device is not received within a preset time period;

issue a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

12. The apparatus of claim 8 , wherein the one or more processors are configured to:

acquire the spatial location of the target device through the camera, and acquire a display location of the image of the target device in a preview interface of the terminal; create the AR anchor corresponding to the target device according to the spatial location and the display location; and generate anchor identification information according to the AR anchor, bind the anchor identification information and device identification information to acquire a binding relationship, and send the binding relationship to a server for storage, wherein the server stores a corresponding relationship between the device identification information of the target device and a control menu of the target device.

13. The apparatus of claim 12 , wherein the one or more processors are configured to:

perform spatial feature recognition through the camera to acquire the multiple spatial feature points;

create the AR anchor according to a positional relationship between a target display location and the multiple spatial feature points.

14. The apparatus of claim 8 , wherein the one or more processors are configured to:

display the control menu of the target device within a preset range of the position according to a location of the AR anchor in the image; and/or

display the control menu of the target device corresponding to the AR anchor closest to a user according to a distance of each AR anchor relative to the user in a case that there are a plurality of AR anchors.

15. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor, causes the processor to perform a device control method, wherein the method is applied to a terminal provided with a camera and comprises:

acquiring an AR anchor in an image captured by the camera, wherein the AR anchor is created in advance according to a spatial location of a target device by: acquiring multiple spatial feature points via the camera, determining the spatial location of the target device according to a display location and a positional relationship among the multiple spatial feature points;

determining the target device bound to the spatial location anchored by the AR anchor;

displaying a control menu of the target device;

generating a control instruction in response to an operation on the control menu, and controlling the target device according to the control instruction.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the acquiring an AR anchor in the image captured by the camera comprises:

performing AR anchor recognition on the image captured by the camera;

acquiring anchor identification information of the AR anchor in a case that the AR anchor is recognized from the image captured by the camera;

wherein determining the target device bound to the spatial location anchored by the AR anchor comprises:

determining the target device bound to the spatial location anchored by the AR anchor according to the anchor identification information of the AR anchor, and a corresponding relationship between pre-stored anchor identification information and target device identification information.

17. The non-transitory computer-readable storage medium of claim 16 , wherein, in a case that the AR anchor is recognized from the image captured by the camera, the method further comprises:

determining whether a target device corresponding to the AR anchor exists in the image;

issuing a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

18. The non-transitory computer-readable storage medium of claim 16 , wherein after controlling the target device according to the control instruction, the method comprises:

determining whether the target device corresponding to the AR anchor exists in the image in a case that a control response of the target device is not received within a preset time period;

issuing a reminder message for reminding a user to delete the AR anchor or update the AR anchor of the target device in a case that the target device corresponding to the AR anchor does not exist in the image.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the AR anchor is created by:

acquiring the spatial location of the target device through the camera, and acquiring a display location of the image of the target device in a preview interface of the terminal;

creating the AR anchor corresponding to the target device according to the spatial location and the display location;

generating anchor identification information according to the AR anchor, binding the anchor identification information and device identification information to acquire a binding relationship, and sending the binding relationship to a server for storage, wherein the server stores a corresponding relationship between the device identification information of the target device and a control menu of the target device.

20. The non-transitory computer-readable storage medium of claim 19 , wherein acquiring the spatial location of the target device through the camera comprises:

performing spatial feature recognition through the camera to acquire of the multiple spatial feature points;

wherein creating the AR anchor corresponding to the target device according to the spatial location and the display location comprises:

creating the AR anchor according to a positional relationship between a target display location and the multiple spatial feature points.