Method and mobile device for acquiring AR or VR information by averaging pixel values

1. A method for acquiring augmented reality (AR) information or virtual reality (VR) information that is applied to a mobile terminal, comprising:

determining a collection direction for collecting an image, and performing image collection by transmitting a radar wave along the collection direction and receiving an echo formed based on the radar wave;

determining an average value of time differences that are acquired for N consecutive times between a transmitting time of the radar wave and a receiving time of an echo at a sampling frequency greater than a sampling frequency threshold, where N is a positive integer greater than 1; determining position information of different positions of a collected object relative to the mobile terminal based on the average value; and determining spatial structure information of the collected object based on the position information; and

obtaining AR information or VR information of the collected object according to the spatial structure information and a collected image.

2. The method of claim 1 , wherein the obtaining the AR information or VR information of the collected object according to the spatial structure information and the collected image further comprises:

establishing a three-dimensional space model of the collected object according to the spatial structure information and the collected image, wherein the three-dimensional space model includes structural features of the collected object indicated by the spatial structure information and texture features of the collected object in the image collection; and

obtaining the AR information or the VR information according to the three-dimensional space model.

3. The method of claim 1 , wherein the mobile terminal is installed with two radar sensors, including a front radar sensor installed on a same side as a front camera in the mobile terminal, and a rear radar sensor installed on a same side as a rear camera in the mobile terminal.

4. The method of claim 1 , wherein a radar sensor is installed on a rotating component of the mobile terminal, and the rotating component of the mobile terminal drives the radar sensor to change a direction.

5. The method of claim 1 , further comprising:

determining a distance difference between distance information of a first position of the collected object relative to the mobile terminal and distance information of a second position adjacent to the first position relative to the mobile terminal;

in response to that the distance difference is greater than a difference threshold, determining, according to the distance difference, a first position corresponding to the distance difference, and

determining contour information of the collected object according to the first position.

6. A device for acquiring augmented reality (AR) information or virtual reality (VR) information that is applied to a mobile terminal, comprising:

a processor; and

a memory for storing instructions executable by the processor;

wherein the processor is configured to:

determine a collection direction for collecting an image, perform an image collection by transmitting a radar wave along the collection direction and receive an echo formed based on the radar wave;

determine an average value of time differences that are acquired for N consecutive times between a transmitting time of the radar wave and a receiving time of an echo at a sampling frequency greater than a sampling frequency threshold, where N is a positive integer greater than 1; determine position information of different positions of a collected object relative to the mobile terminal based on the average value; and determine spatial structure information of the collected object based on the position information; and

obtain AR information or VR information of the collected object according to the spatial structure information and the collected image.

7. The device of claim 6 , wherein the processor is further configured to:

establish a three-dimensional space model of the collected object according to the spatial structure information and the collected image, wherein the three-dimensional space model includes structural features of the collected object indicated by the spatial structure information and texture features of the collected object in the image collection; and

obtain the AR information or the VR information according to the three-dimensional space model.

8. The device of claim 6 , wherein the mobile terminal is installed with two radar sensors, including a front radar sensor installed on a same side as a front camera in the mobile terminal, and a rear radar sensor installed on a same side as a rear camera in the mobile terminal.

9. The device of claim 6 , wherein a radar sensor is installed on a rotating component of the mobile terminal, and the rotating component of the mobile terminal drives the radar sensor to change a direction.

10. The device of claim 6 , wherein the processor is further configured to:

determine a distance difference between distance information of a first position of the collected object relative to the mobile terminal and distance information of a second position adjacent to the first position relative to the mobile terminal;

in response to that the distance difference is greater than a difference threshold, determine, according to the distance difference, a first position corresponding to the distance difference, and

determine contour information of the collected object according to the first position.

11. A non-transitory computer-readable storage medium storing a computer program, the program being executed by a processor to implement a method for acquiring augmented reality (AR) information or virtual reality (VR) information that is applied to a mobile terminal, comprising:

determining a collection direction for collecting an image, and transmitting a radar wave along the collection direction and receiving an echo formed based on the radar wave during image collection;

determining an average value of time differences that are acquired for N consecutive times between a transmitting time of the radar wave and a receiving time of an echo at a sampling frequency greater than a sampling frequency threshold, where N is a positive integer greater than 1; determining position information of different positions of a collected object relative to the mobile terminal based on the average value; and determining spatial structure information of the collected object based on the position information; and

obtaining AR information or VR information of the collected object according to the spatial structure information and a collected image.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the obtaining the AR information or VR information of the collected object according to the spatial structure information and the collected image further comprises:

establishing a three-dimensional space model of the collected object according to the spatial structure information and the collected image, where the three-dimensional space model includes structural features of the collected object indicated by the spatial structure information and texture features of the collected object in the image collection; and

obtaining the AR information or the VR information according to the three-dimensional space model.

13. The non-transitory computer-readable storage medium of claim 11 , wherein the mobile terminal is installed with two radar sensors, including a front radar sensor installed on a same side as a front camera in the mobile terminal, and a rear radar sensor installed on a same side as a rear camera in the mobile terminal.

14. The non-transitory computer-readable storage medium of claim 11 , wherein a radar sensor is installed on a rotating component of the mobile terminal, and the rotating component of the mobile terminal drives the radar sensor to change a direction.

15. The non-transitory computer-readable storage medium of claim 11 , wherein the method further comprises:

determining a distance difference between distance information of a first position of the collected object relative to the mobile terminal and distance information of a second position adjacent to the first position relative to the mobile terminal;

in response to that the distance difference is greater than a difference threshold, determining, according to the distance difference, a first position corresponding to the distance difference, and

determining contour information of the collected object according to the first position.