Positioning and beam alignment based on optical sensing
Techniques for using optical sensing by wireless network nodes to assist with positioning of user equipment (UE) are provided. In some embodiments, such techniques may include sending first configuration information to the UE, the first configuration information indicative of how optical sensory data is to be obtained with the UE; receiving the optical sensory data from the UE; and based at least on the optical sensory data received from the UE, determining angular information regarding wireless transmissions between at least one wireless network node and the UE.
1. A method of assisting positioning of a user equipment (UE), the method comprising:
sending first configuration information to the UE, the first configuration information indicative of how optical sensory data is to be obtained with the UE;
sending second configuration information to at least one wireless network node, the second configuration information indicative of how optical sensory data is to be obtained with the at least one wireless network node;
receiving optical sensory data from the UE;
receiving optical sensory data from the at least one wireless network node; and
based at least on the optical sensory data received from the UE and the optical sensory data received from the at least one wireless network node, determining angular information regarding wireless transmissions between the at least one wireless network node and the UE.
2. The method of claim 1 , further comprising determining an expected positioning metric based at least on the angular information regarding wireless transmissions between the at least one wireless network node and the UE.
3. The method of claim 2 , wherein:
the expected positioning metric comprises an uplink angle of arrival (AoA) expected from the UE, or a downlink AoA expected from the at least one wireless network node; and
the method further comprises sending the uplink AoA to the at least one wireless network node, the uplink AoA configured to be used with positioning or beamforming with the UE; or sending the downlink AoA to the UE, the downlink AoA configured to be used with positioning or beamforming with the UE.
4. The method of claim 2 , further comprising selecting a subset of transmit beams or a subset of receive beams of the at least one wireless network node and the UE based on the expected positioning metric.
5. The method of claim 1 , further comprising receiving a request for assistance data from the UE, wherein the sending of the first configuration information is responsive to the request for assistance data.
6. The method of claim 1 , wherein the optical sensory data received from the UE comprises first visual information sensed by an image-capturing device associated with the UE, and the optical sensory data received from the at least one wireless network comprises second visual information sensed by an image-capturing device associated with the at least one wireless network node.
7. The method of claim 6 , wherein the determining of the angular information regarding wireless transmissions between the at least one wireless network node and the UE comprises:
based on one or more keypoints of the first visual information and one or more keypoints of the second visual information, determining relative orientations between the image-capturing device associated with the at least one wireless network node, and the image-capturing device associated with the UE; and
based on the relative orientations, determining a vector between the at least one wireless network node and the UE, wherein the angular information is determined based on the vector.
8. The method of claim 7 , wherein:
the first configuration information comprises a method for detecting the one or more keypoints of the first visual information, a feature descriptor for the one or more keypoints of the first visual information, a quantity of the one or more keypoints of the first visual information, a first parameter associated with the image-capturing device associated with the UE, or a combination thereof; and
the second configuration information comprises a method for detecting the one or more keypoints of the second visual information, a feature descriptor for the one or more keypoints of the second visual information, a quantity of the one or more keypoints of the second visual information, a second parameter associated with the image-capturing device associated with the at least one wireless network node, or a combination thereof.
9. The method of claim 8 , wherein:
the first parameter comprises an indication of whether one or more parameters of the image-capturing device associated with the UE are static or dynamic;
the second parameter comprises an indication of whether one or more parameters of the image-capturing device associated with the at least one wireless network node are static or dynamic; and
the determining of the relative orientations is further based on the first and second parameters.
10. The method of claim 7 , wherein:
the first configuration information comprises a request to associate the one or more keypoints of the first visual information with a first classification, and the second configuration information comprises a request to associate pixels within the one or more keypoints of the second visual information with a second classification; and
the determining of the relative orientations is further based on the first and second classifications.
11. The method of claim 6 , wherein:
the first configuration information further comprises a first time interval for sensing the first visual information;
the second configuration information further comprises a second time interval for sensing the second visual information; and
the second time interval is shorter than the first time interval.
12. The method of claim 1 , further comprising
receiving subsequent optical sensory data from the UE but not from the at least one wireless network node; and
determining subsequent angular information regarding wireless transmissions between the at least one wireless network node and the UE based on the optical sensory data received from the at least one wireless network node and the subsequent optical sensory data from the UE.
13. An apparatus of a wireless communication network, the apparatus comprising:
one or more network interfaces;
memory; and
one or more processors communicatively coupled to the one or more network interfaces and the memory, and configured to:
send first configuration information to a user equipment (UE), the first configuration information indicative of how optical sensory data is to be obtained with the UE;
send second configuration information to at least one wireless network node, the second configuration information indicative of how optical sensory data is to be obtained with the at least one wireless network node;
receive optical sensory data from the UE;
receive optical sensory data from the at least one wireless network node; and
based at least on the optical sensory data received from the UE and the optical sensory data received from the at least one wireless network node, determine angular information regarding wireless transmissions between the at least one wireless network node and the UE.
14. The apparatus of claim 13 , wherein the one or more processors are further configured to determine an expected positioning metric based at least on the angular information regarding wireless transmissions between the at least one wireless network node and the UE;
wherein:
the expected positioning metric comprises an uplink angle of arrival (AoA) expected from the UE, or a downlink AoA expected from the at least one wireless network node; and
the one or more processors are further configured to send the uplink AoA to the at least one wireless network node, the uplink AoA configured to be used with positioning or beamforming with the UE; or send the downlink AoA to the UE, the downlink AoA configured to be used with positioning or beamforming with the UE.
15. The apparatus of claim 13 , wherein:
the optical sensory data received from the UE comprises first visual information sensed by an image-capturing device associated with the UE, and the optical sensory data received from the at least one wireless network comprises second visual information sensed by an image-capturing device associated with the at least one wireless network node; and
wherein, to determine the angular information regarding wireless transmissions between the at least one wireless network node and the UE, the one or more processors are further configured to:
determine, based on one or more keypoints of the first visual information and one or more keypoints of the second visual information, relative orientations between the image-capturing device associated with the at least one wireless network node and the image-capturing device associated with the UE; and
determine, based on the relative orientations, a vector between the at least one wireless network node and the UE; and
determine the angular information determined based on the vector.
16. The apparatus of claim 15 , wherein:
the first configuration information comprises a method for detecting the one or more keypoints of the first visual information, a feature descriptor for the one or more keypoints of the first visual information, a quantity of the one or more keypoints of the first visual information, a first parameter associated with the image-capturing device associated with the UE, or a combination thereof; and
the second configuration information comprises a method for detecting the one or more keypoints of the second visual information, a feature descriptor for the one or more keypoints of the second visual information, a quantity of the one or more keypoints of the second visual information, a second parameter associated with the image-capturing device associated with the at least one wireless network node, or a combination thereof.
17. The apparatus of claim 13 , the one or more processors are further configured to:
determine an expected positioning metric based at least on the angular information regarding wireless transmissions between the at least one wireless network node and the UE; and
select a subset of transmit beams or a subset of receive beams of the at least one wireless network node and the UE based on the expected positioning metric.
18. The apparatus of claim 13 , the one or more processors are further configured to receive a request for assistance data from the UE, and send the first configuration information in response to the request for assistance data.
19. An apparatus comprising:
means for sending first configuration information to a user equipment (UE), the first configuration information indicative of how optical sensory data is to be obtained with the UE;
means for sending second configuration information to at least one wireless network node, the second configuration information indicative of how optical sensory data is to be obtained with the at least one wireless network node;
means for receiving optical sensory data from the UE;
means for receiving optical sensory data from the at least one wireless network node; and
means for, based at least on the optical sensory data received from the UE and the optical sensory data received from the at least one wireless network node, determining angular information regarding wireless transmissions between the at least one wireless network node and the UE.
20. The apparatus of claim 19 , further comprising:
means for determining an uplink angle of arrival (AoA) expected from the UE, or a downlink AoA expected from the at least one wireless network node, based at least on the angular information regarding wireless transmissions between the at least one wireless network node and the UE; and
means for sending the uplink AoA to the at least one wireless network node, the uplink AoA configured to be used with positioning or beamforming with the UE; or sending the downlink AoA to the UE, the downlink AoA configured to be used with positioning or beamforming with the UE.
21. The apparatus of claim 19 , wherein the optical sensory data received from the UE comprises first visual information sensed by an image-capturing device associated with the UE, and the optical sensory data received from the at least one wireless network comprises second visual information sensed by an image-capturing device associated with the at least one wireless network node.
22. The apparatus of claim 21 , wherein the means for determining the angular information regarding wireless transmissions between the at least one wireless network node and the UE comprise:
means for, based on one or more keypoints of the first visual information and one or more keypoints of the second visual information, determining relative orientations between the image-capturing device associated with the at least one wireless network node, and the image-capturing device associated with the UE; and
means for, based on the relative orientations, determining a vector between the at least one wireless network node and the UE, wherein the angular information is determined based on the vector.
23. A non-transitory computer-readable apparatus comprising a storage medium, the storage medium comprising a plurality of instructions configured to, when executed by one or more processors, cause an apparatus to:
send first configuration information to a user equipment (UE), the first configuration information indicative of how optical sensory data is to be obtained with the UE;
send second configuration information to at least one wireless network node, the second configuration information indicative of how optical sensory data is to be obtained with the at least one wireless network node;
receive optical sensory data from the UE;
receive optical sensory data from the at least one wireless network node; and
based at least on the optical sensory data received from the UE and the optical sensory data received from the at least one wireless network node, determine angular information regarding wireless transmissions between the at least one wireless network node and the UE.
24. The non-transitory computer-readable apparatus of claim 23 , wherein the plurality of instructions are further configured to, when executed by the one or more processors, cause the apparatus to:
determine an uplink angle of arrival (AoA) expected from the UE, or a downlink AoA expected from the at least one wireless network node, based at least on the angular information regarding wireless transmissions between the at least one wireless network node and the UE; and
send the uplink AoA to the at least one wireless network node, the uplink AoA configured to be used with positioning or beamforming with the UE; or sending the downlink AoA to the UE, the downlink AoA configured to be used with positioning or beamforming with the UE.
25. The non-transitory computer-readable apparatus of claim 23 , wherein the optical sensory data received from the UE comprises first visual information sensed by an image-capturing device associated with the UE, and the optical sensory data received from the at least one wireless network comprises second visual information sensed by an image-capturing device associated with the at least one wireless network node.
26. The non-transitory computer-readable apparatus of claim 25 , wherein the determination of the angular information regarding wireless transmissions between the at least one wireless network node and the UE comprises:
based on one or more keypoints of the first visual information and one or more keypoints of the second visual information, determination of relative orientations between the image-capturing device associated with the at least one wireless network node, and the image-capturing device associated with the UE; and
based on the relative orientations, determination of a vector between the at least one wireless network node and the UE, wherein the angular information is determined based on the vector.