Multi-modality localization of users
Systems and methods providing for determining physical location of a device of a user of an augmented reality environment corresponding to a physical space. The systems and methods involve requesting and receiving a list of participating users having a GPS location within a predetermined radius of a first device; sending advertising and scanning beacons, via a first wireless network, to generate a second list of devices present in the physical space; performing simultaneous localization and mapping (SLAM) using the participating devices of the second list; generating a third list based at least partly on a Bluetooth connection between the one or more participating devices of the second list; and identifying the participating devices of the third list.
1. A method of determining physical location of a device of a user of an augmented reality environment corresponding to a physical space, the method comprising:
sending to a database, a query, comprising a request for participating users having a GPS location within a predetermined radius of a first device of a first user of the augmented reality environment;
receiving from the database, a response comprising a first list of participating devices having GPS locations within the predetermined radius;
sending, via a first wireless network, advertising beacons from the participating devices;
sending, via the first wireless network, scanning beacons from the participating devices;
generating, based at least partly on the advertising and scanning beacons, a second list, wherein the second list comprises participating devices present in the physical space;
performing simultaneous localization and mapping (SLAM) using the participating devices of the second list;
generating, based at least partly on a Bluetooth connection between one or more participating devices of the second list, a third list, wherein the third list comprises participating devices of the second list determined to be within a predetermined distance of one another;
identifying the participating devices of the third list;
generating an augmented reality representation of the physical space on one or more participating devices; and
visually identifying the identified participating devices of the third list in the augmented reality representation.
2. The method of claim 1 , wherein SLAM comprises:
receiving three-dimensional maps of the physical space from the participating devices; and
merging the three-dimensional maps into a merged map of the physical space.
3. The method of claim 1 , further comprising:
receiving three-dimensional maps of the physical space from the participating devices of the second list; and
generating a submap of the physical space, comprising the three-dimensional maps of the physical space received from the participating devices of the second list.
4. The method of claim 1 , wherein the augmented reality representation comprises a three-dimensional map of the physical space generated, at least in part by performing SLAM using the participating devices of the second list.
5. The method of claim 1 , wherein the representation comprises video image frames.
6. The method of claim 1 , further comprising locating the identified participants in one or more three-dimensional maps of the physical space, generated by the participating devices of the second and/or third list.
7. The method of claim 1 , further comprising: receiving device identifiers in response to the advertising and scanning beacons, wherein generating the second list comprises removing participating devices of the first list whose device identifiers are not received.
8. The method of claim 1 , wherein performing SLAM is divided between the participating devices of the third list.
9. The method of claim 1 , wherein generating the third list comprises identifying the participating devices able to form a Bluetooth connection with one another.
10. A non-transitory computer-readable medium for determining physical location of a device of a user of an augmented reality environment corresponding to a physical space, the non-transitory computer readable medium comprising instructions for:
sending to a database, a query, comprising a request for participating users having a GPS location within a predetermined radius of a first device of a first user of the augmented reality environment;
receiving from the database, a response comprising a first list of participating devices having GPS locations within the predetermined radius;
sending, via a first wireless network, advertising beacons from the participating devices;
sending, via the first wireless network, scanning beacons from the participating devices;
generating, based at least partly on the advertising and scanning beacons, a second list, wherein the second list comprises participating devices present in the physical space;
performing simultaneous localization and mapping (SLAM) using the participating devices of the second list;
generating, based at least partly on a Bluetooth connection between one or more participating devices of the second list, a third list, wherein the third list comprises participating devices of the second list determined to be within a predetermined distance of one another;
identifying the participating devices of the third list;
generating an augmented reality representation of the physical space on one or more participating devices; and
visually identifying the identified participating devices of the third list in the augmented reality representation.
11. The non-transitory computer readable medium of claim 10 , wherein SLAM comprises:
receiving three-dimensional maps of the physical space from the participating devices; and
merging the three-dimensional maps into a merged map of the physical space.
12. The non-transitory computer readable medium of claim 10 , further comprising instructions for:
receiving three-dimensional maps of the physical space from the participating devices of the second list; and
generating a submap of the physical space, comprising the three-dimensional maps of the physical space received from the participating devices of the second list.
13. The non-transitory computer readable medium of claim 10 , wherein the augmented reality representation comprises a three-dimensional map of the physical space generated, at least in part by performing SLAM using the participating devices of the second list.
14. The non-transitory computer readable medium of claim 10 , wherein the representation comprises video image frames.
15. The non-transitory computer readable medium of claim 10 , further comprising instructions for: locating the identified participants in one or more three-dimensional maps of the physical space, generated by the participating devices of the second and/or third list.
16. The non-transitory computer readable medium of claim 10 , further comprising instructions for: receiving device identifiers in response to the advertising and scanning beacons, wherein generating the second list comprises removing participating devices of the first list whose device identifiers are not received.
17. The non-transitory computer readable medium of claim 10 , wherein performing SLAM is divided between the participating devices of the third list.
18. The non-transitory computer readable medium of claim 10 , wherein generating the third list comprises identifying the participating devices able to form a Bluetooth connection with one another.