Providing an augmented reality overlay for display over a view of a user
The present disclosure is directed toward systems and methods for generating and providing an augmented reality overlay for display in connection with an augmented reality display device. For example, systems and methods described herein identify a user being viewed through an augmented reality display device, and builds an augmented reality overlay for the user that is displayed on a view of the user through the augmented reality display device. Systems and methods described herein build the augmented reality overlay based on the location of the augmented reality display device, and on other networking system information including a networking system relationship between the user wearing the augmented reality display device and the user who is being looked at through the augmented reality display device.
1. A method comprising:
receiving an image from an augmented reality display device associated with a location of the augmented reality display device and depicting a networking system co-user;
generating an augmented reality overlay for the networking system co-user by:
identifying a plurality of augmented reality elements that correspond to the location of the augmented reality display device,
determining, based on information associated with the networking system co-user, a score for each of the plurality of augmented reality elements,
generating a graphical mesh representing a 3-dimensional shape of the networking system co-user,
determining one or more constraints associated with the graphical mesh representing the 3-dimensional shape of the networking system co-user, and
applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh; and
providing the generated augmented reality overlay to the augmented reality display device.
2. The method as recited in claim 1 , further comprising
determining the location of the augmented reality display device.
3. The method as recited in claim 2 , wherein identifying the plurality of augmented reality elements that correspond to the location of the augmented reality display device comprises identifying augmented reality elements associated with one or more of a GPS location of the augmented reality display device, WiFi information associated with the augmented reality display device, networking system information associated with the augmented reality display device, or image analysis information associated with the received image.
4. The method as recited in claim 2 , wherein identifying the plurality of augmented reality elements that correspond to the location of the augmented reality display device is based on one or more of Internet lookups associated with the location of the augmented reality display device or database searches associated with the location of the augmented reality display device.
5. The method as recited in claim 2 , wherein determining the score for each of the plurality of augmented reality elements comprises, for each of the plurality of augmented reality elements, calculating the score based on one or more of user preferences associated with a user of the augmented reality display device, networking system information associated with the user of the augmented reality display device, and a networking system relationship coefficient between the user of the augmented reality display device and the networking system co-user.
6. The method as recited in claim 1 , wherein generating a graphical mesh representing the 3-dimensional shape of the networking system co-user comprises:
scanning the received image to determine a 2-dimensional shape associated with the networking system co-user;
generating a point cloud of data from the data from networking system co-user's 2-dimensional shape; and
generating, based on the point cloud, the graphical mesh representing the 3-dimensional shape of the networking system co-user.
7. The method as recited in claim 1 , wherein applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh comprises:
identifying a subset of the plurality of augmented reality elements with scores above a threshold amount;
and
applying the subset of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh.
8. The method as recited in claim 7 , further comprising:
identifying one or more reality-based constraints; and
wherein applying the subset of the plurality of augmented reality elements to the graphical mesh is further according to the one or more reality-based constraints.
9. A system comprising:
at least one processor; and
at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to:
receive an image from an augmented reality display device associated with a location of the augmented reality display device and depicting a networking system co-user;
generate an augmented reality overlay for the networking system co-user by:
identifying a plurality of augmented reality elements that correspond to the location of the augmented reality display device,
determining, based on information associated with the networking system co-user, a score for each of the plurality of augmented reality elements,
generating a graphical mesh representing a 3-dimensional shape of the networking system co-user,
determining one or more constraints associated with the graphical mesh representing the 3-dimensional shape of the networking system co-user, and
applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh; and
provide the generated augmented reality overlay to the augmented reality display device.
10. The system as recited in claim 9 , further comprising
determining the location of the augmented reality display device.
11. The system as recited in claim 10 , wherein identifying the plurality of augmented reality elements that correspond to the location of the augmented reality display device comprises identifying augmented reality elements associated with one or more of a GPS location of the augmented reality display device, WiFi information associated with the augmented reality display device, networking system information associated with the augmented reality display device, or image analysis information associated with the received image.
12. The system as recited in claim 11 , wherein identifying the plurality of augmented reality elements that correspond to the location of the augmented reality display device is based on one or more of Internet lookups associated with the location of the augmented reality display device or database searches associated with the location of the augmented reality display device.
13. The system as recited in claim 12 , wherein determining the score for each of the plurality of augmented reality elements comprises, for each of the plurality of augmented reality elements, calculating the score based on one or more of user preferences associated with a user of the augmented reality display device, networking system information associated with the user of the augmented reality display device, and a networking system relationship coefficient between the user of the augmented reality display device and the networking system co-user.
14. The system as recited in claim 13 , wherein generating a graphical mesh representing the 3-dimensional shape of the networking system co-user comprises:
scanning the received image to determine a 2-dimensional shape associated with the networking system co-user;
generating a point cloud of data from the data from networking system co-user's 2-dimensional shape; and
generating, based on the point cloud, the graphical mesh representing the 3-dimensional shape of the networking system co-user.
15. The system as recited in claim 14 , wherein applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh comprises:
identifying a subset of the plurality of augmented reality elements with scores above a threshold amount;
and
applying of the subset of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh.
16. The system as recited in claim 15 , further comprising:
identifying one or more reality-based constraints; and
wherein applying the subset of the plurality of augmented reality elements to the graphical mesh is further according to the one or more reality-based constraints.
17. A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computer system to:
receive an image from an augmented reality display device associated with a location of the augmented reality display device and depicting a networking system co-user;
generate an augmented reality overlay for the networking system co-user by:
identifying a plurality of augmented reality elements that correspond to the location of the augmented reality display device,
determining, based on information associated with the networking system co-user, a score for each of the plurality of augmented reality elements,
generating a graphical mesh representing a 3-dimensional shape of the networking system co-user,
determining one or more constraints associated with the graphical mesh representing the 3-dimensional shape of the networking system co-user, and
applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh; and
provide the generated augmented reality overlay to the augmented reality display device.
18. The non-transitory computer-readable medium as recited in claim 17 , further comprising
determining the location of the augmented reality display device.
19. The non-transitory computer-readable medium as recited in claim 18 , wherein generating a graphical mesh representing the 3-dimensional shape of the networking system co-user comprises:
scanning the received image to determine a 2-dimensional shape associated with the networking system co-user;
generating a point cloud of data from the data from networking system co-user's 2-dimensional shape; and
generating, based on the point cloud, the graphical mesh representing the 3-dimensional shape of the networking system co-user.
20. The non-transitory computer-readable medium as recited in claim 19 , wherein applying one or more highest scoring of the plurality of augmented reality elements to the graphical mesh comprises:
identifying a subset of the plurality of augmented reality elements with scores above a threshold amount;
and
applying the subset of the plurality of augmented reality elements to the graphical mesh according to the one or more constraints associated with the graphical mesh.