Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device
Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.
1. A method comprising:
receiving, by a computing device from a head-mounted display device (HMDD), information that identifies a surface of at least one object in a user space;
determining, by the computing device, a classification of video content being presented on a display system of the HMDD;
selecting, by the computing device based on the classification, a plurality of image themes, each image theme of the plurality of image themes comprising one or more image textures;
sending, to the HMDD, a plurality of image theme identifiers, each image theme identifier corresponding to one of the plurality of image themes;
receiving, from the HMDD, a selected image theme identifier; and
sending, to the HMDD, at least one image texture of the image theme identified by the selected image theme identifier for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD concurrent with and adjacent to the video content.
2. The method of claim 1 further comprising:
streaming, by the computing device, the video content to the HMDD; and
wherein determining the classification of the video content being presented on the display system of the HMDD comprises accessing metadata associated with the video content that identifies the classification of the video content.
3. The method of claim 1 wherein determining the classification of the video content being presented on the display system of the HMDD comprises:
receiving, by the computing device from the HMDD, a portion of the video content; and
determining, by the computing device, the classification of the video content based on the portion of the video content.
4. The method of claim 3 wherein determining the classification of the video content based on the portion of the video content further comprises analyzing, by a machine learning algorithm trained to classify video content, the portion of the video content and outputting, by the machine learning algorithm, the classification of the video content.
5. The method of claim 1 wherein selecting, based on the classification, the plurality of image themes further comprises:
accessing user profile information associated with a user of the HMDD; and
selecting the plurality of image themes based on the classification and the user profile information.
6. The method of claim 1 further comprising:
sending, by the computing device to the HMDD, a request for a portion of the video content; and
receiving, by the computing device from the HMDD, the portion of the video content.
7. The method of claim 6 wherein the request identifies an amount of time that the portion of the video content is to span.
8. A computing device, comprising:
a memory; and
a processor device coupled to the memory configured to:
receive, from a head-mounted display device (HMDD), information that identifies a surface of at least one object in a user space;
determine a classification of video content being presented on a display system of the HMDD;
select, based on the classification, a plurality of image themes, each image theme of the plurality of image themes comprising one or more image textures;
send, to the HMDD, a plurality of image theme identifiers, each image theme identifier corresponding to one of the plurality of image themes;
receive, from the HMDD, a selected image theme identifier; and
send, to the HMDD, at least one image texture of the image theme identified by the selected image theme identifier for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD concurrent with and adjacent to the video content.
9. The computing device of claim 8 , wherein the processor device is further configured to:
stream the video content to the HMDD; and
wherein to determine the classification of the video content being presented on the display system of the HMDD, the processor device is further configured to access metadata associated with the video content that identifies the classification of the video content.
10. The computing device of claim 8 wherein, to determine the classification of the video content being presented on the display system of the HMDD, the processor device is further configured to:
receive, from the HMDD, a portion of the video content; and
determine the classification of the video content based on the portion of the video content.
11. The computing device of claim 10 wherein to determine the classification of the video content based on the portion of the video content, the processor device is further configured to analyze, by a machine learning algorithm trained to classify video content, the portion of the video content and outputting, by the machine learning algorithm, the classification of the video content.
12. The computing device of claim 8 wherein to select, based on the classification, the plurality of image themes, the processor device is further configured to:
access user profile information associated with a user of the HMDD; and
select the plurality of image themes based on the classification and the user profile information.
13. The computing device of claim 8 wherein the processor device is further configured to:
send, to the HMDD, a request for a portion of the video content; and
receive, from the HMDD, the portion of the video content.
14. The computing device of claim 13 wherein the request identifies an amount of time that the portion of the video content is to span.
15. A non-transitory computer-readable storage medium that includes executable instructions configured to cause a processor device to:
receive, from a head-mounted display device (HMDD), information that identifies a surface of at least one object in a user space;
determine a classification of video content being presented on a display system of the HMDD;
select, based on the classification, a plurality of image themes, each image theme of the plurality of image themes comprising one or more image textures;
send, to the HMDD, a plurality of image theme identifiers, each image theme identifier corresponding to one of the plurality of image themes;
receive, from the HMDD, a selected image theme identifier; and
send, to the HMDD, at least one image texture of the image theme identified by the selected image theme identifier for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD concurrent with and adjacent to the video content.
16. The non-transitory computer-readable storage medium of claim 15 wherein the instructions further cause the processor device to:
stream the video content to the HMDD; and
wherein to determine the classification of the video content being presented on the display system of the HMDD, the processor device is further configured to access metadata associated with the video content that identifies the classification of the video content.
17. The non-transitory computer-readable storage medium of claim 15 wherein, to determine the classification of the video content being presented on the display system of the HMDD, the instructions further cause the processor device to:
receive, from the HMDD, a portion of the video content; and
determine the classification of the video content based on the portion of the video content.
18. The non-transitory computer-readable storage medium of claim 17 wherein to determine the classification of the video content based on the portion of the video content, the instructions further cause the processor device to analyze, by a machine learning algorithm trained to classify video content, the portion of the video content and outputting, by the machine learning algorithm, the classification of the video content.
19. The non-transitory computer-readable storage medium of claim 15 wherein to select, based on the classification, the plurality of image themes, the instructions further cause the processor device to:
access user profile information associated with a user of the HMDD; and
select the plurality of image themes based on the classification and the user profile information.
20. The non-transitory computer-readable storage medium of claim 15 wherein the instructions further cause the processor device to:
send, to the HMDD, a request for a portion of the video content; and
receive, from the HMDD, the portion of the video content.