Multisensorial presentation of volumetric content
Input indicative of a selection of volumetric content for presentation is received. The volumetric content comprises a volumetric representation of one or more elements of a real-world three-dimensional space. In response to the input, device state data associated with the volumetric content is accessed. The device state data describes a state of one or more network-connected devices associated with the real-world three-dimensional space. The volumetric content is presented. The presentation of the volumetric content includes presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space by a display device and configuring the one or more network-connected devices using the device state data.
1. A method comprising:
receiving input indicative of a selection of volumetric content for presentation, the volumetric content comprising a volumetric representation of one or more elements of a real-world three-dimensional space;
in response to the input, accessing device state data associated with the volumetric content, the device state data describing a state of one or more network-connected devices associated with the real-world three-dimensional space; and
causing presentation of the volumetric content, the causing of the presentation of the volumetric content comprising:
causing, by a display device that is distinct from the one or more network-connected devices, presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space; and
configuring the one or more network-connected devices using the device state data, the configuring of the one or more network-connected devices comprises sending, over a network, a command to a network-connected device located within the real-world three-dimensional space corresponding to the volumetric representation or to a network service associated with the network-connected device, the command causing the network-connected device to be configured according to a state of the network-connected device while the volumetric content was being captured.
2. The method of claim 1 , further comprising generating a data record comprising the volumetric content and the device state data.
3. The method of claim 2 , wherein the generating of the data record comprises determining the state of the one or more network-connected devices at a time of capturing the volumetric content.
4. The method of claim 3 , wherein determining the state of the one or more network-connected devices comprises sending, over the network, a request for the state data to the network-connected device or the network service associated with the network-connected device.
5. The method of claim 3 , wherein determining the state of the one or more network-connected devices comprises collecting sensor data from one or more sensors associated with the real-world three-dimensional space.
6. The method of claim 2 , wherein the generating of the record comprises combining video data, image data, audio data, and sensor data associated with the real-world three-dimensional space.
7. The method of claim 1 , wherein causing presentation of the volumetric content includes: displaying at least one element of the real-world three-dimensional space from multiple perspectives based on user movement.
8. The method of claim 1 , wherein the configuring of the one or more network-connected devices comprises one or more of: setting a temperature of a smart thermostat causing a navigation device to display a navigation path; causing a smart television to present secondary video content; causing a smart speaker to play a song; causing a smart coffee maker to brew coffee; placing a smart lock in a locked or unlocked state; causing a smart dishwasher to start a cycle; causing a washing machine to start a cycle turning a smart light on or off; dimming a smart light; starting, stopping, or changing a speed of a smart fan; and causing a smart door to open or close.
9. The method of claim 1 , further comprising identifying secondary content that was presented within the real-world three-dimensional space while the volumetric content was being captured, wherein the configuring of the one or more network-connected devices comprises causing presentation, by a media device, of the secondary content.
10. The method of claim 1 , wherein:
the device state data includes one or more device settings of the network-connected device; and
the configuring of the one or more network-connected devices comprises applying the one or more device settings to the network-connected device.
11. A system comprising:
one or more hardware processors; and
at least one memory storing instructions that cause the one or more hardware processors to perform operations comprising:
receiving input indicative of a selection of volumetric content for presentation, the volumetric content comprising a volumetric representation of one or more elements of a real-world three-dimensional space;
in response to the input, accessing device state data associated with the volumetric content, the device state data describing a state of one or more network-connected devices associated with the real-world three-dimensional space; and
causing presentation of the volumetric content, the causing of the presentation of the volumetric content comprising:
causing, by a display device that is distinct from the one or more network-connected devices, presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space; and
configuring the one or more network-connected devices using the device state data, the configuring of the one or more network-connected devices comprises sending, over a network, a command to a network-connected device located within the real-world three-dimensional space corresponding to the volumetric representation or to a network service associated with the network-connected device, the command causing the network-connected device to be configured according to a state of the network-connected device while the volumetric content was being captured.
12. The system of claim 11 , wherein the operations further comprise generating a data record comprising the volumetric content and the device state data.
13. The system of claim 12 , wherein the generating of the data record comprises determining the state of the one or more network-connected devices at a time of capturing the volumetric content.
14. The system of claim 13 , wherein determining the state of the one or more network-connected devices comprises sending, over the network, a request for the state data to the network-connected device or the network service associated with the network-connected device.
15. The system of claim 13 , wherein determining the state of the one or more network-connected devices comprises collecting sensor data from one or more sensors associated with the real-world three-dimensional space.
16. The system of claim 13 , wherein causing presentation of the volumetric content includes: displaying at least one element of the real-world three-dimensional space from multiple perspectives based on user movement.
17. The system of claim 12 , wherein the generating of the data record comprises combining video data, image data, audio data, and sensor data associated with the real-world three-dimensional space.
18. The system of claim 11 , wherein the configuring of the one or more network-connected device comprises one or more of: setting a temperature of a smart thermostat causing a navigation device to display a navigation path; causing a smart television to present secondary video content; causing a smart speaker to play a song; causing a smart coffee maker to brew coffee; placing a smart lock in a locked or unlocked state; causing a smart dishwasher to start a cycle; causing a washing machine to start a cycle turning a smart light on or off; dimming a smart light starting, stopping, or changing a speed of a smart fan; and causing a smart door to open or close.
19. The system of claim 11 , wherein the operations further comprise identifying secondary content that was presented within the real-world three-dimensional space while the volumetric content was being captured, wherein the configuring of the at least one network-connected device comprises causing presentation, by a media device, of the secondary content.
20. A machine-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:
receiving input indicative of a selection of volumetric content for presentation, the volumetric content comprising a volumetric representation of one or more elements of a real-world three-dimensional space;
in response to the input, accessing device state data associated with the volumetric content, the device state data describing a state of one or more network-connected devices associated with the real-world three-dimensional space; and
causing presentation of the volumetric content, the causing of the presentation of the volumetric content comprising:
causing, by a display device that is distinct from the one or more network-connected devices, presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space; and
configuring the one or more network-connected devices using the device state data, the configuring of the one or more network-connected devices comprises sending, over a network, a command to a network-connected device located within the real-world three-dimensional space corresponding to the volumetric representation or to a network service associated with the network-connected device, the command causing the network-connected device to be configured according to a state of the network-connected device while the volumetric content was being captured.