Systems and methods of presenting mixed media in a three-dimensional environment
Some examples of the disclosure are directed to systems and methods for displaying supplemental content for two-dimensional content that is being played back in a three-dimensional environment at an electronic device. In some examples, while a content item is displayed in a virtual playback user interface in a three-dimensional environment, the electronic device displays a three-dimensional representation corresponding to the content item in the three-dimensional environment. In some examples, the three-dimensional representation includes a representation of a venue of the event and/or representations of participants in the event. In some examples, portions of the venue and/or a subset of the participants in the event that are not currently displayed/visible in the camera view of the broadcast/stream of the content item are included in the three-dimensional representation. In some examples, the three-dimensional representation is configurable to be interacted with independently of the display of the content item in the three-dimensional environment.
1 . A method comprising:
at an electronic device in communication with one or more displays and one or more input devices:
presenting, via the one or more displays, a virtual playback user interface at a first location in a three-dimensional environment, wherein the virtual playback user interface is configured to display content;
while displaying a first content item for a performance event in the virtual playback user interface at the first location in the three-dimensional environment, detecting an indication of initiation of a first event associated with the first content item; and
in response to detecting the indication:
in accordance with a determination that the first event associated with the first content item satisfies one or more criteria, presenting, via the one or more displays, a first animated spatial effect that is based on the performance event in the three-dimensional environment, wherein the first animated spatial effect is presented as originating from a second location in the three-dimensional environment that is different from the first location of the virtual playback user interface and that is separate from the first content item; and
in accordance with a determination that the first event associated with the first content item does not satisfy the one or more criteria, forgoing presentation of the first animated spatial effect in the three-dimensional environment.
2 . The method of claim 1 , wherein:
the performance event corresponds to an athletic event; and
the one or more criteria include a criterion that is satisfied in accordance with a determination that a respective team participating in the athletic event scores a point.
3 . The method of claim 2 , wherein the criterion is further satisfied in accordance with a determination that the respective team corresponds to a user-preferred team defined according to one or more user preferences.
4 . The method of claim 2 , further comprising:
in response to detecting the indication:
in accordance with the determination that the first event associated with the first content item does not satisfy the one or more criteria because a first team that does not correspond to a user-preferred team participating in the athletic event scores a point, presenting, via the one or more displays, a second animated spatial effect, different from the first animated spatial effect, that is based on the athletic event in the three-dimensional environment.
5 . The method of claim 2 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the first event corresponds to a respective action performed by a respective player participating in the athletic event, a respective venue at which the athletic event is taking place is a first venue, or the performance event corresponds to a user-preferred performance event defined according to one or more user preferences.
6 . The method of claim 1 , further comprising:
after presenting the first animated spatial effect in the three-dimensional environment in accordance with the determination that the first event associated with the first content item satisfied the one or more criteria in response to detecting the indication, detecting an indication of a conclusion of the first event; and
in response to detecting the indication of the conclusion of the first event, ceasing presentation of the first animated spatial effect in the three-dimensional environment.
7 . The method of claim 1 , wherein, before detecting the indication, a portion of the three-dimensional environment surrounding the virtual playback user interface is presented with a first level of brightness relative to the virtual playback user interface, the method further comprising:
in response to detecting the indication:
updating presentation, via the one or more displays, of the portion of the three-dimensional environment surrounding the virtual playback user interface to be displayed with a second level of brightness, less than the first level of brightness, relative to the virtual playback user interface.
8 . The method of claim 1 , wherein presenting the first animated spatial effect includes outputting first audio corresponding to the first animated spatial effect, wherein the first audio is different from audio corresponding to the first content item.
9 . An electronic device comprising:
one or more processors;
memory; and
one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising:
presenting, via one or more displays, a virtual playback user interface at a first location in a three-dimensional environment, wherein the virtual playback user interface is configured to display content;
while displaying a first content item for a performance event in the virtual playback user interface at the first location in the three-dimensional environment, detecting an indication of initiation of a first event associated with the first content item; and
in response to detecting the indication:
in accordance with a determination that the first event associated with the first content item satisfies one or more criteria, presenting, via the one or more displays, a first animated spatial effect that is based on the performance event in the three-dimensional environment, wherein the first animated spatial effect is presented as originating from a second location in the three-dimensional environment that is different from the first location of the virtual playback user interface and that is separate from the first content item; and
in accordance with a determination that the first event associated with the first content item does not satisfy the one or more criteria, forgoing presentation of the first animated spatial effect in the three-dimensional environment.
10 . The electronic device of claim 9 , wherein:
the performance event corresponds to an athletic event; and
the one or more criteria include a criterion that is satisfied in accordance with a determination that a respective team participating in the athletic event scores a point.
11 . The electronic device of claim 10 , wherein the criterion is further satisfied in accordance with a determination that the respective team corresponds to a user-preferred team defined according to one or more user preferences.
12 . The electronic device of claim 10 , wherein the method further comprises:
in response to detecting the indication:
in accordance with the determination that the first event associated with the first content item does not satisfy the one or more criteria because a first team that does not correspond to a user-preferred team participating in the athletic event scores a point, presenting, via the one or more displays, a second animated spatial effect, different from the first animated spatial effect, that is based on the athletic event in the three-dimensional environment.
13 . The electronic device of claim 10 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the first event corresponds to a respective action performed by a respective player participating in the athletic event, a respective venue at which the athletic event is taking place is a first venue, or the performance event corresponds to a user-preferred performance event defined according to one or more user preferences.
14 . The electronic device of claim 9 , wherein the method further comprises:
after presenting the first animated spatial effect in the three-dimensional environment in accordance with the determination that the first event associated with the first content item satisfied the one or more criteria in response to detecting the indication, detecting an indication of a conclusion of the first event; and
in response to detecting the indication of the conclusion of the first event, ceasing presentation of the first animated spatial effect in the three-dimensional environment.
15 . The electronic device of claim 9 , wherein, before detecting the indication, a portion of the three-dimensional environment surrounding the virtual playback user interface is presented with a first level of brightness relative to the virtual playback user interface, the method further comprising:
in response to detecting the indication:
updating presentation, via the one or more displays, of the portion of the three-dimensional environment surrounding the virtual playback user interface to be displayed with a second level of brightness, less than the first level of brightness, relative to the virtual playback user interface.
16 . The electronic device of claim 9 , wherein presenting the first animated spatial effect includes outputting first audio corresponding to the first animated spatial effect, wherein the first audio is different from audio corresponding to the first content item.
17 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising:
presenting, via one or more displays, a virtual playback user interface at a first location in a three-dimensional environment, wherein the virtual playback user interface is configured to display content;
while displaying a first content item for a performance event in the virtual playback user interface at the first location in the three-dimensional environment, detecting an indication of initiation of a first event associated with the first content item; and
in response to detecting the indication:
in accordance with a determination that the first event associated with the first content item satisfies one or more criteria, presenting, via the one or more displays, a first animated spatial effect that is based on the performance event in the three-dimensional environment, wherein the first animated spatial effect is presented as originating from a second location in the three-dimensional environment that is different from the first location of the virtual playback user interface and that is separate from the first content item; and
in accordance with a determination that the first event associated with the first content item does not satisfy the one or more criteria, forgoing presentation of the first animated spatial effect in the three-dimensional environment.
18 . The non-transitory computer readable storage medium of claim 17 , wherein:
the performance event corresponds to an athletic event; and
the one or more criteria include a criterion that is satisfied in accordance with a determination that a respective team participating in the athletic event scores a point.
19 . The non-transitory computer readable storage medium of claim 18 , wherein the criterion is further satisfied in accordance with a determination that the respective team corresponds to a user-preferred team defined according to one or more user preferences.
20 . The non-transitory computer readable storage medium of claim 18 , wherein the method further comprises:
in response to detecting the indication:
in accordance with the determination that the first event associated with the first content item does not satisfy the one or more criteria because a first team that does not correspond to a user-preferred team participating in the athletic event scores a point, presenting, via the one or more displays, a second animated spatial effect, different from the first animated spatial effect, that is based on the athletic event in the three-dimensional environment.
21 . The non-transitory computer readable storage medium of claim 18 , wherein the one or more criteria include a criterion that is satisfied in accordance with a determination that the first event corresponds to a respective action performed by a respective player participating in the athletic event, a respective venue at which the athletic event is taking place is a first venue, or the performance event corresponds to a user-preferred performance event defined according to one or more user preferences.
22 . The non-transitory computer readable storage medium of claim 17 , wherein the method further comprises:
after presenting the first animated spatial effect in the three-dimensional environment in accordance with the determination that the first event associated with the first content item satisfied the one or more criteria in response to detecting the indication, detecting an indication of a conclusion of the first event; and
in response to detecting the indication of the conclusion of the first event, ceasing presentation of the first animated spatial effect in the three-dimensional environment.
23 . The non-transitory computer readable storage medium of claim 17 , wherein, before detecting the indication, a portion of the three-dimensional environment surrounding the virtual playback user interface is presented with a first level of brightness relative to the virtual playback user interface, the method further comprising:
in response to detecting the indication:
updating presentation, via the one or more displays, of the portion of the three-dimensional environment surrounding the virtual playback user interface to be displayed with a second level of brightness, less than the first level of brightness, relative to the virtual playback user interface.
24 . The non-transitory computer readable storage medium of claim 17 , wherein presenting the first animated spatial effect includes outputting first audio corresponding to the first animated spatial effect, wherein the first audio is different from audio corresponding to the first content item.