Augmented reality display for content consumption based on field of view
Systems and methods are presented herein for generating an augmented reality (“AR”) display with user interface (“UI”) elements that respond to changes in pupil characteristics in response to detecting device streaming content. A media stream playing on a device that is within a threshold distance of the AR device is detected. The source of the media stream is identified. The AR device queries the source of the media stream for a consumption option. An AR overlay is generated and comprises selectable UI elements corresponding to the consumption options. In response to receiving an input at a UI element, the AR overlay is generated based on the consumption option.
1. A method, comprising:
detecting a first stream playing on a first device within a threshold distance of an augmented reality (“AR”) device;
receiving a first user interface (“UI”) element associated with the first stream;
detect a second stream playing on a second device within the threshold distance of the AR device, wherein the second device is different than the first device;
receiving a second UI element associated with the second stream; and
in response to detecting the first stream playing on the first device and the second stream playing on the second device, generating an AR overlay on a display of the AR device, wherein the AR overlay comprises:
the first UI element on a first portion of the display; and
the second UI element on a second portion of the display; and
a third UI element corresponding to a first modification instruction, wherein a selection of the third UI element causes the first device to modify the playing of the first stream on the first device.
2. The method of claim 1 , wherein:
the first UI element comprises a portion of the first stream playing on the first device; and
the second UI element comprises a portion of the second stream playing on the second device.
3. The method of claim 1 , wherein:
the first UI element comprises a first image associated with the first stream playing on the first device; and
the second UI element comprises a second image associated with the second stream playing on the second device.
4. The method of claim 1 , wherein:
the first UI element comprises a first identifier associated with a first source of the first stream playing on the first device; and
the second UI element comprises a second identifier associated with a second source of the second stream playing on the second device.
5. The method of claim 4 , further comprising:
receiving the first identifier from the first source, wherein the first source corresponds to a first content server; and
receiving the second identifier from the second source, wherein the second source corresponds to a second content server.
6. The method of claim 1 , wherein the AR overlay further comprises: a fourth UI element associated with the second stream.
7. The method of claim 6 , wherein the first modification instruction comprises at least one of a playback command and a caption setting modification.
8. The method of claim 1 , further comprising:
identifying the first device receiving the first stream, wherein receiving the first UI element associated with the first stream is in response to identifying the first device receiving the first stream; and
identifying the second device receiving the second stream, wherein receiving the second UI element associated with the second stream is in response to identifying the second device receiving the second stream.
9. The method of claim 8 , wherein detecting the first stream playing on the first device that is within the threshold distance of the AR device comprises:
activating a first local communication network at the AR device;
determining that the first device is responsive to the first local communication network based on a response corresponding to the first device; and
identifying the first stream playing on the first device.
10. The method of claim 9 , wherein identifying the first device receiving the first stream comprises retrieving a first device identifier corresponding to the first device receiving the first stream based on at least one of metadata associated with the first device playing the first stream and metadata associated with the first stream.
11. The method of claim 1 , further comprising:
receiving an input corresponding to at least one UI element, wherein receiving the input corresponding to the at least one UI element comprises:
determining that at least one pupil is within an input threshold distance of the AR device;
determining a first iteration of a pupil characteristic, wherein the first iteration corresponds to a first time stamp;
determining a second iteration of the pupil characteristic, wherein the second iteration corresponds to a second time stamp later than the first time stamp;
comparing the first iteration to the second iteration;
in response to determining the first iteration is different from the second iteration, comparing a magnitude of difference to an input deviation threshold; and
in response to determining the magnitude meets or exceeds the input deviation threshold, generating an executable instruction based on the at least one UI element corresponding to the pupil characteristic.
12. The method of claim 11 , wherein the pupil characteristic comprises at least one of a pupil size, a blink rate, and a light reflection magnitude.
13. An apparatus, comprising:
control circuitry; and
at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the control circuitry, cause the apparatus to perform at least the following:
detect a first stream playing on a first device within a threshold distance of the apparatus;
receive a first user interface (“UI”) element associated with the first stream;
detect a second stream playing on a second device within the threshold distance of the apparatus, wherein the second device is different than the first device;
receive a second UI element associated with the second stream; and
in response to detecting the first stream playing on the first device and the second stream playing on the second device, generate an augmented reality (“AR”) overlay on a display, wherein the AR overlay comprises:
the first UI element on a first portion of the display;
the second UI element on a second portion of the display; and
a third UI element corresponding to a first modification instruction, wherein a selection of the third UI element causes the first device to modify the playing of the first stream on the first device.
14. The apparatus of claim 13 , wherein:
the first UI element comprises a first image associated with the first stream playing on the first device; and
the second UI element comprises a second image associated with the second stream playing on the second device.
15. The apparatus of claim 13 , wherein:
the first UI element comprises a first identifier associated with a first source of the first stream playing on the first device; and
the second UI element comprises a second identifier associated with a second source of the second stream playing on the second device.
16. The apparatus of claim 13 , wherein:
the first UI element comprises a portion of the first stream playing on the first device; and
the second UI element comprises a portion of the second stream playing on the second device.