Dynamic curation of sequence events for communication sessions
The techniques disclosed herein provide dynamic curation of sequence events for communication sessions. A system can utilize smart filtering techniques to generate and select sequence events that are designed to optimize user engagement. The system can collect contextual data associated with a communication session, which can be in the form of a private chat session, a multi-user editing session, a group meeting, a live broadcast, etc. The system can utilize the contextual data, and other input data defining user activity, to customize sequence events defining contextually-relevant user interface (UI) layouts, volume levels, camera angles, special effects, and other parameters controlling aspects of the communication session.
1 . A method for reconfiguring incoming streams from a plurality of video streams to achieve visual consistency for a plurality of participants of a communication session, comprising:
analyzing a plurality of renderings depicting the plurality of participants of the communication session to detect one or more discrepancies between a first rendering depicting a first participant and a second rendering depicting a second participant of the communication session, wherein the analysis of the plurality of renderings for detecting the one or more discrepancies comprises,
analyzing a raw data feed from of the plurality of video streams to determine an eye gaze direction that is depicted in the first rendering of the first participant, and
determining that the eye gaze direction of the first participant that is depicted in the first rendering is not directed toward a position of the second rendering of the second participant;
in response to determining that the eye gaze direction of the first participant is not directed toward the position of the second rendering of the second participant, selectively generating communication data for causing one or more computing devices of the plurality of participants to display one or more user interfaces comprising the first rendering depicting the first participant and a corrected orientation of the first participant depicted in the first rendering, wherein the corrected orientation directs the eye gaze direction of the first participant toward the of the position of the second rendering of the second participant; and
causing a transmission of the communication data to the one or more computing devices of the plurality of participants of the communication session, the communication data causing the one or more computing devices to concurrently display the one or more user interfaces comprising the first rendering depicting the first participant having the adjusted eye gaze direction that is directed toward the position of the second rendering of the second participant.
2 . The method of claim 1 , further comprising adjusting a display property of the first rendering, wherein the display property comprises a size of the first rendering of the first participant of the communication session, wherein the discrepancy with the one or more display properties comprises a size that is different from the second rendering of the second participant of the communication session, wherein the scale of the first rendering of the first participant having the adjusted display property is corrected to align at least one physical feature of the first participant depicted in the first rendering with at least one physical feature of the second participant depicted in the second rendering of the communication session.
3 . The method of claim 2 , wherein adjusting a display property comprises adjusting one or more hardware parameters including at least one of a zoom level of a camera capturing an image of the first participant of the communication session, wherein the adjusted display property comprises adjusting the zoom level of the camera to align a size of the first rendering of the first participant with a size of the second rendering of the second participant.
4 . The method of claim 1 , further comprising adjusting a display property of the first rendering, wherein the display property comprises an intensity level of a light applied to the first rendering of the first participant of the communication session, wherein the intensity level of the light is adjusted to match a light level of the second rendering.
5 . The method of claim 4 , wherein adjusting the display property further comprises adjusting one or more hardware parameters, wherein the hardware parameters are adjusted based on at least one of a user preference, user activity, and an analysis of the communication data.
6 . A system for reconfiguring incoming streams from a plurality of video streams to achieve visual consistency for a plurality of participants of a communication session, comprising:
one or more data processing units; and
a computer-readable medium having encoded thereon computer-executable instructions to cause one or more data processing units to:
analyze a plurality of renderings depicting the plurality of participants of the communication session to detect one or more discrepancies between a first rendering depicting a first participant and a second rendering depicting a second participant of the communication session, wherein the analysis of the plurality of renderings for detecting the one or more discrepancies comprises,
analyzing a raw data feed from of the plurality of video streams to determine an eye gaze direction that is depicted in the first rendering of the first participant, and
determining that the eye gaze direction of the first participant that is depicted in the first rendering is not directed toward a position of the second rendering of the second participant;
in response to determining that the eye gaze direction of the first participant is not directed toward the position of the second rendering of the second participant, selectively generate communication data for causing one or more computing devices of the plurality of participants to display one or more user interfaces comprising the first rendering depicting the first participant and a corrected orientation of the first participant depicted in the first rendering, wherein the corrected orientation directs the eye gaze direction of the first participant toward the of the position of the second rendering of the second participant; and
cause a transmission of the communication data to the one or more computing devices of the plurality of participants of the communication session, the communication data causing the one or more computing devices to concurrently display the one or more user interfaces comprising the first rendering depicting the first participant having the adjusted eye gaze direction that is directed toward the position of the second rendering of the second participant.
7 . The system of claim 6 , wherein the instructions further cause the one or more data processing units to adjust a display property of the first rendering, wherein the display property comprises a size of the first rendering of the first participant of the communication session, wherein the discrepancy with the one or more display properties comprises a size that is different from the second rendering of the second participant of the communication session, wherein the scale of the first rendering of the first participant having the adjusted display property is corrected to align at least one physical feature of the first participant depicted in the first rendering with at least one physical feature of the second participant depicted in the second rendering of the communication session.
8 . The system of claim 7 , wherein adjusting a display property comprises adjusting one or more hardware parameters including at least one of a zoom level of a camera capturing an image of the first participant of the communication session, wherein the adjusted display property comprises adjusting the zoom level of the camera to align a size of the first rendering of the first participant with a size of the second rendering of the second participant.
9 . The system of claim 6 , wherein the instructions further cause the one or more data processing units to adjust a display property of the first rendering, wherein the display property comprises an intensity level of a light applied to the first rendering of the first participant of the communication session, wherein the intensity level of the light is adjusted to match a light level of the second rendering.
10 . The system of claim 9 , wherein adjusting the display property further comprises adjusting one or more hardware parameters, wherein the hardware parameters are adjusted based on at least one of a user preference, user activity, and an analysis of the communication data.
11 . A computer storage device having computer-executable instructions stored thereon cause a system to reconfigure incoming streams from a plurality of video streams to achieve visual consistency for a plurality of participants of a communication session, the computer-executable instructions to cause one or more data processing units of the system to:
analyze a plurality of renderings depicting the plurality of participants of the communication session to detect one or more discrepancies between a first rendering depicting a first participant and a second rendering depicting a second participant of the communication session, wherein the analysis of the plurality of renderings for detecting the one or more discrepancies comprises,
analyzing a raw data feed from of the plurality of video streams to determine an eye gaze direction that is depicted in the first rendering of the first participant, and
determining that the eye gaze direction of the first participant that is depicted in the first rendering is not directed toward a position of the second rendering of the second participant;
in response to determining that the eye gaze direction of the first participant is not directed toward the position of the second rendering of the second participant, selectively generate communication data for causing one or more computing devices of the plurality of participants to display one or more user interfaces comprising the first rendering depicting the first participant and a corrected orientation of the first participant depicted in the first rendering, wherein the corrected orientation directs the eye gaze direction of the first participant toward the of the position of the second rendering of the second participant; and
cause a transmission of the communication data to the one or more computing devices of the plurality of participants of the communication session, the communication data causing the one or more computing devices to concurrently display the one or more user interfaces comprising the first rendering depicting the first participant having the adjusted eye gaze direction that is directed toward the position of the second rendering of the second participant.
12 . The computer storage device of claim 11 , wherein the instructions further cause the one or more data processing units to adjust a display property of the first rendering, wherein the display property comprises a size of the first rendering of the first participant of the communication session, wherein the discrepancy with the one or more display properties comprises a size that is different from the second rendering of the second participant of the communication session, wherein the scale of the first rendering of the first participant having the adjusted display property is corrected to align at least one physical feature of the first participant depicted in the first rendering with at least one physical feature of the second participant depicted in the second rendering of the communication session.
13 . The computer storage device of claim 12 , wherein adjusting a display property comprises adjusting one or more hardware parameters including at least one of a zoom level of a camera capturing an image of the first participant of the communication session, wherein the adjusted display property comprises adjusting the zoom level of the camera to align a size of the first rendering of the first participant with a size of the second rendering of the second participant.
14 . The computer storage device of claim 11 , wherein the instructions further cause the one or more data processing units to adjust a display property of the first rendering, wherein the display property comprises an intensity level of a light applied to the first rendering of the first participant of the communication session, wherein the intensity level of the light is adjusted to match a light level of the second rendering.
15 . The computer storage device of claim 14 , wherein adjusting the display property further comprises adjusting one or more hardware parameters, wherein the hardware parameters are adjusted based on at least one of a user preference, user activity, and an analysis of the communication data.