Automated cinematic decisions based on descriptive models
In one embodiment, a method includes, at a first time during an audio-video communication session: (1) determining that a first participant is located in an environment; (2) locating a first body region of the first participant; (3) generating a first color histogram of the first body region that represents a first distribution of colors of the first body region. The method also includes, at a second time: (1) determining that a second participant is located in the environment; (2) locating a second body region of the second participant; (3) generating a second color histogram of the second body region that represents a second distribution of one or more colors of the second body region. The method also includes determining that the first and second color histograms are substantially alike, and based on the determination, determining that the first participant is the same as the second participant.
1. A method comprising, by a computing device:
at a first time period during an audio-video communication session:
determining that a participant is located in an environment associated with the audio-video communication session;
locating a reference body region of the participant;
generating a reference color histogram of the reference body region, wherein the reference color histogram represents a distribution of one or more colors of the reference body region;
at a second time period during the audio-video communication:
determining that a subject participant is located in the environment;
locating a body region of the subject participant from the second time period that corresponds with the reference body region of the participant from the first time period;
generating a color histogram of the body region of the subject participant from the second time period, wherein the color histogram represents a distribution of one or more colors of the body region of the subject participant from the second time period;
determining that the color histogram of the subject participant from the second time period matches the reference color histogram;
based on the determination that the color histogram of the subject participant from the second time period matches the reference color histogram, identifying the subject participant from the second time period as the same participant as the participant from the first time period.
2. The method of claim 1 , wherein the reference color histogram and the color histogram of the body region of the subject participant from the second time period each comprise a number of pixel buckets, wherein the pixel buckets comprise pixels whose color value is within a span associated with the respective pixel bucket.
3. The method of claim 1 , further comprising determining a unique identity of the participant from the first time period and storing the reference color histogram in a social graph associated with the participant from the first time period.
4. The method of claim 1 , further comprising determining one or more body ratios for the participant from the first time period and the subject participant from the second time period, the body ratios comprising a shoulder-to-torso ratio or a head-to-torso ratio, wherein the identifying the subject participant from the second time period as the same participant as the participant from the first time period is further based on the one or more body ratios.
5. The method of claim 1 , further comprising:
determining a first current location for the participant from the first time period and a first trajectory for the participant from the first time period;
determining a second current location for the subject participant from the second time period and a second trajectory for the subject participant from the second time period, wherein the identifying the subject participant from the second time period as the same participant as the participant from the first time period is further based on the first location, first trajectory, second location, and second trajectory.
6. The method of claim 5 , further comprising assigning a plurality of weights to the first trajectory, second trajectory, first location, second location, first color histogram, and second color histogram, wherein at a first weight of the plurality of weights is greater than a second weight of the plurality of weights.
7. The method of claim 1 , wherein the reference body region and the body region of the subject participant from the second time period are a torso region.
8. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
at a first time period during an audio-video communication session:
determine that a participant is located in an environment associated with the audio-video communication session;
locate a reference body region of the participant;
generate a reference color histogram of the reference body region, wherein the reference color histogram represents a distribution of one or more colors of the reference body region;
at a second time period during the audio-video communication:
determine that a subject participant is located in the environment;
locate a body region of the subject participant from the second time period that corresponds with the reference body region of the participant from the first time period;
generate a color histogram of the body region of the subject participant from the second time period, wherein the color histogram represents a distribution of one or more colors of the body region of the subject participant from the second time period;
determine that the color histogram of the subject participant from the second time period matches the reference color histogram;
based on the determination that the color histogram of the subject participant from the second time period matches the reference color histogram, identify the subject participant from the second time period as the same participant as the participant from the first time period.
9. The media of claim 8 , wherein the reference color histogram and the color histogram of the body region of the subject participant from the second time period each comprise a number of pixel buckets, wherein the pixel buckets comprise pixels whose color value is within a span associated with the respective pixel bucket.
10. The media of claim 8 , wherein the software is further operable when executed to determine a unique identity of participant from the first time period and storing the reference color histogram in a social graph associated with the participant from the first time period.
11. The media of claim 8 , wherein the software is further operable when executed to determine one or more body ratios for the participant from the first time period and the subject participant from the second time period, the body ratios comprising a shoulder-to-torso ratio or a head-to-torso ratio, wherein the identifying the participant from the first time period as the same participant as the subject participant from the second time period is further based on the one or more body ratios.
12. The media of claim 8 , wherein the software is further operable when executed to:
determine a first current location for the participant from the first time period and a first trajectory for the participant from the first time period; and
determine a second current location for the subject participant from the second time period and a second trajectory for the subject participant from the second time period, wherein the identifying the first participant is the same participant as the subject participant from the second time period is further based on the first location, first trajectory, second location, and second trajectory.
13. The media of claim 12 , wherein the software is further operable when executed to assign a plurality of weights to the first trajectory, second trajectory, first location, second location, first color histogram, and second color histogram, wherein at a first weight of the plurality of weights is greater than a second weight of the plurality of weights.
14. The media of claim 8 , wherein the reference body region and the body region of the subject participant from the second time period are a torso region.
15. A system comprising:
one or more processors; and
one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
at a first time period during an audio-video communication session:
determine that a participant is located in an environment associated with the audio-video communication session;
locate a reference body region of the participant;
generate a reference color histogram of the reference body region, wherein the reference color histogram represents a distribution of one or more colors of the reference body region;
at a second time period during the audio-video communication:
determine that a subject participant is located in the environment;
locate a body region of the subject participant from the second time period that corresponds with as the reference body region of the participant from the first time period;
generate a color histogram of the body region of the subject participant from the second time period, wherein the color histogram represents a distribution of one or more colors of the body region of the subject participant from the second time period;
determine that the color histogram of the subject participant from the second time period matches the reference color histogram;
based on the determination that the color histogram of the subject participant from the second time period matches the reference color histogram, identify the subject participant from the second time period is the same participant as the participant from the first time period.
16. The system of claim 15 , wherein the reference color histogram and the color histogram of the body region of the subject participant from the second time period each comprise a number of pixel buckets, wherein the pixel buckets comprise pixels whose color value is within a span associated with the respective pixel bucket.
17. The system of claim 15 , wherein the processors are further operable when executing the instructions to determine a unique identity of the participant from the first time period and storing the reference color histogram in a social graph associated with the participant from the first time period.
18. The system of claim 15 , wherein the processors are further operable when executing the instructions to determine one or more body ratios for the participant from the first time period and the subject participant from the second time period, the body ratios comprising a shoulder-to-torso ratio or a head-to-torso ratio, wherein the identifying the subject participant from the second time period as the same participant as the participant from the first time period is further based on the one or more body ratios.
19. The system of claim 15 , wherein the processors are further operable when executing the instructions to:
determine a first current location for the participant from the first time period and a first trajectory for the participant from the first time period; and
determine a second current location for the subject participant from the second time period and a second trajectory for the subject participant from the second time period, wherein the identifying the subject participant from the second time period as the same participant as the participant from the first time period is further based on the first location, first trajectory, second location, and second trajectory.
20. The system of claim 19 , wherein the processors are further operable when executing the instructions to assign a plurality of weights to the first trajectory, second trajectory, first location, second location, first color histogram, and second color histogram, wherein at a first weight of the plurality of weights is greater than a second weight of the plurality of weights.