IP Library Granted Patent US 9,412,377
Granted Patent B2
US 9,412,377 · App. 14/058,178 · Granted Aug 9, 2016

Computer-implemented system and method for enhancing visual representation to individuals participating in a conversation

Inventors: Paul M. Aoki (Berkeley, CA); Margaret H. Szymanski (Santa Clara, CA); James Thornton (Redwood City, CA); Daniel H. Wilson (Portland, OR); Allison G. Woodruff (Berkley, CA)
Assignee: III HOLDINGS 6, LLC
G10L17/005G10L21/0208H04M3/564H04M3/566H04M3/568H04M3/569G10L15/18G10L25/78G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,412,377
App. No.
14/058,178
Granted
Aug 9, 2016
Kind
B2
Abstract

A system and method for enhancing visual representation to individuals participating in a conversation is provided. Visual data for a plurality of individuals participating in one or more conversations is analyzed. Possible conversational configurations of the individuals are generated. Each possible conversational configuration includes one or more pair-wise probabilities of at least two of the individuals. A probability weight is assigned to each of the pair-wise probabilities having a likelihood that the individuals of that pair-wise probability are participating in a conversation. A probability of each possible conversational configuration is determined by combining the probability weights for the pair-wise probabilities of that possible conversational configuration. The possible conversational configuration with the highest probability is selected as a most probable configuration. The individuals participating in the conversations based on the pair-wise probabilities with the most probable configuration are determined. Visual representation is enhanced for each individual participating in the determined conversations.

Claims (58)

1. A computer-implemented method for enhancing visual representation to individuals participating in a computer-implemented conversation, comprising:

analyzing, by a processor, video data for a plurality of individuals participating in one or more conversations;

generating, by a processor, based on the video data, a plurality of possible conversational configurations of the individuals, each possible conversational configuration comprising one or more pair-wise probabilities of at least two of the individuals;

assigning, by a processor, a probability weight to each of the pair-wise probabilities comprising a likelihood that the individuals of that pair-wise probability are participating in one of the conversations;

determining, by a processor, a probability of each possible conversational configuration by combining the probability weights for the pair-wise probabilities of that possible conversational configuration;

selecting, by a processor, one of the possible conversational configurations with the highest probability as a most probable configuration;

determining, by a processor, the individuals participating in the conversations based on the pair-wise probabilities of the most probable configuration;

generating, by a processor, an enhanced visual representation for each individual participating in the determined conversations, and

displaying, by a display, the enhanced visual representation of each individual participating in the determined conversations to the plurality of individuals within a graphical user interface on the display.

2. A method according to claim 1 , further comprising:

calculating, by a processor, a mean of the combined probability weights for the pair-wise probabilities of each possible conversational configuration as the probability of that possible conversational configuration.

3. A method according to claim 1 , further comprising:

determining, by a processor, at least one of the possible conversational configurations, comprising:

representing, by a processor, each of the plurality of individuals as a node;

forming, by a processor, the pair-wise probabilities by connecting two or more nodes with at least one edge; and

combining, by a processor, the pair-wise probabilities as the possible conversational configuration.

4. A method according to claim 1 , further comprising:

maintaining, by a processor, at least one of the determined conversations for a minimum number of timeslices.

5. A method according to claim 1 , further comprising:

providing, by a processor, the individuals of one of the conversations with a different visual representation than members of a different conversation.

6. A method according to claim 1 , further comprising:

highlighting, by a display, for one of the individuals in one of the conversations, the other individuals in that conversation.

7. A method according to claim 1 , further comprising:

generating, by a processor, a participant graph comprising a mapping of all possible parings of the plurality of individuals; and

assigning, by a processor, a weight to each pairing of the plurality of individuals.

8. A method according to claim 7 , further comprising:

identifying, by a processor, for each pair-wise probability, the pairing represented by that pair-wise probability; and

assigning, by a processor, the weight of the pairing to the pair-wise probability.

9. A method according to claim 1 , wherein the visual representations comprise at least one of graphical and textual representations.

10. A method according to claim 1 , further comprising:

providing, by a processor, at least one of the individuals with an override option; and

allowing, by a processor, vocalizations from other individuals to be replaced by vocalizations from the individual with the override option.

11. A computer-implemented system for enhancing visual representation to individuals participating in a computer-implemented conversation, comprising at least one processor configured to:

analyze video data for a plurality of individuals participating in one or more conversations;

generate based on the video data, a plurality of possible conversational configurations of the individuals, each possible conversational configuration comprising one or more pair-wise probabilities of at least two of the individuals;

assign a probability weight to each of the pair-wise probabilities comprising a likelihood that the individuals of that pair-wise probability are participating in one of the conversations;

determine a probability of each possible conversational configuration by combining the probability weights for the pair-wise probabilities of that possible conversational configuration;

select one of the possible conversational configurations with the highest probability as a most probable configuration;

determine the individuals participating in the conversations based on the pair-wise probabilities of the most probable configuration; and

generate an enhanced visual representation within a graphic user interface displayed on a computer screen for each individual participating in the determined conversations displayed to the plurality of individuals.

12. A system according to claim 11 , wherein the at least one processor is further configured to:

calculate a mean of the combined probability weights for the pair-wise probabilities of each possible conversational configuration as the probability of that possible conversational configuration.

13. A system according to claim 11 , wherein the at least one processor is further configured to:

determine at least one of the possible conversational configurations by representing each of the plurality of individuals as a node, forming the pair-wise probabilities by connecting two or more nodes with at least one edge, and combining the pair-wise probabilities as the possible conversational configuration.

14. A system according to claim 11 , wherein the at least one processor is further configured to:

maintain at least one of the determined conversations for a minimum number of timeslices.

15. A system according to claim 11 , further comprising:

a display to provide the individuals of one of the conversations with a different visual representation than members of a different conversation.

16. A system according to claim 11 , further comprising:

a visual display module to highlight for one of the individuals in one of the conversations, the other individuals in that conversation.

17. A system according to claim 11 , wherein the at least one processor is further configured to:

generate a participant graph comprising a mapping of all possible parings of the plurality of individuals; and

assign a weight to each pairing of the plurality of individuals.

18. A system according to claim 17 , wherein the at least one processor is further configured to:

identify for each pair-wise probability, the pairing represented by that pair-wise probability and to assign the weight of the pairing to the pair-wise probability.

19. A system according to claim 11 , wherein the visual representations comprise at least one of graphical and textual representations.

20. A system according to claim 11 , wherein the at least one processor is further configured to:

provide at least one of the individuals with an override option and to allow vocalizations from other individuals to be replaced by vocalizations from the individual with the override option.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2015
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: III HOLDINGS 6, LLC
Reel/Frame 036198/0543 →
Continuity (6)
Division 13802728 · Mar 14, 2013
Continuation 13406365 · Feb 27, 2012
Continuation 12615239 · Nov 9, 2009
Continuation 10414912 · Apr 16, 2003
Provisional Application 60450724 · Feb 28, 2003
Related Publication 20140046665A1 · Feb 13, 2014