IP Library Granted Patent US 9,774,548
Granted Patent B2
US 9,774,548 · App. 14/132,606 · Granted Sep 26, 2017

Integrating user personas with chat sessions

Inventors: Dennis Lin (Urbana, IL); Sumant Kowshik (Champaign, IL); Sanjay Patel (Urbana, IL)
Assignee: Personify, Inc.
H04L51/04H04L51/10G06F3/0484H04L12/1822H04N5/272H04N2005/2726
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,774,548
App. No.
14/132,606
Granted
Sep 26, 2017
Kind
B2
Abstract

Embodiments disclose extracting a user persona from a video of arbitrary duration and associating that persona with text for a chat session. Embodiments cause the persona to be extracted at the moment text is sent or received to convey the body language associated with the text.

Claims (41)

1. A computer-implemented method for combining extracted personas with respective associated content during a chat session, the method comprising:

displaying a first-user persona associated with a first user and at least a second-user persona associated with a second user;

creating a plurality of first-user scenes, wherein creating a given first-user scene comprises:

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmitting the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially displaying the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receiving a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially displaying the plurality of second-user scenes together with the displayed plurality of first-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

2. The computer-implemented method of claim 1 , further comprising receiving a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

3. The computer-implemented method of claim 1 , further comprising receiving a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and responsively updating the displayed first-user persona with the previously-displayed first-user persona.

4. The computer-implemented method of claim 1 , further comprising creating a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.

5. A non-transient computer-readable medium comprising a set of instructions which, when executed by a computer, combine extracted personas with respective associated content during a chat session, said set comprising instructions for:

displaying a first-user persona associated with a first user and at least a second-user persona associated with a second user;

creating a plurality of first-user scenes, wherein creating a given first-user scene comprises:

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmitting the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially displaying the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receiving a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially displaying the plurality of second-user scenes together with the displayed plurality of first-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

6. The non-transient computer-readable medium of claim 5 , said set further comprising instructions for receiving a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

7. The non-transient computer-readable medium of claim 5 , said set further comprising instructions for receiving a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and responsively updating the displayed first-user persona with the previously-displayed first-user persona.

8. The non-transient computer-readable medium of claim 5 , said set further comprising instructions for creating a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.

9. A system for combining extracted personas with respective associated content during a chat session, the system comprising:

at least one computer; and

a non-transitory computer readable medium having stored thereon one or more programs, which when executed by the computer, cause the computer to:

display a first-user persona associated with a first user and at least a second-user persona associated with a second user;

create a plurality of first-user scenes, wherein creating a given first-user scene comprises:

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmit the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially display the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receive a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially display, together with the displayed plurality of first-user scenes, the plurality of second-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

10. The system of claim 9 , wherein the system is further configured to receive a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

11. The system of claim 9 , wherein the system is further configured to receive a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and to responsively update the displayed first-user persona with the previously-displayed first-user persona.

12. The system of claim 9 , further comprising one or more programs, which when executed by the computer, cause the computer to create a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2021
From: HONGFUJIN PRECISION INDUSTRY WUHAN
To: PERSONIFY, INC.
Reel/Frame 057467/0738 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2019
From: PERSONIFY, INC.
To: HONGFUJIN PRECISION INDUSTRY (WUHAN) CO. LTD.
Reel/Frame 051367/0920 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2014
From: LIN, DENNIS J.; KOWSHIK, SUMANT; PATEL, SANJAY
To: PERSONIFY, INC.
Reel/Frame 032716/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2014
From: LIN, DENNIS; KOWSHIK, SUMANT; PATEL, SANJAY
To: PERSONIFY, INC.
Reel/Frame 031882/0333 →
Continuity (1)
Related Publication 20150172069A1 · Jun 18, 2015