IP Library Granted Patent US 12711689
Granted Patent B2
US 12711689 · App. 18/463,799 · Granted Aug 18, 2026

System and method for displaying reaction animations

Inventors: David Giovanni Marino (Montréal, CA); Max Henry (Outremont, CA); Pascal Fortin (Jonquière, CA); Jeremy Cooperstock (Westmount, CA)
Assignee: 17707461 Canada Inc.
G06T13/80G06T7/70G06V40/171G06V40/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12711689
App. No.
18/463,799
Granted
Aug 18, 2026
Kind
B2
Abstract

System and method for displaying reaction animations that represent audience reactions to content. A reaction measurement module receives video data featuring at least one audience user from at least one video capture device. The reaction measurement module processes the video data to determine reaction data based on characteristics of the audience user's head. The reaction data is passed to a server and an animation-generation module generates animation data based on the reaction data. The animation data is passed to a user device for display. In some embodiments, the reaction animation(s) are displayed with the content in real or near real time. In other embodiments, the reaction animations are recorded for later viewing. In some embodiments, the animation(s) each represent multiple audience users.

Claims (71)

1 . A system for displaying animations to a user, said system comprising:

a reaction measurement module receiving video data of an audience user from a video capture device, wherein said reaction measurement module determines reaction data from said video data and wherein said reaction data represents reactions of said audience user to content;

a server, said server receiving said reaction data and said server further comprising:

an animation-generation module for generating animation data based on said reaction data, said animation data being for use in a reaction animation;

wherein said animation data is for sending to a computing device used by at least one user,

wherein said reaction animation is displayed to said at least one user at said device,

wherein changes of said reaction animation are representative of movements of said audience user,

wherein said changes in said reaction animation are one of:

changing from a first two-dimensional non-facial shape to at least one second two-dimensional non-facial shape; and

movement of a plurality of particles displayed on said computing device, an amount of movement of said particles being based on one or more of: large facial expression movements from a minority of said audience users; general movements of all of said audience users; and similar movements and facial expressions of many of said audience users at a specific time,

wherein each two-dimensional non-facial shape is representative of at least one audience user,

wherein an origin of said at least one audience user's head maps to a geometric origin of said each two-dimensional non-facial shape, and

wherein said reaction data is representative of user engagement with said content.

2 . The system according to claim 1 , wherein said content is video content and said content is displayed to said user concurrently with said reaction animation.

3 . The system according to claim 1 , wherein said content is one of: live and pre-recorded.

4 . The system according to claim 1 , wherein the reaction data is based on characteristics of said audience user's head.

5 . The system according to claim 2 , wherein said characteristics comprise at least one of:

a position of said head relative to a predetermined point;

a roll of said head;

a pitch of said head; and

a yaw of said head.

6 . The system according to claim 2 , wherein said characteristics comprise facial characteristics.

7 . The system according to claim 4 , wherein said facial characteristics comprise at least one of:

a size of said audience user's mouth relative to an original size;

a distance between said audience user's eyebrows and said audience user's eyes; and

a distance between said audience user's jaw and a central point of said audience user's face.

8 . The system according to claim 1 , wherein changing from a first two-dimensional non-facial shape to at least one second two-dimensional non-facial shape maps to said movements of said audience user.

9 . The system according to claim 1 , wherein said content is delivered to said user and said audience user through an active video communication channel and wherein said reaction animation is one of:

displayed to all users of said video communication channel;

displayed to a subset of users of said video communication channel; and

displayed to only one user of said video communication channel.

10 . The system according to claim 1 , wherein:

said content is consumed by a plurality of audience users, each of said plurality of audience users having an associated video capture device, such that said server receives reaction data relating to each of said plurality of audience users;

wherein said animation-generation module generates animation data for at least a subset of said plurality of audience users based on corresponding reaction data;

said server further comprises a merging module for merging together said animation data from said at least a subset of said plurality of audience users, to thereby produce merged animation data; and

said reaction animation is based on said merged animation data,

such that said changes of said reaction animation are representative of movements of said at least a subset of said plurality of audience users.

11 . The system according to claim 9 , wherein multiple reaction animations are generated, each of said reaction animations corresponding to a specific subset of said plurality of audience users.

12 . The system according to claim 1 , wherein said reaction measurement module is hosted on at least one of: a computing device in communication with said video capture device; said server; and a second server.

13 . The system according to claim 1 , wherein said reaction data is determined in near-real time and said reaction animation is updated in near-real time.

14 . The system according to claim 1 , wherein said reaction animation is recorded and stored for non-real-time display.

15 . The system according to claim 1 , wherein at least one user is shown a different reaction animation than at least one other user.

16 . A system for displaying animations to users, said system comprising:

a reaction measurement module receiving video data of audience users from associated video capture devices, wherein said reaction measurement module determines reaction data from said video data and wherein said reaction data represents reactions of said audience users to content;

a server receiving said reaction data and said server further comprising:

an animation-generation module for generating animation data based on said reaction data, said animation data being for use in reaction animations;

a merging module for merging together at least a subset of said animation data to thereby produce merged animation data;

wherein said merged animation data is for sending to a computing device used by at least one of said users,

wherein at least one reaction animation is displayed to said at least one of said users at said device,

wherein changes of said at least one reaction animation are representative of movements of at least a subset of said audience users,

wherein said changes of said at least one reaction animation are one of:

changing from a first two-dimensional non-facial shape to at least one second two-dimensional non-facial shape; and

movement of a plurality of particles displayed on said computing device, an amount of movement of said particles being based on one or more of: large facial expression movements from a minority of said audience users; general movements of all of said audience users; and similar movements and facial expressions of many of said audience users at a specific time,

wherein each two-dimensional non-facial shape is representative of at least one audience user,

wherein an origin of said at least one audience user's head maps to a geometric origin of said each two-dimensional non-facial shape, and

wherein said reaction data is representative of user engagement with said content.

17 . A method for displaying animations to a user, said method comprising the steps of:

receiving, from at least one video capture device, video data of at least one audience user consuming content;

determining reaction data from said video data;

based on said reaction data, generating animation data for use in a reaction animation; and

sending said animation data to a computing device used by said user, wherein said animation data is used to display said reaction animation at said computing device

wherein changes of said reaction animation are representative of movements of said at least one audience user,

wherein said changes in said reaction animation are one of:

changing from a first two-dimensional non-facial shape to at least one second two-dimensional non-facial shape; and

movement of a plurality of particles displayed on said computing device, an amount of movement of said particles being based on one or more of: large facial expression movements from a minority of said audience users; general movements of all of said audience users; and similar movements and facial expressions of many of said audience users at a specific time,

wherein each two-dimensional non-facial shape is representative of at least one audience user,

wherein an origin of said at least one audience user's head maps to a geometric origin of said each two-dimensional non-facial shape, and

wherein said reaction data is representative of user engagement with said content.

18 . The method according to claim 17 , wherein said content is video content and said content is displayed to said user concurrently with said reaction animation.

19 . The method according to claim 17 , wherein multiple reaction animations are generated, each of said reaction animations corresponding to a specific subset of said audience users.

20 . The method according to claim 17 , wherein changing from a first two-dimensional non-facial shape to at least one second two-dimensional non-facial shape maps to said movements of said audience user.