IP Library Granted Patent US 11,871,093
Granted Patent B2
US 11,871,093 · App. 17/532,722 · Granted Jan 9, 2024

Socially annotated audiovisual content

Inventor: Daniel Strickland (Seattle, WA)
Assignee: WP INTERACTIVE MEDIA, INC.
H04N21/8547H04N21/23418H04N21/435H04N21/44218H04N21/8133
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,871,093
App. No.
17/532,722
Granted
Jan 9, 2024
Kind
B2
Abstract

A system that includes a content distributor, a reaction content server, and a plurality of viewer computer devices. The content distributor provides original content to the viewer computer devices. The viewer computer devices present the original content to viewers and generate viewer-reaction content of the viewers during presentation of the original content. The viewer computer devices provide the viewer-reaction content to the reaction content server to provide to other viewer computer devices. The viewer computer devices also present viewer-reaction content received from the reaction content server to the viewers in synchronization with the original content, which allows the viewers to experience other viewer's reactions while experiencing the same original content.

Claims (78)

1. A system, comprising:

a first processor-readable storage medium having first computer instructions that, when executed by a first processor of a server computing device, cause the first processor to perform first actions, the first actions including:

analyzing audiovisual content to identify a moment-of-interest in the audiovisual content;

in response to identifying the moment-of-interest:

identifying a start of the moment-of-interest;

setting a capture-reaction flag indicating a start of the moment-of-interest;

modifying the capture-reaction flag to be prior to the start of the moment-of-interest; and

including the modified capture-reaction flag in the audiovisual content:

providing the audiovisual content with the modified capture-reaction flag to a first viewer computing device; and

a second processor-readable storage medium having second computer instructions that, when executed by a second processor of the first viewer computing device, cause the second processor to perform second actions, the second actions including:

presenting the audiovisual content to a first viewer of the first viewer computing device;

during presentation of the audiovisual content to the first viewer, capturing a reaction of the first viewer prior to and during the moment-of-interest based on the modified capture-reaction flag; and

providing the reaction to the server computing device.

2. The system of claim 1 , wherein execution of the second computer instructions by the second processor cause the second processor to perform further actions, the further actions comprising:

analyzing the audiovisual content for the modified capture-reaction flag during presentation of the audiovisual content to the first viewer; and

in response to identifying the modified capture-reaction flag, utilizing a microphone or a camera associated with the first viewer computing device to generate the reaction of the first viewer.

3. The system of claim 1 , wherein execution of the first computer instructions by the first processor cause the first processor to perform further actions, the further actions comprising:

obtaining the reaction from the first viewer computing device.

4. The system of claim 1 , wherein execution of the first computer instructions by the first processor cause the first processor to perform further actions, the further actions comprising:

receiving the reaction from the first viewer computing device; and

providing the reaction along with the audiovisual content to a second viewer computing device for presentation to a second viewer.

5. The system of claim 1 , further comprising:

a third processor-readable storage medium having third computer instructions that, when executed by a third processor of a second viewer computing device, cause the third processor to perform third actions, the third actions including:

analyzing the audiovisual content for the modified capture-reaction flag during presentation of the audiovisual content to a second viewer of the second viewer computing device; and

in response to identifying the modified capture-reaction flag, presenting the reaction to the second viewer along with the audiovisual content.

6. The system of claim 1 , further comprising:

a third processor-readable storage medium having third computer instructions that, when executed by a third processor of a second viewer computing device, cause the third processor to perform third actions, the third actions including:

presenting the audiovisual content to a second viewer of the second viewer computing device; and

presenting the reaction to the second viewer during presentation of the moment-of-interest.

7. The system of claim 1 , wherein execution of the second computer instructions by the second processor cause the second processor to perform further actions, the further actions comprising:

receiving another reaction of a second viewer from the server computing device; and

presenting the other reaction along with the audiovisual content to the first viewer during presentation of the moment-of-interest to the first viewer.

8. A method, comprising:

analyzing audiovisual content for a moment-of-interest in the audiovisual content;

generating information indicative of the moment-of-interest in the audiovisual content, including:

identifying a start of the moment-of-interest; and

modifying the information to indicate a time prior to the start of the moment-of-interest in which a reaction of a viewer is to be captured;

providing the audiovisual content with the generated information for presentation of the audiovisual content to a first viewer; and

receiving a reaction of the first viewer that was generated during presentation of the audiovisual content to the first viewer based on the generated information.

9. The method of claim 8 , further comprising:

providing the reaction along with the audiovisual content to a viewer computing device for presentation to a second viewer.

10. The method of claim 8 , further comprising:

providing the audiovisual content with the generated information to a viewer computing device;

receiving, from the viewer computing device, another reaction of a second viewer that was generated during presentation of the audiovisual content to the second viewer based on the generated information; and

providing the other reaction for presentation to the first viewer during presentation of the moment-of-interest of the audiovisual content to the first viewer.

11. The method of claim 8 , wherein generating the information indicative of the moment-of-interest comprises:

generating a capture-reaction flag indicating the time prior to the start of the moment-of-interest in the audiovisual content; and

embedding the capture-reaction flag in the audiovisual content.

12. The method of claim 8 , further comprising:

presenting the audiovisual content to the first viewer; and

during presentation of the audiovisual content to the first viewer, employing the generated information to capture the reaction of the first viewer.

13. The method of claim 8 , further comprising:

presenting the audiovisual content to the first viewer;

identifying the moment-of-interest during presentation of the audiovisual content to the first viewer based on the generated information; and

in response to identifying the moment-of-interest during presentation of the audiovisual content to the first viewer, capturing the reaction of the first viewer via a microphone or a camera.

14. The method of claim 8 , wherein analyzing the audiovisual content for the moment-of-interest in the audiovisual content comprises:

employing at least one image processing technique on the audiovisual content and at least one moment-of-interest rule to identify the moment-of-interest.

15. A computing device, comprising:

a memory that is configured to stores computer instructions; and

at least one processor that is configured to execute the computer instructions to:

receive content;

identify a moment-of-interest in the content;

identify a start of the moment-of-interest;

generate a capture-reaction flag to be prior to the start of the moment-of-interest;

modify the content to include the capture-reaction flag associated with the moment-of-interest; and

receive a reaction of a viewer during presentation of the content to the viewer based on the capture-reaction flag.

16. The computing device of claim 15 , wherein the at least one processor is configured to further execute the computer instructions to:

provide the content and the capture-reaction flag to a viewer computing device of the viewer; and

receive the reaction from the viewer computing device.

17. The computing device of claim 15 , wherein the at least one processor is configured to further execute the computer instructions to:

present the content to the viewer; and

generate the reaction during the presentation of the content based on the capture-reaction flag.

18. The computing device of claim 15 , wherein the at least one processor identifies the moment-of-interest by being configured to further execute the computer instructions to:

analyze the content for the moment-of-interest based on a plurality of moment-of-interest rules.

19. The computing device of claim 15 , wherein the at least one processor identifies the moment-of-interest by being configured to further execute the computer instructions to:

receive user input identifying the moment-of-interest in the content.

20. The computing device of claim 15 , wherein the at least one processor is configured to further execute the computer instructions to:

provide the reaction along with the moment-of-interest to another viewer during presentation of the content to the other viewer.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2023
From: STRICKLAND, DANIEL
To: REALNETWORKS, INC.
Reel/Frame 063057/0948 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2023
From: REALNETWORKS, INC.
To: SCENER INC.
Reel/Frame 063057/0958 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2023
From: SCENER INC.
To: WP INTERACTIVE MEDIA, INC.
Reel/Frame 062434/0501 →
Continuity (3)
Continuation 17043585
Provisional Application 62650499 · Mar 30, 2018
Related Publication 20220086537A1 · Mar 17, 2022