IP Library › Granted Patent US 12,348,798
Granted Patent B2
US 12,348,798 · App. 18/542,401 · Granted Jul 1, 2025

Computer system and method for broadcasting audiovisual compositions via a video platform

Inventors: Matt Ward (San Francisco, CA); Phil Cluff (San Francisco, CA); Walker Griggs (San Francisco, CA); Garrett Graves (San Francisco, CA)
Assignee: Mux, Inc.
H04N21/2365H04N21/2187H04N21/23418
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,798
App. No.
18/542,401
Granted
Jul 1, 2025
Kind
B2
Abstract

A method including: accessing a first configuration; accessing a primary video stream comprising a first set of video content, from a first online video platform; accessing a secondary video stream comprising a second set of video content; and at an initial time, combining the primary video stream and the secondary video stream according to the default viewing arrangement; at a first time, detecting the first trigger event in the primary video stream; in response to detecting the first trigger event, combining the primary video stream and the secondary video stream according to the first target viewing arrangement, and publishing the first composite video to a second video platform; and at a second time, detecting the second trigger event in the secondary video stream; in response to detecting the second trigger event, combining the primary video stream and the secondary video stream according to the second target viewing arrangement.

Claims (176)

1. A method comprising:

for a first streaming event, defining:

a first viewing arrangement specifying a first set of viewing characteristics;

a second viewing arrangement:

specifying a second set of viewing characteristics different from the first set of viewing characteristics; and

associated with a first trigger event;

accessing a first video stream;

accessing a second video stream;

at a first time during the first streaming event:

generating a first composite video, based on the first video stream and the second video stream, according to the first viewing arrangement; and

streaming the first composite video;

at a second time during the first streaming event:

detecting the first trigger event in the first video stream;

in response to detecting the first trigger event:

generating a second composite video, based on the first video stream and the second video stream, according to the second viewing arrangement; and

streaming the second composite video; and

following completion of the first streaming event, publishing the second composite video.

2. The method of claim 1 :

wherein accessing the first video stream comprises accessing the first video stream, comprising a first set of video content, from a first video platform;

wherein accessing the second video stream comprises accessing the second video stream comprising a second set of video content from a second video platform;

wherein streaming the first composite video comprises streaming the first composite video to the first video platform concurrently with the first video stream;

wherein streaming the second composite video comprises streaming the second composite video to the second video platform concurrently with the first video stream; and

wherein publishing the first composite video comprises publishing the first composite video to the second video platform.

3. The method of claim 1 :

wherein defining the first viewing arrangement comprises:

defining the first viewing arrangement specifying the first set of viewing characteristics comprising:

a first set of video window dimensions for the first video stream and a second set of video window dimensions for the second video stream within a platform window arranged according to the first viewing arrangement;

a first video window location for the first video stream and a second video window location for the second video stream within the platform window; and

a first location of a first chat box window within the platform window; and

wherein defining the second viewing arrangement comprises:

defining the second viewing arrangement specifying the second set of viewing characteristics comprising:

a third video window size for the first video stream and a fourth video window size for the second video stream within the platform window arranged according to the second viewing arrangement;

a third video window location for the first video stream and a fourth video window location for the second video stream within the platform window; and

a second location of a second chat box window within the platform window.

4. The method of claim 1 :

wherein defining the second viewing arrangement associated with the first trigger event comprises:

defining the second viewing arrangement associated with the first trigger event comprising a first visual content trigger linked to a first resource; and

further comprising, at the second time during the first streaming event:

detecting a first visual feature at a first timestamp in the first video stream; and

correlating the first visual feature with the first visual content trigger; and

wherein generating the second composite video comprises:

in response to correlating the first visual feature with the first visual content trigger:

accessing the first resource;

incorporating the first resource into the first video stream proximal the first timestamp; and

generating the second composite video, based on the first video stream and the second video stream according to the second viewing arrangement.

5. The method of claim 4 :

wherein defining the second viewing arrangement associated with the first trigger event comprising the first visual content trigger linked to the first resource comprises:

defining the second viewing arrangement associated with the first trigger event comprising the first visual content trigger linked to the first resource, the first visual content trigger comprising a target object displayed in a frame of the first video stream, and the first resource comprising a webpage; and

wherein incorporating the first resource into the first video stream proximal the first timestamp comprises embedding the webpage into the first video stream at the first timestamp.

6. The method of claim 1 :

wherein defining the second viewing arrangement associated with the first trigger event comprises:

defining the second viewing arrangement associated with the first trigger event comprising a first visual content trigger linked to a first resource; and

further comprising, at the second time during the first streaming event:

detecting a first visual feature at a first timestamp in the second video stream; and

correlating the first visual feature with the first visual content trigger; and

wherein generating the second composite video comprises:

in response to correlating the first visual feature with the first visual content trigger:

accessing the first resource;

incorporating the first resource into the second video stream proximal the first timestamp; and

generating the second composite video, based on the first video stream, the second video stream, according to the second viewing arrangement.

7. The method of claim 1 :

wherein defining the second viewing arrangement associated with the first trigger event comprises:

defining the second viewing arrangement associated with the first trigger event comprising a first audio content trigger linked to a second resource; and

further comprising, at the second time during the first streaming event:

accessing an audio stream associated with the first video stream;

detecting a first audio sequence at a second timestamp in the audio stream; and

correlating the first audio sequence with the first audio content trigger; and

wherein generating the second composite video comprises:

in response to correlating the first audio sequence with the first audio content trigger:

accessing the second resource;

incorporating the second resource into the first video stream proximal the second timestamp; and

generating the second composite video, based on the first video stream, the second video stream, according to the second viewing arrangement.

8. The method of claim 7 :

wherein defining the second viewing arrangement associated with the first trigger event comprising the first audio content trigger linked to the second resource comprises:

defining the second viewing arrangement associated with the first trigger event comprising the first audio content trigger linked to the second resource, the first audio content trigger comprising a keyword in the audio stream of the first video stream, and the second resource comprising a first image; and

wherein incorporating the second resource into the first video stream proximal the second timestamp comprises:

embedding the first image into the first video stream at the second timestamp.

9. The method of claim 1 :

wherein defining the second viewing arrangement associated with the first trigger event comprises:

defining the second viewing arrangement associated with the first trigger event comprising a human gesture; and

wherein generating the first composite video according to the first viewing arrangement comprises:

arranging the first video stream and the second video stream into the first viewing arrangement comprising a split screen arrangement;

wherein detecting the first trigger event in the first video stream comprises:

detecting the human gesture in the first video stream; and

wherein generating the second composite video according to the second viewing arrangement comprises:

arranging the first video stream and the second video stream into the second viewing arrangement comprising an arrangement comprising the first video stream is characterized by a first window size and the second video stream is characterized by a second window size, the first window size exceeding the second window size.

10. A method comprising:

for a first set of devices:

defining a first viewing arrangement; and

defining a second viewing arrangement associated with a first visual content trigger linked to a first resource; and

accessing a first video stream recorded by a first device, in the first set of devices, from a first video platform;

during a first time period, streaming the first video stream to the first video platform according to the first viewing arrangement;

during a second time period:

detecting a first visual feature at a first timestamp in the first video stream;

correlating the first visual feature with the first visual content trigger;

in response to correlating the first visual feature with the first visual content trigger, accessing the first resource;

based on the first video stream and the first resource, generating a first composite video according to the second viewing arrangement, the first composite video including the first resource proximal the first timestamp; and

streaming the first composite video to the first video platform; and

publishing the first composite video to a second video platform.

11. The method of claim 10 , wherein publishing the first composite video to the second video platform comprises:

accessing a second target rendition associated with the second video platform;

transcoding the first composite video into the second target rendition; and

publishing the first composite video in the second target rendition to the second video platform.

12. The method of claim 10 :

wherein defining the second viewing arrangement associated with the first visual content trigger linked to the first resource comprises:

defining the first visual content trigger linked to the first resource stored at a first resource locator, the first resource comprising a first webpage;

wherein accessing the first resource comprises accessing the first webpage at the first resource locator; and

wherein generating the first composite video according to the second viewing arrangement comprises:

generating the first composite video according to the second viewing arrangement, the first composite video including the first webpage proximal the first timestamp.

13. The method of claim 10 , further comprising:

during the second time period:

receiving a set of resource removal requests from a first subset of devices in the first set of devices, the set of resource removal requests requesting removal of the first resource from the first composite video;

based on the set of resource removal requests, calculating a frequency of resource removal requests; and

in response to the frequency of resource removal requests exceeding a frequency threshold:

removing the first resource from the first composite video; and

withholding aggregation of the first video stream and the first resource into the first composite video during a third time period succeeding the second time period.

14. The method of claim 10 , further comprising:

for the first set of devices:

defining a third viewing arrangement associated with a first audio content trigger linked to a second resource; and

at a third time period:

accessing an audio stream corresponding to the first video stream;

detecting a first audio sequence in the audio stream at a second timestamp;

correlating the first audio sequence with the first audio content trigger;

in response to correlating the first audio sequence with the first audio content trigger, accessing the second resource; and

based on the first video stream and the second resource, updating the first composite video according to the third viewing arrangement, the first composite video including the second resource proximal the second timestamp; and

streaming the first composite video to the first video platform.

15. The method of claim 10 , further comprising,

identifying a second subset of devices in the first set of devices, the second subset of devices associated with a group of users characterized by a user characteristic;

for the second device subset of devices in the first set of devices:

defining a third viewing arrangement associated with a third visual content trigger linked to a third resource; and

during the second time period:

detecting a third visual feature at a second timestamp in the first video stream;

correlating the third visual feature with the third visual content trigger;

in response to correlating the third visual feature with the third visual content trigger, accessing the third resource;

based on the first video stream and the third resource, generating a second composite video according to the third viewing arrangement, the second composite video including the third resource proximal the second timestamp; and

streaming the second composite video to the second subset of devices.

16. A method comprising:

accessing a first viewing arrangement;

accessing a second viewing arrangement associated with a first audio content trigger linked to a first resource; and

accessing a first video stream from a first video platform, the first video stream comprising an audio stream;

during a first time period, streaming the first video stream to the first video platform according to the first viewing arrangement;

during a second time period:

detecting a first audio sequence at a first timestamp in the audio stream;

correlating the first audio sequence with the first audio content trigger;

in response to correlating the first audio sequence with the first audio content trigger, accessing the first resource;

based on the first video stream and the first resource, generating a first composite video according to the first viewing arrangement, the first composite video including the first resource proximal the first timestamp; and

streaming the first composite video to the first video platform; and

publishing the first composite video to a second video platform.

17. The method of claim 16 , wherein publishing the first composite video to the second video platform comprises:

accessing a first target rendition associated with the second video platform;

transcoding the first composite video into the first target rendition; and

publishing the first composite video in the first target rendition to the second video platform.

18. The method of claim 16 , further comprising:

during the second time period:

receiving a set of resource removal requests requesting removal of the first resource from the first composite video;

based on the set of resource removal requests, calculating a frequency of resource removal requests; and

in response to the frequency of resource removal requests exceeding a frequency threshold:

removing the first resource from the first composite video; and

withholding aggregation of the first video stream and the first resource into the first composite video during a third time period succeeding the second time period.

19. The method of claim 16 :

wherein defining the second viewing arrangement associated with the first audio content trigger linked to the first resource comprises:

defining the first audio content trigger linked to the first resource stored at a first resource locator, the first resource comprising a first video clip;

wherein accessing the first resource comprises accessing the first video clip at the first resource locator; and

wherein generating the first composite video according to the second viewing arrangement comprises:

generating the first composite video according to the second viewing arrangement, the first composite video including the first video clip proximal the first timestamp.

20. The method of claim 16 , further comprising:

wherein accessing the first viewing arrangement comprises:

accessing the first viewing arrangement specifying a first set of viewing characteristics comprising:

a first set of video window dimensions for the first video stream within a platform window arranged according to the first viewing arrangement;

a first video window location for the first video stream within the platform window; and

a first location of a first chat box window within the platform window; and

wherein accessing the second viewing arrangement comprises:

accessing the second viewing arrangement specifying a second set of viewing characteristics comprising:

a second video window size for the first video stream within the platform window arranged according to the second viewing arrangement;

a second video window location for the first video stream within the platform window; and

a second location of a second chat box window within the platform window.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: WARD, MATT; CLUFF, PHIL; GRIGGS, WALKER; GRAVES, GARRETT
To: MUX, INC.
Reel/Frame 066107/0541 →
Continuity (3)
Continuation 18083208 · Dec 16, 2022
Provisional Application 63290571 · Dec 16, 2021
Related Publication 20240196027A1 · Jun 13, 2024
References Cited (2)
US 10419826B2 · Geduldig · 2019 [cited by examiner]
US 20220004254A1 · Roberts · 2022 [cited by examiner]