Systems and methods for improving live streaming

1 . A method, the method comprising:

receiving, at a computing device and at a first time, a content item comprising a plurality of segments, wherein the content item comprises a live content item;

identifying that a first segment of the plurality of segments is below a first quality threshold;

characterizing the first segment;

selecting, from a plurality of neural networks and based at least in part on the characterization of the first segment, a neural network that will give a largest increase in quality of the first segment;

processing the first segment with the selected neural network to improve the quality of the first segment;

updating the content item with the improved-quality first segment;

receiving, at a second time, a request to access the content item; and

transmitting at least a first portion of the updated content item comprising the improved-quality first segment in response to the request;

identifying a second segment of the updated content item that is above a second quality threshold;

refining the selected neural network based on, at least in part, the second segment of the updated content item to produce a refined neural network, wherein the refining comprises updating one or more weights of the selected neural network;

processing a third segment of the content item with the refined neural network to improve the quality of the third segment;

updating the content item with the improved-quality third segment; and

transmitting, substantially in real time, at least a second portion of the updated content item comprising the improved-quality third segment.

2 . The method of claim 1 , wherein:

identifying the second segment comprises identifying a subset of the plurality of segments of the content item that are above the second quality threshold, wherein the subset comprises the second segment; and

refining the selected neural network comprises refining the selected neural network based on, at least in part, the identified subset of the plurality of segments.

3 . The method of claim 2 , further comprising refining the selected neural network on data, received from a second computing device, that is related to the first segment.

4 . The method of claim 1 , wherein:

the content item is a first content item and the plurality of segments are a first plurality of segments, the method further comprising:

receiving, at a third time, a second content item comprising a second plurality of segments, wherein:

the third time is between the first time and the second time;

the second plurality of segments correspond to the first plurality of segments; and

at least a subset of segments of the second plurality of segments are of a higher quality than the corresponding segments of the first plurality of segments; and

processing the first segment to improve the quality of the first segment further comprises:

identifying the corresponding segment in the second plurality of segments;

identifying that the corresponding segment is of a higher quality than the first segment; and

replacing the first segment with the higher-quality corresponding segment.

5 . The method of claim 4 , wherein the computing device is a first computing device, the method further comprising:

a second computing device for transmitting, via a network, the first and second content items to the first computing device;

capturing, at the second computing device, a capture;

identifying, based at least in part on network conditions, a first target bitrate;

generating, at the second computing device, a first content item from the capture, wherein the first plurality of segments is generated based at least in part on the first target bitrate;

identifying, based at least in part on a desired quality, a second target bitrate;

generating, at the second computing device, a second content item from the capture, wherein the second plurality of segments are generated based at least in part on the second target bitrate;

storing at least a subset of the second plurality of segments at the second computing device;

transmitting, from the second computing device to the first computing device, the first plurality of segments;

identifying unutilized network capacity; and

transmitting, from the second computing device to the first computing device, the second plurality of segments when there is unutilized network capacity.

6 . The method of claim 5 , further comprising:

identifying, at the second computing device, that a quality of a segment of the first plurality of segments is below a third threshold;

identifying a corresponding higher-quality segment in the second plurality of segments; and

prioritizing the identified corresponding higher-quality segment for transmission from the second computing device to the first computing device.

7 . The method of claim 1 , further comprising:

generating a manifest file based at least in part on the plurality of segments of the content item;

identifying that a difference in quality between the first segment and the improved-quality first segment is above a threshold value; and

updating the manifest file to refer to the improved-quality first segment.

8 . The method of claim 1 , wherein:

the content item is a first content item and the plurality of segments are a first plurality of segments, the method further comprising:

receiving, at a third time, a second content item comprising a second plurality of segments, wherein:

the third time is between the first time and the second time;

the second plurality of segments correspond to the first plurality of segments; and

at least a subset of segments of the second plurality of segments are of a higher quality than the corresponding segments of the first plurality of segments; and

processing the first segment to improve the quality of the first segment further comprises:

determining that a difference between the quality of the first segment and the corresponding segment in the second plurality of segments is above a threshold value;

identifying the corresponding segment in the second plurality of segments;

identifying that the corresponding segment is of a higher quality than the first segment; and

replacing the first segment with the higher-quality corresponding segment.

9 . The method of claim 1 , wherein improving the quality of the first segment comprises improving the quality of audio and video components of the first segment.

10 . A system, the system comprising:

a communication port;

a memory storing instructions; and

control circuitry communicably coupled to the memory and the communication port and configured to execute instructions to:

receive, at a computing device and at a first time, a content item comprising a plurality of segments, wherein the content item comprises a live content item;

identify that a first segment of the plurality of segments is below a first quality threshold;

characterize the first segment;

select, from a plurality of neural networks and based at least in part on the characterization of the first segment, a neural network that will give a largest increase in quality of the first segment;

process the first segment with the selected neural network to improve the quality of the first segment;

update the content item with the improved-quality first segment;

receive, at a second time, a request to access the content item; and

transmit at least a first portion of the updated content item comprising the improved-quality first segment in response to the request;

identify a second segment of the updated content item that is above a second quality threshold;

refine the selected neural network based on, at least in part, the second segment of the updated content item to produce a refined neural network, wherein the refining comprises updating one or more weights of the selected neural network;

process a third segment of the content item with the refined neural network to improve the quality of the third segment;

update the content item with the improved-quality third segment; and

transmit, substantially in real time, at least a second portion of the updated content item comprising the improved-quality third segment.

11 . The system of claim 10 , wherein:

the control circuitry configured to identify the second segment is configured to identify a subset of the plurality of segments of the content item that are above the second quality threshold, wherein the subset comprises the second segment; and

the control circuitry configured to refine the selected neural network is configured to refine the selected neural network based on, at least in part, the identified subset of the plurality of segments.

12 . The system of claim 11 , wherein the control circuitry configured to refine the selected neural network is further configured to refine the identified neural network on data, received from a second computing device, that is related to the first segment.

13 . The system of claim 10 , wherein:

the content item is a first content item, the plurality of segments are a first plurality of segments, and the control circuitry is further configured to:

receive, at a third time, a second content item comprising a second plurality of segments, wherein:

the third time is between the first time and the second time;

the second plurality of segments correspond to the first plurality of segments, and

at least a subset of segments of the second plurality of segments are of a higher quality than the corresponding segments of the first plurality of segments; and

the control circuitry configured to process the first segment to improve the quality of the first segment is further configured to:

identify the corresponding segment in the second plurality of segments;

identify that the corresponding segment is of a higher quality than the first segment; and

replace the first segment with the higher-quality corresponding segment.

14 . The system of claim 13 , wherein the computing device is a first computing device, the system further comprising:

a second computing device for transmitting, via a network, the first and second content items to the first computing device, and wherein the control circuitry is further configured to:

capture, at the second computing device, a capture;

identify, based at least in part on network conditions, a first target bitrate;

generate, at the second computing device, a first content item from the capture, wherein the first plurality of segments is generated based at least in part on the first target bitrate;

identify, based at least in part on a desired quality, a second target bitrate;

generate, at the second computing device, a second content item from the capture, wherein the second plurality of segments are generated based at least in part on the second target bitrate;

store at least a subset of the second plurality of segments at the second computing device;

transmit, from the second computing device to the first computing device, the first plurality of segments;

identify unutilized network capacity; and

transmit, from the second computing device to the first computing device, the second plurality of segments when there is unutilized network capacity.

15 . The system of claim 14 , wherein the control circuitry is further configured to:

identify, at the second computing device, that a quality of a segment of the first plurality of segments is below a third threshold;

identify a corresponding higher-quality segment in the second plurality of segments; and

prioritize the identified corresponding higher-quality segment for transmission from the second computing device to the first computing device.

16 . The system of claim 10 , wherein the control circuitry is further configured to:

generate a manifest file based at least in part on the plurality of segments of the content item;

identify that a difference in quality between the first segment and the improved-quality first segment is above a threshold value; and

update the manifest file to refer to the improved-quality first segment.

17 . The system of claim 10 , wherein the content item is a first content item and the plurality of segments are a first plurality of segments, the control circuitry further configured to:

receive, at a third time, a second content item comprising a second plurality of segments, wherein:

the third time is between the first time and the second time;

the second plurality of segments correspond to the first plurality of segments; and

at least a subset of segments of the second plurality of segments are of a higher quality than the corresponding segments of the first plurality of segments; and

the control circuitry configured to process the first segment to improve the quality of the first segment is further configured to:

determine that a difference between the quality of the first segment and the corresponding segment in the second plurality of segments is above a threshold value;

identify the corresponding segment in the second plurality of segments;

identify that the corresponding segment is of a higher quality than the first segment; and

replace the first segment with the higher-quality corresponding segment.

18 . The system of claim 10 , wherein the control circuitry configured to improve the quality of the first segment is further configured to improve the quality of audio and video components of the first segment.

19 . The method of claim 1 , wherein the refining the selected neural network comprises comparing different versions of the second segment of the content item, wherein the different versions have different bitrates and are accessible via a variable bitrate ladder.

20 . The system of claim 10 , wherein the control circuitry configured to refine the selected neural network is further configured to compare different versions of the second segment of the content item, wherein the different versions have different bitrates and are accessible via a variable bitrate ladder.