IP Library Granted Patent US 12,047,616
Granted Patent B2
US 12,047,616 · App. 17/507,503 · Granted Jul 23, 2024

Systems and methods for providing content during reduced streaming quality

Inventors: Vikram Makam Gupta (Karnataka, IN); Vishwas Sharadanagar Panchaksharaiah (Karnataka, IN)
Assignee: Rovi Guides, Inc.
H04N21/23406H04N21/23418H04N21/2343H04N21/2401H04N21/2402H04N21/44004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,047,616
App. No.
17/507,503
Granted
Jul 23, 2024
Kind
B2
Abstract

Systems and methods are described herein for providing content during reduced streaming quality. Data streaming is susceptible to degradation in quality that adversely affects the delivery of content. For example, sufficient reduction in streaming quality can cause video and audio portions of a data stream to become unsynchronized. The system compares currently streamed video frames to previously received video frames to identify suitable replacement video frames for the currently streamed video frames in the event that the currently streamed video frames are affected by the sufficiently reduced streaming quality.

Claims (67)

1. A method comprising:

receiving a segment of a content item for display in a streaming session;

analyzing a quality of the segment;

determining that the quality of the segment of the content item does not comply with a predetermined standard;

in response to determining that the quality of the segment of the content item does not comply with the predetermined standard, comparing a currently streamed video frame of the content item to a previously stored video frame of the content item from the same streaming session;

determining a replacement portion based on the comparing, wherein the replacement portion is identified prior to the determining that the quality of the segment of the content item does not comply with the predetermined standard, and wherein the replacement portion is based on the previously stored video frame of the content item from the same streaming session;

replacing a portion of the segment with the replacement portion; and

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion.

2. The method of claim 1 , further comprising:

determining, using the control circuitry, that the previously stored video frame is similar to the currently streamed video frame; and

determining that the similar previously stored video frame can be used in place of the currently streamed video frame as the replacement portion,

wherein the similar previously stored video frame shows scene continuity with the currently streamed video frame, and

wherein the comparing the currently streamed video frame to the previously stored video frame comprises comparing a scene including the currently streamed video frame to a scene including the previously stored video frame.

3. The method of claim 1 , wherein the replacing the portion of the segment with the replacement portion comprises at least one of replacing a video frame affected by the non-compliant quality with the previously stored video frame, replacing a video frame with a previously stored video frame while continuing to provide audio, or replacing the currently streamed video frame with a similar video frame that occurred as long ago in time as possible relative to the currently streamed video frame.

4. The method of claim 1 , wherein the replacing the portion of the segment with the replacement portion comprises replacing the segment of the content item with pre-curated video frames.

5. The method of claim 1 , wherein the previously stored video frame has a second camera angle and the currently streamed video frame has a first camera angle, wherein the first camera angle is different than the second camera angle, and wherein the replacing the portion of the segment with the replacement portion comprises replacing, based on determining the previously stored video frame having the second camera angle is similar to the currently streamed video frame having the first camera angle, the currently streamed video frame having the first camera angle with the previously stored video frame having the second camera angle while continuing to provide audio.

6. A system comprising:

input circuitry configured to:

receive a segment of a content item for display in a streaming session; and

control circuitry configured to:

analyze a quality of the segment;

determine that the quality of the segment of the content item does not comply with a predetermined standard;

in response to determining that the quality of the segment of the content item does not comply with the predetermined standard, compare a currently streamed video frame of the content item to a previously stored video frame of the content item from the same streaming session;

determine a replacement portion based on the comparing, wherein the replacement portion is identified prior to the determining that the quality of the segment of the content item does not comply with the predetermined standard, and wherein the replacement portion is based on the previously stored video frame of the content item from the same streaming session;

replace a portion of the segment with the replacement portion; and

generate for output the currently streamed video frame including the portion of the segment replaced with the replacement portion.

7. The system of claim 6 , the control circuitry further configured to:

determine, using the control circuitry, that the previously stored video frame is similar to the currently streamed video frame; and

determine that the similar previously stored video frame can be used in place of the currently streamed video frame as the replacement portion,

wherein the similar previously stored video frame shows scene continuity with the currently streamed video frame, and

wherein the comparing the currently streamed video frame to the previously stored video frame comprises comparing a scene including the currently streamed video frame to a scene including the previously stored video frame.

8. The system of claim 6 , wherein the replacing the portion of the segment with the replacement portion comprises at least one of replacing a video frame affected by the non-compliant quality with the previously stored video frame, replacing a video frame with a previously stored video frame while continuing to provide audio, or replacing the currently streamed video frame with a similar video frame that occurred as long ago in time as possible relative to the currently streamed video frame.

9. The system of claim 6 , wherein the replacing the portion of the segment with the replacement portion comprises replacing the segment of the content item with pre-curated video frames.

10. The system of claim 6 , wherein the previously stored video frame has a second camera angle and the currently streamed video frame has a first camera angle, wherein the first camera angle is different than the second camera angle, and wherein the replacing the portion of the segment with the replacement portion comprises replacing, based on determining the previously stored video frame having the second camera angle is similar to the currently streamed video frame having the first camera angle, the currently streamed video frame having the first camera angle with the previously stored video frame having the second camera angle while continuing to provide audio.

11. A non-transitory computer-readable medium having instructions encoded thereon that when executed by control circuitry performs a method comprising:

receiving a segment of a content item for display in a streaming session;

analyzing a quality of the segment;

determining that the quality of the segment of the content item does not comply with a predetermined standard;

in response to determining that the quality of the segment of the content item does not comply with the predetermined standard, comparing a currently streamed video frame of the content item to a previously stored video frame of the content item from the same streaming session;

determining a replacement portion based on the comparing, wherein the replacement portion is identified prior to the determining that the quality of the segment of the content item does not comply with the predetermined standard, and wherein the replacement portion is based on the previously stored video frame of the content item from the same streaming session;

replacing a portion of the segment with the replacement portion; and

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion.

12. The non-transitory computer-readable medium of claim 11 , the method further comprising:

determining, using the control circuitry, that the previously stored video frame is similar to the currently streamed video frame; and

determining that the similar previously stored video frame can be used in place of the currently streamed video frame as the replacement portion,

wherein the similar previously stored video frame shows scene continuity with the currently streamed video frame, and

wherein the comparing the currently streamed video frame to the previously stored video frame comprises comparing a scene including the currently streamed video frame to a scene including the previously stored video frame.

13. The non-transitory computer-readable medium of claim 11 , wherein the replacing the portion of the segment with the replacement portion comprises at least one of replacing a video frame affected by the non-compliant quality with the previously stored video frame, replacing a video frame with a previously stored video frame while continuing to provide audio, replacing the currently streamed video frame with a similar video frame that occurred as long ago in time as possible relative to the currently streamed video frame, or replacing the segment of the content item with pre-curated video frames.

14. The non-transitory computer-readable medium of claim 11 , wherein the previously stored video frame has a second camera angle and the currently streamed video frame has a first camera angle, wherein the first camera angle is different than the second camera angle, and wherein the replacing the portion of the segment with the replacement portion comprises replacing, based on determining the previously stored video frame having the second camera angle is similar to the currently streamed video frame having the first camera angle, the currently streamed video frame having the first camera angle with the previously stored video frame having the second camera angle while continuing to provide audio.

15. The method of claim 1 , comprising:

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without generating a buffering notification.

16. The method of claim 1 , comprising:

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without communicating with a central server or a cloud resource.

17. The system of claim 6 , wherein the control circuitry is configured to:

generate for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without generating a buffering notification.

18. The system of claim 6 , wherein the control circuitry is configured to:

generate for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without communicating with a central server or a cloud resource.

19. The non-transitory computer-readable medium of claim 11 , wherein the method comprises:

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without generating a buffering notification.

20. The non-transitory computer-readable medium of claim 11 , wherein the method comprises:

generating for output the currently streamed video frame including the portion of the segment replaced with the replacement portion without communicating with a central server or a cloud resource.

21. The method of claim 1 , wherein the determining the replacement portion is further based on at least one of scene continuity, a change in scene, chronological order, or dialogue association.

22. The method of claim 21 , wherein the determining the replacement portion is further based on the scene continuity, the change in the scene, the chronological order, and the dialogue association.

23. The system of claim 6 , wherein the control circuitry configured to determine the replacement portion is further configured to be based on at least one of scene continuity, a change in scene, chronological order, or dialogue association.

24. The system of claim 23 , wherein the control circuitry configured to determine the replacement portion is further configured to be based on the scene continuity, the change in the scene, the chronological order, and the dialogue association.

25. The non-transitory computer-readable medium of claim 11 , wherein the determining the replacement portion is further based on at least one of scene continuity, a change in scene, chronological order, or dialogue association.

26. The non-transitory computer-readable medium of claim 25 , wherein the determining the replacement portion is further based on the scene continuity, the change in the scene, the chronological order, and the dialogue association.

Assignments (3)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0207 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2021
From: GUPTA, VIKRAM MAKAM; PANCHAKSHARAIAH, VISHWAS SHARADANAGAR
To: ROVI GUIDES, INC.
Reel/Frame 057870/0549 →
Continuity (2)
Continuation 16557936 · Aug 30, 2019
Related Publication 20220046297A1 · Feb 10, 2022