IP Library Granted Patent US 9,955,183
Granted Patent B2
US 9,955,183 · App. 15/181,750 · Granted Apr 24, 2018

Open to closed group of pictures conversion in interframe video compression

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,955,183
App. No.
15/181,750
Granted
Apr 24, 2018
Kind
B2
Abstract

Methods of converting an open group of pictures (GOP) to a Closed GOP are described that remove backward references to the GOP prior to the GOP undergoing conversion in an Open GOP interframe-encoded video stream. Within the GOP undergoing conversion, bipredictive frames with backward references to the prior GOP are replaced with frames referring only to the I frame of the GOP undergoing conversion, which is flagged as an IDR frame. Consolidation and assembly of video clips that are encoded using Open GOP compression schemes generally result in broken interframe references between GOPs. To address this, existing methods involve significant decoding and re-encoding of edited video sequences. The described methods serve to break the backward chain of references in the encoded stream, resulting in reduced re-encoding requirements, with attendant reduced quality degradation of the edited sequence.

Claims (30)

1. A method of converting an open group of pictures (GOP) used in interframe video compression into a Closed GOP, the method comprising:

receiving an encoded bitstream that has been encoded using Open GOP interframe video compression;

extracting a first Open GOP from the bitstream;

decoding at least part of the first Open GOP to generate a first group of uncompressed frames of video;

extracting a second Open GOP sequentially following the first Open GOP in the bitstream, wherein the extracted second GOP comprises a series of encoded frames including an intra-coded picture (I frame);

referring to at least one frame of the first group of uncompressed frames, decoding at least a part of the second Open GOP to generate a second group of uncompressed frames of video;

re-encoding the second group of uncompressed frames to generate a re-encoded second GOP comprising one or more re-encoded bipredictive coded pictures (B frames) having a display order preceding an I frame of the second GOP, the re-encoded B frames being re-encoded with reference to a frame generated by decompressing the I frame of the second GOP as received in the bitstream and without reference to a frame of the first Open GOP;

converting the second Open GOP to a corresponding Closed GOP, the Closed GOP comprising:

the one or more re-encoded B frames;

the I frame of the second GOP as received in the encoded bitstream, wherein the encoder flags the I frame of the second GOP as received in the encoded bitstream as an instantaneous decoder refresh (IDR) frame; and

encoded data as received in the encoded bitstream for each frame of the second GOP that is displayed sequentially following the I frame of the second GOP.

2. The method of claim 1 , wherein the bitstream represents part of an encoded video clip that is being consolidated to generate a consolidated video clip, and wherein the second Open GOP that is converted into a corresponding Closed GOP is a first full GOP of the consolidated video clip sequentially following a start point of the consolidated video clip.

3. The method of claim 2 , wherein the start point of the consolidated video clip is a start point of the first full GOP of the consolidated video clip.

4. The method of claim 2 , wherein the start point of the consolidated clip falls within the first GOP, and the consolidated clip includes a short GOP prior to the first full GOP, wherein the short GOP is a Closed GOP comprising frames of the first GOP temporally subsequent to the start point of the consolidated clip.

5. The method of claim 1 , wherein the bitstream represents an encoded video clip that is being assembled into a sequence comprising portions of a plurality of clips, and wherein the second Open GOP that is converted into a corresponding Closed GOP is a first full GOP of a portion of the encoded video clip that is included in the assembled sequence.

6. The method of claim 1 , wherein the encoded bitstream is encoded using intraframe compression in addition to the Open GOP interframe compression.

7. The method of claim 6 , wherein the intraframe compression is lossy.

8. The method of claim 1 , wherein the bitstream is an H.264 encoded bitstream.

9. A computer program product comprising:

a non-transitory computer-readable medium with computer program instructions encoded thereon, wherein the computer program instructions, when processed by a computer, instruct the computer to perform a method of converting an open group of pictures (GOP) used in interframe video compression into a Closed GOP, the method comprising:

receiving an encoded bitstream that has been encoded using Open GOP interframe video compression;

extracting a first Open GOP from the bitstream;

decoding at least part of the first Open GOP to generate a first group of uncompressed frames of video;

extracting a second Open GOP sequentially following the first Open GOP in the bitstream, wherein the extracted second GOP comprises a series of encoded frames including an intra-coded picture (I frame);

referring to at least one frame of the first group of uncompressed frames, decoding at least a part of the second Open GOP to generate a second group of uncompressed frames of video;

re-encoding the second group of uncompressed frames to generate a re-encoded second GOP comprising one or more re-encoded bipredictive coded pictures (B frames) having a display order preceding an I frame of the second GOP, the re-encoded B frames being re-encoded with reference to a frame generated by decompressing the I frame of the second GOP as received in the bitstream and without reference to a frame of the first Open GOP;

converting the second Open GOP to a corresponding Closed GOP, the Closed GOP comprising:

the one or more re-encoded B frames;

the I frame of the second GOP as received in the encoded bitstream, wherein the encoder flags the I frame of the second GOP as received in the encoded bitstream as an instantaneous decoder refresh (IDR) frame; and

encoded data as received in the encoded bitstream for each frame of the second GOP that is displayed sequentially following the I frame of the second GOP.

Assignments (3)
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 054900/0716) Recorded Nov 8, 2023
From: JPMORGAN CHASE BANK, N.A.
To: AVID TECHNOLOGY, INC.
Reel/Frame 065523/0146 →
PATENT SECURITY AGREEMENT Recorded Nov 8, 2023
From: AVID TECHNOLOGY, INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 065523/0194 →
SECURITY INTEREST Recorded Jan 5, 2021
From: AVID TECHNOLOGY, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054900/0716 →