IP Library Granted Patent US 9,716,883
Granted Patent B2
US 9,716,883 · App. 14/502,651 · Granted Jul 25, 2017

Tracking and determining pictures in successive interdependency levels

Inventors: Arturo A. Rodriguez (Norcross, GA); Benjamin M. Cook (Flowery Branch, GA); Ken L. Eppinett (Madison, AL); John R. Bean (Madison, AL)
Assignee: Cisco Technology, Inc.
H04N19/00424H04N19/30H04N19/61H04N21/2365H04N21/23418H04N21/4343H04N21/4347H04N21/8455H04N7/17318
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,716,883
App. No.
14/502,651
Granted
Jul 25, 2017
Kind
B2
Abstract

Systems and methods that receive a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level, track the compressed pictures to ascertain which of the compressed pictures correspond to the first level, and responsive to ascertaining which of the compressed pictures correspond to the first level, tracking the compressed pictures to ascertain which of the compressed pictures correspond to the second level.

Claims (50)

1. A method, comprising:

receiving a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

performing a first level of tracking of pictures of the received stream to ascertain whether pictures belong to a first level;

performing a second level of tracking of pictures with an ascending presentation time stamp (PTS), wherein performing a second level of tracking of pictures comprises:

ascertaining the first level of pictures based on an indicated adherence to one or more picture independency rules received with the video stream,

determining that a predetermined number of first level of pictures have been tracked, and

performing, when the predetermined number of first level pictures have been tracked, the second level tracking of pictures with the ascending PTS; and

classifying pictures immediately subsequent to pictures tracked at the second level of tracking as candidates for a third level of tracking; and

processing the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

2. The method of claim 1 , wherein the first level of tracking comprises tracking random access points (RAPs).

3. The method of claim 1 , wherein the first level of tracking commences during a previous group of pictures (GOP) from a present GOP.

4. The method of claim 1 , further comprising resetting tracking when a RAP comprises an instantaneous decoder refresh (IDR).

5. The method of claim 1 , further comprising commencing the second level of tracking only after a sufficient number of RAPs have been ascertained.

6. The method of claim 1 , further comprising employing a confirmation during tracking based on determining an adherence of one or more tracked pictures to the one or more picture interdependency rules.

7. The method of claim 1 , wherein the one or more picture interdependency rules is regarding compressed bit size.

8. The method of claim 1 , wherein tracking continues until a predefined number of ascending PTS markers are detected.

9. A method comprising:

receiving a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

performing a first level of tracking of RAPs in the received stream;

classifying RAPs tracked by the first level of tracking as first level pictures;

performing a second level of tracking of pictures with an ascending PTS, wherein performing the second level of tracking comprises;

ascertaining the first level pictures based on an indicated adherence to picture independency rules received with the video stream,

determining that a predetermined number of the first level pictures have been tracked, and

performing, when the predetermined number of the first level pictures have been tracked, the second level of tracking of pictures with the ascending PTS;

classifying pictures tracked by the second level of tracking as second level pictures;

classifying pictures immediately subsequent to second level pictures as candidates for a third level of tracking; and

process the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

10. The method of claim 9 , further comprising making the picture interdependency rules based on whether a PTS associated with a candidate level three picture is less than a PTS associated with an immediately preceding second level picture.

11. The method of claim 9 , further comprising making the picture interdependency rules based on whether a PTS associated with a candidate level three picture is greater than a predetermined threshold value.

12. The method of claim 9 , further comprising making the picture interdependency rules based on whether a difference between a PTS associated with a candidate level three picture and a PTS associated with an immediately preceding second level picture is greater than a predetermined threshold value.

13. The method of claim 12 , further comprising determining a time symmetry between a plurality of bounding pictures.

14. An apparatus, comprising:

a memory comprising instructions; and

one or more processors configured to execute the instructions to cause the one or more processors to:

receive a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

perform a first level of tracking of RAPs in the received stream;

classify RAPs tracked by the first level of tracking as first level pictures;

perform a second level of tracking of pictures with an ascending PTS, wherein the one or more processors being configured to perform the second level of tracking comprises the one or more processors being further configured to:

ascertain the first level pictures based on an indicated adherence to picture independency rules received with the video stream,

determine that a predetermined number of first level pictures have been tracked, and

perform, when the predetermined number of first level pictures have been tracked, the second level tracking of pictures with the ascending PTS;

classify pictures tracked by the second level of tracking as second level pictures; and

classify pictures immediately subsequent to second level pictures as candidates for a third level, of tracking; and

process the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

15. The apparatus of claim 14 , the instructions further comprising confirming the candidates for level three pictures prior to classification as level three pictures.

16. The apparatus of claim 15 , wherein the confirmation is based on one or more confirmation factors.

17. The apparatus of claim 16 , wherein one of the one or more confirmation factors ascertains from a PES layer from a candidate level three picture whether its corresponding PTS-DTS is greater than two.

18. The apparatus of claim 16 , wherein one of the one or more confirmation factors determines the size of a candidate level three picture relative to an immediately preceding picture.

19. The apparatus of claim 14 , wherein the first, second, and third levels of compressed picture correspond to first, second, and third tiers of picture interdependencies, respectively, wherein the first, second, and third tiers of picture interdependencies are different from each other.

20. The apparatus of claim 14 , the instructions further comprising annotating the first, second, and third levels of pictures in a storage device.

Continuity (5)
Continuation 12333296 · Dec 11, 2008
Provisional Application 61032478 · Feb 29, 2008
Provisional Application 61013209 · Dec 12, 2007
Provisional Application 61007074 · Dec 11, 2007
Related Publication 20150016549A1 · Jan 15, 2015