IP Library Granted Patent US 10,536,708
Granted Patent B2
US 10,536,708 · App. 15/712,058 · Granted Jan 14, 2020

Efficient frame loss recovery and reconstruction in dyadic hierarchy based coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,536,708
App. No.
15/712,058
Granted
Jan 14, 2020
Kind
B2
Abstract

A method for efficient frame loss recovery and reconstruction (EFLRR) in a dyadic hierarchy is described herein. The method includes obtaining a current frame of a group of pictures. The method also includes calculating a Dyadic Hierarchy Picture Index difference based on a layer information in response to a prior frame missing in the group of pictures. Finally, the method includes decoding the current frame in response to a determined frame continuity based on the Dyadic Hierarchy Picture Index difference.

Claims (38)

1. A system, comprising:

a display to render a plurality of frames;

a memory that is to store instructions and that is communicatively coupled to the display; and

a processor communicatively coupled to the display and the memory, wherein when the processor is to execute the instructions, the processor is configured to:

obtain a current frame of a group of pictures;

calculate a dyadic hierarchy picture index difference (DHPIDX DIFF ) for a current frame based on a base layer and an enhancement layer information data structure in response to a prior frame missing in the group of pictures; and

decode the current frame in response to a determined frame continuity based on the dyadic hierarchy picture Index difference.

2. The system of claim 1 , wherein frame continuity indicates each frame used or referenced to code the current frame is available for referencing.

3. The system of claim 1 , where the current frame is a base layer frame, and the frame continuity is determined by the Dyadic Hierarchy Picture Index difference being equal to two to the power of a maximum supported layer value minus one.

4. The system of claim 1 , where the current frame is a high level frame, and the frame continuity is determined by the Dyadic Hierarchy Picture Index difference being equal to two to the power of a maximum supported layer value minus a temporal layer identification (TID).

5. The system of claim 1 , wherein in response to the current frame being an Instantaneous Decoding Refresh (IDR) frame, the layer information data structure is reset.

6. The system of claim 1 , wherein in response to the current frame being not decodable, retransmission is requested.

7. The system of claim 1 , wherein in response to no packet loss in a network transmission the dyadic hierarchy picture index difference is not calculated and the current frame is decoded according to information stored in a packet header.

8. The system of claim 1 , wherein a dyadic hierarchy picture index difference is maintained for each frame and used to determine decodability in response to a packet loss.

9. The system of claim 1 , wherein a Dyadic Hierarchy Picture Index difference is maintained for each frame and is transmitted to a receiver in-band via a network transmission packet.

10. The system of claim 1 , wherein a temporal identification (TID) and Dyadic Hierarchy Picture Index (DHPIDX) are cached to generate a layer information data structure array of that is sized according to the maximum frames supported.

11. A method, comprising:

obtaining a current frame of a group of pictures;

calculating a dyadic hierarchy picture index difference (DHPIDX DIFF ) for a current frame based on a base layer and an enhancement layer information data structure in response to a prior frame missing in the group of pictures;

decoding the current frame in response to a determined frame continuity based on the dyadic hierarchy picture index difference; and

requesting re-transmission of a frame in response to a broken frame continuity.

12. The method of claim 11 , wherein a frame continuity indicates each frame used to code the current frame is available for referencing.

13. The method of claim 11 , where the current frame is a base layer frame, and the frame continuity is determined by the dyadic hierarchy picture index difference being equal to two to the power of a maximum supported layer value minus one.

14. The method of claim 11 , where the current frame is a high level frame, and the frame continuity is determined by the dyadic hierarchy picture index difference being equal to two to the power of a maximum supported layer value minus a temporal layer identification (TID).

15. The method of claim 11 , wherein in response to the current frame being an IDR frame, a data structure is reset.

16. The method of claim 11 , wherein in response to the current frame being not decodable, retransmission is requested.

17. The method of claim 11 , wherein in response to no packet loss on in a network transmission the dyadic hierarchy picture index difference is not calculated and the current frame is decoded according to information stored in a packet header.

18. An apparatus, comprising:

an image capture mechanism to obtain a current frame of a group of pictures;

a counter to calculate a dyadic hierarchy picture index difference (DHPIDX DIFF ) for a current frame based on a base layer and an enhancement layer information data structure in response to a prior frame missing in the group of pictures; and

a decoder to decode the current frame in response to a determined frame continuity based on the dyadic hierarchy picture index difference.

19. The apparatus of claim 18 , wherein frame continuity indicates each frame referenced to code the current frame is available for referencing.

20. The apparatus of claim 18 , where the current frame is a base layer frame, and the frame continuity is determined by the dyadic hierarchy picture index difference being equal to two to the power of a maximum supported layer value minus one.

21. The apparatus of claim 18 , where the current frame is a high level frame, and the frame continuity is determined by the dyadic hierarchy picture index difference being equal to two to the power of a maximum supported layer value minus a temporal layer identification (TID).

22. The apparatus of claim 18 , wherein in response to the current frame being an IDR frame, the layer information data structure is reset.

23. The apparatus of claim 18 , wherein in response to the current frame being not decodable, retransmission is requested.

24. The apparatus of claim 18 , wherein in response to no packet loss on in a network transmission the dyadic hierarchy picture index difference is not calculated and the current frame is decoded according to information stored in a packet header.

25. The apparatus of claim 18 , wherein a dyadic hierarchy picture index difference is maintained for each frame and used to determine decodability in response to a packet loss.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: INTEL CORPORATION
To: TAHOE RESEARCH, LTD.
Reel/Frame 061175/0176 →