IP Library Granted Patent US 11,539,820
Granted Patent B2
US 11,539,820 · App. 17/077,546 · Granted Dec 27, 2022

Signaling and identifying picture boundary in video payload format over IP network

Inventors: Stephan Wenger (Hillsborough, CA); Byeongdoo Choi (Palo Alto, CA); Shuai Zhao (Pleasanton, CA)
Assignee: TENCENT AMERICA LLC
H04L69/22H04L65/65
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,539,820
App. No.
17/077,546
Granted
Dec 27, 2022
Kind
B2
Abstract

A method, device, and computer-readable medium for packetizing a plurality of network abstraction layer (NAL) units of a picture using at least one processor, including obtaining the plurality of NAL units including a first NAL unit of the picture and a last NAL unit of the picture; splitting the first NAL unit of the picture into a first plurality of fragments and splitting the last NAL unit of the picture into a last plurality of fragments; packetizing the first plurality of fragments into a first plurality of fragmentation unit (FU) packets and packetizing the last plurality of fragments in to a last plurality of FU packets; and transmitting the first plurality of FU packets and the last plurality of FU packets, wherein a last FU packet of the last plurality of FU packets includes a last FU header including a last R bit, and wherein the last R bit is set to 1.

Claims (65)

1. A method of packetizing a plurality of network abstraction layer (NAL) units of a picture using at least one processor, the method comprising:

obtaining the plurality of NAL units including a first NAL unit of the picture and a last NAL unit of the picture;

splitting the first NAL unit of the picture into a first plurality of fragments and splitting the last NAL unit of the picture into a last plurality of fragments;

packetizing the first plurality of fragments into a first plurality of fragmentation unit (FU) packets and packetizing the last plurality of fragments in to a last plurality of FU packets; and

transmitting the first plurality of FU packets and the last plurality of FU packets,

wherein a last FU packet of the last plurality of FU packets includes a last FU header including a last E bit and a last R bit, and

wherein the last R bit is set to 1, and

wherein the last R bit being set to 1 indicates that a fragment corresponding to the last FU packet of the last plurality of FU packets is a last fragment of the last NAL unit of the picture.

2. The method of claim 1 , wherein the first plurality of FU packets and the last plurality of FU packets comprise real-time transport protocol (RTP) packets.

3. The method of claim 1 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first R bit, and

wherein the first R bit is set to 0.

4. The method of claim 1 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first S bit,

wherein the last FU header includes a last S bit.

5. The method of claim 4 , wherein the first S bit is set to 1, and

wherein the last S bit is set to 0.

6. The method of claim 1 , wherein the plurality of NAL units includes a middle NAL unit between the first NAL unit and the last NAL unit,

wherein the middle NAL unit is split into a middle plurality of fragments,

wherein the middle plurality of fragments is packetized into a middle plurality of FU packets.

7. The method of claim 6 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first E bit,

wherein a last FU packet of the middle plurality of FU packets includes a middle FU header including a middle E bit,

wherein the last FU header includes the last E bit.

8. The method of claim 7 , wherein the first E bit is set to 0,

wherein the middle E bit is set to 1, and

wherein the last E bit is set to 0.

9. A device for packetizing a plurality of network abstraction layer (NAL) units of a picture, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

obtaining code configured to cause the at least one processor to obtain the plurality of NAL units including a first NAL unit of the picture and a last NAL unit of the picture;

splitting code configured to cause the at least one processor to split the first NAL unit of the picture into a first plurality of fragments and splitting the last NAL unit of the picture into a last plurality of fragments;

packetizing code configured to cause the at least one processor to packetize the first plurality of fragments into a first plurality of fragmentation unit (FU) packets and packetizing the last plurality of fragments in to a last plurality of FU packets; and

transmitting code configured to cause the at least one processor to transmit the first plurality of FU packets and the last plurality of FU packets,

wherein a last FU packet of the last plurality of FU packets includes a last FU header including a last E bit and a last R bit,

wherein the last R bit is set to 1, and

wherein the last R bit being set to 1 indicates that a fragment corresponding to the last FU packet of the last plurality of FU packets is a last fragment of the last NAL unit of the picture.

10. The device of claim 9 , wherein the first plurality of FU packets and the last plurality of FU packets comprise real-time transport protocol (RTP) packets.

11. The device of claim 9 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first R bit, and

wherein the first R bit is set to 0.

12. The device of claim 9 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first S bit,

wherein the last FU header includes a last S bit.

13. The device of claim 12 , wherein the first S bit is set to 1, and

wherein the last S bit is set to 0.

14. The device of claim 9 , wherein the plurality of NAL units includes a middle NAL unit between the first NAL unit and the last NAL unit,

wherein the middle NAL unit is split into a middle plurality of fragments,

wherein the middle plurality of fragments is packetized into a middle plurality of FU packets.

15. The device of claim 14 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first E bit,

wherein a last FU packet of the middle plurality of FU packets includes a middle FU header including a middle E bit.

wherein the last FU header includes the last E bit.

16. The device of claim 15 , wherein the first E bit is set to 0,

wherein the middle E bit is set to 1, and

wherein the last E bit is set to 0.

17. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for packetizing a plurality of network abstraction layer (NAL) units of a picture, cause the one or more processors to:

obtain the plurality of NAL units including a first NAL unit of the picture and a last NAL unit of the picture;

split the first NAL unit of the picture into a first plurality of fragments and splitting the last NAL unit of the picture into a last plurality of fragments;

packetize the first plurality of fragments into a first plurality of fragmentation unit (FU) packets and packetizing the last plurality of fragments in to a last plurality of FU packets; and

transmit the first plurality of FU packets and the last plurality of FU packets,

wherein a last FU packet of the last plurality of FU packets includes a last FU header including a last E bit and a last R bit,

wherein the last R bit is set to 1 and

wherein the last R bit being set to 1 indicates that a fragment corresponding to the last FU packet of the last plurality of FU packets is a last fragment of the last NAL unit of the picture.

18. The non-transitory computer-readable medium of claim 17 , wherein the first plurality of FU packets and the last plurality of FU packets comprise real-time transport protocol (RTP) packets.

19. The non-transitory computer-readable medium of claim 17 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first R bit, and

wherein the first R bit is set to 0.

20. The non-transitory computer-readable medium of claim 17 , wherein a first FU packet of the first plurality of FU packets includes a first FU header including a first S bit,

wherein the last FU header includes a last S bit,

wherein the first S bit is set to 1, and

wherein the last S bit is set to 0.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: WENGER, STEPHAN; CHOI, BYEONGDOO; ZHAO, SHUAI
To: TENCENT AMERICA LLC
Reel/Frame 054141/0385 →
Continuity (2)
Provisional Application 62994563 · Mar 25, 2020
Related Publication 20210306443A1 · Sep 30, 2021