IP Library Granted Patent US 9,706,565
Granted Patent B2
US 9,706,565 · App. 14/305,460 · Granted Jul 11, 2017

Method and device for video transmission

Inventors: Jian Zhang (Shenzhen, CN); Wei Quan (Shenzhen, CN); Peng Zhang (Shenzhen, CN); Yi Jiang (Shenzhen, CN)
Assignee: Huawei Technologies Co., Ltd.
H04W72/1247H04L65/80H04L67/322H04W4/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,706,565
App. No.
14/305,460
Granted
Jul 11, 2017
Kind
B2
Abstract

Embodiments of the present application provide a method and a device for video transmission, which relates to the field of communications and is able to reduce feedback time, thus realizing the purpose of fully using resources and reducing data loss. The method includes at least the following operations: a base station receiving a second video data packet sent by a server and first feedback information about a first video data packet sent by user equipment, performing scheduling process according to the first feedback information, and after the scheduling process, transmitting the second video data packet to the user equipment according to the result of the scheduling process.

Claims (69)

1. A method for video transmission, comprising:

receiving, by a base station, a second set of video data packets from a server, wherein the second set of video data packets is a current set of video data packets, and is obtained by encapsulating an encoded stream of each region into a video data packet respectively, and encoded streams of regions with different importance are obtained by encoding data in the regions with different importance in a video image according to different encoding modes;

reading, by the base station, the encoded streams of regions with different importance in the second set of video data packets;

storing, by the base station, the video data packets, which are obtained by encapsulating the encoded streams of regions with different importance in the second set of video data packets, into different buffers respectively, or, configuring different radio bearers (RB) respectively for the video data packets which are obtained by encapsulating the encoded streams of regions with different importance;

receiving, by the base station, first feedback information about a first video data packet from a user equipment device, and performing a scheduling process according to the first feedback information and different importance of encoded streams of different regions in each frame of video image encapsulated in the second set of video data packets, wherein the first set of video data packets is a previous set of video data packets of the second set of video data packets, and the previous set of video data packets is received from the server and forwarded to the user equipment device by the base station; and

transmitting, by the base station, the second set of video data packets to the user equipment device according to a result of the scheduling process.

2. The method according to claim 1 , wherein, the first feedback information comprises: at least one of parameters: relative time delay, packet loss ratio, average throughput, and data amount of a play-out buffer;

the performing of the scheduling process according to the first feedback information, comprising:

comparing the first feedback information with second feedback information, wherein the second feedback information being feedback information for a previous set of video data packets of the first video data packet;

if a result of the comparison comprises at least one of following circumstances: the relative time delay becomes shorter, the packet loss ratio becomes lower, the average throughput is increased, and the data amount of the play-out buffer is increased;

then the scheduling process is performed according to at least one of following manners: raising priority of a video data packet obtained by encapsulating an encoded stream of data in a least important region, not discarding the second set of video data packets, and reducing a scheduling priority of the user equipment device;

if a result of the comparison comprises at least one of following circumstances: the relative time delay becomes longer, the packet loss ratio becomes higher, the average throughput is decreased, and the data amount of the play-out buffer is decreased;

then the scheduling process is performed according to at least one of following manners: discarding a video data packet obtained by encapsulating an encoded stream of data in a least important region, reducing a scheduling priority of the video data packet obtained by encapsulating a an encoded stream of data in the least important region, raising a scheduling priority of a video data packet obtained by encapsulating an encoded stream of data in a most important region, and raising a scheduling priority of the user equipment device.

3. The method according to claim 1 , wherein, the first feedback information comprises: data amount of a receive buffer of the user equipment device;

wherein the performing of the scheduling process according to the first feedback information, comprising one of:

if the data amount of the receive buffer is less than or equal to a predetermined first minimum protection threshold, performing one or more of:

raising a scheduling priority of the user equipment device, and,

discarding a video data packet obtained by encapsulating an encoded stream of data in a least important region; and

if the data amount of the receive buffer is greater than or equal to a predetermined first highest protection threshold, reducing the scheduling priority of the user equipment device.

4. The method according to claim 1 , further comprising: receiving, by the base station, video application state information from the user equipment device;

if the video application state information is off, performing one of:

stopping, by the base station, the scheduling process and transmission of a subsequent video data packet for the user equipment device; or

transmitting, by the base station, a stop notice to the server, so that the server stops transmission of a subsequent video data packet for the user equipment device;

if the video application state information is stop or pause, performing one of:

pausing, by the base station, the scheduling process and transmission of a subsequent video data packet for the user equipment device; or

transmitting, by the base station, a pause notice to the server, so that the server pauses transmission of a subsequent video data packet for the user equipment device;

if the video application state information is buffer, continuing, by the base station, with the scheduling process and transmission of a subsequent video data packet for the user equipment device.

5. A base station, comprising at least a processor operating in conjunction with at least a memory storing code for:

receiving a second set of video data packets from a server, wherein the second set of video data packets is a current set of video data packets, and is obtained by encapsulating an encoded stream of each region into a video data packet respectively, and encoded streams of regions with different importance are obtained by encoding data in the regions with different importance in a video image according to different encoding modes;

reading the encoded streams of regions with different importance in the second set of video data packets;

storing the video data packets, which are obtained by encapsulating the encoded streams of regions with different importance in the second set of video data packets, into different buffers respectively, or, configuring different radio bearers (RB) respectively for the video data packets which are obtained by encapsulating the encoded streams of regions with different importance;

receiving first feedback information about a first video data packet from a user equipment device, and performing a scheduling process according to the first feedback information and different importance of encoded streams of different regions in each frame of video image encapsulated in the second set of video data packets, wherein the first set of video data packets is a previous set of video data packets of the second set of video data packets, and the previous set of video data packets is received from the server and forwarded to the user equipment device by the base station; and

transmitting the second set of video data packets to the user equipment device according to a result of the scheduling process.

6. The base station according to claim 5 ,

wherein when the first feedback information comprises at least one of: relative time delay, packet loss ratio, average throughput, and data amount of a play-out buffer,

the scheduling process comprises:

comparing the first feedback information with second feedback information;

if a result of the comparison comprises at least one of following circumstances: the relative time delay becomes shorter, the packet loss ratio becomes lower, the average throughput is increased, and the data amount of the play-out buffer is increased;

then the scheduling process is performed according to at least one of the following manners: raising priority of a video data packet obtained by encapsulating an encoded stream of data in a least important region, not discarding the second set of video data packets, and reducing a scheduling priority of the user equipment device;

if a result of the comparison comprises at least one of following circumstances: the relative time delay becomes longer, the packet loss ratio becomes higher, the average throughput is decreased, and the data amount of the play-out buffer data amount is decreased;

then the scheduling process is performed according to at least one of following manners: discarding a video data packet obtained by encapsulating an encoded stream of data in a least important region, reducing a scheduling priority of the video data packet obtained by encapsulating an encoded stream of data in the least important region, raising a scheduling priority of a video data packet obtained by encapsulating an encoded stream of data in a most important region, and raising a scheduling priority of the user equipment device; wherein the second feedback information being feedback information for a previous set of video data packets of the first set of video data packets;

when the first feedback information comprises data amount of a receive buffer of the user equipment device,

the scheduling process comprises at least one of:

raise a scheduling priority of the user equipment device, and/or, discard a video data packet obtained by encapsulating an encoded stream of data in a least important region, when the data amount of the receive buffer is less than or equal to a predetermined first minimum protection threshold; and

reduce the scheduling priority of the user equipment device, when the data amount of the receive buffer is greater than or equal to a predetermined first highest protection threshold.

7. The base station according to claim 5 , wherein,

the memory further storing code for:

receiving video application state information from the user equipment device;

when the video application state information received is off, stopping the scheduling process and transmission of a subsequent video data packet for the user equipment device; or transmitting a stop notice to the server, so that the server stops transmission of a subsequent video data packet for the user equipment device;

when the video application state information is stop or pause, pausing the scheduling process and transmission of a subsequent video data packet for the user equipment device; or transmitting a pause notice to the server, so that the server pauses transmission of a subsequent video data packet for the user equipment device;

when the video application state information is buffer, continuing with the scheduling process and transmission of a subsequent video data packet for the user equipment device.

8. A method for video transmission, comprising:

receiving, by a base station, third feedback information from a user equipment device, wherein the third feedback information is quantity of video data packets in each transmit buffer of the user equipment device, wherein the video data packets in the transmit buffers of the user equipment device comprise: a set of video data packets which are obtained by encapsulating an encoded stream of each region into a video data packet respectively by the user equipment device, and the encoded streams of regions with different importance are obtained by encoding data in the regions with different importance in a video image according to different encoding modes;

reading, by the base station, the encoded streams of regions with different importance in received video data packets;

configuring, by the base station, different radio bearers (RB) respectively for the video data packets, which are obtained by encapsulating the encoded streams of regions with different importance, in the received video data packets;

performing, by the base station, a scheduling process to the video data packets in the transmit buffers of the user equipment device according to the third feedback information and different importance of encoded streams of different regions in each frame of video image;

receiving, by the base station, a scheduled processed video data packet from the user equipment device, and transmitting the scheduled processed video data packet to a server.

9. The method according to claim 8 ,

wherein the performing, by the base station, the scheduling process to the video data packets in the transmit buffers of the user equipment device according to the third feedback information, comprising:

if the quantity of the video data packets in the transmit buffers of the user equipment device is less than or equal to a predetermined second minimum protection threshold, reducing a priority of the video data packets in the transmit buffers of the user equipment device;

if the quantity of the video data packets in the transmit buffers of the user equipment device is greater than or equal to a predetermined second highest protection threshold, raising a priority of the video data packets in the transmit buffers of the user equipment device.

10. A base station, at least a processor circuitry operating in conjunction with at least a memory storing codes for:

receiving, by a base station, third feedback information form a user equipment device, wherein the third feedback information is quantity of video data packets in each transmit buffer of the user equipment device, and the video data packets in the transmit buffers of the user equipment device comprise: a set of video data packets, which are obtained by encapsulating an encoded stream of each region into a video data packet respectively by the user equipment device, and the encoded streams of regions with different importance are obtained by encoding data in the regions with different importance in a video image according to different encoding modes;

reading encoded streams of regions with different importance in received video data packets; and configuring different radio bearers (RB) respectively for the video data packets which are obtained by encapsulating the encoded streams of regions with different importance and in the received video data packets;

performing, by the base station, a scheduling process to the video data packets in the transmit buffers of the user equipment device according to the third feedback information and different importance of encoded streams of different regions in each frame of video image;

receiving, by the base station, a scheduled processed video data packet from the user equipment device, and transmitting the scheduled processed video data packet to a server.

11. The base station according to claim 10 , wherein:

if the quantity of the video data packets in the transmit buffers of the user equipment device is less than or equal to a predetermined second minimum protection threshold, reducing a priority of the video data packets in the transmit buffers of the user equipment device;

if the quantity of the video data packets in the transmit buffers of the user equipment device is greater than or equal to a predetermined second highest protection threshold, raising a priority of the video data packets in the transmit buffers of the user equipment device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2017
From: ZHANG, JIAN; QUAN, WEI; ZHANG, PENG; JIANG, YI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 042152/0387 →
Priority Claims (1)
CN 2011 1 0418170 · Dec 14, 2011 · national
Continuity (2)
Continuation PCTCN2012086234 · Dec 8, 2012
Related Publication 20140321378A1 · Oct 30, 2014