Multimedia system with dynamic adaptation

1 . A multimedia system comprising:

user equipment (UE) comprising:

a modem configured to collect modem assistance information and transmit the modem assistance information;

a media decoder configured to decode compressed media to frames; and

a frame renderer configured to render the frames decoded by the media decoder; and

a server comprising:

a frame generator configured to generate the frames according to the modem assistance information; and

a media encoder configured to encode the frames to the compressed media according to the modem assistance information;

wherein:

the user equipment transmits the modem assistance information through a first UE port and receives the compressed media through a second UE port; and

the server receives the modem assistance information through a first server port and transmits the compressed media to the user equipment through a second server port.

2 . The multimedia system of claim 1 , wherein the frame generator, the media encoder, the first server port and the second server port operate at an application layer.

3 . The multimedia system of claim 2 , wherein the frame renderer, the media decoder, the first UE port and the second UE port operate at the application layer.

4 . The multimedia system of claim 3 , wherein the modem operates at a physical layer.

5 . The multimedia system of claim 1 , wherein the modem assistance information is transmitted by the modem through cross-layer APIs (application programming interfaces) to the first UE port, and the first UE port transmits the modem assistance information to the first server port.

6 . The multimedia system of claim 1 , wherein the modem assistance information comprises congestion information and handover events.

7 . The multimedia system of claim 6 , wherein the congestion information comprises an estimated data rate, downlink jitters, and/or an uplink scheduling delay.

8 . The multimedia system of claim 7 , wherein the modem initiates a transmission of the modem assistance information when the estimated data rate drops more than 10%.

9 . The multimedia system of claim 1 , wherein when the media encoder implements bitrate adaptation according to the modem assistance information.

10 . The multimedia system of claim 1 , wherein the frame generator implements rendering optimization according to the modem assistance information.

11 . A method of streaming in a multimedia system, the multimedia system comprising user equipment (UE) and a server, the user equipment comprising a modem, a media decoder and a frame renderer, the server comprising a frame generator and a media encoder, the method comprising:

collecting modem assistance information by the modem;

transmitting the modem assistance information through a first UE port of the user equipment to the server through a first server port of the server;

generating frames by the frame generator according to the modem assistance information;

encoding the frames to compressed media by the media encoder according to the modem assistance information;

transmitting the compressed media by the server through a second server port of the server to the user equipment through a second UE port of the user equipment;

decoding the compressed media to the frames by the media decoder; and

rendering the frames by the frame renderer.

12 . The method of claim 11 , wherein the frame generator, the media encoder, the first server port and the second server port operate at an application layer.

13 . The method of claim 12 , wherein the frame renderer, the media decoder, the first UE port and the second UE port operate at the application layer.

14 . The method of claim 13 , wherein the modem operate at a physical layer.

15 . The method of claim 11 , wherein the modem assistance information is transmitted from the modem through cross-layer APIs (application programming interfaces) to the first UE port, and the first UE port transmits the modem assistance information to the first server port.

16 . The method of claim 11 , wherein the modem assistance information comprises congestion information and handover events.

17 . The method of claim 16 , wherein the congestion information comprises an estimated data rate, downlink jitters, an uplink and/or scheduling delay.

18 . The method of claim 17 , wherein the modem initiates a transmission of the modem assistance information when the estimated data rate drops more than 10%.

19 . The method of claim 11 , wherein when the media encoder implements bitrate adaptation according to the modem assistance information.

20 . The method of claim 11 , wherein the frame generator implements rendering optimization according to the modem assistance information.