IP Library Granted Patent US 9,762,939
Granted Patent B2
US 9,762,939 · App. 14/040,051 · Granted Sep 12, 2017

Enhanced user experience for miracast devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,762,939
App. No.
14/040,051
Granted
Sep 12, 2017
Kind
B2
Abstract

A method is implementable in a source device operable to provide, via a wireless channel, a video stream to a sink device for display by the sink device. The method includes receiving link quality information indicative of a condition of the wireless channel and/or performance of communications between the source device and the sink device via the wireless channel. The method also includes determining a measure of network congestion based on the link quality information, and, based on the measure of network congestion, skipping one or more, but not all, video frames of a plurality of video frames in the video stream, such that the one or more video frames are not provided to the sink device, reconfiguring a video encoder operating on the plurality of video frames, such that an output bit rate of the video encoder is changed, and/or changing a video format of the video stream.

Claims (34)

1. A method implementable in a source device, wherein the source device is operable to provide, via a wireless channel, a video stream to a sink device for display by the sink device, the method comprising:

receiving, at a processor of the source device, link quality information from a wireless local area network (WLAN) interface of the source device, the link quality information indicative of at least one of (i) a condition of the wireless channel, or (ii) performance of communications between the source device and the sink device via the wireless channel, wherein the processor implements application layer functions and is external to the WLAN interface;

determining, at the processor of the source device, a measure of network congestion based on the link quality information;

based on the measure of network congestion,

in response to detecting network congestion, reconfiguring, with the processor of the source device, a video encoder operating on the plurality of video frames, such that an output bit rate of the video encoder is changed, and

in response to determining network congestion has continued for at least a threshold period of time, changing, with the processor of the source device, a video format of the video stream, including at least one of (i) reducing a refresh rate of the video stream, or (ii) reducing a resolution of the video stream; and

in response to receiving a message from the sink device that the sink device did not correctly receive a particular I-frame in the video stream, causing, with the processor, the WLAN interface to retransmit the particular I-frame.

2. The method of claim 1 , further comprising:

based on the measure of network congestion, skipping one or more, but not all, video frames of the plurality of video frames in the video stream, such that the one or more video frames are not provided to the sink device.

3. The method of claim 1 , further comprising:

based on the measure of network congestion, reconfiguring the video encoder operating on the plurality of video frames, such that the output bit rate of the video is changed.

4. The method of claim 3 , wherein reconfiguring the video encoder includes increasing a quantization parameter of the video encoder.

5. The method of claim 1 , wherein the at least one of (i) reducing a refresh rate of the video stream, or (ii) reducing a resolution of the video stream, includes causing one or more Real Time Streaming Protocol (RTSP) messages to be sent to the sink device, and wherein the one or more RTSP messages are messages used to renegotiate video format.

6. The method of claim 1 , wherein receiving link quality information includes receiving information indicating at least one of (i) a number of packets dropped, (ii) a reason that one or more packets were dropped, or (iii) a current throughput.

7. A source device operable to provide, via a wireless channel, a video stream to a sink device for display by the sink device, the source device comprising:

a wireless network interface configured to communicate with the sink device via the wireless channel;

a video encoder configured to encode video data of the video stream to generate compressed video data, wherein the compressed video data is generated at an output bit rate; and

one or more application processors configured to

receive, from the wireless network interface, link quality information indicative of at least one of (i) a condition of the wireless channel, or (ii) performance of communications between the source device and the sink device via the wireless channel,

a measure of network congestion based on the link quality information, and

based on the measure of network congestion,

in response to detecting network congestion, reconfigure a video encoder operating on the plurality of video frames, such that an output bit rate of the video encoder is changed, and

in response to determining network congestion has continued for at least a threshold period of time, change a video format of the video stream, including at least one of (i) reducing a refresh rate of the video stream, or (ii) reducing a resolution of the video stream;

wherein the one or more application processors are further configured to, in response to receiving a message from the sink device that the sink device did not correctly receive a particular I-frame in the video stream, cause the wireless network interface to retransmit the particular I-frame.

8. The source device of claim 7 , wherein the one or more application processors are configured to:

based on the measure of network congestion, skip one or more, but not all, video frames of the plurality of video frames in the video stream such that the one or more video frames are not provided in the sink device.

9. The source device of claim 7 , wherein the one or more application processors are configured to:

based on the measure of network congestion, reconfigure the video encoder to reduce the output bit rate.

10. The source device of claim 9 , wherein the one or more application processors are configured to:

reconfigure the video encoder at least by increasing a quantization parameter of the video encoder.

11. The source device of claim 7 , wherein the one or more application processors are configured to:

in response to the one or more application processors determining that the network has been congested for at least the threshold period of time, cause one or more Real Time Streaming Protocol (RTSP) messages to be sent to the sink device, wherein the one or more RTSP messages are messages used to renegotiate video format.

12. The source device of claim 7 , wherein the one or more application processors are configured to:

receive link quality information at least by receiving information indicating at least one of i) a number of packets dropped, ii) a reason that one or more packets were dropped, or iii) a current throughput.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: MARVELL INTERNATIONAL LTD.
To: NXP USA, INC.
Reel/Frame 051536/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2017
From: MARVELL SEMICONDUCTOR, INC.
To: MARVELL INTERNATIONAL LTD.
Reel/Frame 040885/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2017
From: BEI, JIANWEI; KUMAR, MANISH; WAGHOLIKAR, SARANG SHRIKRISHNA
To: MARVELL SEMICONDUCTOR, INC.
Reel/Frame 040885/0641 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2017
From: MARVELL INTERNATIONAL LTD.
To: MARVELL WORLD TRADE LTD.
Reel/Frame 040885/0646 →
LICENSE Recorded Jan 6, 2017
From: MARVELL WORLD TRADE LTD.
To: MARVELL INTERNATIONAL LTD.
Reel/Frame 040885/0663 →