IP Library Granted Patent US 10,628,181
Granted Patent B2
US 10,628,181 · App. 15/653,705 · Granted Apr 21, 2020

Redirecting multimedia output of a virtual desktop to a mobile device using image scanning

Inventors: Dong Wang (Beijing, CN); Haiou Jiang (Palo Alto, CA); Yunfei San (Beijing, CN); Kun Shi (Beijing, CN); Peng Guo (Beijing, CN)
Assignee: VMware, Inc.
G06F9/452G06F9/45558G06Q20/322G06Q20/3274H04L67/025H04L67/08H04L67/2814H04W4/80G06F2009/45587G06F2009/45595H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,181
App. No.
15/653,705
Granted
Apr 21, 2020
Kind
B2
Abstract

A system for multimedia redirection where a virtual desktop client device can utilize the multimedia accessories such as digital camera(s) and/or microphone(s) of nearby mobile devices by utilizing image scanning techniques. The mobile device contains a web browser and image scanning technology, such as a QR code reader. The mobile device scans a QR code displayed by the virtual desktop client device and establishes a connection with a web server on the virtual desktop client device. The multimedia stream captured by the multimedia accessories of the mobile device is streamed to the virtual desktop client device using the connection and is redirected by the virtual desktop client device to the virtual desktop. The virtual desktop client device may also redirect multimedia, such as an audio-out stream received from the virtual desktop, to the mobile device in order to playback audio using the speaker of the mobile device.

Claims (59)

1. A method for redirecting multimedia from a virtual desktop to a proximate mobile device, the method comprising:

starting a virtual desktop client configured to establish a session with the virtual desktop on a client computer, wherein the virtual desktop sets up a web server used for multimedia redirection on the client computer;

displaying a QR code by the client computer that is executing the virtual desktop client, the QR code having an identifier of the web server encoded thereon, the web server operating on the client computer;

receiving a connection request from a mobile device that has scanned the QR code to the web server;

establishing a network connection between a web browser on the mobile device and the web server operating on the client computer based on the scanned QR code; and

transmitting a multimedia output stream of the virtual desktop received by the virtual desktop client from the web server on the client computer to the web browser operating on the mobile device over the established network connection.

2. The method of claim 1 , further comprising:

receiving user input indicating a request for multimedia redirection; and

in response to the request, generating the QR code and displaying the QR code by a QR module in the virtual desktop client.

3. The method of claim 1 , wherein the web server is a hypertext transfer protocol (HTTP) server that hosts a web application, wherein the web application is executed on the browser of the mobile device and establishes the network connection, wherein the network connection is a Web Socket connection.

4. The method of claim 1 , wherein the virtual desktop client further includes a Real Time Audio Video (RTAV) module configured to receive the multimedia output stream from the virtual desktop and transmit the multimedia output stream to the mobile device.

5. The method of claim 1 , further comprising:

receiving video captured on the mobile device by the virtual desktop client over the established network connection; and

redirecting the video to the virtual desktop.

6. The method of claim 1 , further comprising:

receiving user input indicating a request to discontinue the transmission; and

terminating the network connection between the mobile device and the client computer.

7. The method of claim 1 , further comprising:

encoding the Internet Protocol (IP) address of the web server operating on the client computer into the QR code; and

encoding a one-time use token into the QR code, wherein the one-time use token is configured to expire and become unavailable for future connections after the network connection is established between the mobile device and the web server on the client computer.

8. A computing system, comprising:

at least one processor; and

memory including instructions that, when executed by the at least one processor, cause the computing system to perform the operations of:

starting a virtual desktop client configured to establish a session with the virtual desktop on a client computer, wherein the virtual desktop sets up a web server used for multimedia redirection on the client computer;

displaying a QR code by the client computer that is executing the virtual desktop client, the QR code having an identifier of the web server encoded thereon, the web server operating on the client computer;

receiving a connection request from a mobile device that has scanned the QR code to the web server;

establishing a network connection between a web browser on the mobile device and the web server operating on the client computer based on the scanned QR code; and

transmitting a multimedia output stream of the virtual desktop received by the virtual desktop client from the web server on the client computer to the web browser operating on the mobile device over the established network connection.

9. The computing system of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the computing system to perform the operations of:

receiving user input indicating a request for multimedia redirection; and

in response to the request, generating the QR code and displaying the QR code by a QR module in the virtual desktop client.

10. The computing system of claim 8 , wherein the web server is a hypertext transfer protocol (HTTP) server that hosts a web application, wherein the web application is executed on the browser of the mobile device and establishes the network connection, wherein the network connection is a Web Socket connection.

11. The computing system of claim 8 , wherein the virtual desktop client further includes a Real Time Audio Video (RTAV) module configured to receive the multimedia output stream from the virtual desktop and transmit the multimedia output stream to the mobile device.

12. The computing system of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the computing system to perform the operations of:

receiving video captured on the mobile device by the virtual desktop client over the established network connection; and

redirecting the video to the virtual desktop.

13. The computing system of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the computing system to perform the operations of:

receiving user input indicating a request to discontinue the transmission; and

terminating the network connection between the mobile device and the client computer.

14. The computing system of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the computing system to perform the operations of:

encoding the Internet Protocol (IP) address of the web server operating on the client computer into the QR code; and

encoding a one-time use token into the QR code, wherein the one-time use token is configured to expire and become unavailable for future connections after the network connection is established between the mobile device and the web server on the client computer.

15. A non-transitory computer readable storage medium comprising a set of instructions, the instructions when executed by one or more processors causing the one or more processors to perform the operations of:

starting a virtual desktop client configured to establish a session with the virtual desktop on a client computer, wherein the virtual desktop sets up a web server used for multimedia redirection on the client computer;

displaying a QR code by the client computer that is executing the virtual desktop client, the QR code having an identifier of the web server encoded thereon, the web server operating on the client computer;

receiving a connection request from a mobile device that has scanned the QR code to the web server;

establishing a network connection between a web browser on the mobile device and the web server operating on the client computer based on the scanned QR code; and

transmitting a multimedia output stream of the virtual desktop received by the virtual desktop client from the web server on the client computer to the web browser operating on the mobile device over the established network connection.

16. The non-transitory computer readable storage medium of claim 15 , further comprising instructions executed by the one or more processors and causing the one or more processors to perform the operations of:

receiving user input indicating a request for multimedia redirection; and

in response to the request, generating the QR code and displaying the QR code by a QR module in the virtual desktop client.

17. The non-transitory computer readable storage medium of claim 15 , wherein the web server is a hypertext transfer protocol (HTTP) server that hosts a web application, wherein the web application is executed on the browser of the mobile device and establishes the connection, wherein the network connection is a Web Socket connection.

18. The non-transitory computer readable storage medium of claim 15 , wherein the virtual desktop client further includes a Real Time Audio Video (RTAV) module configured to receive the multimedia output stream from the virtual desktop and transmit the multimedia output stream to the mobile device.

19. The non-transitory computer readable storage medium of claim 15 , further comprising instructions executed by the one or more processors and causing the one or more processors to perform the operations of:

receiving video captured on the mobile device by the virtual desktop client over the established network connection; and

redirecting the video to the virtual desktop.

20. The non-transitory computer readable storage medium of claim 15 , further comprising instructions executed by the one or more processors and causing the one or more processors to perform the operations of:

encoding the Internet Protocol (IP) address of the web server operating on the client computer into the QR code; and

encoding a one-time use token into the QR code, wherein the one-time use token is configured to expire and become unavailable for future connections after the network connection is established between the mobile device and the web server on the client computer.

Assignments (4)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2017
From: WANG, DONG; JIANG, HAIOU; SAN, YUNFEI; SHI, KUN; GUO, PENG
To: VMWARE, INC.
Reel/Frame 043041/0248 →
Continuity (1)
Related Publication 20190026122A1 · Jan 24, 2019