IP Library Granted Patent US 10,620,976
Granted Patent B2
US 10,620,976 · App. 15/653,692 · Granted Apr 14, 2020

Redirecting multimedia captured on a mobile device to a virtual desktop using image scanning

Inventors: Dong Wang (Beijing, CN); Haiou Jiang (Palo Alto, CA); Yunfei San (Beijing, CN); Kun Shi (Beijing, CN); Peng Guo (Beijing, CN)
Assignee: VMware, Inc.
G06F9/452G06F9/45558G06Q20/322G06Q20/3274H04L67/025H04L67/08H04L67/141H04L67/2814H04W4/80G06F2009/45587G06F2009/45595H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,620,976
App. No.
15/653,692
Granted
Apr 14, 2020
Kind
B2
Abstract

A system for multimedia redirection where a virtual desktop client device can utilize the multimedia accessories such as digital camera(s) and/or microphone(s) of nearby mobile devices by utilizing image scanning techniques. The mobile device contains a web browser and image scanning technology, such as a QR code reader. The mobile device scans a QR code displayed by the virtual desktop client device and establishes a connection with a web server on the virtual desktop client device. The multimedia stream captured by the multimedia accessories of the mobile device is streamed to the virtual desktop client device using the connection and is redirected by the virtual desktop client device to the virtual desktop. The virtual desktop client device may also redirect multimedia, such as an audio-out stream received from the virtual desktop, to the mobile device in order to playback audio using the speaker of the mobile device.

Claims (47)

1. A method for redirecting multimedia captured on a mobile device to a virtual desktop, the method comprising:

scanning a Quick Response (QR) code by the mobile device, the QR code being displayed by a client computing device having a virtual desktop client application operating thereon;

accessing a web server identified by the QR code over a network by a browser on the mobile device, the web server running on the client computing device;

accessing a camera of the mobile device;

capturing video using the camera of the mobile device;

streaming the captured video over the network from the browser of the mobile device to the virtual desktop client application operating on the client computing device, the virtual desktop client application configured to redirect the video received from the mobile device to a virtual desktop executing on a remote host server over a virtual channel.

2. The method of claim 1 , wherein the web server hosts a web application that is executed on the browser of the mobile device, the web application configured to transmit the captured video to the virtual desktop client application operating on the client computing device over a Web Socket connection.

3. The method of claim 1 , wherein the captured video is received by the client computing device and provided to a Real Time Audio Video (RTAV) module operating in the virtual desktop client application.

4. The method of claim 1 , further comprising:

receiving user input indicating a request to discontinue the multimedia redirection; and

terminating the connection between the mobile device and the client computing device.

5. The method of claim 1 , wherein the QR code contains an Internet Protocol (IP) address of the web server and a one-time token that becomes unavailable for future connections after a connection is established between the mobile device and the client computing device.

6. The method of claim 1 , further comprising:

capturing audio using a microphone of the mobile device;

streaming the captured audio over the network from the browser of the mobile device to the virtual desktop client application operating on the client computing device, the virtual desktop client application configured to redirect the captured audio to a virtual desktop over a virtual channel.

7. The method of claim 1 , further comprising:

receiving an audio stream from the virtual desktop client application and playing back the audio stream using a speaker of the mobile device.

8. A mobile device, comprising:

at least one processor; and

memory including instructions that, when executed by the at least one processor, cause the mobile device to perform the steps of:

scanning a Quick Response (QR) code by the mobile device, the QR code being displayed by a client computing device having a virtual desktop client application operating thereon;

accessing a web server identified by the QR code over a network by a browser on the mobile device, the web server running on the client computing device;

accessing a camera of the mobile device;

capturing video using the camera of the mobile device;

streaming the captured video over the network from the browser of the mobile device to the virtual desktop client application operating on the client computing device, the virtual desktop client application configured to redirect the video received from the mobile device to a virtual desktop executing on a remote host server over a virtual channel.

9. The mobile device of claim 8 , wherein the web server hosts a web application that is executed on the browser of the mobile device, the web application configured to transmit the captured video to the virtual desktop client application operating on the client computing device over a Web Socket connection.

10. The mobile device of claim 8 , wherein the captured video is received by the client computing device and provided to a Real Time Audio Video (RTAV) module operating in the virtual desktop client application.

11. The mobile device of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the mobile device to perform the steps of:

receiving user input indicating a request to discontinue the multimedia redirection; and

terminating the connection between the mobile device and the client computing device.

12. The mobile device of claim 8 , wherein the QR code contains an Internet Protocol (IP) address of the web server and a one-time token that becomes unavailable for future connections after a connection is established between the mobile device and the client computing device.

13. The mobile device of claim 8 , wherein the QR code is displayed in response to receiving user input indicating a request to access a camera and/or microphone of a mobile device in physical proximity to the client computing device.

14. The mobile device of claim 8 , wherein the memory further comprises instructions that, when executed by the at least one processor, cause the mobile device to perform the steps of:

receiving an audio stream from the virtual desktop client application and playing back the audio stream using a speaker of the mobile device.

15. A non-transitory computer readable storage medium comprising a set of instructions, the instructions when executed by one or more processors causing the one or more processors to perform the operations of:

scanning a Quick Response (QR) code by the mobile device, the QR code being displayed by a client computing device having a virtual desktop client application operating thereon;

accessing a web server identified by the QR code over a network by a browser on the mobile device, the web server running on the client computing device;

accessing a camera of the mobile device;

capturing video using the camera of the mobile device;

streaming the captured video over the network from the browser of the mobile device to the virtual desktop client application operating on the client computing device, the virtual desktop client application configured to redirect the video received from the mobile device to a virtual desktop executing on a remote host server over a virtual channel.

16. The non-transitory computer readable storage medium of claim 15 , wherein the web server hosts a web application that is executed on the browser of the mobile device, the web application configured to transmit the captured video to the virtual desktop client application operating on the client computing device over a Web Socket connection.

17. The non-transitory computer readable storage medium of claim 15 , wherein the captured video is received by the client computing device and provided to a Real Time Audio Video (RTAV) module operating in the virtual desktop client application.

18. The non-transitory computer readable storage medium of claim 15 , further comprising instructions executed by one or more processors and causing the one or more processors to perform the operations of:

receiving user input indicating a request to discontinue the multimedia redirection; and

terminating the connection between the mobile device and the client computing device.

19. The non-transitory computer readable storage medium of claim 15 , wherein the QR code contains an Internet Protocol (IP) address of the web server and a one-time token that becomes unavailable for future connections after a connection is established between the mobile device and the client computing device.

20. The non-transitory computer readable storage medium of claim 15 , wherein the QR code is displayed in response to receiving user input indicating a request to access a camera and/or microphone of a mobile device in physical proximity to the client computing device.

Assignments (4)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2017
From: WANG, DONG; JIANG, HAIOU; SAN, YUNFEI; SHI, KUN; GUO, PENG
To: VMWARE, INC.
Reel/Frame 043041/0103 →
Continuity (1)
Related Publication 20190026121A1 · Jan 24, 2019