IP Library Granted Patent US 8,593,502
Granted Patent B2
US 8,593,502 · App. 13/008,280 · Granted Nov 26, 2013

Controlling videoconference with touch screen interface

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,593,502
App. No.
13/008,280
Granted
Nov 26, 2013
Kind
B2
Abstract

A videoconferencing system includes a touch screen display device and a videoconferencing unit. The display device displays video data for the videoconference and generates touch data based on user selections relative to the touch screen. The videoconferencing unit is operatively coupled to the touch screen device by a video connection and a data interface connection, for example. The unit establishes and conducts a videoconference with one or more endpoints via a network. The unit sends video data to the display device and receives touch data from the device. The received touch data is used to control operation of the videoconferencing system. The received touch data can be used to initiate a videoconference call, change an operating parameter, change orientation of a camera, initiate a picture-in-picture display, access a menu, access memory, change a source of video data, initiate a whiteboard display, and access a screen of a connected device.

Claims (105)

1. A videoconferencing apparatus, comprising:

a touch panel generating touch data and having a sensor, the sensor generating a source selection in response to user movement relative thereto; and

a videoconferencing device operatively coupled to the touch panel and to a plurality of sources, the videoconferencing device configured to:

establish a videoconference with at least one endpoint via a network,

send video from at least a first of the sources to the at least one endpoint via the network,

receive the source selection from the touch panel when user movement is made relative to the sensor,

automatically select at least one second of the sources in response to the source selection,

automatically switch from the at least one first source to the at least one second source, and

send video from the at least one second source to the at least one endpoint,

wherein the sources are selected from the group consisting of a network interface coupled to the at least one endpoint via the network, a camera, a video cassette recorder, a digital versatile disc player, a laptop computer, a personal computer, a programmable controller of visual sources, and an Extended Graphics Array splitter.

2. The apparatus of claim 1 , wherein the videoconferencing device is configured to send video from one or more of the sources to the touch panel for display.

3. The apparatus of claim 1 , wherein to automatically switch, the videoconferencing device is configured to:

generate a whiteboard in response to the source selection,

receive touch data from the touch screen device,

combine the received touch data as annotation to the whiteboard, and

send the annotated whiteboard to the at least one endpoint.

4. The apparatus of claim 3 , wherein the videoconferencing device is configured to send the annotated whiteboard to the touch panel for display.

5. The apparatus of claim 1 , further comprising a visual controller coupled between the videoconferencing device and the touch panel.

6. The apparatus of claim 5 , wherein one or more of the sources are coupled to one or more video inputs of the visual controller, and wherein the visual controller comprises one or more video outputs coupled to one or more video inputs of the videoconferencing device.

7. The apparatus of claim 1 , wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the source selection when the user moves the user tool relative thereto.

8. The apparatus of claim 1 , wherein the videoconferencing device is configured to control operation of at least one camera using touch data received from the touch panel.

9. The apparatus of claim 8 , wherein the at least one camera comprises a near-end camera coupled to the videoconferencing device, and wherein to control operation of the near-end camera based on the associated touch control, the videoconferencing device is configured to send a control signal to the near-end camera.

10. The apparatus of claim 8 , wherein the at least one camera comprises a far-end camera coupled to the at least one endpoint, and wherein to control operation of the far-end camera based on the associated touch control, the videoconferencing device is configured to send a control signal to the far-end camera via the network.

11. The apparatus of claim 8 , wherein to control operation of the at least one camera, the videoconferencing device is configured to:

send video received from the at least one camera to the touch panel for display;

designate at least one area of the sent video as at least one touch control for user selection, the at least one touch control for controlling pan, tilt, or zoom of the at least one camera;

receive touch data from the touch panel;

associate the received touch data with the at least one touch control; and

control operation of the at least one camera based on the associated touch control.

12. The apparatus of claim 11 , wherein the at least one camera comprises a pan-tilt-zoom camera, and wherein to designate at least one area of the sent video as at least one touch control for user selection, the videoconferencing unit is configured to generate a grid for display in conjunction with the video sent to the touch screen device, the grid having at least one area corresponding to the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera.

13. The apparatus of claim 12 , wherein the grid comprises a first pair of areas corresponding to first touch controls for panning the pan-tilt-zoom camera, a second pair of areas corresponding to second touch controls for tilting the pan-tilt-zoom camera, and a third pair of areas corresponding to third touch controls for zooming the pan-tilt-zoom camera.

14. The apparatus of claim 1 , wherein the touch panel displays a graphical user interface and generates touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

15. The apparatus of claim 14 , wherein the separate user interface screens comprise one or more of: a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.

16. A videoconferencing method, comprising:

establishing a videoconference with at least one endpoint via a network;

sending video from a first of a plurality of sources to the at least one endpoint via the network;

receiving a source selection from a touch panel, the touch panel generating touch data and having a sensor, the sensor generating the source selection when user movement is made relative to the sensor;

automatically selecting at least one second of the sources in response to the source selection;

automatically switching from the at least one first source to the at least one second source; and

sending video from the at least one second source to the at least one endpoint,

wherein the sources are selected from the group consisting of a network interface coupled to the at least one endpoint via the network, a camera, a video cassette recorder, a digital versatile disc player, a laptop computer, a personal computer, a programmable controller of visual sources, and an Extended Graphics Array splitter.

17. The method of claim 16 , further comprising sending video from one or more of the sources to the touch panel for display.

18. The method of claim 16 , wherein automatically switching from the at least one first source to the at least one second source comprises:

generating a whiteboard in response to the source selection;

receiving touch data from the touch panel; and

combining the received touch data as annotation to the whiteboard for sending to the at least one endpoint.

19. The method of claim 18 , further comprising sending the annotated whiteboard to the touch panel for display.

20. The method of claim 16 , wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the source selection when the user moves the user tool relative thereto.

21. The method of claim 16 , further comprising controlling operation of at least one camera using touch data received from the touch panel.

22. The method of claim 21 , wherein controlling the operation of the at least one camera using the touch data received from the touch panel comprises:

sending video received from the at least one camera to the touch panel for display;

designating at least one area of the sent video as at least one touch control for user selection, the at least one touch control for controlling pan, tilt, or zoom of the at least one camera;

receiving the touch data from the touch panel;

associating the received touch data with the at least one touch control; and

controlling the operation of the at least one camera based on the associated touch control.

23. The method of claim 22 , wherein designating at least one area of the sent video as at least one touch control for user selection comprises generating a grid for display in conjunction with the video sent to the touch screen device, the grid having at least one area corresponding to the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera.

24. The method of claim 23 , wherein the grid comprises a first pair of areas corresponding to first touch controls for panning the pan-tilt-zoom camera, a second pair of areas corresponding to second touch controls for tilting the pan-tilt-zoom camera, and a third pair of areas corresponding to third touch controls for zooming the pan-tilt-zoom camera.

25. The method of claim 16 , further comprising displaying a graphical user interface on the touch panel and generating touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

26. The method of claim 25 , wherein the separate user interface screens comprise one or more of: a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, or a sixth screen for scheduling a videoconference.

27. A videoconferencing apparatus, comprising:

a touch panel configured to generate touch data, the touch panel having a sensor generating an indication in response to user movement relative thereto;

a videoconferencing device operatively coupled to the touch panel and configured to:

establish a videoconference with at least one endpoint via a network,

send video from at least one first source to the at least one endpoint via the network,

receive the indication from the touch panel when user movement is made relative to the sensor, and

automatically switch to an annotation mode of operation in response to the indication;

wherein in the annotation mode of operation, the videoconferencing apparatus combines touch data from the touch panel as annotation to content from at least one second source and sends the annotated content to the at least one endpoint via the network and to the touch panel for display.

28. The apparatus of claim 27 , wherein the at least one first source is the same as or different from the at least one second source.

29. The apparatus of claim 27 , comprising a computer operatively coupled to the videoconferencing device, the computer combining the touch data from the touch panel as annotation to content and sending the annotated content to the videoconferencing device.

30. The apparatus of claim 27 , wherein the annotated content sent in the annotation mode of operation comprises a whiteboard, a computer screen, an image, or visual media.

31. The apparatus of claim 27 , wherein in the annotation mode of operation, the videoconferencing apparatus is configured to:

generate a whiteboard;

receive touch data from the touch panel;

combine the received touch data as annotation to the whiteboard; and

send the annotated whiteboard to the touch panel and to the at least one endpoint.

32. The apparatus of claim 27 , wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the indication when the user moves the user tool relative thereto.

33. The apparatus of claim 27 , wherein the videoconferencing device is configured to:

receive another indication from the touch panel when user movement is made relative to the sensor;

automatically select at least one third source in response to the other indication;

automatically switch from the annotated content currently sent to the at least one third source automatically selected; and

send video from the at least one third source to the at least one endpoint.

34. The apparatus of claim 27 , wherein the touch panel displays a graphical user interface and generates touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

35. The apparatus of claim 34 , wherein the separate user interface screens comprise one or more of: a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.

36. A videoconferencing method, comprising:

establishing a videoconference with at least one endpoint via a network;

sending video from at least one first source to the at least one endpoint via the network;

receiving an indication from a touch panel configured to display video and generate touch data, the touch panel having a sensor generating the indication when user movement is made relative to the sensor;

automatically switching to an annotation mode of operation in response to the indication;

combining touch data from the touch panel as annotation to content from at least one second source; and

sending the annotated content to the at least one endpoint via the network and to the touch panel for display.

37. The method of claim 36 , wherein the at least one first source is the same as or different from the at least one second source.

38. The method of claim 36 , wherein the annotated content sent in the annotation mode of operation comprises a whiteboard, a computer screen, an image, or visual media.

39. The method of claim 36 , wherein automatically switching to the annotation mode of operation, combining the touch data, and sending the annotated content comprise:

generating a whiteboard;

receiving touch data from the touch panel;

combining the received touch data as annotation to the whiteboard; and

sending the annotated whiteboard to the touch panel and to the at least one endpoint.

40. The method of claim 36 , wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the indication when the user moves the user tool relative thereto.

41. The method of claim 36 , further comprising:

receiving another indication from the touch panel when user movement is made relative to the sensor;

automatically selecting at least one third source in response to the other indication;

automatically switching from the annotated content currently sent to the at least one third source automatically selected; and

sending video from the at least one third source to the at least one endpoint.

42. The method of claim 36 , further comprising displaying a graphical user interface on the touch panel and generating touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

43. The method of claim 42 , wherein the separate user interface screens comprise one or more of: a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.

Assignments (9)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 22, 2023
From: POLYCOM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 064056/0894 →
RELEASE OF PATENT SECURITY INTERESTS Recorded Aug 30, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: PLANTRONICS, INC.; POLYCOM, INC.
Reel/Frame 061356/0366 →
SECURITY AGREEMENT Recorded Jul 5, 2018
From: PLANTRONICS, INC.; POLYCOM, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 046491/0915 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 046472/0815 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 047247/0615 →
RELEASE OF SECURITY INTEREST Recorded Sep 27, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: POLYCOM, INC.; VIVU, INC.
Reel/Frame 040166/0162 →
GRANT OF SECURITY INTEREST IN PATENTS - FIRST LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0094 →
GRANT OF SECURITY INTEREST IN PATENTS - SECOND LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0459 →
SECURITY AGREEMENT Recorded Dec 9, 2013
From: POLYCOM, INC.; VIVU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 031785/0592 →