IP Library Granted Patent US 10,440,327
Granted Patent B1
US 10,440,327 · App. 16/108,057 · Granted Oct 8, 2019

Methods and systems for video-conferencing using a native operating system and software development environment

Inventor: Labinot Bytyqi (Fontana, CA)
H04N7/152G06F3/1454G06F3/167H04N5/23299
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,440,327
App. No.
16/108,057
Granted
Oct 8, 2019
Kind
B1
Abstract

In an embodiment, a video-conferencing system may include a computing device, camera and networking capabilities integrated into a single set-top box unit. The system may receive first input audio data and first input video data via a network connection, the audio data and video data being captured at a location remote from the video-conferencing device; generate instructions to send the first input audio data and first input video data to a first display device coupled to the video-conferencing device; capture, using a camera of the video-conferencing device, output video data of an environment surrounding the video-conferencing device; capture, using a microphone array of the video-conferencing device, output audio data of the environment surrounding the video-conferencing device; and generate instructions to send the output video data and the output audio data to a remotely located receiving device.

Claims (73)

1. A communication system comprising:

a video-conferencing device comprising:

a camera;

a microphone array; and

one or more processors operable to execute instructions from a memory medium, wherein when executing the instructions, the processors perform operations comprising:

receiving first input audio data and first input video data via a network connection, the audio data and video data being captured at a location remote from the video-conferencing device;

generating instructions to send the first input audio data and first input video data to a first display device coupled to the video-conferencing device for display;

capturing, using the camera, output video data of an environment surrounding the video-conferencing device;

capturing, using the microphone array, output audio data of the environment surrounding the video-conferencing device;

generating instructions to send the output video data and the output audio data via the network connection to a remotely located receiving device;

generating instructions to offer a remote application program interface (API) to one or more third-party entities, wherein the remote API allows the one or more third-party entities to control a tilt of the camera or a zoom of the camera via the network connection;

receiving a remote API request via the network connection from a remote participant of a current video-communication session to tilt or adjust the zoom of the camera; and

in response to the remote API request, tilting or adjusting the view of the camera in accordance with the remote request.

2. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

receiving a voice command from a user of the video-conferencing device through the microphone array;

categorizing the voice command into one of a plurality of predetermined voice-command categories, the plurality of predetermined voice-command categories comprising calling a contact of the user, launching an application, retrieving information from the Internet, playing music, playing video, or starting a video-conferencing session.

3. The communication system of claim 1 , wherein the video-conferencing device further comprises one or more physical buttons for disabling the camera or the microphone array at a hardware level.

4. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

receiving an indication from a user to transfer a communication session from a personal device to the video-conferencing device, wherein the indication comprises a swipe on a touch screen of the personal device;

in response to receiving the indication, transferring the communication session from the personal device to the video-conferencing device without an interruption in the communication session.

5. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

receiving user input indicating a change in direction of the camera; and

tilting the camera in accordance with the user input.

6. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising generating instructions to switch to a dual-screen mode, wherein in the dual-screen mode, second input video data and second input audio data are sent to a second display device coupled to the video-conferencing device and the first display device via one or more wired connections.

7. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising generating instructions to integrate a digital whiteboarding functionality into a dual-screen mode, wherein the digital whiteboarding functionality comprises:

receiving user-generated content from a personal device of a participant in a video-conferencing session;

generating instructions to send the user-generated content the first display device and to a remotely located receiving device.

8. The communication system of claim 1 , wherein a video depicting one or more participants of a video-conferencing session is displayed on the first display screen at the same time as a user-generated content is displayed on the first display screen.

9. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

accessing information in a third-party database; and

generating instructions to send the information in the third-party database to a first display device coupled to the video-conferencing device via a wired connection.

10. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

receiving a voice command from a user of the video-conferencing device through the microphone array;

analyzing a waveform of the voice command;

based on the analysis of the waveform of the voice command, matching the voice command to a user of the video-conferencing device.

11. The communication system of claim 1 , wherein the processors, when executing the instructions, further perform operations comprising:

receiving an indication from a user to transfer a communication session from a personal device to the video-conferencing device;

detecting that multiple video-conferencing devices are available to handle the transfer of the communication session;

determining a closest video-conferencing device of the multiple video-conferencing devices; and

transferring the communication session from the personal device to the closest video-conferencing device without an interruption in the communication session.

12. A method, comprising, by one or more computing devices associated with a video-conferencing device:

receiving first input audio data and first input video data via a network connection, the audio data and video data being captured at a location remote from the video-conferencing device;

generating instructions to send the first input audio data and first input video data to a first display device coupled to the video-conferencing device for display;

capturing, using the camera, output video data of an environment surrounding the video-conferencing device;

capturing, using the microphone array, output audio data of the environment surrounding the video-conferencing device;

generating instructions to send the output video data and the output audio data via the network connection to a remotely located receiving device;

generating instructions to offer a remote application program interface (API) to one or more third-party entities, wherein the remote API allows the one or more third-party entities to control a tilt of the camera or a zoom of the camera via the network connection;

receiving a remote API request via the network connection from a remote participant of a current video-communication session to tilt or adjust the zoom of the camera; and

in response to the remote API request, tilting or adjusting the view of the camera in accordance with the remote request.

13. The method of claim 12 , further comprising:

receiving a voice command from a user of the video-conferencing device through the microphone array;

categorizing the voice command into one of a plurality of predetermined voice-command categories, the plurality of predetermined voice-command categories comprising calling a contact of the user, launching an application, retrieving information from the Internet, playing music, playing video, or starting a video-conferencing session.

14. The method of claim 12 , wherein the video-conferencing device comprises an operating system that operates in at least two modes, the at least two modes comprising a gaming mode and a video streaming mode.

15. The method of claim 12 , further comprising:

receiving an indication from a user to transfer a communication session from a personal device to the video-conferencing device, wherein the indication comprises and only comprises a swipe on a touch screen of the personal device;

in response to receiving the indication, transferring the communication session from the personal device to the video-conferencing device without an interruption in the communication session.

16. The method of claim 12 , wherein the processors, when executing the instructions, further perform operations comprising generating instructions to switch to a dual-screen mode, wherein in the dual-screen mode, second input video data and second input audio data are sent to a second display device coupled to the video-conferencing device and the first display device via one or more wired connections.

17. A non-transitory computer-readable storage medium comprising software with instructions encoded thereon that, when executed by a processor, cause the processor to:

receive first input audio data and first input video data via a network connection, the audio data and video data being captured at a location remote from the video-conferencing device;

generate instructions to send the first input audio data and first input video data to a first display device coupled to the video-conferencing device for display;

capture, using the camera, output video data of an environment surrounding the video-conferencing device;

capture, using the microphone array, output audio data of the environment surrounding the video-conferencing device;

generate instructions to send the output video data and the output audio data via the network connection to a remotely located receiving device;

generate instructions to offer a remote application program interface (API) to one or more third-party entities, wherein the remote API allows the one or more third-party entities to control a tilt of the camera or a zoom of the camera via the network connection;

receive a remote API request via the network connection from a remote participant of a current video-communication session to tilt or adjust the zoom of the camera; and

in response to the remote API request, tilt or adjust the view of the camera in accordance with the remote request.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the instructions, further cause the processor to:

receive a voice command from a user of the video-conferencing device through the microphone array;

categorize the voice command into one of a plurality of predetermined voice-command categories, the plurality of predetermined voice-command categories comprising calling a contact of the user, launching an application, retrieving information from the Internet, playing music, playing video, or starting a video-conferencing session.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the video-conferencing device comprises an operating system that operates in at least two modes, the at least two modes comprising a gaming mode and a video streaming mode.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the instructions, further cause the processor to:

receive an indication from a user to transfer a communication session from a personal device to the video-conferencing device, wherein the indication comprises and only comprises a swipe on a touch screen of the personal device;

in response to receiving the indication, transfer the communication session from the personal device to the video-conferencing device without an interruption in the communication session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2019
From: BYTYQI, LABINOT
To: SOLABORATE LLC
Reel/Frame 049340/0263 →
Cited By (2)
US 12,231,517 US 12,675,030