IP Library Granted Patent US 9,185,343
Granted Patent B2
US 9,185,343 · App. 13/893,172 · Granted Nov 10, 2015

Methods and systems for mobile telepresence

Inventors: Richard John George (Arthur, CA); Brian Alexander Oliver (Kitchener, CA)
Assignee: BlackBerry Limited
H04N7/15G06F1/3203H04L65/1006H04L65/1069H04L65/403H04L65/80H04N21/2343H04N21/2662H04N21/41407H04N21/4394H04N21/4424H04N21/44209H04N21/44218H04N21/44245H04N21/4532H04N21/4858H04W4/00H04W48/08H04W52/0261H04W88/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,185,343
App. No.
13/893,172
Granted
Nov 10, 2015
Kind
B2
Abstract

Exemplary methods and systems relate to telepresence at mobile devices. In one example the method can be performed on the mobile device. The mobile device can determine real-time availability of resources. The mobile device can further determine the composition of the telepresence session. The mobile device can further communicate the determined composition of telepresence data to a remote server. The mobile device can further receive telepresence data and perform a portion of the telepresence session data. Additionally, the present system can be configured to operate on a server or other electronic device.

Claims (35)

1. A method for telepresence at a mobile device comprising:

determining, on the mobile device, a real-time availability of resources, including a current status of a battery powering the mobile device and a current bandwidth available over a wireless network;

determining, on the mobile device, a video composition and a display composition of telepresence session data based at least in part on the determined availability of resources including video capabilities and display capabilities of the mobile device, wherein determining the display composition of the telepresence session data comprises selecting a video stream composition requiring higher bandwidth upon detection of availability of a higher bandwidth wireless network connection;

transmitting, from the mobile device to a remote server, the video composition and the display composition of telepresence data;

receiving, on the mobile device, a first portion of the telepresence session data in accordance with the display composition;

transmitting, by the mobile device, a second portion of the telepresence session data in accordance with the video composition; and,

performing, on the mobile device, the first portion of the telepresence session data.

2. The method of claim 1 , further comprising receiving a selection of one or more of a plurality of high-definition video sources available on the mobile device, and implementing that selection in determining the video composition of telepresence session data.

3. The method of claim 1 , wherein the display composition is based on one or more of a resolution of a display at the mobile device, size of the display, and availability of video and audio codecs at the mobile device.

4. The method of claim 1 , wherein the performing the first portion of the telepresence session data includes outputting an audio portion over speakers of the mobile device.

5. The method of claim 1 , wherein the performing the first portion of the telepresence session data includes rendering a video portion on a display of the mobile device.

6. The method of claim 1 , wherein the telepresence session data includes at least one of audio or video data.

7. A server-based method for providing telepresence-like capabilities to one or more mobile devices, comprising:

establishing a connection from the server to one or more mobile devices each having one or more cameras and at least one camera configured for high-definition video;

receiving telepresence session configuration information updates from one of the one or more mobile devices for a telepresence session;

receiving a determination of real-time availability of resources, including a current status of a battery powering the one or more mobile devices and a current bandwidth available over a wireless network to the respective one or more mobile devices;

determining, at the server, a video composition and a display composition of telepresence session data based at least in part on the determined availability of resources including video capabilities and display capabilities of the mobile device, wherein determining the display composition of the telepresence session data comprises selecting a video stream composition requiring higher bandwidth upon detection of availability of a higher bandwidth wireless network connection; and

transmitting, from the server, the video composition and the display composition of telepresence data to the mobile device.

8. The method of claim 7 , wherein the video composition comprises a video composition format from available formats comprising a roster view, an active speaker view, and a thumbnail matrix view.

9. The method of claim 7 , the video composition comprises one or more of a selection from the received video streams, a frame rate, and a resolution.

10. The method of claim 7 , wherein the determining of the display composition of the telepresence session data comprises selecting a video stream composition requiring lower bandwidth upon detection of unavailability of the higher bandwidth wireless network connection.

11. A mobile telepresence-enabled device, comprising:

a display;

a network interface;

a memory resource;

processing resources coupled with the memory resource, the network interface, the display, for operation under battery power, and comprising one or more modules configured to determine a real-time availability of resources, including a current status of a battery powering the mobile device and a current bandwidth available over a wireless network;

determine a video composition and a display composition of telepresence session data based at least in part on the determined availability of resources including video capabilities and display capabilities of the mobile device, wherein determining the display composition of the telepresence session data comprises selecting a video stream composition requiring higher bandwidth upon detection of availability of a higher bandwidth wireless network connection;

transmit the video composition and the display composition of telepresence data;

receive a first portion of the telepresence session data in accordance with the display composition;

transmit a second portion of the telepresence session data in accordance with the video composition; and,

perform the first portion of the telepresence session data.

12. The mobile device of claim 11 , wherein the display composition is based on one or more of a resolution of the display at the mobile device, size of the display, and availability of video and audio codecs at the mobile device.

13. The mobile device of claim 11 , wherein the determining of real-time availability of resources further includes determining whether an alternative network is available to mobile device.

14. The mobile device of claim 11 , wherein the performing portion of the telepresence session data includes transmitting data to speakers of the mobile device.

15. The mobile device of claim 11 , wherein the performing portion of the telepresence session data includes transmitting data to the display of the mobile device.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE ADDED PATENT NUMBER TO REMOVE PATENT NO. 8,873,407 AT PREVIOUSLY RECORDED ON REEL 64066 FRAME 1. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE DATE MARCH 20, 2023. Recorded Feb 2, 2026
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 074921/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET AT PAGE 50 TO REMOVE 12817157 PREVIOUSLY RECORDED ON REEL 063471 FRAME 0474. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 5, 2023
From: BLACKBERRY LIMITED
To: OT PATENT ESCROW, LLC
Reel/Frame 064806/0669 →
CORRECTIVE ASSIGNMENT TO CORRECT 12817157 APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 064015 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 5, 2023
From: OT PATENT ESCROW, LLC
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064807/0001 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064066/0001 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 16, 2023
From: OT PATENT ESCROW, LLC
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064015/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2023
From: BLACKBERRY LIMITED
To: OT PATENT ESCROW, LLC
Reel/Frame 063471/0474 →
CHANGE OF NAME Recorded Nov 3, 2014
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 034143/0567 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2013
From: GEORGE, RICHARD JOHN; OLIVER, BRIAN ALEXANDER
To: RESEARCH IN MOTION LIMITED
Reel/Frame 030602/0846 →
Continuity (3)
Continuation 12636270 · Dec 11, 2009
Provisional Application 61232256 · Aug 7, 2009
Related Publication 20130242037A1 · Sep 19, 2013