IP Library Patent Application 14123652
Patent Application
App. No. 14/123,652

METHOD AND APPARATUS FOR LIVE VIDEO SHARING WITH MULTIMODAL MODES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/123,652
Abstract

An approach is provided for enhancing a communication session. The approach involves receiving a request for communicating at least substantially live video data between a device and one or more other devices. The approach also involves determining capability information, resource availability information, or a combination thereof of the device, the one or more other devices, or a combination thereof. The approach further involves processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to cause, at least in part, an extraction of multimodal information from the at least substantially live video data. The approach additionally involves causing, at least in part, an exchange of the multimodal information in place of at least a portion of the at least substantially live video data in response to the request.

Claims (64)

1 - 38 . (canceled)

39 . An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

receive a request for communicating at least substantially live video data between a device and one or more other devices;

determine capability information, resource availability information, or a combination thereof of the device, the one or more other devices, or a combination thereof;

process and/or facilitate a processing of the capability information, the resource availability information, or a combination thereof to cause, at least in part, an extraction of multimodal information from the at least substantially live video data; and

cause, at least in part, an exchange of the multimodal information in place of at least a portion of the at least substantially lie video data in response to the request.

40 . An apparatus of claim 39 , wherein the apparatus is further caused to perform at least the following:

process and/or facilitate a processing of the capability information, the resource availability information, or a combination thereof to determine one or more available multimodal modes,

wherein the extraction of the multimodal information is based, at least in part, on the one or more available multimodal modes.

41 . An apparatus of claim 39 , wherein the multimodal information includes, at least in part, one or more key frames, audio data, reduced-resolution video data, speech-to-text data, or a combination thereof.

42 . An apparatus of claim 41 , wherein the apparatus is further caused to perform at least the following:

process and/or facilitate a processing of a previously recorded portion of the at least substantially live video data to determine the one or more key frames.

43 . An apparatus of claim 42 , wherein the apparatus is further caused to perform at least the following:

determine one or more scene changes in the previously recorded portion of the at least substantially live video data; and

determine the one or more key frames based, at least in part, on the one or more scene changes.

44 . An apparatus of claim 41 , wherein the apparatus is further caused to perform at least the following:

receive an input for selecting at least one of the one or more key frames; and

cause, at least in part, an exchange of a portion of the at least substantially live video data associated with the at least one of the one or more key frames.

45 . An apparatus of claim 41 , wherein the apparatus is further caused to perform at least the following:

process and/or facilitate a processing of the previously recorded portion the at least substantially live video data, concurrently recorded audio data, or a combination thereof to determine one or more audio segments based, at least in part, on one or more audio selection criteria,

wherein the audio data comprises at least in part the one or more audio segments.

46 . An apparatus of claim 41 , wherein the apparatus is further caused to perform at least the following:

process and/or facilitate a processing of the capability information, the resource availability information, or a combination thereof to determine one or more reduced resolution video encoding parameters; and

cause, at least in part, a generation of the reduced-resolution video data based, at least in part, on the one or more reduced resolution video encoding parameters.

47 . An apparatus of claim 39 , wherein the apparatus is further caused to perform at least the following:

determine context information associated with the device, the one or more other devices, the at least substantially live video data, or a combination thereof,

wherein the multimodal information includes, at least in part, the context information.

48 . A method comprising:

receiving a request for communicating at least substantially live video data between a device and one or more other devices;

determining capability information, resource availability information, or a combination thereof of the device, the one or more other devices, or a combination thereof;

processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to cause, at least in part, an extraction of multimodal information from the at least substantially live video data; and

causing, at least in part, an exchange of the multimodal information in place of at least a portion of the at least substantially lie video data in response to the request.

49 . A method of claim 48 , further comprising:

processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to determine one or more available multimodal modes,

wherein the extraction of the multimodal information is based, at least in part, on the one or more available multimodal modes.

50 . A method of claim 48 , wherein the multimodal information includes, at least in part, one or more key frames, audio data, reduced-resolution video data, speech-to-text data, or a combination thereof.

51 . A method of claim 50 , further comprising:

processing and/or facilitating a processing of a previously recorded portion of the at least substantially live video data to determine the one or more key frames.

52 . A method of claim 51 , further comprising:

determining one or more scene changes in the previously recorded portion of the at least substantially live video data; and

determining the one or more key frames based, at least in part, on the one or more scene changes.

53 . A method of claim 50 , further comprising:

receiving an input for selecting at least one of the one or more key frames; and

causing, at least in part, an exchange of a portion of the at least substantially live video data associated with the at least one of the one or more key frames.

54 . A method of claim 50 , further comprising:

processing and/or facilitating a processing of the previously recorded portion the at least substantially live video data, concurrently recorded audio data, or a combination thereof to determine one or more audio segments based, at least in part, on one or more audio selection criteria,

wherein the audio data comprises at least in part the one or more audio segments.

55 . A method of claim 50 , further comprising:

processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to determine one or more reduced resolution video encoding parameters; and

causing, at least in part, a generation of the reduced-resolution video data based, at least in part, on the one or more reduced resolution video encoding parameters.

56 . A method of claim 48 , further comprising:

determining context information associated with the device, the one or more other devices, the at least substantially live video data, or a combination thereof,

wherein the multimodal information includes, at least in part, the context information.

57 . A computer program product including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the steps:

receiving a request for communicating at least substantially live video data between a device and one or more other devices;

determining capability information, resource availability information, or a combination thereof of the device, the one or more other devices, or a combination thereof;

processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to cause, at least in part, an extraction of multimodal information from the at least substantially live video data; and

causing, at least in part, an exchange of the multimodal information in place of at least a portion of the at least substantially lie video data in response to the request.

58 . A computer program product of claim 57 , wherein the apparatus is caused, at least in part, to further perform:

processing and/or facilitating a processing of the capability information, the resource availability information, or a combination thereof to determine one or more available multimodal modes,

wherein the extraction of the multimodal information is based, at least in part, on the one or more available multimodal modes.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035398/0933 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2013
From: ZENG, XIAO; ZOU, YANMING; XIE, XIAOHUI; WANG, KONGQIAO
To: NOKIA CORPORATION; NOKIA CORPORATION
Reel/Frame 031707/0483 →