IP Library Granted Patent US 8,874,538
Granted Patent B2
US 8,874,538 · App. 13/012,547 · Granted Oct 28, 2014

Method and apparatus for video synthesis

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,874,538
App. No.
13/012,547
Granted
Oct 28, 2014
Kind
B2
Abstract

An approach is provided for generating a compilation of media items. A plurality of media items is received. Respective context vectors for the media items are determined. The context vectors include, at least in part, orientation information, tilt information, altitude information, geo-location information, timing information, or a combination thereof associated with the creation of the respective media items. A compilation of at least a portion of the media items is generated based, at least in part, on the context vectors.

Claims (64)

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

a plurality of media items;

respective context vectors for the media items, wherein the context vectors includes, at least in part, orientation information, tilt information, altitude information, geo-location information, timing information, or a combination thereof associated with creation of the media items;

one or more criteria, wherein the criteria includes one or more specifications, filters, or a combination thereof associated with the context vectors or the media items; and

at least one compilation, by a processor, of at least a portion of the media items based, at least in part, on the context vectors, wherein the at least one compilation is dynamically generated during playback of one or more of the plurality of media items, and the portion of the media items is selected for incorporation in the compilation based on the one or more criteria.

2. A method of claim 1 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of one or more regions of interest of the media items based, at least in part, on the context vectors,

wherein the compilation is further based, at least in part, on the one or more regions of interest.

3. A method of claim 1 , wherein one or more of the context vectors are associated with one or more segments of the respective media items, and

wherein the compilation is further based, at least in part, on the selection.

4. A method of claim 3 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one augmentation of the compilation,

wherein the one or more criteria relate to a classification of one or more panning events, associated with the media items, detected based, at least in part, on the context vectors.

5. A method of claim 1 , wherein the media items are captured live, and wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

reception of the context vectors and media items from a plurality of mobile devices;

one or more characteristics of already captured media items based on one or more context vector parameters, the context vectors, or a combination thereof; and

at least one determination to direct capturing of subsequent media items based, at least in part, on the one or more characteristics.

6. A method of claim 1 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of one or more events based, at least in part, on the context vectors,

wherein the compilation is further based, at least in part, on the one or more events, and the context vectors are associated with a plurality of views that are associated with one or more perspectives of the one or more events.

7. A method of claim 1 , wherein the context vectors further comprise orientation data including accelerometer data, magnetometer data, altimeter data, gyroscope data, zoom level data, focal length data, field of view data, range sensor data, or a combination thereof.

8. A method of claim 1 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the tilt information to identify one or more objects, spatial characteristics of the one or more objects, or a combination thereof.

9. A method of claim 1 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the context vectors, the media items, or a combination thereof to determine one or more descriptive concepts associated with the media items,

wherein the compilation is further based, at least in part, on the one or more descriptive concepts.

10. A method of claim 9 , wherein the one or more descriptive concepts include, at least in part, one or more primitive concepts, one or more composite concepts, or a combination thereof, and wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the context vectors, the media items, or a combination thereof to determine the one or more primitive concepts; and

a processing of the one or more primitive concepts to determine the one or more composite concepts,

wherein the compilation is further based, at least in part, on the one or more primitive concepts, the one or more composite concepts, or a combination thereof.

11. A method of claim 9 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the context vectors to determine one or more characteristics associated with the media items, and

at least one determination of one or more messages to direct capturing of additional media items based on the one or more characteristics.

12. A method of claim 9 , wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the one or more descriptive concepts to determine an intra-device correlation of the one or more descriptive concepts, an inter-device correlation of the one or more descriptive concepts, or a combination thereof for one or more devices associated with the creation of the media items,

wherein the compilation is further based, at least in part, on the intra-device correlation, the inter-device correlation, or a combination thereof.

13. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

receive a plurality of media items;

determine respective context vectors for the media items, wherein the context vectors includes, at least in part, orientation information, tilt information, altitude information, geo-location information, timing information, or a combination thereof associated with creation of the media items;

determine one or more criteria, wherein the criteria includes one or more specifications, filters, or a combination thereof associated with the context vectors or the media items; and

determine to dynamically generate, during playback of one or more of the plurality of media items, a compilation of at least a portion of the media items based, at least in part, on the context vectors, wherein the portion of the media items is selected for incorporation in the compilation based on the one or more criteria.

14. An apparatus of claim 13 , wherein the apparatus is further caused to:

determine one or more regions of interest of the media items based, at least in part, on the context vectors,

wherein the compilation is further based, at least in part, on the one or more regions of interest.

15. An apparatus of claim 13 ,

wherein one or more of the context vectors are associated with one or more segments of the respective media items, and

wherein the compilation is further based, at least in part, on the selection.

16. An apparatus of claim 13 , wherein the media items are captured live, and wherein the apparatus is further caused to:

receive the context vectors and media items from a plurality of mobile devices;

determine one or more characteristics of already captured media items based on one or more context vector parameters, the context vectors, or a combination thereof; and

determine to direct capturing of subsequent media items based, at least in part, on the one or more characteristics.

17. An apparatus of claim 13 , wherein the apparatus is further caused to:

determine one or more deficiencies in the media items; and

process and/or facilitate a processing of the tilt information to identify one or more objects, spatial characteristics of the one or more objects, or a combination thereof.

18. An apparatus of claim 13 , wherein the apparatus is further caused to:

process and/or facilitate a processing of the context vectors, the media items, or a combination thereof to determine one or more descriptive concepts associated with the media items,

wherein the one or more descriptive concepts include, at least in part, one or more primitive concepts, one or more composite concepts, or a combination thereof, and wherein the compilation is further based, at least in part, on the one or more descriptive concepts, the one or more primitive concepts, the one or more composite concepts, or a combination thereof.

19. A method of claim 13 , wherein the context vectors are determined based on one or more identifiers linking the media items to the respective context vectors, and the context vectors, the media items, or a combination thereof include, at least in part, multimodal data recorded by one or more devices.

20. An apparatus of claim 13 , wherein the apparatus is further caused to:

process and/or facilitate a processing of the one or more descriptive concepts to determine an intra-device correlation of the one or more descriptive concepts, an inter-device correlation of the one or more descriptive concepts, or a combination thereof for one or more devices associated with the creation of the media items,

wherein the compilation is further based, at least in part, on the intra-device correlation, the inter-device correlation, or a combination thereof.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035468/0231 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2011
From: MATE, SUJEET SHYAMSUNDAR; CURCIO, IGOR DANILO DIEGO; CRICRI, FRANCESCO; DABOV, KOSTADIN NIKOLAEV
To: NOKIA CORPORATION
Reel/Frame 026113/0155 →