METHOD, APPARATUS, AND COMPUTER PROGRAM PRODUCT FOR AUTOMATIC REMIX AND SUMMARY CREATION USING CROWD-SOURCED INTELLIGENCE
A method, apparatus, and computer program product are disclosed to create media mixes and summaries using crowd-sourced intelligence. In the context of a method, sensor and context data is received from at least one device. The method includes causing generation of a media remix based on the sensor and context data received from the at least one device. In addition, the method includes causing transmission of the media remix to a client device. In some embodiments, the sensor data from the at least one device comprises at least one selected from the group consisting of: orientation with respect to north; orientation with respect to horizontal; position in three dimensional space; GPS data; or location data, and the context data from the at least one device enables calculation of the depth of focus of the at least one device. A corresponding apparatus and computer program product are also provided.
1 . A method comprising:
receiving sensor and context data from at least one device;
causing, by a processor, generation of a media remix based on the sensor and context data received from the at least one device; and
causing transmission of the media remix to a client device.
2 . The method of claim 1 ,
wherein the sensor data from the at least one device comprises at least one selected from the group consisting of: orientation with respect to north; orientation with respect to horizontal; position in three dimensional space; global positioning system (GPS) data; or location data, and
wherein the context data from the at least one device enables calculation of the depth of focus of the at least one device.
3 . The method of claim 1 , wherein generation of the media remix comprises:
identifying at least one focus of interest based on the sensor and context data;
extracting relevant media segments from a recording engine based on candidate views corresponding to the at least one focus of interest; and
generating the media remix based on the relevant media segments.
4 . The method of claim 3 , wherein identifying the at least one focus of interest based on the sensor and context data comprises:
determining a location, orientation, and area of focus of the at least one device based on the sensor and context data; and
identifying the at least one focus of interest based on the location, orientation, and area of focus of the at least one device.
5 . The method of claim 3 , wherein generation of the media remix further comprises identifying the candidate views corresponding to the at least one focus of interest by:
evaluating candidate views from the recording engine based on at least one of:
a comparison of distance of focus of the candidate view to distance of focus of the focus of interest,
a comparison of an orientation of the candidate view with respect to the focus of interest, and
detectability of the focus of interest in the candidate view using object detection or object recognition analysis; and
selecting candidate views from the recording engine based on the evaluation.
6 . The method of claim 3 , wherein the media segments comprise audio or video segments.
7 . The method of claim 1 , wherein causing generation of the media remix is further based on the sensor and context data of the client device.
8 . An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
receive sensor and context data from at least one device;
generate a media remix based on the sensor and context data received from the at least one device; and
transmit the media remix to a client device.
9 . The apparatus of claim 8 ,
wherein the sensor data from the at least one device comprises at least one selected from the group consisting of: orientation with respect to north; orientation with respect to horizontal; position in three dimensional space; GPS data; or location data, and
wherein the context data from the at least one device enables calculation of the depth of focus of the at least one device.
10 . The apparatus of claim 8 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to generate the media remix by:
identifying at least one focus of interest based on the sensor and context data;
extracting relevant media segments from a recording engine based on candidate views corresponding to the at least one focus of interest; and
generating the media remix based on the relevant media segments.
11 . The apparatus of claim 10 , wherein identifying the at least one focus of interest based on the sensor and context data comprises:
determining a location, orientation, and area of focus of the at least one device based on the sensor and context data; and
identifying the at least one focus of interest based on the location, orientation, and area of focus of the at least one device.
12 . The apparatus of claim 10 , wherein generating the media remix further comprises identifying the candidate views corresponding to the at least one focus of interest by:
evaluating candidate views from the recording engine based on at least one of:
a comparison of distance of focus of the candidate view to distance of focus of the focus of interest,
a comparison of an orientation of the candidate view with respect to the focus of interest, and
detectability of the focus of interest in the candidate view using object detection or object recognition analysis; and
selecting candidate views from the recording engine based on the evaluation.
13 . The apparatus of claim 10 , wherein the media segments comprise audio or video segments.
14 . The apparatus of claim 8 , wherein generating the media remix is further based on the sensor and context data of the client device.
15 . A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions that, when executed, cause an apparatus to:
receive sensor and context data from at least one device;
generate a media remix based on the sensor and context data received from the at least one device; and
transmit the media remix to a client device.
16 . The computer program product of claim 15 ,
wherein the sensor data from the at least one device comprises at least one selected from the group consisting of: orientation with respect to north; orientation with respect to horizontal; position in three dimensional space; GPS data; or location data, and
wherein the context data from the at least one device enables calculation of the depth of focus of the at least one device.
17 . The computer program product of claim 15 , wherein the program code instructions that, when executed, cause the apparatus to generate the media mix comprise program code instructions that, when executed, cause the apparatus to:
identify at least one focus of interest based on the sensor and context data;
extract relevant media segments from a recording engine based on candidate views corresponding to the at least one focus of interest; and
generate the media remix based on the relevant media segments.
18 . The computer program product of claim 17 , wherein the program code instructions that, when executed, cause an apparatus to identify the at least one focus of interest based on the sensor and context data comprise program code instructions that, when executed, cause the apparatus to:
determine a location, orientation, and area of focus of the at least one device based on the sensor and context data; and
identify the at least one focus of interest based on the location, orientation, and area of focus of the at least one device.
19 . The computer program product of claim 17 , wherein generation of the media remix further comprises identifying the candidate views corresponding to the at least one focus of interest by:
evaluating candidate views from the recording engine based on at least one of:
a comparison of distance of focus of the candidate view to distance of focus of the focus of interest,
a comparison of an orientation of the candidate view with respect to the focus of interest, and
detectability of the focus of interest in the candidate view using object detection or object recognition analysis; and
selecting candidate views from the recording engine based on the evaluation.
20 . The computer program product of claim 1 , wherein generating the media remix is further based on the sensor and context data of the client device.