Systems and methods for creating customized content
Systems and methods are disclosed for generating a content structure that can then be used as a content design building block. Specifically, new content can be automatically generated by combining, replacing or mixing and matching objects, actions, settings, effects, audio, etc., from any number of previously stored content structures to create a new content structure, which is then rendered as a new content segment. Content segments are then stitched together to generate a finished content stream. In this way, new and original content can be created without the traditionally expensive and labor-intensive filming or computer animation processes.
1. A method for creating new content based on deconstructed content, the method comprising:
receiving a first content portion that depicts a first object;
deconstructing the first content portion into a plurality of attributes and a plurality of attribute values associated with the first object;
generating first mappings that comprise the plurality of attribute values corresponding to the plurality of attributes;
generating a first content structure comprising the plurality of attributes and the first mappings;
accessing a data structure comprising at least a second attribute associated with a second object, wherein the second attribute corresponds to a second attribute value;
retrieving, from the data structure, second mappings that comprise the second attribute and the second attribute value;
determining a match between at least one of the first mappings and at least one of the second mappings;
generating a second content structure by selectively combining (i) the second attribute with the plurality of attributes and (ii) the second attribute value with the plurality of attribute values based on the determined match;
constructing, based on the second content structure, a second content portion to depict the first object with the second attribute and the second attribute value.
2. The method of claim 1 , wherein:
each one of the first mappings indicates at least one of a feature, state, action, audio or location mapping corresponding to the first object, wherein each one of the feature, state, action, audio or location mapping comprises at least one attribute and one corresponding attribute value; and
each one of the second mappings indicates at least one of a feature, state, action, audio or location mapping corresponding to the second object, wherein each one of the feature, state, action, audio or location mapping comprises at least one attribute and one corresponding attribute value.
3. The method of claim 2 , wherein the determining the match between at least one of the first mappings and at least one of the second mappings, comprises:
identifying a first attribute in the first mappings and the second attribute in the second mappings that indicate the same feature, state, action, audio, or location mapping of an object, wherein the first attribute corresponds to an undefined first attribute value and the second attribute corresponds to a defined second attribute value.
4. The method of claim 3 , wherein generating the second content structure comprises:
combining the defined second attribute value with the undefined first attribute value.
5. The method of claim 1 , wherein the deconstructing the first content portion comprises:
determining, based on using pattern recognition on the first content portion, a plurality of objects depicted in the first content portion; and
for each object of the plurality of objects:
determining, based on the depiction in the first content portion, attributes and associated attribute values; and
storing the attributes and the attribute values in an attribute table associated with each of the plurality of objects.
6. The method of claim 1 , wherein generating the first mappings comprises:
mapping the plurality of attribute values to a plurality of sub-portions within the first content portion during which the first object is depicted with the plurality of attributes corresponding to the plurality of attribute values; and
storing indicators for each of the plurality of sub-portions in association with the first object.
7. The method of claim 1 , wherein creating the second content structure comprises adjusting a time frame associated with the second attribute value to match a time frame associated with a first attribute value.
8. The method of claim 7 , wherein the first content portion is extracted based on at least one of a predetermined duration, a portion definition indicator, a pause in audio, and closed caption data.
9. The method of claim 1 , wherein receiving the first content portion comprises:
receiving a content stream comprising the first content portion; and
extracting the first content portion.
10. The method of claim 1 , wherein the first content portion comprises a sequence of video frames, and wherein the method further comprises:
identifying an object in the first content portion that appears in each video frame of the sequence of video frames;
tracking, for the identified object, a changing attribute in the sequence, wherein tracking the changing attribute comprises determining, for the changing attribute of the identified object, attribute values corresponding to each video frame of the sequence; and
wherein the first mappings comprise the changing attribute mapped to the sequence based on the determined attribute values.
11. A system for creating new content based on deconstructed content, the method comprising:
input/output circuitry configured to:
receive a first content portion that depicts a first object; and
control circuitry configured to:
deconstruct the first content portion into a plurality of attributes and a plurality of attribute values associated with the first object;
generate first mappings that comprise the plurality of attribute values corresponding to the plurality of attributes;
generate a first content structure comprising the plurality of attributes and the first mappings;
access a data structure comprising at least a second attribute associated with a second object, wherein the second attribute corresponds to a second attribute value;
retrieve, from the data structure, second mappings that comprise the second attribute and the second attribute value;
determine a match between at least one of the first mappings and at least one of the second mappings;
generate a second content structure by selectively combining (i) the second attribute with the plurality of attributes and (ii) the second attribute value with the plurality of attribute values based on the determined match;
construct, based on the second content structure, a second content portion to depict the first object with the second attribute and the second attribute value.
12. The system of claim 11 , wherein:
each one of the first mappings indicates at least one of a feature, state, action, audio or location mapping corresponding to the first object, wherein each one of the feature, state, action, audio or location mapping comprises at least one attribute and one corresponding attribute value; and
each one of the second mappings indicates at least one of a feature, state, action, audio or location mapping corresponding to the second object, wherein each one of the feature, state, action, audio or location mapping comprises at least one attribute and one corresponding attribute value.
13. The system of claim 12 , wherein the control circuitry is configured to determine the match between at least one of the first mappings and at least one of the second mappings, by:
identifying a first attribute in the first mappings and the second attribute in the second mappings that indicate the same feature, state, action, audio, or location mapping of an object, wherein the first attribute corresponds to an undefined first attribute value and the second attribute corresponds to a defined second attribute value.
14. The system of claim 13 , wherein the control circuitry is configured to generate the second content structure by:
combining the defined second attribute value with the undefined first attribute value.
15. The system of claim 11 , wherein the control circuitry is configured to deconstruct the first content portion by:
determining, based on using pattern recognition on the first content portion, a plurality of objects depicted in the first content portion; and
for each object of the plurality of objects:
determining, based on the depiction in the first content portion, attributes and associated attribute values; and
storing the attributes and the attribute values in an attribute table associated with each of the plurality of objects.
16. The system of claim 11 , wherein the control circuitry is configured to generate the first mappings by:
mapping the plurality of attribute values to a plurality of sub-portions within the first content portion during which the first object is depicted with the plurality of attributes corresponding to the plurality of attribute values; and
storing indicators for each of the plurality of sub-portions in association with the first object.
17. The system of claim 11 , wherein the control circuitry is configured to create the second content structure by adjusting a time frame associated with the second attribute value to match a time frame associated with a first attribute value.
18. The system of claim 17 , wherein the control circuitry is configured to extract the first content portion based on at least one of a predetermined duration, a portion definition indicator, a pause in audio, and closed caption data.
19. The system of claim 11 , wherein the control circuitry is configured to receive the first content portion by:
receiving a content stream comprising the first content portion; and
extracting the first content portion.
20. The system of claim 11 , wherein the first content portion comprises a sequence of video frames, and wherein the control circuitry is further configured to:
identify an object in the first content portion that appears in each video frame of the sequence of video frames;
track, for the identified object, a changing attribute in the sequence, wherein tracking the changing attribute comprises determining, for the changing attribute of the identified object, attribute values corresponding to each video frame of the sequence; and
wherein the first mappings comprise the changing attribute mapped to the sequence based on the determined attribute values.