Text-to-scene conversion
View Patent ↗A system is disclosed for generating a scene description from a set of words. The system includes modules that perform the following functions: performing a linguistic analysis on a set of words to generate a structure representation of semantic relationships between words within the set of words, converting the structure to a set of description elements representative of objects to be depicted in a scene and relationships between objects, depicting a spatial relationship by using at least one spatial tag of an associated one or more of the object, and assigning a set of depictors to each of the description elements. Each depictor in the set of depictors may include a reference to an object to be modified, parameters used in modifying the object and a procedure for modifying the object. The system may also include a module that generates the same description by execution of the procedure for the modification of the objects.
1. A system for generating a scene description from a set of words, the system comprising:
a module configured to perform a linguistic analysis on a set of words to generate a structure representative of semantic relationships between words within the set of words;
a module configured to convert the structure to a set of description elements representative of objects to be depicted in a scene and relationships between the objects;
a module configured to depict a spatial relationship by using at least one spatial tag of an associated one or more of the objects;
a module configured to assign a set of depictors to each of the description elements, wherein each depictor in the set of depictors comprises:
a reference to an object to be modified;
parameters used in modifying the object; and
a procedure for the modification of the object; and
a module configured to generate the scene description by execution of the procedure for the modification of the objects.
2. The system of claim 1 , wherein the linguistic analysis includes tagging the set of words with grammatical parts of speech.
3. The system of claim 1 , wherein the linguistic analysis includes parsing the set of words into a parse tree structure representative of the structure of the set of words.
4. The system of claim 1 , wherein the structure representative of the semantic relations of the set of words is a dependency structure, wherein the dependency structure indicates words that a given word is dependent on and indicates the words that depend on the given word.
5. The system of claim 1 , wherein each of the description elements is classified as belonging to a respective description element type.
6. The system of claim 5 , wherein each of the description element types has an object to which the respective description element refers.
7. The system of claim 1 , wherein at least one of the description elements is modified to resolve conflicts between some of the description elements.
8. The system of claim 1 , wherein at least one of the description elements is modified to add constraints to at least some of the description elements.
9. The system of claim 1 , wherein at least one of the depictors is modified to resolve conflicts between at least some of the depictors.
10. The system of claim 1 , wherein at least one of the depictors is modified to add constraints to at least some of the depictors.
11. A system for generating a low-level scene description from a set of words, the system comprising:
a module configured to tag a set of words with parts of speech;
a module configured to parse the tagged set of words into a parse tree structure representative of a structure of the set of words;
a module configured to convert the parse tree into a structure representative of the semantic relations of the set of words;
a module configured to convert the structure into a high-level scene description that includes at least one description element;
a module configured to assign a set of depictors to each description element, wherein each of the depictors comprises:
a reference to an object to be modified;
parameters used in modifying the object; and
a procedure for the modification of the object; and
a module configured to identify at least one conflict between at least some of the depictors;
a module configured to modify at least one of the depictors to resolve the at least one conflict; and
a module configured to generate the low-level scene description by execution of the procedures for the modification of the objects.
12. The system of claim 11 , wherein the structure representative of the semantic relations of the set of words is a dependency structure that indicates at least one word that a given word is dependent on and indicates the words that depend on the given word.
13. The system of claim 11 , wherein each of the description elements is classified as belonging to a description element type.
14. The system of claim 11 , wherein at least one of the description elements is modified to resolve conflicts between at least some of the description elements.
15. The system of claim 11 , wherein at least one of the description elements is modified to add constraints to at least some of the description elements.
16. The system of claim 11 , further comprising:
a module configured to depict a spatial relation by using at least one spatial tag of an associated one or more of the objects.
17. A system for generating a scene description from a set of words, the system comprising:
means for performing a linguistic analysis on the set of words to generate a structure representative of semantic relationships between words within the set of words;
means for converting the structure to a set of description elements representative of objects to be depicted in a scene and relationships between the objects;
means for depicting a spatial relation by using at least one spatial tag of an associated one or more of the objects;
means for assigning a set of constraints to each description element in the set of description elements; and
means for generating the scene description by solving the set of constraints for the set of descriptive elements.
18. The system of claim 17 , wherein the linguistic analysis includes tagging the set of words with grammatical parts of speech.
19. The system of claim 17 , wherein the linguistic analysis includes parsing the set of words into a parse tree structure representative of the structure of the set of words.
20. The system of claim 17 , wherein the structure representative of the semantic relations of the set of words is a dependency structure, wherein the dependency structure indicates words that a given word is dependent on and indicates the words that depend on the given word.