Method and system for synchronized search and retrieval of visual work instructions using artificial intelligence
View Patent ↗The present invention relates to generating training data for performing artificial intelligence. A method and apparatus for generating section data of a visual work instruction for performing artificial intelligence are provided for generating data for searching a user's desired section in a visual work instruction using an artificial intelligence-based text search model.
1 . A method for providing a search for a segment that a user is looking for in a video work instruction, comprising:
(a) separating a video segment from text information associated with the video work instruction, wherein the text information has a hierarchical structure including a module name, a unit name belonging to the module name, and a part name belonging to the unit name, and wherein the separating is performed based on a detection of a change in at least one of the unit name or the part name within the text information;
(b) generating and storing a text file corresponding to the video segment separated in step (a) based on the text information, wherein the generated text file integrates all of a description of an entire video work instruction, a task name, a task description, and the module name, the unit name, and the part name corresponding to the separated video segment into a single document for the separated video segment, and wherein, when the separating is performed based on a change in the unit name, the generated text file includes all part names associated with the unit name, whereas when the separating is performed based on a change in the part name, the generated text file includes a specific part name corresponding to the separated video segment;
(c) generating and storing synchronization information for the video segment separated in step (a) and the text file generated in step (b);
(d) searching for a text file corresponding to a query input by the user from among the stored text files;
(e) determining a video segment corresponding to the query input by the user by referring to the synchronization information of the searched text file; and
(f) providing the video segment corresponding to the query input by the user, determined in step (e), to the user,
wherein the synchronization information of step (c) is a start time and an end time of the video content for the text file generated in step (b).
2 . An apparatus for providing a search for a segment that a user is looking for in a video work instruction, comprising:
at least one processor; and
at least one memory for storing computer-executable instructions,
wherein the computer-executable instructions stored in the at least one memory cause the at least one processor to perform:
(a) separating a video segment from text information associated with the video work instruction, wherein the text information has a hierarchical structure including a module name, a unit name belonging to the module name, and a part name belonging to the unit name, and wherein the separating is performed based on a detection of a change in at least one of the unit name or the part name within the text information;
(b) generating and storing a text file corresponding to the video segment separated in step (a) based on the text information, wherein the generated text file integrates all of a description of an entire video work instruction, a task name, a task description, and the module name, the unit name, and the part name corresponding to the separated video segment into a single document for the separated video segment, and wherein, when the separating is performed based on a change in the unit name, the generated text file includes all part names associated with the unit name, whereas when the separating is performed based on a change in the part name, the generated text file includes a specific part name corresponding to the separated video segment;
(c) generating and storing synchronization information for the video segment separated in step (a) and the text file generated in step (b);
(d) searching for a text file corresponding to a query input by the user from among the stored text files;
(e) determining a video segment corresponding to the query input by the user by referring to the synchronization information of the searched text file; and
(f) providing the video segment corresponding to the query input by the user, determined in step (e), to the user,
wherein the synchronization information of step (c) is a start time and an end time of the video content for the text file generated in step (b).