Granted Patent B2

US 12,468,876 · App. 18/234,808 · Granted Nov 11, 2025

Inventors: Frank Maggiore (Jersey City, NJ); Angelo Stracquatanio (Jersey City, NJ); Obay Alchorbaji (Jersey City, NJ); Emilee Cook (Jersey City, NJ); Karl Baranov (Jersey City, NJ); Josh Morgan (Jersey City, NJ); John Zimmerman (Jersey City, NJ); Ahmed Bekhit (Jersey City, NJ); Matthew Hall (Jersey City, NJ); Younge Qu (Jersey City, NJ); Jonathan Borgia (Jersey City, NJ)

Assignee: Apprentice FS, Inc.

G06F40/10G06F3/167G06F16/40G06F40/166G06F40/186G06F40/20G06F40/279G06Q10/06G09B5/065

Abstract

Claims (150)

1 . A method for modifying steps of a procedure comprising:

accessing an instructional block library containing a set of verified instructional blocks associated with approved digital procedures performed within a facility;

accessing a first unverified draft instructional block, authored by an operator, for a new digital procedure at the facility;

detecting a first set of language signals in the first unverified draft instructional block;

correlating a first equipment unit language signal, in the first set of language signals, with a first equipment unit located within the facility;

correlating a first action language signal, in the first set of language signals, with a first action prompt related to the first equipment unit;

correlating a first risk language signal, in the first set of language signals, with a first process risk associated with execution of the first action prompt with the first equipment unit;

identifying a first verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as analogous to the first unverified draft instructional block in response to the first verified instructional block comprising language signals associated with the first equipment unit, the first action prompt, and the first process risk; and

inserting the first verified instructional block, in place of the first unverified draft instructional block, in the new digital procedure.

2 . The system of claim 1 , further comprising:

at a remote computer system, transmitting the new digital procedure containing the first verified instructional block to a second operator device associated with a second operator assigned to perform the new digital procedure at the facility; and

in response to initiation of the first verified instructional block by the second operator:

extracting a first instruction, in a set of formats, from the first verified instructional block;

presenting the first instruction in a particular format, in the set of formats, corresponding to a particular degree of guidance corresponding to the first process risk.

3 . The method of claim 1 , wherein accessing the instructional block library containing the set of verified instructional blocks associated with approved digital procedures performed within the facility comprises:

accessing a record of instances of digital procedures completed at the facility;

identifying a subset of instances of verified digital procedure in the record of instances of digital procedures, each instance of a verified digital procedure in the subset of instances of verified digital procedures:

performed by an operator at the facility; and

validated as a verified digital procedure by a supervisor overseeing digital procedures performed at the facility;

initializing the instructional block library; and

for each instance of a verified digital procedure in the subset of instances of verified digital procedures:

detecting a sequence of instructional blocks representing a sequence of steps for the verified digital procedure; and

for each instructional block in the sequence of instructional blocks, storing the instructional block as a verified instructional block in the instructional block library.

4 . The method of claim 3 , further comprising, for each instructional block in the sequence of instructional blocks:

detecting a set of language signals in text content, audio content, and visual content contained within the instructional block, the set of language signals comprising:

an equipment unit language signal corresponding to a particular equipment unit in the facility;

an action language signal corresponding to an action prompt for the particular equipment unit;

a risk language signal corresponding to a process risk associated with execution of the action prompt for the particular equipment unit; and

tagging the equipment unit language signal, the action language signal, and the risk language signal to the instructional block; and

storing the instructional block tagged with the equipment unit language signal, the action language signal, and the risk language signal in the instructional block library.

5 . The method of claim 1 , further comprising:

accessing a second unverified draft instructional block, authored by an operator, for the new digital procedure at the facility;

detecting a second set of language signals in the second unverified draft instructional block;

correlating a second equipment unit language signal, in the second set of language signals, with a second equipment unit located within the facility;

correlating a second action language signal, in the second set of language signals, with a second action prompt related to the second equipment unit;

correlating a second risk language signal, in the second set of language signals, with a second process risk associated with execution of the second action prompt with the second equipment unit;

identifying a second verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as related to the unverified draft instructional block in response to:

the second verified instructional block comprising language signals associated with the second equipment unit and the second action prompt; and

detecting absence of the second risk language signal in the second verified instructional block;

inserting the second verified instructional block, in place of the second unverified draft instructional block, in the new digital procedure; and

flagging the new digital procedure for manual review by a supervisor overseeing digital procedures performed at the facility.

6 . The system of claim 1 , further comprising:

accessing a second unverified draft instructional block, authored by an operator, for the new digital procedure at the facility;

detecting a second set of language signals in the second unverified draft instructional block;

correlating a second equipment unit language signal, in the second set of language signals, with a second equipment unit located within the facility;

correlating a second action language signal, in the second set of language signals, with a second action prompt related to the second equipment unit;

correlating a second risk language signal, in the second set of language signals, with a second process risk associated with execution of the second action prompt with the second equipment unit;

identifying absence of language signals associated with the second equipment unit, the second action prompt, and the second process risk, in the set of verified instructional blocks contained in the instructional block library; and

in response to identifying the absence of language signals, flagging the new digital procedure for manual review by a supervisor overseeing digital procedures performed at the facility.

7 . The system of claim 1 :

wherein correlating the first equipment unit language signal, in the first set of language signals, with the first equipment unit located within the facility comprises:

accessing a first natural language processing model trained on equipment unit lexicon;

based on the first natural language processing model, identifying a first set of words describing the first equipment unit at the facility, in the first unverified draft instructional block;

normalizing the first set of words to a first equipment unit language concept; and

representing the first equipment unit language concept in the equipment unit signal;

wherein correlating the first action language signal, in the first set of language signals, with the first action prompt related to the first equipment unit comprises:

accessing a second natural language processing model trained on action and prompt lexicon;

based on the second natural language processing model, identifying a second set of words describing the first action prompt associated with the first equipment unit, in the first unverified draft instructional block;

normalizing the second set of words to a standard action language concept; and

representing the standard action language concept in the first action language signal; and

wherein correlating the first risk language signal, in the first set of language signals, with the first process risk associated with execution of the first action prompt with the first equipment unit comprises:

accessing a third natural language processing model trained on threat and instability lexicon;

based on the third natural language processing model, identifying a third set of words describing the first process risk associated with the action, in the first unverified draft instructional block;

normalizing the third set of words to a risk language concept; and

representing the risk language concept in the first risk language signal.

8 . The method of claim 1 :

wherein accessing the first unverified draft instructional block, authored by the operator, for the new digital procedure at the facility comprises accessing the first unverified draft instructional block comprising a first instruction in a set of formats comprising:

a text format comprising a textual description of a first process step in the new digital procedure;

an audio format comprising an audio recording of a voice describing the first process step; and

a visual format comprising a video clip depicting performance of the first process step; and

wherein detecting the first set of language signals in the first unverified draft instructional block comprises:

extracting a first sequence of words from the textual description of the first instruction in the text format;

extracting a first set of audio features from the audio recording of the first instruction in the audio format;

extracting a first set of visual features from the video clip of the first reference image in the visual format; and

detecting the first set of language signals in the first unverified draft instructional block based on the first sequence of words, the first set of audio features, and the first set of visual features.

9 . The method of claim 8 :

wherein correlating the first equipment unit language signal, in the first set of language signals, with the first equipment unit located within the facility comprises identifying presence of the first equipment unit depicted in the video clip based on the first set of visual features;

wherein correlating the first action language signal, in the first set of language signals, with the first action prompt related to the first equipment unit comprises interpreting the first sequence of words as describing the first action prompt related to the first equipment unit; and

wherein correlating the first risk language signal, in the first set of language signals, with the first process risk associated with execution of the first action prompt with the first equipment unit comprises identifying an audible alert corresponding to the first process risk in the audio recording based on the first set of audio features.

10 . The method of claim 8 :

wherein accessing the instructional block library containing the set of verified instructional blocks associated with approved digital procedures performed within the facility comprises:

detecting a set of language signals in text content, audio content, and visual content contained within the instructional block, the set of language signals comprising:

an equipment unit language signal corresponding to a particular equipment unit in the facility;

an action language signal corresponding to an action prompt for the particular equipment unit; and

a risk language signal corresponding to a process risk associated with execution of the action prompt for the particular equipment unit; and

storing the set of language signals in a language signal tag, in a set of language signal tags, associated with the instructional block; and

wherein identifying the first verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as analogous to the first unverified draft instructional block comprises:

querying the set of language signal tags for a first language signal tag comprising the first equipment unit language signal, the first action language signal, and the first risk language signal; and

in response to identifying the first language signal tag, retrieving the first verified instructional block associated with the first language signal tag, from the instructional block library.

11 . The method of claim 1 , wherein accessing the first unverified draft instructional block, authored by the operator, for the new digital procedure at the facility comprises:

receiving selection of a particular verified instructional block, in the instructional block library, from the operator;

loading the particular verified instructional block;

receiving a modification to the particular verified instructional block from the operator; and

in response to receiving the modification, storing the particular verified instructional block as the first unverified draft instructional block.

12 . The method of claim 11 , further comprising:

characterizing a scope of modification to the particular verified instructional block by the operator; and

in response to the scope of modification exceeding a threshold scope of modification:

scanning the first unverified draft instructional block for the first set of language signals; and

identifying the first verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as analogous to the first unverified draft instructional block in response to the first verified instructional block comprising language signals associated with the first equipment unit, the first action prompt, and the first process risk.

13 . The method of claim 1 :

further comprising:

accessing an electronic document representing the new digital procedure authored by the operator;

identifying a sequence of steps specified in the electronic document; and

for each step in the sequence of steps:

extracting an instruction in a set of formats for the step;

initializing an unverified draft instructional block, in a sequence of unverified draft instructional blocks, for the step; and

populating the unverified draft instructional block with the instruction in the set of formats for the step;

wherein accessing a first unverified draft instructional block, authored by an operator, for the new digital procedure at the facility comprises accessing the first unverified draft instructional block from the sequence of unverified draft instructional blocks.

14 . The method of claim 13 , further comprising:

serving the sequence of unverified draft instructional blocks for the new digital procedure to an operator device associated with the operator for completion of a first instance of the new digital procedure at the facility by the operator;

at the operator device, recording a media file of completion of the first instance of the new digital procedure by the operator;

segmenting the media file into a set of media clips; and

populating each unverified draft instructional block, in the sequence of unverified draft instructional blocks, with a corresponding media clip in the set of media clips.

15 . The method of claim 1 , further comprising appending an audit trail for the new digital procedure comprising:

an identifier of the operator authoring the new digital procedure;

an identifier of a current revision of the first unverified draft instructional block in the new digital procedure; and

the first verified instructional block analogous to the first unverified draft instructional block.

16 . A method for modifying steps of a procedure comprising:

accessing an instructional block library containing a set of verified instructional blocks associated with approved digital procedures performed within a facility;

accessing a first unverified draft instructional block, authored by an operator, for a new digital procedure at the facility;

detecting a first set of language signals in the first unverified draft instructional block;

correlating a first equipment unit language signal, in the first set of language signals, with a first equipment unit located within the facility;

correlating a first action language signal, in the first set of language signals, with a first action prompt related to the first equipment unit;

correlating a first risk language signal, in the first set of language signals, with a first process risk associated with execution of the first action prompt with the first equipment unit;

identifying a first verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as related to the unverified draft instructional block in response to:

the first verified instructional block comprising language signals associated with the first equipment unit and the first action prompt; and

detecting absence of the first risk language signal in the first verified instructional block; and

inserting the first verified instructional block, in place of the first unverified draft instructional block, in the new digital procedure.

17 . The method of claim 16 , wherein accessing the first unverified draft instructional block, authored by the operator, for the new digital procedure at the facility comprises:

receiving selection of a particular verified instructional block, in the instructional block library, from the operator;

loading the particular verified instructional block;

receiving, block from the operator, a modification to the particular verified instructional;

characterizing a scope of modification for the modification to the particular verified instructional block by the operator; and

in response to the scope of modification exceeding a threshold scope of modification, storing the particular verified instructional block as the first unverified draft instructional block.

18 . The method of claim 16 :

wherein accessing the first unverified draft instructional block, authored by the operator, for the new digital procedure at the facility comprises accessing the first unverified draft instructional block comprising a first instruction in a set of formats comprising:

a text format comprising a textual description of a first process step in the new digital procedure;

an audio format comprising an audio recording of a voice describing the first process step; and

a visual format comprising a video clip depicting performance of the first process step; and

wherein detecting the first set of language signals in the first unverified draft instructional block comprises detecting the first set of language signals in the textual description, the audio recording, and the video clip.

19 . The method of claim 16 :

wherein accessing the instructional block library containing the set of verified instructional blocks associated with approved digital procedures performed within the facility comprises:

detecting a set of language signals in text content, audio content, and visual content contained within the instructional block, the set of language signals comprising:

an equipment unit language signal corresponding to a particular equipment unit in the facility;

an action language signal corresponding to an action prompt for the particular equipment unit; and

a risk language signal corresponding to a process risk associated with execution of the action prompt for the particular equipment unit; and

storing the set of language signals in a language signal tag, in a set of language signal tags, associated with the instructional block; and

wherein identifying the first verified instructional block, in the set of verified instructional blocks contained in the instructional block library, as related to the first unverified draft instructional block comprises:

querying the set of language signal tags for a first language signal tag comprising the first equipment unit language signal and the first action language signal; and

in response to detecting absence of the risk language signal in the first language signal tag, retrieving the first verified instructional block associated with the first language signal tag, from the instructional block library.

Assignments (1)

Continuity (7)

References Cited (30)