Granted Patent B2

US 12,293,611 · App. 17/394,022 · Granted May 6, 2025

Inventor: Nathan Thomas North (Seattle, WA)

Assignee: Transportation IP Holdings, LLC

G07C5/006G05B23/0243G06F30/27G07C5/008G07C5/0825G07C5/0833

Abstract

Claims (42)

1. A system comprising:

a maintenance task input unit configured to generate a plurality of input data groups, wherein the plurality of input data groups correspond to a maintenance task performed on a component of a vehicle, wherein each of the plurality of input data groups corresponds to a different format of a plurality of formats, and wherein the maintenance task input unit comprises one or more of a keyboard, a manual input peripheral device, a camera, a microphone, or any combination thereof; and

one or more processors communicably coupled to the maintenance task input unit, the one or more processors are configured to:

obtain the plurality of input data groups from the maintenance task input unit;

identify a particular format of the plurality of formats for each of the plurality of input data groups;

generate a plurality of intermediate representations corresponding to each of the plurality of input data groups, wherein the plurality of intermediate representations are based on the particular format for each of the plurality of input data groups;

modify the plurality of intermediate representations corresponding to each of the plurality of input data groups to provide a plurality of model inputs, wherein each of the plurality of model inputs are modified to have a common format; and

evaluate the plurality of model inputs with a maintenance system artificial intelligence modeler, wherein the maintenance system artificial intelligence modeler compares the plurality of model inputs to a completed maintenance task; and

determine a sufficiency assessment of the maintenance task.

2. The system of claim 1 , wherein the one or more processors are configured to prepare the plurality of intermediate representations by generating an n-dimensional array having an n-dimensional array format corresponding to the particular format for each of the plurality of input data groups.

3. The system of claim 2 , wherein the common format defines a common n-dimensional array format.

4. The system of claim 1 , wherein the plurality of formats include at least one of an image format, a text format, a video format, or an audio format.

5. The system of claim 1 , wherein the one or more processors are configured to modify the plurality of intermediate representations to generate the plurality of model inputs by altering at least one of a size or a shape of an n-dimensional array of the plurality of intermediate representations.

6. The system of claim 1 , wherein the maintenance task input unit is configured to generate the plurality of input data groups by at least one of acquiring image information or acquiring audio information corresponding to the maintenance task performed on the component of the vehicle.

7. The system of claim 1 , wherein the one or more processors are further configured to perform a responsive task based on the sufficiency assessment of the maintenance task.

8. The system of claim 1 , wherein the sufficiency assessment of the maintenance task comprises completed satisfactory, completed unsatisfactory, or incomplete.

9. A method comprising:

obtaining a plurality of input data groups of input information corresponding to a maintenance task performed on a component of a vehicle, wherein each of the plurality of input data groups corresponds to a different format of a plurality of formats;

identifying a particular format of the plurality of formats for each of the plurality of input data groups;

generating a plurality of intermediate representations of the plurality of input data groups based on the particular format that is identified for each of the plurality of input data groups;

modifying the plurality of intermediate representations corresponding to the plurality of input data groups to provide a plurality of model inputs, wherein each of the plurality of model inputs are modified to have a common format;

evaluating the plurality of model inputs with a maintenance system artificial intelligence modeler, wherein the maintenance system artificial intelligence modeler compares the plurality of model inputs to a maintenance task; and

determining a sufficiency assessment of the maintenance task.

10. The method of claim 9 , wherein preparing the plurality of intermediate representations comprises generating an n-dimensional array having an n-dimensional array format corresponding to the particular format for each of the plurality of input data groups.

11. The method of claim 10 , wherein the common format defines a common n-dimensional array format.

12. The method of claim 9 , wherein the plurality of formats include at least one of an image format, a text format, a video format, or an audio format.

13. The method of claim 9 , wherein modifying the plurality of intermediate representations to provide generate the plurality of model inputs by altering at least one of a size or a shape of an n-dimensional array of the plurality of intermediate representations.

14. The method of claim 9 , wherein obtaining the plurality of input data groups comprises at least one of acquiring an image file or acquiring an audio file corresponding to the maintenance task performed on the component of the vehicle.

15. The method of claim 9 , further comprising:

performing a responsive task based on the sufficiency assessment of the maintenance task, wherein the sufficiency assessment is completed unsatisfactory or incomplete.

16. A method comprising:

obtaining maintenance task data for a maintenance task on a component of a vehicle;

generating an input data including input information corresponding to the maintenance task data;

obtaining, by one or more processors, the input data of the input information, wherein the input data corresponds to a plurality of formats;

identifying a particular format of the plurality of formats for the input data;

generating an intermediate representation of the input data based on the particular format that is identified;

modifying the intermediate representation to provide a model input having a common format;

evaluating the model input with a maintenance system artificial intelligence modeler, wherein the maintenance system artificial intelligence modeler compares the model input to a maintenance task; and

determining a sufficiency assessment of the maintenance task.

17. The method of claim 16 , wherein obtaining the input data comprises at least one of acquiring an image file or acquiring an audio file corresponding to the maintenance task.

18. The method of claim 16 , further comprising:

performing a responsive task based on the sufficiency assessment of the maintenance task, wherein the sufficiency assessment is completed unsatisfactory or incomplete.

Assignments (1)

Continuity (2)

References Cited (34)