IP Library Granted Patent US 10,871,949
Granted Patent B2
US 10,871,949 · App. 16/430,351 · Granted Dec 22, 2020

Integration of learning models into a software development system

Inventors: Alexander B. Brown (Mountain View, CA); Michael R. Siracusa (Mountain View, CA); Gaurav Kapoor (Santa Clara, CA); Elizabeth Ottens (San Francisco, CA); Christopher M. Hanson (Campbell, CA); Zachary A. Nation (Seattle, WA); Vrushali Mundhe (Fremont, CA); Srikrishna Sridhar (Seattle, WA)
Assignee: Apple Inc.
G06F8/315G06F8/35G06N20/00G06F8/10G06F8/30G06F8/36G06F8/60G06F8/71
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,871,949
App. No.
16/430,351
Granted
Dec 22, 2020
Kind
B2
Abstract

The subject technology transforms a machine learning model into a transformed machine learning model in accordance with a particular model specification when the machine learning model does not conform to the particular model specification, the particular model specification being compatible with an integrated development environment (IDE). The subject technology generates a code interface and code for the transformed machine learning model, the code interface including code statements in the object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model. Further, the subject technology provides the generated code interface and the code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.

Claims (51)

1. A method comprising:

transforming a machine learning model into a transformed machine learning model in accordance with a particular model specification when the machine learning model does not conform to the particular model specification, the particular model specification being compatible with an integrated development environment (IDE);

generating a code interface and code for the transformed machine learning model, the code interface including code statements in an object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model; and

providing the generated code interface and the generated code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.

2. The method of claim 1 , further comprising:

receiving additional code corresponding to calling a function provided by the code for the transformed machine learning model.

3. The method of claim 2 , further comprising:

compiling the code interface, the code for the transformed machine learning model, and the additional code into a compiled machine learning model, wherein compiling includes generating object code for the object oriented programming language; and

sending the compiled machine learning model as part of a software package to a runtime environment of a target computing device for execution.

4. The method of claim 3 , wherein compiling the code interface, the code for the transformed machine learning model, and the additional code for the transformed machine learning model into the compiled machine learning model further comprises:

combining object code corresponding to the code interface, the code, and the additional code for the transformed machine learning model.

5. The method of claim 3 , further comprising:

performing preprocessing on the code interface, the code for the transformed machine learning model, and the additional code, wherein the preprocessing further comprises:

indexing the code interface, the code for the transformed machine learning model, and the additional code.

6. The method of claim 1 , wherein generating the code interface and code for the transformed machine learning model further comprises:

generating a function for performing an operation of the transformed machine learning model, the function including code written in an object oriented programming language.

7. The method of claim 6 , wherein the function further comprises an input variable that corresponds to machine learning data associated with the transformed machine learning model.

8. The method of claim 1 , wherein generating the code interface and code for the transformed machine learning model further comprises:

determining an input data type used by the machine learning model; and

determining a target data type for transformed machine learning model based on the input data type, wherein the input data type is different than the target data type.

9. The method of claim 1 , wherein generating the code interface and code for the transformed machine learning model further comprises:

determining hardware or processing requirements for the machine learning model, the hardware or processing requirements including information indicating a GPU, a CPU, an ASIC, or a cloud computing service.

10. The method of claim 1 , wherein generating the code interface and code for the transformed machine learning model further comprises:

generating data objects corresponding to machine learning primitives included in the machine learning model.

11. The method of claim 1 , wherein generating the code interface and code for the transformed machine learning model further comprises:

mapping a function call to an input data type required by the transformed machine learning model, the input data type comprising an input vector or a matrix.

12. The method of claim 1 , further comprising:

tagging the transformed machine learning model to indicate that the machine learning model has been transformed into the particular model specification, wherein tagging includes assigning an identifier to the transformed machine learning model.

13. A system comprising;

a processor;

a memory device containing instructions, which when executed by the processor cause the processor to:

obtain a machine learning model corresponding to a particular model specification that is compatible with an integrated development environment (IDE);

generate a code interface and code for the machine learning model, the code interface including code statements in an object oriented programming language, the code statements corresponding to an object representing the machine learning model; and

provide the generated code interface and the generated code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.

14. The system of claim 13 , wherein the memory device contains further instructions, which when executed by the processor, further cause the processor to:

receive additional code corresponding to calling a function provided by the code for the machine learning model.

15. The system of claim 14 , wherein the memory device contains further instructions, which when executed by the processor, further cause the processor to:

compile the code interface, the code for the machine learning model, and the additional code into a compiled machine learning model, wherein compiling includes generating object code for the object oriented programming language; and

send the compiled machine learning model as part of a software package to a runtime environment of a target computing device for execution.

16. The system of claim 15 , wherein to compile the code interface, the code for the machine learning model, and the additional code for the machine learning model into the compiled machine learning model further comprises:

combining object code corresponding to the code interface, the code, and the additional code for the machine learning model.

17. The system of claim 15 , wherein the memory device contains further instructions, which when executed by the processor, further cause the processor to:

perform preprocessing on the code interface, the code for the machine learning model, and the additional code, wherein the preprocessing further comprises:

indexing the code interface, the code for the machine learning model, and the additional code.

18. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

generating a code interface and code for a machine learning model, the code interface including code statements in an object oriented programming language, the code statements corresponding to an object representing the machine learning model; and

providing the generated code interface and the generated code for display in an integrated development environment (IDE), the IDE enabling modifying of the generated code interface and the code.

19. The non-transitory computer-readable medium of claim 18 , wherein the operations further comprise:

verifying that the machine learning model is compliant with a particular model specification that is compatible with the IDE prior to generating the code interface and the code.

20. The non-transitory computer-readable medium of claim 18 , wherein generating the code interface and code for the machine learning model further comprises:

generating a function for performing an operation of the machine learning model, the function including code written in an object oriented programming language.

Continuity (3)
Continuation 15721712 · Sep 29, 2017
Provisional Application 62514780 · Jun 3, 2017
Related Publication 20190286424A1 · Sep 19, 2019