IP Library Granted Patent US 12,437,241
Granted Patent B2
US 12,437,241 · App. 18/422,506 · Granted Oct 7, 2025

Machine learning model registry

Inventor: Chongyuan Xiang (San Francisco, CA)
Assignee: Opendoor Labs Inc.
G06N20/20G06F17/18G06N5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,437,241
App. No.
18/422,506
Granted
Oct 7, 2025
Kind
B2
Abstract

Systems and methods to utilize a machine learning model registry are described. The system deploys a first version of a machine learning model and a first version of an access module to server machines. Each of the server machines utilizes the model and the access module to provide a prediction service. The system retrains the machine learning model to generate a second version. The system performs an acceptance test of the second version of the machine learning model to identify it as deployable. The system promotes the second version of the machine learning model by identifying the first version of the access module as being interoperable with the second version of the machine learning model and by automatically deploying the first version of the access module and the second version of the machine learning model to the plurality of server machines to provide the prediction service.

Claims (40)

1. A system comprising:

at least one processor and memory having instructions that, when executed, cause the at least one processor to perform operations comprising:

automatically deploying a first version of an access module and a first version of a machine learning model to a plurality of machines to provide a prediction service;

generating a second version of the access module;

automatically identifying the second version of the access module as being interoperable with the first version of the machine learning model; and

automatically deploying the second version of the access module and the first version of the machine learning model to the plurality of machines to provide the prediction service.

2. The system of claim 1 , wherein the operations further comprise:

retraining the first version of the machine learning model to generate a second version of the machine learning model, wherein the second version of the machine learning model is a linear regression model.

3. The system of claim 2 , wherein the operations further comprise:

validating the second version of the machine learning model to identify the second version of the machine learning model as being deployable, wherein the validating the second version of the machine learning model is based on predetermined criteria.

4. The system of claim 3 , wherein the predetermined criteria includes a model evaluation metric.

5. The system of claim 4 , wherein the model evaluation metric includes a mean squared error metric.

6. The system of claim 3 , wherein the validating the second version of the machine learning model includes identifying that the second version of the access module and the second version of the machine learning model utilize common features, wherein the common features includes a number of features, wherein the access module includes a version identifier, a module name, and a deployable indicator, and wherein the deployable indicator indicates whether the version of the access module being identified by the version identifier is deployable.

7. The system of claim 6 , wherein the validating the second version of the machine learning model includes identifying the second version of the access module is interoperable with the second version of the machine learning model.

8. The system of claim 2 , wherein the operations further comprise:

presenting a user interface including a comparison of the first version of the machine learning model with the second version of the machine learning model, wherein the comparison is based on a model evaluation metric.

9. The system of claim 8 , wherein the operations further comprise:

receiving an identifier for identifying the second version of the machine learning model.

10. A method comprising:

automatically deploying a first version of an access module and a first version of a machine learning model to a plurality of machines to provide a prediction service;

generating a second version of the access module by utilizing at least one processor;

automatically identifying the second version of the access module as being interoperable with the first version of the machine learning model by utilizing at least one processor; and

automatically deploying the second version of the access module and the first version of the machine learning model to the plurality of machines to provide the prediction service.

11. The method of claim 10 , further comprising:

retraining the first version of the machine learning model to generate a second version of the machine learning model, wherein the second version of the machine learning model is a linear regression model.

12. The method of claim 11 , further comprising:

validating the second version of the machine learning model to identify the second version of the machine learning model as being deployable, wherein the validating the second version of the machine learning model is based on predetermined criteria.

13. The method of claim 12 , wherein the predetermined criteria includes a model evaluation metric.

14. The method of claim 13 , wherein the model evaluation metric includes a mean squared error metric.

15. The method of claim 12 , wherein the validating the second version of the machine learning model includes identifying the second version of the access module and the second version of the machine learning model as utilizing common features, wherein the common features includes a number of features, wherein the access module includes a version identifier, a module name, and a deployable indicator, and wherein the deployable indicator indicates whether the version of the access module being identified by the version identifier is deployable.

16. The method of claim 15 , wherein the validating the second version of the machine learning model includes identifying that the second version of the access module interoperates with the second version of the machine learning model.

17. The method of claim 11 , further comprising presenting a user interface including a comparison of the first version of the machine learning model with the second version of the machine learning model, wherein the comparison is based on a model evaluation metric.

18. The method of claim 17 , further comprising:

receiving an identifier for identifying the second version of the machine learning model.

19. A non-transitory machine-readable medium and storing a set of instructions that, when executed by a processor, causes a machine to perform operations comprising:

automatically deploying a first version of an access module and a first version of a machine learning model to a plurality of machines to provide a prediction service;

generating a second version of the access module by utilizing at least one processor;

automatically identifying the second version of the access module as being interoperable with the first version of the machine learning model by utilizing at least one processor; and

automatically deploying the second version of the access module and the first version of the machine learning model to the plurality of machines to provide the prediction service.

20. The non-transitory machine-readable medium of claim 19 , wherein the operations further comprise training the first version of the machine learning model to generate a second version of the machine learning model, wherein the second version of the machine learning model is a linear regression model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2024
From: XIANG, CHONGYUAN
To: OPENDOOR LABS INC.
Reel/Frame 066247/0618 →
Continuity (4)
Continuation 17962165 · Oct 7, 2022
Continuation 16835710 · Mar 31, 2020
Provisional Application 62981679 · Feb 26, 2020
Related Publication 20240161018A1 · May 16, 2024
References Cited (43)
US 8843427B1 · Lin et al. · 2014 [cited by applicant]
US 10685308B1 · Avery, Jr. et al. · 2020 [cited by applicant]
US 10965484B2 · Rajashekar Vashisht · 2021 [cited by examiner]
US 11094024B2 · Burns · 2021 [cited by examiner]
US 11164199B2 · Lundgren · 2021 [cited by examiner]
US 11182691B1 · Zhang · 2021 [cited by applicant]
US 11243933B2 · Chen · 2022 [cited by examiner]
US 11257002B2 · Faulhaber, Jr. et al. · 2022 [cited by applicant]
US 11341339B1 · Li et al. · 2022 [cited by applicant]
US 11494703B2 · Xiang · 2022 [cited by examiner]
US 11593704B1 · Jenatton et al. · 2023 [cited by applicant]
US 11605021B1 · Khare et al. · 2023 [cited by applicant]
US 11704566B2 · Ma · 2023 [cited by examiner]
US 11797535B1 · Stefani et al. · 2023 [cited by applicant]
US 11809966B2 · Chen · 2023 [cited by examiner]
US 11972337B2 · Xiang · 2024 [cited by examiner]
US 20180157993A1 · Northrup · 2018 [cited by examiner]
US 20180293498A1 · Campos et al. · 2018 [cited by applicant]
US 20190294999A1 · Guttmann · 2019 [cited by applicant]
US 20190370695A1 · Chandwani et al. · 2019 [cited by applicant]
US 20200012935A1 · Goodsitt · 2020 [cited by examiner]
US 20200060007A1 · Harrison et al. · 2020 [cited by applicant]
US 20200104959A1 · Ensign · 2020 [cited by applicant]
US 20200210867A1 · Banis · 2020 [cited by examiner]
US 20200234121A1 · Stapleton et al. · 2020 [cited by applicant]
US 20200285899A1 · Chen et al. · 2020 [cited by applicant]
US 20200327457A1 · Cmielowski et al. · 2020 [cited by applicant]
US 20200401948A1 · Ma et al. · 2020 [cited by applicant]
US 20210065064A1 · Xu et al. · 2021 [cited by applicant]
US 20210097444A1 · Bansal et al. · 2021 [cited by applicant]
US 20210208545A1 · Zhang et al. · 2021 [cited by applicant]
US 20210232980A1 · Velagapudi et al. · 2021 [cited by applicant]
US 20210264321A1 · Xiang · 2021 [cited by applicant]
US 20210326717A1 · Mueller et al. · 2021 [cited by applicant]
US 20220100831A1 · Moreno et al. · 2022 [cited by applicant]
US 20230036004A1 · Xiang · 2023 [cited by applicant]
US 20240086867A1 · Miller · 2024 [cited by examiner]
U.S. Appl. No. 16/835,710 U.S. Pat. No. 11,494,703, filed Mar. 31, 2020, Machine Learning Model Registry. [cited by applicant]
U.S. Appl. No. 17/962,165, filed Oct. 7, 2022, Machine Learning Model Registry. [cited by applicant]
“U.S. Appl. No. 16/835,710, Notice of Allowance mailed Jul. 7, 2022”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/962,165, Non Final Office Action mailed Aug. 24, 2023”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/962,165, Notice of Allowance mailed Dec. 26, 2023”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/962,165, Response filed Nov. 22, 2023 to Non Final Office Action mailed Aug. 24, 2023”, 11 pgs. [cited by applicant]