IP Library Granted Patent US 10,871,918
Granted Patent B2
US 10,871,918 · App. 15/667,448 · Granted Dec 22, 2020

Writing composite objects to a data store

Inventor: Grigoriy Kesler (Mountain View, CA)
Assignee: INTUIT INC.
G06F3/0659G06F3/0604G06F3/067G06F9/30G06F9/46G06F16/13G06F16/9024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,871,918
App. No.
15/667,448
Granted
Dec 22, 2020
Kind
B2
Abstract

This disclosure relates to optimizing write requests based on an object dependency graph. An example method generally includes receiving, from a client device, a write request specifying an object to be written to the data store. A gateway server determines, based on an object dependency graph associated with the specified object and identifying relationships between the specified object and one or more dependency objects, one or more dependency objects to be written to the data store. The gateway server generates a plurality of write requests for the specified object and the one or more dependency objects and generates an execution plan for the plurality of write requests based on the object dependency graph. The gateway server executes the plurality of write requests based on the execution plan.

Claims (67)

1. A method for writing data to a data store, comprising:

receiving, from a client device, a write request specifying an object to be written to the data store;

determining, based on traversing an object dependency graph defining the specified object and identifying relationships between the specified object and dependency objects of the specified object, dependency objects to be written to a plurality of data stores including the data store, wherein the dependency objects comprise objects stored across the plurality of data stores or objects to be written across the plurality of data stores prior to writing the specified object to the data store;

generating a plurality of write requests for the specified object and the dependency objects, each of the plurality of write requests being directed to one of the plurality of data stores;

generating an execution plan for the plurality of write requests based on the object dependency graph; and

executing the plurality of write requests against the plurality of data stores based on the execution plan.

2. The method of claim 1 , wherein generating the execution plan comprises:

instantiating a write request queue;

traversing the object dependency graph to identify write requests corresponding to independent data objects;

inserting the write requests corresponding to independent data objects into the write request queue; and

inserting write requests corresponding to objects dependent on the independent data objects into the write request queue.

3. The method of claim 2 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same object type, coalescing the plurality of write requests into a single write request.

4. The method of claim 2 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same data store location, coalescing the plurality of write requests into a single write request.

5. The method of claim 1 , further comprising:

obtaining the object dependency graph by introspection into a definition of the specified object.

6. The method of claim 1 , wherein the object dependency graph comprises a plurality of nodes, each node being associated with an object and including an object name, a location at which the object is stored, and references to one or more other nodes that the object depends on.

7. The method of claim 1 , wherein executing the plurality of write requests comprises:

executing a first write request against a data store specified by the first write request;

upon detecting a failure to successfully execute the first write request, repeating execution of the first write request; and

upon detecting that the first write request successfully executed, executing a second write request of the plurality of write requests against a data store specified by the second write request.

8. A system, comprising:

a processor; and

a memory storing instructions which, when executed on the processor, perform an operation for writing data to a data store, the operation comprising:

receiving, from a client device, a write request specifying an object to be written to the data store;

determining, based on traversing an object dependency graph defining the specified object and identifying relationships between the specified object and dependency objects of the specified object, dependency objects to be written to a plurality of data stores including the data store, wherein the dependency objects comprise objects stored across the plurality of data stores or objects to be written across the plurality of data stores prior to writing the specified object to the data store;

generating a plurality of write requests for the specified object and the dependency objects, each of the plurality of write requests being directed to one of the plurality of data stores;

generating an execution plan for the plurality of write requests based on the object dependency graph; and

executing the plurality of write requests against the plurality of data stores based on the execution plan.

9. The system of claim 8 , wherein generating the execution plan comprises:

instantiating a write request queue;

traversing the object dependency graph to identify write requests corresponding to independent data objects;

inserting the write requests corresponding to independent data objects into the write request queue; and

inserting write requests corresponding to objects dependent on the independent data objects into the write request queue.

10. The system of claim 9 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same object type, coalescing the plurality of write requests into a single write request.

11. The system of claim 9 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same data store location, coalescing the plurality of write requests into a single write request.

12. The system of claim 8 , wherein the operation further comprises:

obtaining the object dependency graph by introspection into a definition of the specified object.

13. The system of claim 8 , wherein the object dependency graph comprises a plurality of nodes, each node being associated with an object and including an object name, a location at which the object is stored, and references to one or more other nodes that the object depends on.

14. The system of claim 8 , wherein executing the plurality of write requests comprises:

executing a first write request against a data store specified by the first write request;

upon detecting a failure to successfully execute the first write request, repeating execution of the first write request; and

upon detecting that the first write request successfully executed, executing a second write request of the plurality of write requests against a data store specified by the second write request.

15. A non-transitory computer-readable medium comprising instructions which, when executed on one or more processors, performs an operation for writing data to a data store, the operation comprising:

receiving, from a client device, a write request specifying an object to be written to the data store;

determining, based on traversing an object dependency graph defining the specified object and identifying relationships between the specified object and dependency objects of the specified object, dependency objects to be written to a plurality of data stores including the data store, wherein the dependency objects comprise objects stored across the plurality of data stores or objects to be written across the plurality of data stores prior to writing the specified object to the data store;

generating a plurality of write requests for the specified object and the dependency objects, each of the plurality of write requests being directed to one of the plurality of data stores;

generating an execution plan for the plurality of write requests based on the object dependency graph; and

executing the plurality of write requests against the plurality of data stores based on the execution plan.

16. The non-transitory computer-readable medium of claim 15 , wherein generating the execution plan comprises:

instantiating a write request queue;

traversing the object dependency graph to identify write requests corresponding to independent data objects;

inserting the write requests corresponding to independent data objects into the write request queue; and

inserting write requests corresponding to objects dependent on the independent data objects into the write request queue.

17. The non-transitory computer-readable medium of claim 16 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same object type, coalescing the plurality of write requests into a single write request.

18. The non-transitory computer-readable medium of claim 16 , wherein inserting the write requests corresponding to independent objects comprises:

upon determining that a plurality of write requests in the write request queue are associated with a same data store location, coalescing the plurality of write requests into a single write request.

19. The non-transitory computer-readable medium of claim 15 , wherein the operation further comprises:

obtaining the object dependency graph by introspection into a definition of the specified object.

20. The non-transitory computer-readable medium of claim 15 , wherein executing the plurality of write requests comprises:

executing a first write request against a data store specified by the first write request;

upon detecting a failure to successfully execute the first write request, repeating execution of the first write request; and

upon detecting that the first write request successfully executed, executing a second write request of the plurality of write requests against a data store specified by the second write request.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2017
From: KESLER, GRIGORIY
To: INTUIT, INC.
Reel/Frame 043814/0807 →
Continuity (1)
Related Publication 20190042149A1 · Feb 7, 2019