IP Library Granted Patent US 12,072,843
Granted Patent B1
US 12,072,843 · App. 17/580,475 · Granted Aug 27, 2024

Data maintenance transaction rollbacks

Inventors: Prakhar Jain (Sunnyvale, CA); Bart Samwel (Oegstgeest, NL); Burak Yavuz (San Francisco, CA)
Assignee: Databricks, Inc.
G06F16/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,072,843
App. No.
17/580,475
Granted
Aug 27, 2024
Kind
B1
Abstract

The present application discloses a method, system, and computer system for managing a data in a storage system. The method includes receiving a first transaction that modifies or deletes first data stored in a storage system, determining that the first data is subject to an intervening re-arrangement transaction, and in response to determining that the first data is subject to the intervening re-arrangement transaction, rolling back the re-arrangement transaction at least with respect to the first data and committing the first transaction.

Claims (55)

1. A system, comprising:

one or more processors configured to:

receive a first transaction that modifies or deletes first data stored in a storage system;

determine that the first data is subject to an intervening re-arrangement transaction; and

in response to determining that the first data is subject to the intervening re-arrangement transaction,

rollback the intervening re-arrangement transaction at least with respect to the first data; and

commit the first transaction; and

a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.

2. The system of claim 1 , wherein the intervening re-arrangement transaction is a compaction of the first data with second data.

3. The system of claim 1 , wherein the intervening re-arrangement transaction creates third data based at least in part on compaction of at least the first data with second data.

4. The system of claim 3 , wherein rolling back of the intervening re-arrangement transaction comprises removing the first data from the third data.

5. The system of claim 1 , wherein the one or more processors are further configured to:

determine, based at least in part on the first transaction, that the first data is to be modified or deleted in connection with the first transaction.

6. The system of claim 5 , wherein the one or more processors are further configured to:

in response to determining that the first data is to be modified or deleted in connection with the first transaction, determine whether the first data is subject to one or more intervening re-arrangement transactions.

7. The system of claim 6 , wherein:

determining whether the first data is subject to the one or more intervening re-arrangement transactions comprises querying a log of the one or more intervening re-arrangement transactions; and

wherein the log of the one or more intervening re-arrangement transactions comprises a mapping of the one or more intervening re-arrangement transactions to data subject to corresponding re-arrangement transactions.

8. The system of claim 1 , wherein:

the intervening re-arrangement transaction is a compaction of the first data with one or more other data; and

rolling back the intervening re-arrangement transaction at least with respect to the first data comprises:

rolling back the intervening re-arrangement transaction with respect to the first data and one or more data.

9. The system of claim 1 , wherein:

the intervening re-arrangement transaction is a compaction of the first data with one or more other data; and

rolling back the intervening re-arrangement transaction at least with respect to the first data comprises:

rolling back the intervening re-arrangement transaction with respect to the first data and a first subset of one or more data.

10. The system of claim 9 , wherein a second subset of the one or more data is not rolled back.

11. The system of claim 9 , wherein a second subset of the one or more data is still subject to the compaction after the rolling back of the intervening re-arrangement transaction with respect to the first data and the first subset of the one or more data.

12. The system of claim 1 , wherein:

rolling back the intervening re-arrangement transaction at least with respect to the first data comprises:

determining one or more policies pertaining to one or more of (i) the intervening re-arrangement transaction, and (ii) rolling back the intervening re-arrangement transactions; and

determining whether to roll-back the intervening re-arrangement transaction based at least in part on the one or more policies; and

wherein the intervening re-arrangement transaction is rolled back at least with respect to the first data in response to determining to roll-back the intervening re-arrangement transaction based at least in part on the one or more policies.

13. The system of claim 12 , wherein an extent to which the intervening re-arrangement transaction rolled back is based at least in part on the one or more policies.

14. The system of claim 1 , wherein in response to a determination that the first data subject is subject to a plurality of intervening re-arrangement transactions, the plurality of intervening re-arrangement transactions are respectively rolled back at least with respect to the first data.

15. The system of claim 14 , wherein the plurality of intervening arrangement transactions are completely rolled back.

16. The system of claim 1 , wherein:

rolling back the intervening re-arrangement transaction at least with respect to the first data comprises:

querying a user for an indication to rollback the intervening re-arrangement transaction; and

the intervening re-arrangement transaction is rolled back at least with respect to the first data in response to receipt of the indication to rollback the intervening re-arrangement transaction from the user.

17. The system of claim 16 , wherein the user is queried for the indication to rollback the intervening re-arrangement transaction in response to determining that a state of the storage system satisfies one or more predefined criteria.

18. The system of claim 1 , wherein rolling back the intervening re-arrangement transaction at least with respect to the first data comprises:

updating an index mapping of files with respect to at least the first data so that an index mapping points to a location of the first data before the intervening re-arrangement transaction.

19. A method, comprising:

receiving, by one or more processors, a first transaction that modifies or deletes first data stored in a storage system;

determining that the first data is subject to an intervening re-arrangement transaction; and

in response to determining that the first data is subject to the intervening re-arrangement transaction,

rolling back the intervening re-arrangement transaction at least with respect to the first data; and

committing the first transaction.

20. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:

receiving, by one or more processors, a first transaction that modifies or deletes first data stored in a storage system;

determining that the first data is subject to an intervening re-arrangement transaction; and

in response to determining that the first data is subject to the intervening re-arrangement transaction,

rolling back the intervening re-arrangement transaction at least with respect to the first data; and

committing the first transaction.

Assignments (3)
SECURITY INTEREST Recorded Jan 6, 2025
From: DATABRICKS, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 069825/0419 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME FROM "DATABRICKS INC." TO --DATABRICKS, INC.-- PREVIOUSLY RECORDED AT REEL: 059774 FRAME: 0251. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 6, 2023
From: JAIN, PRAKHAR; SAMWEL, BART; YAVUZ, BURAK
To: DATABRICKS, INC.
Reel/Frame 065463/0409 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: JAIN, PRAKHAR; SAMWEL, BART; YAVUZ, BURAK
To: DATABRICKS INC.
Reel/Frame 059774/0251 →
Cited By (3)
US 12,332,911 US 12,360,849 US 12,430,294