IP Library › Granted Patent US 11,526,415
Granted Patent B2
US 11,526,415 · App. 16/855,881 · Granted Dec 13, 2022

Progressive error handling

Inventor: Hari Shreedharan (San Jose, CA)
Assignee: StreamSets, Inc.
G06F11/327G06F9/542G06F9/544G06F11/3006G06F11/323
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,526,415
App. No.
16/855,881
Granted
Dec 13, 2022
Kind
B2
Abstract

Systems and methods herein describe receiving identification from a data pipeline, accessing first data offset information for a first data origin and second data offset information for a second data origin, bisecting the first data origin using the first data offset information, processing the data pipeline with the bisected first data offset information and the second data offset information, receiving a notification indicating a data pipeline status, and causing presentation of the notification on a graphical user interface of a computing device.

Claims (60)

1. A method comprising:

receiving, using one or more processors, an identification from a data pipeline;

in response to receiving the identification; accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;

bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;

processing the data pipeline with the bisected first data offset information and the second data offset information;

in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and

based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

2. The method of claim 1 , wherein the identification of the data pipeline indicates a data pipeline failure.

3. The method of claim 1 , wherein the first data offset information represents data from the first data origin that was most recently processed by the data pipeline, the method further comprising:

storing the first offset information in a permanent storage system.

4. The method of claim 1 , wherein the bisected first data offset information comprises a first set of bisected first data offset information and a second set of bisected first data offset information.

5. The method of claim 4 , wherein the data pipeline status is a partial failure, the method further comprising:

bisecting the first set of bisected first data information, the bisecting including generated updated bisected first data offset information; and

performing a second processing of the data pipeline using the updated bisected first data offset information and the second data offset information.

6. The method of claim 5 , further comprising:

in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and

based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device.

7. The method of claim 4 , wherein the data pipeline status is a complete failure, the method further comprising:

bisecting the second data origin using the second data offset information, the bisecting including generating bisected second data offset information; and

performing a second processing of the data pipeline using the first data offset information and the bisected second data offset information.

8. The method of claim 7 , further comprising:

in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and

based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device.

9. The method of claim 1 further comprising:

generating an indication of data from the first data origin that caused the failure; and

causing presentation of the indication on the graphical user interface of the computing device.

10. A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:

receiving, using one or more processors, an identification from a data pipeline;

in response to receiving the identification, accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;

bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;

processing the data pipeline with the bisected first data offset information and the second data offset information;

in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and

based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

11. The computing apparatus of claim 10 , wherein the identification of the data pipeline indicates a data pipeline failure.

12. The computing apparatus of claim 10 , wherein the first data offset information represents data from the first data origin that was most recently processed by the data pipeline, the operations further comprising:

storing the first offset information in a permanent storage system.

13. The computing apparatus of claim 10 , wherein the bisected first data offset information comprises a first set of bisected first data offset information and a second set of bisected first data offset information.

14. The computing apparatus of claim 13 , wherein the data pipeline status is a partial failure, the operations further comprising:

bisecting the first set of bisected first data information, the bisecting including generated updated bisected first data offset information; and

performing a second processing of the data pipeline using the updated bisected first data offset information and the second data offset information.

15. The computing apparatus of claim 14 , the operations further comprising:

in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and

based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device.

16. The computing apparatus of claim 13 , wherein the data pipeline status is a complete failure, the operations further comprising:

bisecting the second data origin using the second data offset information, the bisecting including generating bisected second data offset information; and

performing a second processing of the data pipeline using the first data offset information and the bisected second data offset information.

17. The computing apparatus of claim 16 , the operations further comprising:

generating an indication of data from the first data origin that caused the failure; and

causing presentation of the indication on the graphical user interface of the computing device.

18. The computing apparatus of claim 10 , wherein the first data origin is a first data source and the second data origin is a second data source.

19. A non-transitory computer-storage medium storing instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving, using one or more processors, an identification from a data pipeline;

in response to receiving the identification, accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;

bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;

processing the data pipeline with the bisected first data offset information and the second data offset information;

in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and

based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

20. The non-transitory computer storage medium of claim 19 , wherein the identification of the data pipeline indicates a data pipeline failure.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: STREAMSETS, INC.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 069219/0116 →
RELEASE OF SECURITY INTEREST Recorded May 9, 2022
From: AB PRIVATE CREDIT INVESTORS LLC, AS ADMINISTRATIVE AGENT
To: STREAMSETS, INC.
Reel/Frame 059870/0831 →
SECURITY INTEREST Recorded Nov 25, 2020
From: STREAMSETS, INC.
To: AB PRIVATE CREDIT INVESTORS LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 054472/0345 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2020
From: SHREEDHARAN, HARI
To: STREAMSETS, INC.
Reel/Frame 053830/0094 →
Continuity (1)
Related Publication 20210334189A1 · Oct 28, 2021