IP Library Granted Patent US 11,385,954
Granted Patent B2
US 11,385,954 · App. 16/259,075 · Granted Jul 12, 2022

Graphical management of big data pipelines

Inventors: Edward Bortnikov (Haifa, IL); Dmitry Basin (Petah Tikva, IL); Eran Meir (Alon HaGalil, IL)
Assignee: YAHOO ASSETS LLC
G06F11/079G06F9/485G06F9/4881G06F11/0709G06F11/327G06F2209/481
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,385,954
App. No.
16/259,075
Granted
Jul 12, 2022
Kind
B2
Abstract

Technologies for enhancing work scheduling of a big data framework. The technologies can include generating, in a database, configurable namespaces to be used by a work scheduling enhancement application to group together tasks of one or more big data clusters. The namespaces can be hierarchical. The technologies can also include linking in the database, by the application, related tasks with respective namespaces to categorize and group together the related tasks. The technologies can also include configuring, by the application, a display scheme for displaying error handling and root cause analysis of tasks of the one or more big data clusters. The technologies can also include generating or rendering, by the application, a GUI having a navigable hierarchal view for displaying the namespaces. The generation or rendering of the GUI can be based partially on the display scheme.

Claims (52)

1. A method comprising:

generating, in a database, a first configurable namespace to be used by a work scheduling enhancement application, executed by at least one processor, to group together a first plurality of data processing tasks of a big data processing;

generating, in the database, a second configurable namespace to be used by the application to group together a second plurality of data processing tasks of the big data processing, the second configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the second configurable namespace;

generating, in the database, a third configurable namespace to be used by the application to group together a third plurality of data processing tasks of the big data processing, the third configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the third configurable namespace and the second configurable namespace is a sibling namespace of the third configurable namespace;

linking in the database, by the application, the second plurality of tasks with the second configurable namespace to group together the second plurality of tasks under the second configurable namespace;

linking in the database, by the application, the third plurality of tasks with the third configurable namespace to group together the third plurality of tasks under the third configurable namespace;

configuring, by the application, a display scheme for displaying error handling and root cause analysis of tasks of the big data processing, wherein the configuring of the display scheme comprises configuring a color scheme for displaying error handling and root cause analysis of tasks;

generating, by the application and using stored information from the database, a graphical user interface (GUI) comprising a navigable hierarchal view displaying the first configurable namespace as a parent namespace of the second and third configurable namespaces, the generation of the GUI based partially on the display scheme, the GUI comprising a plurality of components for graphically monitoring and managing execution of the big data processing tasks;

responsive to a change in execution state of big-data processing of at least one task of the big data processing, updating the GUI to indicate the change in execution state;

displaying a task linked to one of the configurable namespaces with a background of a first selected color and with error handling and root cause analysis of the task, based on the color scheme, when the task fails to be completed; and

displaying the task with a background of a second selected color and without error handling and root cause analysis, based on the color scheme, when the task is completed.

2. The method of claim 1 , further comprising linking in the database, by the application, the first plurality of tasks with the first configurable namespace to group together the first plurality of tasks under the first configurable namespace.

3. The method of claim 2 , wherein the display scheme comprises respective first, second, and third sub-display schemes for the first, second, and third configurable namespaces, and wherein the method further comprises configuring, by the application, each of the sub-display schemes for displaying error handling and root cause analysis of tasks separately and differently.

4. The method of claim 1 , further comprising displaying a task linked to one of the configurable namespaces with error handling and root cause analysis of the task, when the task fails to be completed.

5. The method of claim 4 , further comprising:

selectively collapsing the display of error handling and root cause analysis such that the navigable hierarchal view is only displaying the task failing to be completed without the display of error handling and root cause analysis; and

selectively expanding the collapsed display to display the error handling and root cause analysis.

6. The method of claim 1 , further comprising the GUI displaying, in the navigable hierarchal view, selectable parts for performing a function selected from a group consisting of starting, suspending, resuming, and stopping tasks of the namespaces, or any combination thereof.

7. The method of claim 1 , wherein the scope of the first configurable namespace corresponds to the scope of big data management and processing of an entire grouping of computing devices, and wherein the first configurable namespace has at least one sibling configurable namespace having a scope corresponding to the scope of big data management and processing of another entire grouping of computing devices.

8. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a processor of computing device, performs a method, the method comprising:

generating, in a database, a first configurable namespace to use to group together a first plurality of data processing tasks of a big data processing;

generating, in the database, a second configurable namespace to use to group together a second plurality of data processing tasks of the big data processing, the second configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the second configurable namespace;

generating, in the database, a third configurable namespace to use to group together a third plurality of data processing tasks of the big data processing, the third configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the third configurable namespace and the second configurable namespace is a sibling namespace of the third configurable namespace;

configuring a display scheme for displaying error handling and root cause analysis of tasks of the big data processing, wherein the configuring of the display scheme comprises configuring a color scheme for displaying error handling and root cause analysis of tasks;

generating, using stored information from the database, a graphical user interface (GUI) comprising a navigable hierarchal view displaying the first configurable namespace as a parent namespace of the second and third configurable namespaces, the generation of the GUI based partially on the display scheme, the GUI comprising a plurality of components for graphically monitoring and managing execution of the big data processing tasks at various hierarchical levels;

displaying, with one of the configurable namespaces displayed in the navigable hierarchal view, error handling and root cause analysis of a task linked to the one of the configurable namespaces, when the task fails to be completed;

responsive to a change in execution state of big-data processing of at least one task of the big data processing, updating the GUI to indicate the change in execution state;

displaying a task linked to one of the configurable namespaces with a background of a first selected color and with error handling and root cause analysis of the task, when the task fails to be completed; and

displaying the task with a background of a second selected color and without error handling and root cause analysis, when the task is completed.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the method further comprises:

linking, in the database, the first plurality of tasks with the first configurable namespace to group together the first plurality of tasks under the first configurable namespace;

linking, in the database, the second plurality of tasks with the second configurable namespace to group together the second plurality of tasks under the second configurable namespace; and

linking, in the database, the third plurality of tasks with the third configurable namespace to group together the third plurality of tasks under the third configurable namespace.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the method further comprises:

selectively collapsing the display of error handling and root cause analysis such that the navigable hierarchal view is only displaying the task failing to be completed without the display of error handling and root cause analysis; and

selectively expanding the collapsed display to display the error handling and root cause analysis.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the method further comprises the GUI displaying, in the navigable hierarchal view, selectable parts for starting, suspending, resuming, and stopping tasks of the namespaces.

12. The non-transitory computer-readable storage medium of claim 8 , wherein the scope of the first configurable namespace corresponds to the scope of big data management and processing of an entire grouping of computing devices, and wherein the first configurable namespace has at least one sibling configurable namespace having a scope corresponding to the scope of big data management and processing of another entire grouping of computing devices.

13. A system, comprising:

a computing device, comprising a processor and a non-transitory computer-readable storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:

executable logic for generating, in a database, a first configurable namespace to use to group together a first plurality of data processing tasks of a big data processing;

executable logic for generating, in the database, a second configurable namespace to use to group together a second plurality of data processing tasks of the big data processing, the second configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the second configurable namespace;

executable logic for generating, in the database, a third configurable namespace to use to group together a third plurality of data processing tasks of the big data processing, the third configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the third configurable namespace and the second configurable namespace is a sibling namespace of the third configurable namespace;

executable logic for configuring a display scheme for displaying error handling and root cause analysis of tasks of the big data processing, wherein the executable logic for configuring of the display scheme comprises executable logic for configuring a color scheme for displaying error handling and root cause analysis of tasks;

executable logic for generating, by the application and using stored information from the database, a graphical user interface (GUI) comprising a navigable hierarchal view displaying the first configurable namespace as a parent namespace of the second and third configurable namespaces, the generation of the GUI based partially on the display scheme, the GUI comprising a plurality of components for graphically monitoring and managing execution of the big data processing tasks at various hierarchical levels;

responsive to a change in execution state of big-data processing of at least one task of the big data processing, executable logic for updating the GUI to indicate the change in execution states

executable logic for displaying a task linked to one of the configurable namespaces with a background of a first selected color and with error handling and root cause analysis of the task, when the task fails to be completed; and

executable logic for displaying the task with a background of a second selected color and without error handling and root cause analysis, when the task is completed.

14. The system of claim 13 , wherein the program logic further comprises:

displaying, with one of the configurable namespaces displayed in the navigable hierarchal view, error handling and root cause analysis of a task linked to the one of the configurable namespaces when the task fails to be completed;

selectively collapsing the display of error handling and root cause analysis such that the navigable hierarchal view is only displaying the task failing to be completed without the display of error handling and root cause analysis; and

selectively expanding the collapsed display to display the error handling and root cause analysis.

Assignments (4)
PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 29, 2022
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 061571/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 058982/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2019
From: BORTNIKOV, EDWARD; BASIN, DMITRY; MEIR, ERAN
To: OATH INC.
Reel/Frame 048154/0740 →