IP Library Granted Patent US 9,723,041
Granted Patent B2
US 9,723,041 · App. 15/352,307 · Granted Aug 1, 2017

Vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system

Inventors: Wei Shan Dong (Beijing, CN); Ning Duan (Beijing, CN); Peng Gao (Beijing, CN); Chang Sheng Li (Beijing, CN); Chun Yang Ma (Beijing, CN); Xin Zhang (Beijing, CN); Jun Zhu (Shanghai, CN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
H04L65/4069G06F9/4881G08G1/0112H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,723,041
App. No.
15/352,307
Granted
Aug 1, 2017
Kind
B2
Abstract

A vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system includes a first data processing level and a second data processing level. The first data processing level includes a first-level buffer configured to buffer data provided from a plurality of raw data streams output from a plurality of vehicles. The second data processing level includes an electronic task-queue-dictionary (TQD) module and a plurality of second-level data processing buffers. The TQD module is configured to create a plurality of tasks in response to receiving a serial data stream output from the first-level buffer. The TQD module is further configured to assign each task to a corresponding second-level buffer, and separate the serial data stream into individual data values that are delivered to a specific second-level buffer based on the task so as to generate a multi-level parallel context-based buffering operation.

Claims (26)

1. A vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system comprising:

a first data processing level including a first-level buffer configured to store high volume data received from a plurality of different vehicles; and

a second data processing level in signal communication with the first data processing level, the second data processing level including an electronic task-queue-dictionary (TQD) module and a plurality of second-level data processing buffers, the TQD module configured to create a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles,

wherein the TQD module separates the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations, and wherein the TQD module stores each individual data value in a respective second-level buffer assigned to store given individual data values corresponding to the processing operation task of the individual data value.

2. The system of claim 1 , wherein the TQD module delivers the individual data values in parallel to the corresponding second-level buffers.

3. The system of claim 2 , wherein the individual data values include vehicle identification information, and the TQD module assigns a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

4. The system of claim 2 , wherein the TQD module limits each vehicle to a single working task created in the second data processing level.

5. The system of claim 2 , wherein the TQD module loads each second-level buffer based on a timestamp indicated by a respective individual data value.

6. A method of processing data streams in a vehicle domain, the method comprising:

storing, in a first data processing level including a first-level buffer, high volume data received from a plurality of different vehicles;

creating, via an electronic task-queue-dictionary (TQD) module installed in a second data processing level in signal communication with the first data processing level, a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles;

separating, via the TQD module, the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations; and

storing each individual data value in a respective second-level buffer installed in the second data processing level, the second-level buffer assigned to store data values corresponding to the processing operation task of the individual data value.

7. The method of claim 6 , wherein the TQD module delivers the individual data values in parallel to the corresponding second-level buffers.

8. The method of claim 7 , further comprising embedding vehicle identification information in the individual data values, wherein the TQD module assigns a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

9. The method of claim 7 , wherein the TQD module limits each vehicle to a single working task created in the second data processing level.

10. The method of claim 7 , wherein the TQD module loads each second-level buffer based on a timestamp indicated by a respective individual data value.

11. A computer program product to control a vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by an electronic computer processor such that the system performs operations comprising:

storing, in a first data processing level including a first-level buffer, high volume data received from a plurality of different vehicles;

creating, via an electronic task-queue-dictionary (TQD) module installed in a second data processing level in signal communication with the first data processing level, a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles;

separating, via the TQD module, the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations; and

storing each individual data value in a respective second-level buffer installed in the second data processing level, the second-level buffer assigned to store given individual data values corresponding to the processing operation task of the individual data value.

12. The computer program product of claim 11 , wherein the operations further comprise delivering the individual data values in parallel to the corresponding second-level buffers.

13. The computer program product of claim 12 , wherein the operations further comprise embedding vehicle identification information in the individual data values, and assigning a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

14. The computer program product of claim 12 , wherein the operations further comprise limiting each vehicle to a single working task created in the second data processing level.

15. The computer program product of claim 12 , wherein the operations further comprise loading each second-level buffer based on a timestamp indicated by a respective individual data value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2016
From: DONG, WEI SHAN; DUAN, NING; GAO, PENG; LI, CHANG SHENG; MA, CHUN YANG; ZHANG, XIN; ZHU, JUN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 040331/0080 →
Continuity (2)
Continuation 14955218 · Dec 1, 2015
Related Publication 20170155696A1 · Jun 1, 2017