IP Library Granted Patent US 10,607,484
Granted Patent B2
US 10,607,484 · App. 15/859,324 · Granted Mar 31, 2020

Privacy-preserving distributed visual data processing

Inventors: Shao-Wen Yang (San Jose, CA); Yen-Kuang Chen (Palo Alto, CA); Addicam V. Sanjay (Gilbert, AZ)
Assignee: Intel Corporation
G08G1/091G06F9/4881G06F9/505G06F21/604G06F21/6245G06K9/00369G06K9/00771G06K9/4604G06K9/6268G06K9/6271G06Q50/26G11B27/031H04N7/181G06F2209/506G08G1/0116G08G1/087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,484
App. No.
15/859,324
Granted
Mar 31, 2020
Kind
B2
Abstract

This disclosure presents embodiments for performing privacy-preserving distributed computing. For example, a workload that includes a plurality of tasks may be identified, and a workload graph may be generated to represent the workload. In addition, a device connectivity graph with connectivity information for a plurality of processing devices may be identified. A privacy policy associated with the workload, along with privacy level information associated with the plurality of processing devices, may also be identified. A privacy constraint may then be identified based on the privacy policy and the privacy level information. A workload schedule that includes a mapping of the workload onto the plurality of processing devices may be determined based on the privacy constraint, the workload graph, and the device connectivity graph. The workload schedule may be sent to the plurality of processing devices, which may execute the workload based on the workload schedule.

Claims (74)

1. An apparatus, comprising:

a processor to:

identify a workload comprising a plurality of tasks;

generate a workload graph based on the workload, wherein the workload graph comprises information associated with the plurality of tasks;

identify a device connectivity graph, wherein the device connectivity graph comprises device connectivity information associated with a plurality of processing devices;

identify a privacy policy associated with the workload;

identify privacy level information associated with the plurality of processing devices;

identify a privacy constraint based on the privacy policy and the privacy level information; and

determine a workload schedule, wherein the workload schedule comprises a mapping of the workload onto the plurality of processing devices, and wherein the workload schedule is determined based on the privacy constraint, the workload graph, and the device connectivity graph; and

a communication interface to send the workload schedule to the plurality of processing devices, wherein the workload is executed by the plurality of processing devices based on the workload schedule.

2. The apparatus of claim 1 , wherein the processor to determine the workload schedule is further to solve an integer linear programming model based on the privacy constraint.

3. The apparatus of claim 1 , wherein the plurality of tasks is associated with processing sensor data from one or more sensors.

4. The apparatus of claim 3 , wherein the one or more sensors comprise one or more of:

a camera;

an infrared sensor; or

a laser-based sensor.

5. The apparatus of claim 3 , wherein the sensor data comprises visual data.

6. The apparatus of claim 1 , wherein the workload graph further comprises information associated with a plurality of task dependencies among the plurality of tasks.

7. The apparatus of claim 6 , wherein the privacy policy comprises a plurality of privacy requirements associated with the plurality of task dependencies.

8. The apparatus of claim 1 , wherein the device connectivity information comprises information associated with a plurality of device connectivity links among the plurality of processing devices.

9. The apparatus of claim 8 , wherein the privacy level information comprises a plurality of privacy levels associated with the plurality of device connectivity links.

10. A system, comprising:

a plurality of sensors to capture sensor data associated with an environment;

a plurality of processing devices, wherein the plurality of processing devices comprises a plurality of edge processing devices and a plurality of cloud processing devices, and wherein the plurality of processing devices is to:

identify a workload, wherein the workload comprises a plurality of tasks associated with processing the sensor data captured by the plurality of sensors;

generate a workload graph based on the workload, wherein the workload graph comprises information associated with the plurality of tasks;

identify a device connectivity graph, wherein the device connectivity graph comprises device connectivity information associated with the plurality of processing devices;

identify a privacy policy associated with the workload;

identify privacy level information associated with the plurality of processing devices;

identify a privacy constraint based on the privacy policy and the privacy level information;

determine a workload schedule, wherein the workload schedule comprises a mapping of the workload onto the plurality of processing devices, and wherein the workload schedule is determined based on the privacy constraint, the workload graph, and the device connectivity graph; and

distribute the workload schedule to the plurality of processing devices, wherein the workload is executed by the plurality of processing devices based on the workload schedule.

11. The system of claim 10 , wherein the plurality of processing devices to determine the workload schedule is further to solve an integer linear programming model based on the privacy constraint.

12. The system of claim 10 , wherein the plurality of sensors comprises one or more of:

a camera;

an infrared sensor; or

a laser-based sensor.

13. The system of claim 10 , wherein the workload graph further comprises information associated with a plurality of task dependencies among the plurality of tasks.

14. The system of claim 13 , wherein the privacy policy comprises a plurality of privacy requirements associated with the plurality of task dependencies.

15. The system of claim 10 , wherein the device connectivity information comprises information associated with a plurality of device connectivity links among the plurality of processing devices.

16. The system of claim 15 , wherein the privacy level information comprises a plurality of privacy levels associated with the plurality of device connectivity links.

17. At least one non-transitory machine accessible storage medium having instructions stored thereon, wherein the instructions, when executed on a machine, cause the machine to:

identify a workload comprising a plurality of tasks;

generate a workload graph based on the workload, wherein the workload graph comprises information associated with the plurality of tasks;

identify a device connectivity graph, wherein the device connectivity graph comprises device connectivity information associated with a plurality of processing devices;

identify a privacy policy associated with the workload;

identify privacy level information associated with the plurality of processing devices;

identify a privacy constraint based on the privacy policy and the privacy level information;

determine a workload schedule, wherein the workload schedule comprises a mapping of the workload onto the plurality of processing devices, and wherein the workload schedule is determined based on the privacy constraint, the workload graph, and the device connectivity graph; and

distribute the workload schedule to the plurality of processing devices, wherein the workload is executed by the plurality of processing devices based on the workload schedule.

18. The at least one non-transitory machine accessible storage medium of claim 17 , wherein the instructions that cause the machine to determine the workload schedule further cause the machine to solve an integer linear programming model based on the privacy constraint.

19. The at least one non-transitory machine accessible storage medium of claim 17 , wherein the plurality of tasks is associated with processing sensor data from one or more sensors.

20. The at least one non-transitory machine accessible storage medium of claim 17 , wherein:

the workload graph further comprises information associated with a plurality of task dependencies among the plurality of tasks; and

the privacy policy comprises a plurality of privacy requirements associated with the plurality of task dependencies.

21. The at least one non-transitory machine accessible storage medium of claim 17 , wherein:

the device connectivity information comprises information associated with a plurality of device connectivity links among the plurality of processing devices; and

the privacy level information comprises a plurality of privacy levels associated with the plurality of device connectivity links.

22. A method, comprising:

identifying a workload, wherein the workload comprises a plurality of tasks associated with processing sensor data from one or more sensors;

generating a workload graph based on the workload, wherein the workload graph comprises information associated with the plurality of tasks;

identifying a device connectivity graph, wherein the device connectivity graph comprises device connectivity information associated with a plurality of processing devices;

identifying a privacy policy associated with the workload;

identifying privacy level information associated with the plurality of processing devices;

identifying a privacy constraint based on the privacy policy and the privacy level information;

determining a workload schedule, wherein the workload schedule comprises a mapping of the workload onto the plurality of processing devices, and wherein the workload schedule is determined based on the privacy constraint, the workload graph, and the device connectivity graph; and

distributing the workload schedule to the plurality of processing devices, wherein the workload is executed by the plurality of processing devices based on the workload schedule.

23. The method of claim 22 , wherein determining the workload schedule comprises solving an integer linear programming model based on the privacy constraint.

24. The method of claim 22 , wherein:

the workload graph further comprises information associated with a plurality of task dependencies among the plurality of tasks; and

the privacy policy comprises a plurality of privacy requirements associated with the plurality of task dependencies.

25. The method of claim 22 , wherein:

the device connectivity information comprises information associated with a plurality of device connectivity links among the plurality of processing devices; and

the privacy level information comprises a plurality of privacy levels associated with the plurality of device connectivity links.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: INTEL CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 067737/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2019
From: YANG, SHAO-WEN; CHEN, YEN-KUANG; SANJAY, ADDICAM V.
To: INTEL CORPORATION
Reel/Frame 048590/0972 →
Continuity (2)
Provisional Application 62611536 · Dec 28, 2017
Related Publication 20190034235A1 · Jan 31, 2019
Cited By (5)
US 12,204,676 US 12,238,214 US 12,254,435 US 12,511,163 US 12,561,969