IP Library Granted Patent US 10,104,265
Granted Patent B2
US 10,104,265 · App. 15/136,132 · Granted Oct 16, 2018

Method and device for generating a privatized electronic image for a plurality of electronic documents

Inventors: Dustin Lineweber (Lincoln, NE); Christopher Adams (Kansas City, MO)
Assignee: Email Data Source, Inc.
H04N1/32267G06F17/211G06T1/0028G06T11/60H04L51/063G06T2201/0051
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,104,265
App. No.
15/136,132
Granted
Oct 16, 2018
Kind
B2
Abstract

A set of electronic documents, such as emails, may include private information. A privatized image is generated to represent the set of electronic documents by identifying probable-pixel and proven-pixel locations within a subset of images. The subset of images is used to create blurred and obfuscated image having the private information distorted.

Claims (41)

1. A method for generating a privatized image corresponding to a set of electronic documents having private information within the documents, the method comprising:

converting each electronic document to an image file to generate a plurality of image files;

forming a set of images from the plurality of image files, wherein the set of images includes private pixels containing private information within the electronic documents;

determining a location collection of the private pixels for each unique pair of images within the set of images;

determining a subset of private images from the set of images according to the location collection of private pixels;

generating an average image from the subset of private images;

generating a difference array for at least one location of private pixels within the average image;

blurring the average image; and

copying the pixels of the blurred average image to the location of private pixels to generate a representative image of the plurality of images, wherein the representative image includes none of the private information identified by the private pixels.

2. The method of claim 1 , further comprising stirring the pixels within the blurred average image by randomly moving around the pixels.

3. The method of claim 1 , further comprising overlaying a separate image onto the pixels of the blurred average image at the location of the private pixels, wherein the separate image contains no pixels from the average image or the blurred average image.

4. The method of claim 1 , wherein the generating the difference array includes determining a location collection of the private pixels between each private image within the subset of private images and the average image.

5. The method of claim 1 , wherein the generating the difference array step includes determining at least one proven-private pixel at the at least one location.

6. The method of claim 5 , further comprising determining at least one probable-private pixel based on the at least one proven-private pixel.

7. The method of claim 1 , wherein the electronic documents are emails.

8. The method of claim 1 , wherein private pixels include probable-private pixels and proven-private pixels.

9. The method of claim 8 , wherein proven-private pixels include pixels that differ between the set of images.

10. A method for generating a representative electronic document representing a plurality of electronic documents, the method comprising:

determining a subset of private images within the plurality of electronic documents based upon differences between pixels within each private image pair, wherein the differences relate to private information represented by the pixels within the electronic documents;

calculating an average image from the subset of images;

determining at least one location of proven-private pixels within the average image;

determining at least one location of probable-private pixels within the average image;

blurring pixels within the locations of probable-private and proven-private pixels;

randomly moving the blurred pixels within a region around the locations of probable-private and proven-private pixels; and

copying the blurred pixels into the average image to generate a representative image of the plurality of electronic documents.

11. The method of claim 10 , further comprising determining a location collection of the private pixels for the plurality of electronic documents to determine the differences between the pixels.

12. The method of claim 10 , further comprising overlaying a separate image onto the blurred pixels, wherein the separate image contains no pixels from the average image or the blurred pixels.

13. The method of claim 10 , wherein the determining the at least one location of probable-private pixels within the average image includes identifying a group of pixels adjacent the at least one location of proven-private pixels.

14. The method of claim 10 , further comprising converting the plurality of electronic documents into the subset of private images.

15. A computing device for generating a privatized image corresponding to a set of electronic documents having private information within the documents, the computing device comprising one or more processors, one or more computer-readable storage devices, and program instructions stored on at least one of the one or more computer-readable storage devices for execution by at least one of the one or more processors, wherein the program instructions configure the one or more processors to

convert each electronic document to an image file to generate a plurality of image files;

form a set of images from the plurality of image files, wherein the set of images include private pixels containing private information within the electronic documents;

determine a location collection of the private pixels for each unique pair of images within the set of images;

determine a subset of private images from the set of images according to the location collection of private pixels;

generate an average image from the subset of private images;

generate a difference array for at least one location of private pixels within the average image;

blur the average image; and

copy the pixels of the blurred average image to the location of private pixels to generate a representative image of the plurality of images, wherein the representative image includes none of the private information identified by the private pixels.

16. The computing device of claim 15 , further comprising program instructions, stored on at least one of the one or more computer-readable storage devices for execution by the one or more processors to configure the one or more processors to stir the pixels within the blurred average image by randomly moving around the pixels.

17. The computing device of claim 15 , further comprising program instructions, stored on at least one of the one or more computer-readable storage devices for execution by the one or more processors to configure the one or more processors to overlay a separate image onto the pixels of the blurred average image at the location of the private pixels, wherein the separate image contains no pixels from the average image or the blurred average image.

18. The computing device of claim 15 , further comprising program instructions, stored on at least one of the one or more computer-readable storage devices for execution by the one or more processors to configure the one or more processors to generate the difference array by determining a location collection of the private pixels between each private image within the subset of private images and the average image.

Assignments (11)
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Apr 23, 2026
From: BIRD BIDCO B.V.; MESSAGEBIRD UK LIMITED; BIRD.COM, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075472/0812 →
RELEASE OF SECURITY INTEREST Recorded Mar 28, 2025
From: BLUE OWL CAPITAL CORPORATION; OWL ROCK CAPITAL CORPORATION
To: BIRD.COM INC. F/K/A MESSAGEBIRD USA INC. AND MESSAGE SYSTEMS, INC., AND AS SUCCESSOR BY MERGER WITH EACH OF EMAIL DATA SOURCE, INC., PORT25 SOLUTIONS, INC., AND MESSAGEBIRD US CO.
Reel/Frame 070662/0827 →
SECURITY INTEREST Recorded Sep 26, 2023
From: MESSAGEBIRD USA INC.
To: BLUE OWL CAPITAL CORPORATION
Reel/Frame 065023/0547 →
MERGER Recorded Aug 17, 2023
From: EMAIL DATA SOURCE, INC.
To: MESSAGEBIRD USA INC.
Reel/Frame 064625/0943 →
SECURITY INTEREST Recorded Aug 5, 2021
From: EMAIL DATA SOURCE, INC.; PORT25 SOLUTIONS, INC.; MESSAGE SYSTEMS, INC.
To: OWL ROCK CAPITAL CORPORATION
Reel/Frame 057095/0876 →
SECURITY INTEREST Recorded Aug 5, 2021
From: MESSAGE SYSTEMS, INC.; EMAIL DATA SOURCE, INC.; PORT25 SOLUTIONS, INC.
To: OWL ROCK CAPITAL CORPORATION
Reel/Frame 057103/0847 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2021
From: PNC BANK, NATIONAL ASSOCIATION
To: EMAIL DATA SOURCE, INC.; MESSAGE SYSTEMS, INC. (DBA SPARKPOST)
Reel/Frame 056174/0488 →
RELEASE OF SECURITY INTEREST Recorded Jan 7, 2021
From: PACIFIC WESTERN BANK
To: EMAIL DATA SOURCE, INC.
Reel/Frame 054849/0605 →
SECURITY INTEREST Recorded Jan 5, 2021
From: MESSAGE SYSTEMS, INC. (DBA SPARKPOST); EMAIL DATA SOURCE, INC.
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 054813/0912 →
SECURITY INTEREST Recorded Nov 21, 2019
From: EMAIL DATA SOURCE, INC.
To: PACIFIC WESTERN BANK
Reel/Frame 051079/0731 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2016
From: LINEWEBER, DUSTIN; ADAMS, CHRISTOPHER
To: EMAIL DATA SOURCE, INC.
Reel/Frame 038355/0723 →
Continuity (2)
Provisional Application 62151087 · Apr 22, 2015
Related Publication 20160316097A1 · Oct 27, 2016