IP Library Granted Patent US 7,920,717
Granted Patent B2
US 7,920,717 · App. 11/676,994 · Granted Apr 5, 2011

Pixel extraction and replacement

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,920,717
App. No.
11/676,994
Granted
Apr 5, 2011
Kind
B2
Abstract

A method for pixel extraction and replacement is disclosed. In one implementation, the method includes generating a set of pixel values and pixel value frequencies for a pixel presented in a series of digital images of a scene. A digital image of the scene which includes a pixel value for the pixel is received and a comparison is made between the pixel value and the set of pixel values. A determination is performed to decide upon substitution of the pixel value with a different pixel value based on the comparison. Other techniques are also disclosed.

Claims (43)

1. A method comprising:

defining one or more protected regions of a scene that correspond to one or more sensitive portions within the scene;

determining that a coordinate location representing a pixel within the scene lies within at least one of the one or more protected regions;

receiving a temporal series of digital images of the scene;

generating a set of pixel values and pixel value frequencies for the pixel as the pixel reoccurs at a same coordinate location for each received digital image in the temporal series of digital images;

receiving a subsequent digital image of the scene, wherein the subsequent digital image comprises a subsequent pixel value for the pixel at the same coordinate location within the scene;

comparing the subsequent pixel value with the set of pixel values and pixel value frequencies; and

based on the comparing, determining whether to substitute the subsequent pixel value with a different pixel value.

2. The method of claim 1 , wherein the generating comprises creating a pixel value histogram for the pixel, the pixel value histogram representing the set of pixel values and pixel value frequencies.

3. The method of claim 1 , further comprising updating the set of pixel values and pixel value frequencies based on the subsequent pixel value.

4. The method of claim 3 , wherein updating further comprises computing Euclidian distances between the set of pixel values and the subsequent pixel value.

5. The method of claim 4 , wherein updating further comprises comparing the Euclidian distance with a predetermined threshold value.

6. The method of claim 1 , wherein the different pixel value corresponds to a highest pixel value frequency in the set of pixel value frequencies.

7. The method of claim 1 , wherein the subsequent pixel value is substituted with the different pixel value to mask the one or more sensitive portions within the scene.

8. The method of claim 7 , wherein the masking hides movement of a private object associated with the one or more sensitive portions within the scene by utilizing image data previously received in the temporal series of digital images.

9. A system comprising:

one or more processors;

a memory; and

an image processing module configured to:

receive a digital image of a scene;

determine that a coordinate location representing a pixel in the digital image lies within one or more masked regions of the scene that correspond to one or more sensitive portions within the scene;

extract a pixel value for the pixel in the digital image;

compare the pixel value with a set of pixel values previously extracted from a series of previously received digital images of a same scene, the set of pixel values being associated with a count of occurrences of different pixel values extracted at a same coordinate location in each of the previously received digital images; and

assign a substitute pixel value to the coordinate location representing the pixel, the substitute pixel value being a highest count of occurrence pixel value in the set of pixel values.

10. The system of claim 9 , wherein the image processing module comprises a pixel extraction module programmed to generate the set of pixel values.

11. The system of claim 10 , wherein the pixel extraction module updates the set of pixel values based on the pixel value.

12. The system of claim 9 , wherein the image processing module modifies the set of pixel values to reflect changes in light conditions and noise characteristics associated with a camera.

13. The system of claim 9 further comprising an interface configured to enable a user to select the one or more masked regions.

14. One or more computer readable media comprising computer-executable instructions stored thereon, that, when executed by a computer perform acts comprising:

selecting one or more protected regions of a scene that correspond to one or more sensitive portions within the scene;

determining that a coordinate location representing a pixel within the scene lies within at least one of the one or more protected regions;

generating a pixel value histogram for the coordinate location representing the pixel within the scene, the pixel value histogram representing a set of pixel values and pixel value frequencies that occur at a same coordinate location for each digital image in a temporal series of digital images of the scene;

receiving a subsequent digital image of the scene, wherein the subsequent digital image comprises a subsequent pixel value representing the same coordinate location within the scene;

comparing the subsequent pixel value to the set of pixel values and pixel value frequencies in the pixel value histogram; and

based on the comparing, determining whether to substitute the subsequent pixel value with the most frequent pixel value in the pixel value histogram.

15. One or more computer readable media as in claim 14 , further comprising updating the pixel value histogram by computing a vector distance between the set of pixel values in the pixel value histogram and the subsequent pixel value.

16. One or more computer readable media as in claim 15 , wherein the updating further comprises:

generating a threshold; and

comparing the vector distance to the threshold.

17. One or more computer readable media as in claim 14 , further comprising modifying the pixel value histogram to reflect changes in light conditions and noise associated with a camera.

18. One or more computer readable media as in claim 14 , wherein the one or more protected regions are selected based on user input.

19. One or more computer readable media as in claim 14 , wherein the subsequent pixel value is substituted with the most frequent pixel value to mask the one or more sensitive portions within the scene.

20. One or more computer readable media as in claim 19 , wherein the masking hides movement of a private object associated with the one or more sensitive portions within the scene by utilizing image data previously received in the temporal series of digital images.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034542/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2007
From: KANSAL, AMAN
To: MICROSOFT CORPORATION
Reel/Frame 019191/0755 →