IP Library › Granted Patent US 10,200,695
Granted Patent B2
US 10,200,695 · App. 15/063,234 · Granted Feb 5, 2019

Methods and systems for masking multimedia data

Inventors: Yashwant Dutt (Bangalore, IN); Kumar Desappan (Bangalore, IN); Piyali Goswami (Bangalore, IN)
Assignee: Texas Instruments Incorporated
H04N19/167H04N19/103H04N19/124H04N19/157H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,200,695
App. No.
15/063,234
Granted
Feb 5, 2019
Kind
B2
Abstract

Several methods and systems for masking multimedia data are disclosed. In an embodiment, a method for masking includes performing a prediction for at least one multimedia data block based on a prediction mode of a plurality of prediction modes. The at least one multimedia data block is associated with a region of interest (ROI). A residual multimedia data associated with the at least one multimedia data block is generated based on the prediction. A quantization of the residual multimedia data is performed based on a quantization parameter (QP) value. The QP value is variable such that varying the QP value controls a degree of masking of the ROI.

Claims (71)

1. A method, comprising:

receiving, by one or more processors, a frame comprising a video block; and

performing, by the one or more processors, prediction on the video block, comprising:

performing prediction, by the one or more processors, on the video block using a first prediction mode, to generate a predicted video block, thereby privacy masking the video block, in response to determining that the video block is included in a privacy mask region of the frame; and

performing prediction, by the one or more processors, on the video block using a second prediction mode, to generate the predicted video block, in response to determining that the video block is not included in the privacy mask region of the frame, the second prediction mode being different than the first prediction mode.

2. The method of claim 1 , further comprising:

determining a plurality of sum of absolute differences (SAD) values associated with a plurality of prediction modes that includes the first prediction mode and the second prediction mode,

wherein the first prediction mode corresponds to a first SAD value of the SAD values, and

wherein the second prediction mode corresponds to a second SAD value of the SAD values, the second SAD value being different than the first SAD value.

3. The method of claim 1 , wherein the first prediction mode is a DC mode, and

wherein the second prediction mode is a prediction mode that corresponds to a lowest sum of absolute differences (SAD) value.

4. The method of claim 3 , further comprising:

determining at least one guard band in proximity to at least one boundary portion of the privacy mask region.

5. The method of claim 4 , further comprising:

performing prediction in the at least one guard band configured at a right-side boundary portion of the privacy mask region based on a vertical intra-prediction mode; and

performing prediction in the at least one guard band configured at a bottom boundary portion of the privacy mask region based on a horizontal intra-prediction mode.

6. The method of claim 1 , further comprising:

generating a residual block based on the predicted video block; and

performing a quantization of the residual block based on a quantization parameter (QP) value, the QP value being variable such that varying the QP value controls a degree of masking of the privacy mask region.

7. The method of claim 1 , further comprising:

rendering at least one corner pixel associated with a reference frame grey;

generating at least one padded portion in the reference frame, the at least one padded portion comprising at least one grey corner portion generated by using the at least one corner pixel; and

causing at least one motion vector to point towards the at least one grey corner portion to render the privacy mask region grey.

8. A device comprising:

one or more processors; and

a non-transitory computer readable storage medium storing a program for execution by the one or more processors, the program including instructions to:

receive a frame comprising a video block; and

perform prediction on the video block, comprising instructions to:

perform prediction on the video block using a first prediction mode, to generate a predicted video block, thereby privacy masking the video block, in response to determining that the video block is included in a privacy mask region of the frame; and

perform prediction on the video block using a second prediction mode, to generate the predicted video block, in response to determining that the video block is not included in the privacy mask region of the frame, the second prediction mode being different than the first prediction mode.

9. The device of claim 8 , wherein the instructions further comprise instructions to:

determine a plurality of sum of absolute differences (SAD) values associated with a plurality of prediction modes that includes the first prediction mode and the second prediction mode,

wherein the first prediction mode corresponds to a first SAD value of the SAD values, and

wherein the second prediction mode corresponds to a second SAD value of the SAD values, the second SAD value being different than the first SAD value.

10. The device of claim 8 ,

wherein the first prediction mode is a DC mode, and

wherein the second prediction mode is a prediction mode that corresponds to a lowest sum of absolute differences (SAD) value.

11. The device of claim 10 , wherein the instructions further comprise instructions to:

determine at least one guard band in proximity to at least one boundary portion of the privacy mask region.

12. The device of claim 11 , wherein the instructions further comprise instructions to:

intra-predict the video block;

perform prediction in the at least one guard band configured at a right-side boundary portion of the privacy mask region based on a vertical prediction mode; and

perform prediction in the at least one guard band configured at a bottom boundary portion of the privacy mask region based on a horizontal prediction mode.

13. The device of claim 8 , wherein the instructions further comprise instructions to:

generate a residual block based on the predicted video block; and

perform a quantization of the residual block based on a quantization parameter (QP) value, the QP value being variable such that varying the QP value controls a degree of masking of the privacy mask region.

14. The device of claim 8 , wherein the instructions further comprise instructions to:

render at least one corner pixel associated with a reference frame grey;

generate at least one padded portion in the reference frame, the at least one padded portion comprising at least one grey corner portion generated by using the at least one corner pixel; and

cause at least one motion vector to point towards the at least one grey corner portion to render the privacy mask region grey.

15. A non-transitory computer readable storage medium storing a program for execution by one or more processors, the program including instructions to:

receive a frame comprising a video block; and

perform prediction on the video block, comprising instructions to:

perform prediction on the video block using a first prediction mode, to generate a predicted video block, thereby privacy masking the video block, in response to determining that the video block is included in a privacy mask region of the frame; and

perform prediction on the video block using a second prediction mode, to generate the predicted video block, in response to determining that the video block is not included in the privacy mask region of the frame, the second prediction mode being different than the first prediction mode.

16. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further comprise instructions to:

determine a plurality of sum of absolute differences (SAD) values associated with a plurality of prediction modes that includes the first prediction mode and the second prediction mode,

wherein the first prediction mode corresponds to a first SAD value of the SAD values, and

wherein the second prediction mode corresponds to a second SAD value of the SAD values, the second SAD value being different than the first SAD value.

17. The non-transitory computer readable storage medium of claim 15 ,

wherein the first prediction mode is a DC mode, and

wherein the second prediction mode is a prediction mode that corresponds to a lowest sum of absolute differences (SAD) value.

18. The non-transitory computer readable storage medium of claim 17 , wherein the instructions further comprise instructions to:

determine at least one guard band in proximity to at least one boundary portion of the privacy mask region.

19. The non-transitory computer readable storage medium of claim 18 , wherein the instructions further comprise instructions to:

intra-predict the video block;

perform prediction in the at least one guard band configured at a right-side boundary portion of the privacy mask region based on a vertical prediction mode; and

perform prediction in the at least one guard band configured at a bottom boundary portion of the privacy mask region based on a horizontal prediction mode.

20. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further comprise instructions to:

generate a residual block based on the predicted video block; and

perform a quantization of the residual block based on a quantization parameter (QP) value, the QP value being variable such that varying the QP value controls a degree of masking of the privacy mask region.

Priority Claims (1)
IN 835/CHE/2011 · Mar 18, 2011 · national
Continuity (2)
Continuation 13417896 · Mar 12, 2012
Related Publication 20160191923A1 · Jun 30, 2016