Framework for embedding data in encoded video

1. A method comprising:

receiving an encoded video stream;

selecting a set of areas of a spatially distinct region of a video frame to be modified;

removing an entropy layer from the spatially distinct region of a video frame;

storing a state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame;

decoding one area of the set of areas of the spatially distinct region of the video frame, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting, and decoding the one area are decoded;

performing a modification of the decoded one area, wherein performing the modification of the decoded one area comprises re-slicing the spatially distinct region of the video frame, the re-sliced spatially distinct region of the video frame comprising the one area of the set of areas of the spatially distinct region of the video frame, and wherein re-slicing the spatially distinct region of the video frame comprises re-slicing existing slices into a plurality of smaller slices, each of the plurality of smaller slices comprising the one area of the set of areas of the spatially distinct region of the video frame modified by a watermark;

re-encoding the modified decoded one area according to a re-encoding condition;

retrieving the stored state of the removed entropy layer; and

re-applying the entropy layer at the stored location of the first area to the spatially distinct region of the video frame which comprises the set of areas.

2. The method according to claim 1 wherein the received encoded video stream is encoded according to the H.264 encoding video standard.

3. The method according to claim 2 wherein the spatially distinct regions of the video frame are H.264 compliant slices.

4. The method according to claim 2 wherein the one area of the spatially distinct regions of the video frame is an H.264 compliant macroblock.

5. The method according to claim 1 wherein the received encoded video stream is encoded according to the H.265 encoding standard.

6. The method according to claim 5 wherein the spatially distinct regions of the video frame are H.265 compliant slices areas.

7. The method according to claim 5 wherein the one area of the spatially distinct regions of the video frame is an H.265 compliant coding tree block.

8. The method according to claim 1 , wherein the re-encoding condition comprises the modified decoded one area undergoing a change of its visual representation, wherein new YUV values of the modified decoded one area are re-encoded to be Prediction values plus new Residual values.

9. The method according to claim 1 , wherein the re-encoding condition comprises the modified decoded one area undergoing re-encoding in order to prevent inter-frame and intra-frame drift due to manipulations of others of the set of areas undergoing a change of their visual representation, wherein YUV values of the modified decoded one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new predicted Prediction values.

10. The method according to claim 1 , wherein the re-encoding condition comprises the modified decoded one area being an intra-predicted one area whose set of neighbors are suitable for use for intra-prediction which will change as a result of the modifying, wherein the YUV values of the modified decoded one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new Prediction values from the set of neighbors.

11. The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises modifying at least one pixel in one of a Y, a U, or a V domain.

12. The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises embedding the watermark into the one area.

13. The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises embedding a logo into the one area.

14. The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises blurring a region of the one area.

15. A system comprising:

a receiver operative to receive an encoded video stream;

a video modifier operative to select a set of areas of a spatially distinct region of a video frame to be modified;

the video modifier further operative to remove an entropy layer from the spatially distinct region of a video frame which comprises the at least one set of areas;

the video modifier further operative to store, in a storage unit, a state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame;

a video decoder operative to decode one area of the spatially distinct region of the video frame, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting and decoding the one area are decoded;

the video modifier operative to modify the decoded one area, wherein the video modifier operative to modify the decoded one area comprises the video modifier operative to re-slice the spatially distinct region of the video frame, the re-sliced spatially distinct region of the video frame comprising the one area of the set of areas of the spatially distinct region of the video frame, and wherein the video modifier operative to re-slice the spatially distinct region of the video frame comprises the video modifier operative to re-slice existing slices into a plurality of smaller slices, each of the plurality of smaller slices comprising the one area of the set of areas of the spatially distinct region of the video frame modified by a watermark;

a video encoder operative to re-encode the modified decoded one area according tea a re-encoding condition;

the video modifier operative to retrieve the stored state of the removed entropy layer from the storage unit; and

the video modifier operative to re-apply the entropy layer at the stored location of the first area to the spatially distinct region of, the video frame which comprises the set of areas.

16. The system according to claim 15 wherein the received encoded video stream is encoded according to the H.264 encoding video standard.

17. The system according to claim 15 wherein the received encoded video stream is encoded according to the H.265 encoding video standard.

18. The system according to claim 15 , wherein the re-coding condition comprises one of the following:

the modified decoded one area undergoing a change of its visual representation, wherein new YUV values of the one area of the spatially distinct region of the video frame are re-encoded to be Prediction values plus new Residual values;

the modified decoded one area undergoing re-encoding in order to prevent inter-frame and intra-frame drift due to manipulations of others of the set of areas undergoing a change of their visual representation, wherein YUV values of the one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new predicted Prediction values; and

the modified decoded one area being an intra-predicted one area whose set of neighbors are suitable for use for intra-prediction which will change as a result of the modifying, wherein the YUV values of the one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new Prediction values from the set of neighbors.

19. The system according to claim 15 wherein the modification of the decoded one area comprises at least one of the following:

modifying at least one pixel in one of a Y, a U, or a V domain;

embedding the watermark into the one area;

embedding a logo into one area;

blurring a region of the one area; and

re-slicing the spatially distinct region of the video frame, the re-sliced spatially distinct region of the video frame comprising the one area of the set of areas of the spatially distinct region of the video frame.