Method and apparatus for video coding

1. A method of video coding at a decoder, comprising:

receiving metadata associated with a coded video bitstream, the metadata including labeling information of one or more objects detected in a first picture that is coded in the coded video bitstream, the labeling information comprising, for an object of the one or more objects, (i) a first location of a bounding box surrounding the object in the first picture and (ii) a second location of a bounding box corresponding to the object, the second location indicating coordinates of the bounding box outside a picture boundary of a second picture that is coded in the coded video bitstream to indicate that the object is not shown in the second picture and that the bounding box corresponding to the object is not to be displayed in the second picture;

decoding the labeling information of the one or more objects in the first picture that is coded in the coded video bitstream; and

applying the labeling information to the one or more objects in the first picture.

2. The method of claim 1 , wherein the metadata is included in a supplementary enhancement information (SEI) message in the coded video bitstream.

3. The method of claim 1 , wherein the metadata is included in a file that is separate from the coded video bitstream.

4. The method of claim 1 , wherein the labeling information indicates a total number of bounding boxes in the first picture and includes location information and size information of each bounding box, each bounding box being associated with one of the one or more objects in the first picture.

5. The method of claim 1 , wherein the labeling information includes category information that indicates a category for each of the one or more objects.

6. The method of claim 1 , wherein the labeling information includes identification information that identifies each of the one or more objects in a video sequence.

7. The method of claim 4 , wherein the location information of one of the bounding boxes includes a location offset of the one of the bounding boxes between the first picture and the second picture that is coded in the video bitstream.

8. The method of claim 1 , further comprising:

sending a request to receive the metadata associated with the coded video bitstream.

9. An apparatus, comprising:

processing circuitry configured to:

receive metadata associated with a coded video bitstream, the metadata including labeling information of one or more objects detected in a first picture that is coded in the coded video bitstream, the labeling information comprising, for an object of the one or more objects, (i) a first location of a bounding box surrounding the object in the first picture and (ii) a second location of a bounding box corresponding to the object, the second location indicating coordinates of the bounding box outside a picture boundary of a second picture that is coded in the coded video bitstream to indicate that the object is not shown in the second picture and that the bounding box corresponding to the object is not to be displayed in the second picture;

decode the labeling information of the one or more objects in the first picture that is coded in the coded video bitstream; and

apply the labeling information to the one or more objects in the first picture.

10. The apparatus of claim 9 , wherein the metadata is included in a supplementary enhancement information (SEI) message in the coded video bitstream.

11. The apparatus of claim 9 , wherein the metadata is included in a file that is separate from the coded video bitstream.

12. The apparatus of claim 9 , wherein the labeling information indicates a total number of bounding boxes in the first picture and includes location information and size information of each bounding box, each bounding box being associated with one of the one or more objects in the first picture.

13. The apparatus of claim 9 , wherein the labeling information includes category information that indicates a category for each of the one or more objects.

14. The apparatus of claim 9 , wherein the labeling information includes identification information that identifies each of the one or more objects in a video sequence.

15. The apparatus of claim 12 , wherein the location information of one of the bounding boxes includes a location offset of the one of the bounding boxes between the first picture and the second picture that is coded in the video bitstream.

16. The apparatus of claim 9 , wherein the processing circuitry is further configured to:

send a request to receive the metadata associated with the coded video bitstream.

17. A non-transitory computer-readable storage medium storing instructions which when executed by at least one processor cause the at least one processor to perform:

receiving metadata associated with a coded video bitstream, the metadata including labeling information of one or more objects detected in a first picture that is coded in the coded video bitstream, the labeling information comprising, for an object of the one or more objects, (i) a first location of a bounding box corresponding to the object in the first picture and (ii) a second location of a bounding box surrounding the object, the second location indicating coordinates of the bounding box outside a picture boundary of a second picture that is coded in the coded video bitstream to indicate that the object is not shown in the second picture and that the bounding box corresponding to the object is not to be displayed in the second picture;

decoding the labeling information of the one or more objects in the first picture that is coded in the coded video bitstream; and

applying the labeling information to the one or more objects in the first picture.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the metadata is included in a supplementary enhancement information (SEI) message in the coded video bitstream.