IP Library › Granted Patent US 12,375,726
Granted Patent B1
US 12,375,726 · App. 18/342,406 · Granted Jul 29, 2025

Computer-implemented method and apparatus for video coding using an implicit video frame output process

Inventors: Byeongdoo Choi (Irvine, CA); Christopher Andrew Segall (Camas, WA); Kiran Mukesh Misra (Camas, WA)
Assignee: Amazon Technologies, Inc.
H04N19/70H04N19/172H04N19/184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,726
App. No.
18/342,406
Granted
Jul 29, 2025
Kind
B1
Abstract

The present disclosure relates to methods, apparatus, systems, and non-transitory computer-readable storage media for video coding using an implicit video frame output process. According to some examples, a computer-implemented method includes receiving a video at a content delivery service; encoding, by the content delivery service, the video into an encoded video; generating, by the content delivery service, at least one open bitstream unit from the encoded video according to a video coding format that does not utilize a show existing frame syntax element set to one to indicate a frame in a reference picture buffer of a decoder is to be displayed; and transmitting the at least one open bitstream unit from the content delivery service to the decoder.

Claims (35)

1. A computer-implemented method comprising:

receiving a video at a content delivery service;

encoding, by the content delivery service, the video into an encoded video;

generating, by the content delivery service, at least one open bitstream unit from the encoded video according to a video coding format that does not utilize a show existing frame syntax element set to one to indicate a frame in a reference picture buffer of a decoder is to be displayed; and

transmitting the at least one open bitstream unit from the content delivery service to the decoder.

2. The computer-implemented method of claim 1 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream is according to the video coding format that utilizes a display order hint to indicate the frame in the reference picture buffer of the decoder is to be displayed.

3. The computer-implemented method of claim 2 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream is according to the video coding format that further utilizes a showable frame syntax element to indicate the frame in the reference picture buffer of the decoder is to be displayed.

4. A computer-implemented method comprising:

receiving a video at a content delivery service;

encoding, by the content delivery service, the video into an encoded video;

generating, by the content delivery service, at least one open bitstream unit from the encoded video without including a show existing frame syntax element to indicate a frame in a reference picture buffer of a decoder is to be displayed; and

transmitting the at least one open bitstream unit from the content delivery service to the decoder.

5. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream utilizes a display order hint to indicate the frame in the reference picture buffer of the decoder is to be displayed.

6. The computer-implemented method of claim 5 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream further utilizes a showable frame syntax element to indicate the frame in the reference picture buffer of the decoder is to be displayed.

7. The computer-implemented method of claim 5 , wherein the display order hint is a value within a range that is less than a total number of frames in the video.

8. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded video is without including a showable frame syntax element.

9. The computer-implemented method of claim 8 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded video is without including a show frame syntax element.

10. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded video is without including a show frame syntax element.

11. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream utilizes a picture order count to indicate the frame in the reference picture buffer of the decoder is to be displayed.

12. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream utilizes a frame identifier to indicate the frame in the reference picture buffer of the decoder is to be displayed.

13. The computer-implemented method of claim 4 , wherein the generating, by the content delivery service, the at least one open bitstream unit from the encoded bitstream utilizes a time stamp to indicate the frame in the reference picture buffer of the decoder is to be displayed.

14. The computer-implemented method of claim 13 , wherein the time stamp is a frame presentation time syntax element.

15. An apparatus comprising:

a coupling to a display; and

a video decoder to:

receive at least one open bitstream unit, of an encoded video, that does not include a show existing frame syntax element that indicates a decoded frame in a reference picture buffer of the video decoder is to be displayed,

generate the decoded frame based on the at least one open bitstream unit of the encoded video,

store the decoded frame in the reference picture buffer of the video decoder,

determine, based on other information available to the video decoder, that the decoded frame in the reference picture buffer of the video decoder is to be displayed, and

transmit the decoded frame from the reference picture buffer of the video decoder to the coupling for displaying on the display.

16. The apparatus of claim 15 , wherein the other information comprises a display order hint in the at least one open bitstream unit.

17. The apparatus of claim 16 , wherein the display order hint is a value within a range that is less than a total number of frames in the video.

18. The apparatus of claim 15 , wherein the at least one open bitstream unit does not include a showable frame syntax element.

19. The apparatus of claim 15 , wherein the at least one open bitstream unit does not include a show frame syntax element.

20. The apparatus of claim 15 , wherein the other information comprises a frame presentation time syntax element.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: CHOI, BYEONGDOO; SEGALL, CHRISTOPHER ANDREW; MISRA, KIRAN MUKESH
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 064086/0334 →
References Cited (41)
US 8989508B2 · Deshpande · 2015 [cited by examiner]
US 9049427B2 · Hattori · 2015 [cited by examiner]
US 9319703B2 · Wang · 2016 [cited by examiner]
US 9969299B2 · Murase · 2018 [cited by examiner]
US 10313698B2 · Sullivan · 2019 [cited by examiner]
US 10623753B2 · Skupin · 2020 [cited by examiner]
US 11700390B2 · Wang · 2023 [cited by examiner]
US 11743505B2 · Wang · 2023 [cited by examiner]
US 11765394B2 · Wang · 2023 [cited by examiner]
US 11812062B2 · Wang · 2023 [cited by examiner]
US 12022122B2 · Deshpande · 2024 [cited by examiner]
US 12034927B2 · Okawa · 2024 [cited by examiner]
US 20060126952A1 · Suzuki et al. · 2006 [cited by applicant]
US 20100220939A1 · Tourapis et al. · 2010 [cited by applicant]
US 20140086336A1 · Wang · 2014 [cited by examiner]
US 20190068969A1 · Rusanovskyy et al. · 2019 [cited by applicant]
US 20200374524A1 · Gao et al. · 2020 [cited by applicant]
US 20220321919A1 · Deshpande · 2022 [cited by applicant]
US 20240137577A1 · Lin et al. · 2024 [cited by applicant]
US 20240205439A1 · Sjöberg et al. · 2024 [cited by examiner]
US 20240214558A1 · Dumas et al. · 2024 [cited by applicant]
US 20240236366A1 · Choi · 2024 [cited by examiner]
US 20240267548A1 · Du et al. · 2024 [cited by applicant]
US 20240292003A1 · Damghanian · 2024 [cited by examiner]
U.S. Appl. No. 18/186,084, Pending. [cited by applicant]
U.S. Appl. No. 18/186,006, Pending. [cited by applicant]
U.S. Appl. No. 18/752,554, Pending. [cited by applicant]
De Rivaz, P., et al., “AV1 Bitstream & Decoding Process Specification”, Version 1.0.0 with Errata 1, Jan. 8, 2019, available online at https://aomediacodec.github.io/av1-spec/av1-spec.pdf, 681 pages. [cited by applicant]
The Linux Foundation, “CONV2D”, PyTorch open source code, Dec. 2022, retrieved from https://pytorch.org/docs/stable/generated/torch.nn.Conv2d.html, 2 pages. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 18/186,006, Oct. 25, 2024, 12 pages. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 18/186,084, Aug. 14, 2024, 20 pages. [cited by applicant]
Ding, Dandan et al., “Advances In Video Compression System Using Deep Neural Network: A Review And Case Studies”, arXiv:2101.06341v1, Jan. 16, 2021, 27 pages. [cited by applicant]
International Search Report and Written Opinion, PCT App. No. PCT/US2024/010748, May 3, 2024, 09 pages. [cited by applicant]
Kang, Jihong et al., “Multi-modal/multi-scale Convolutional Neural Network Based In-loop Filter Design for Next Generation Video Codec”, IEEE International Conference on Image Processing (ICIP), Sep. 2017, pp. 26-30. [cited by applicant]
Wang, Zhao et al., “AHG11: Separate Density Attention Network for Loop Filtering”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, Apr. 2021, 3 pages. [cited by applicant]
Zhao, Yanchen et al., “Joint Luma and Chroma Multi-Scale CNN In-loop Filter for Versatile Video Coding”, IEEE International Symposium on Circuits and Systems (ISCAS), May 2022, pp. 3205-3209. [cited by applicant]
Final Office Action, U.S. Appl. No. 18/186,084, Mar. 7, 2025, 25 pages. [cited by applicant]
Kang, Jihong et al., “Multi-modal/Multi-scale Convolutional Neural Network Based In-loop Filter Design for Next Generation Video Codec”, IEEE International Conference on Image Processing, Sep. 2017, 5 pages. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 18/186,006, Apr. 7, 2025, 7 pages. [cited by applicant]
Wang, Zhao et al., “AHG11: Separate Density Attention Network for Loop Filtering”, 22nd Meeting of the Joint Video Experts Team (JVET), Document No. JVET-V0074-v3, Apr. 2021, 3 pages. [cited by applicant]
Wang, Zhao et al., “Multi-Density Attention Network for Loop Filtering in Video Compression”, arXiv:2104. 12865v1, Apr. 8, 2021, 9 pages. [cited by applicant]