IP Library › Granted Patent US 12,335,509
Granted Patent B2
US 12,335,509 · App. 18/593,515 · Granted Jun 17, 2025

Tracking a reference picture on an electronic device

Inventors: Kiran Misra (Vancouver, WA); Sachin G. Deshpande (Camas, WA); Christopher A. Segall (Camas, WA)
Assignee: DOLBY INTERNATIONAL AB
H04N19/503H04N19/423H04N19/44H04N19/573H04N19/58H04N19/587H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,509
App. No.
18/593,515
Granted
Jun 17, 2025
Kind
B2
Abstract

A method for tracking a reference picture on an electronic device is described. The method includes receiving a bitstream. The method also includes decoding a portion of the bitstream to produce a decoded reference picture. The method further includes tracking the decoded reference picture in a decoded picture buffer (DPB) with reduced overhead referencing. The method additionally includes decoding a picture based on the decoded reference picture.

Claims (28)

1. A method for decoding a video bitstream comprising:

receiving a bitstream comprising quantized transform coefficients;

receiving a reference description for decoded reference pictures from said bitstream;

determining a picture order count (POC) of a current picture for decoding, wherein each of the decoded reference pictures is associated with a picture order count (POC), and the picture order counts (POCs) of the decoded reference pictures are ordered in a plurality of sets each having a range [0 . . . MaxPOC−1] of POC values, wherein a particular value of MaxPOCSetIndex corresponds to a particular set of [0 . . . MaxPOC−1] of POC values,

wherein said reference description includes a modification parameter for a long term reference picture,

wherein the modification parameter for the long term reference picture is a difference between a value of MaxPOCSetIndex of a decoded reference picture of the current picture and a value of MaxPOCSetIndex of the current picture;

identifying said decoded reference picture of said current picture from a decoded picture buffer based on said picture order count (POC) of the current picture and said modification parameter;

decoding said current picture using inter-frame prediction based on said decoded reference picture; and

buffering said decoded picture in said decoded picture buffer for future prediction.

2. The method of claim 1 , wherein said modification parameter is a POC cycle parameter.

3. The method of claim 2 , wherein said POC cycle parameter is in a slice header.

4. The method of claim 1 , wherein said modification parameter is an indicator to start another POC cycle.

5. The method of claim 1 , wherein said reference description includes a picture order count for said decoded reference pictures.

6. A method for encoding a video stream comprising:

determining a picture order count (POC) of a current picture being encoded;

identifying a reference picture of said current picture from reference pictures in a decoded picture buffer;

encoding the current picture using inter-frame prediction based on the reference picture, wherein each of the reference pictures is associated with a picture order count (POC), and the picture order counts (POCs) of the reference pictures are ordered in a plurality of sets each having a range [0 . . . MaxPOC−1] of POC values, wherein a particular value of MaxPOCSetIndex corresponds to a particular set of [0 . . . MaxPOC−1] of POC values;

determining a reference description for reference pictures;

transmitting a bitstream including the encoded picture and the reference description for reference pictures;

wherein said bitstream includes quantized transform coefficients,

wherein said reference description includes a modification parameter for a long term reference picture,

wherein the modification parameter for the long term reference picture is a difference between a value of MaxPOCSetIndex of the reference picture used for encoding the current picture and a value of MaxPOCSetIndex of the current picture,

wherein identifying the reference picture of said current picture from the decoded picture buffer is based on a picture order count of the current picture and the modification parameter;

decoding said current picture using inter-frame prediction based on the reference picture used for encoding the current picture; and

buffering said decoded picture in said decoded picture buffer for future prediction.

7. An apparatus for encoding a video stream, comprising:

a processor;

a data storage storing instructions executable by the processor to perform the method of claim 6 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2025
From: SHARP LABORATORIES OF AMERICA, INC.
To: DOLBY INTERNATIONAL AB
Reel/Frame 070386/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2024
From: MISRA, KIRAN; DESHPANDE, SACHIN G.; SEGALL, CHRISTOPHER A.
To: SHARP LABORATORIES OF AMERICA, INC.
Reel/Frame 067896/0781 →
Continuity (6)
Continuation 17408936 · Aug 23, 2021
Continuation 16436215 · Jun 10, 2019
Continuation 15040718 · Feb 10, 2016
Continuation 14284233 · May 21, 2014
Continuation 13273191 · Oct 13, 2011
Related Publication 20240292016A1 · Aug 29, 2024
References Cited (106)
US 7379496B2 · Holcomb et al. · 2008 [cited by applicant]
US 7403660B2 · Hannuksela · 2008 [cited by applicant]
US 7724818B2 · Hannuksela et al. · 2010 [cited by applicant]
US 7782946B2 · Jeon et al. · 2010 [cited by applicant]
US 7817865B2 · Yang · 2010 [cited by applicant]
US 8165216B2 · Chen et al. · 2012 [cited by applicant]
US 8532184B2 · Koo · 2013 [cited by examiner]
US 8768079B2 · Misra et al. · 2014 [cited by applicant]
US 8787688B2 · Misra et al. · 2014 [cited by applicant]
US 8855433B2 · Misra et al. · 2014 [cited by applicant]
US 9992507B2 · Misra et al. · 2018 [cited by applicant]
US 10321146B2 · Misra et al. · 2019 [cited by applicant]
US 10327006B2 · Misra et al. · 2019 [cited by applicant]
US 11102500B2 · Misra et al. · 2021 [cited by applicant]
US 11943466B2 · Misra et al. · 2024 [cited by applicant]
US 20050180512A1 · Narasimhan et al. · 2005 [cited by applicant]
US 20060013318A1 · Webb et al. · 2006 [cited by applicant]
US 20060221418A1 · Lee et al. · 2006 [cited by applicant]
US 20070058724A1 · Paul et al. · 2007 [cited by applicant]
US 20070274679A1 · Yahata et al. · 2007 [cited by applicant]
US 20080267287A1 · Hannuksela · 2008 [cited by applicant]
US 20090003445A1 · Ying · 2009 [cited by examiner]
US 20090003446A1 · Wu et al. · 2009 [cited by applicant]
US 20090122860A1 · Yin et al. · 2009 [cited by applicant]
US 20090147850A1 · Pandit · 2009 [cited by applicant]
US 20090232199A1 · Kobayashi et al. · 2009 [cited by applicant]
US 20090304068A1 · Pandit et al. · 2009 [cited by applicant]
US 20100034254A1 · Wang · 2010 [cited by applicant]
US 20100111173A1 · Koo et al. · 2010 [cited by applicant]
US 20100189182A1 · Hannuksela · 2010 [cited by applicant]
US 20100238822A1 · Koyabu et al. · 2010 [cited by applicant]
US 20110019747A1 · Hannuksela et al. · 2011 [cited by applicant]
US 20110222837A1 · Walton et al. · 2011 [cited by applicant]
US 20120033039A1 · Sasaki et al. · 2012 [cited by applicant]
US 20130058408A1 · Wahadaniah et al. · 2013 [cited by applicant]
US 20130077681A1 · Chen et al. · 2013 [cited by applicant]
US 20130077687A1 · Wang et al. · 2013 [cited by applicant]
US 20130089135A1 · Chen et al. · 2013 [cited by applicant]
US 20130094585A1 · Misra et al. · 2013 [cited by applicant]
US 20130094772A1 · Deshoande et al. · 2013 [cited by applicant]
US 20130215975A1 · Samuelsson et al. · 2013 [cited by applicant]
US 20140254672A1 · Misra et al. · 2014 [cited by applicant]
US 20140294076A1 · Misra et al. · 2014 [cited by applicant]
US 20220046265A1 · Misra et al. · 2022 [cited by applicant]
CN 1523892 · 2004 [cited by applicant]
CN 1781313 · 2006 [cited by applicant]
CN 1825976 · 2006 [cited by applicant]
CN 101185334 · 2008 [cited by applicant]
CN 101202923 · 2008 [cited by applicant]
CN 101222638 · 2008 [cited by applicant]
CN 101379828 · 2009 [cited by applicant]
CN 101390400 · 2009 [cited by applicant]
CN 101491099 · 2009 [cited by applicant]
CN 101668212 · 2010 [cited by applicant]
CN 102025992 · 2011 [cited by applicant]
CN 102036066 · 2011 [cited by applicant]
CN 102160381 · 2011 [cited by applicant]
EP 2104361 · 2009 [cited by applicant]
EP 2727342 · 2016 [cited by applicant]
JP 2009260735 · 2009 [cited by applicant]
JP 2010219983 · 2010 [cited by applicant]
JP 2014518486 · 2014 [cited by applicant]
WO WO2006040413 · 2006 [cited by applicant]
WO WO2006118384 · 2006 [cited by applicant]
WO WO2013002700 · 2013 [cited by applicant]
WO WO2013002701 · 2013 [cited by applicant]
WO WO2013035313 · 2013 [cited by applicant]
WO WO2013055681 · 2016 [cited by applicant]
Advanced video coding for generic audiovisual services, Int. Telecommun. Union-Telecommun. (ITU-T) and Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC) JTC 1, Recommendation H.264 and ISO/IEC 14496-10 (MPEG-4) AVC,… [cited by applicant]
Chen et al., “Comments on Clean Decoding Refresh Pictures,” 5. JCT-VC Meeting; 96. MPEG Meeting; Mar. 16, 2011-Mar. 23, 2011; Geneva; JCT on Video Coding of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16); http://WFTP3.ITU.INT… [cited by applicant]
Detection of CDR for random access, Youngp Park, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-F604. [cited by applicant]
Eifrig, “POC Wrap, RAP, and Missing frames and fields,” 6. JVT meeting; 63. MPEG meeting; Sep. 12, 2002-Dec. 12, 2002; Awaji, JP; (Joint Video Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVT-F098-L, Dec. 13, 2… [cited by applicant]
EP Notice of Opposition in European Appln. No. 20194910.4, mailed on Jan. 5, 2023, 48 pages. [cited by applicant]
Extended European Search Report in European Appln. No. 12839718.9, mailed on May 15, 2015, 8 pages. [cited by applicant]
Extended European Search Report in European Appln. No. 16203741.0, mailed on Apr. 7, 2017, 7 pages. [cited by applicant]
Extended European Search Report in European Appln. No. 20194910.4, mailed on Nov. 24, 2020, 9 pages. [cited by applicant]
Extended European Search Report in European Appln. No. 22165192, mailed on May 23, 2022, 11 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/JP2012/077021, mailed on Apr. 15, 2014, 7 pages. [cited by applicant]
International Search Report issued for International Application No. PCT/JP2012/077021 mailed on Dec. 18, 2012. [cited by applicant]
International Search Report issued for International Patent Application No. PCT/JP2013/002505 mailed on Jul. 9, 2013. [cited by applicant]
JCTVC-F493, “Absolute signaling of reference pictures,” Rickard Sjoberg, Jonatan Samuelsson, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 6th Meeting: Torino, IT, Jul. 1… [cited by applicant]
JCTVC-F803_d1, “WD4: Working Draft 4 of High-Efficiency Video Coding” (a.k.a. Buffer Descriptions Display Process Suggestion), Benjamin Bross, Woo-Jin Han, Jens-Rainer Ohm, Gary J. Sullivan, Thomas Wiegand, Joint Collab… [cited by applicant]
JCTVC-F803_d1, “WD4: Working Draft 4 of High-Efficiency Video Coding” (a.k.a. Buffer Descriptions rO) Benjamin Bross, Woo-Jin Han, Jens-Rainer Ohm, Gary J. Sullivan, Thomas Wiegand, Joint Collaborative Team on Video Cod… [cited by applicant]
JCTVC-F803_d2, “WD4: Working Draft 4 of High-Efficiency Video Coding,” Benjamin Bross, Woo-Jin Han, Jens-Rainer Ohm, Gary J. Sullivan, Thomas Wiegand, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 … [cited by applicant]
JCTVC-H0468, “AHG21: Flexible signaling of long-term reference pictures,” Viktor Whadaniah, ChongSoon Lim, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 8th Meeting: San … [cited by applicant]
JCTVC-H0496, “On bitstreams starting with CRA pictures.” Ye-Kui Wang et al., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 8th Meeting: San Jose, CA, USA, Feb. 1-10, 2012… [cited by applicant]
JCTVC-H0502, “Signaling of long-term reference pictures in the PPS,” Ye-Kui Wang, Ying Chen, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 8th Meeting: San Jose, CA, USA,… [cited by applicant]
JCTVC-H1003_dK, “High efficiency video coding (HEVC) text specification draft 6,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 8th Meeting: San Jose, CA, USA, Feb. 1-10,… [cited by applicant]
JCTVC-J0116r1, “AHG13: Signaling of long-term reference pictures in the SPS,” Adarsh K. Ramasubramonian, Ye-Kui Wang, Ying Chen, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/… [cited by applicant]
Misra et al., “AHG18/21: Absolute signaling for resolution switching, ” Joint Collaborative Team on Video Coding (JCT-VC) 7th Meeting: Geneva, CH, Nov. 2011. [cited by applicant]
Misra et al., “Long Term Picture Referencing Using Wrapped POC,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting JCTVC-G713, Nov. 2011. [cited by applicant]
Opposition, “Document JCTVC-D234; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; 4th Meeting: Daegu, Korea, Jan. 20-28, 2011; “Random Access Support for HEVC,” Fujibayash… [cited by applicant]
Opposition, “Document JCTVC-E400; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; 5th Meeting: Geneva, CH, Mar. 16-23, 2011; “Comments on Clean Decoding Refresh Pictures,”… [cited by applicant]
Opposition, “Document JCTVC-E603_d8; JCTVC-F604 Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; 5th Meeting: Geneva, CH, Mar. 16-23, 2011; “WD3: Working Draft 3 of High-Ef… [cited by applicant]
Opposition, “Document JCTVC-F493; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; 6th Meeting: Torino, Jul. 14-22, 2011, “Absolute signaling of reference pictures,” Sjober… [cited by applicant]
Opposition, “Document JCTVC-F604; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC29/WG1; 6th Meeting: Torino, Jul. 14-22, 2011; “Detection of a CDR for random access”; proposal d… [cited by applicant]
Opposition, Document JCTVC-F604; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; 6th Meeting: Torino, Jul. 14-22, 2011; “Detection of CDR decoding status (JCTVC-F604); Pow… [cited by applicant]
Opposition, “Document JCTVC-F803_d6; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 6th Meeting: Torino, IT, Jul. 14-22, 2011,” Exhibit E8 in European Appln. No. 20194910.… [cited by applicant]
Opposition, “Telecommunications Standardization Sector of International Telecommunication Union ITU-T Recommendation H.264 (May 2003); Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services… [cited by applicant]
Opposition, “WO 2006/040413A1, Reference Picture Managing in Video Coding, Wang et al., Nokia Corporation, Earliest priority claimed Oct. 14, 2004; Published Apr. 20, 2006,” Exhibit E5 in European Appln. No. 20194910.4,… [cited by applicant]
Park et al., “Detection of a CDR for random access,” JCTVC-F604, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, Dated Jul. 22, 2011, 4 pages. [cited by applicant]
Park et al., “Detection of CDR decoding status,” 6. JCT-VC Meeting; 97. MPEG Meeting; Jul. 14, 2011-Jul. 22, 2011; Torino; JCT-VC of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16); URL: http://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE… [cited by applicant]
Sjoberg and Samuelsson, “AHG21: Long-term pictures and pruning of reference picture sets,” Joint Collaborative Team on Video Coding (JCT-VC), 7th Meeting: Geneva, CH, Nov. 2011, JCTVC-G637, 1-3. [cited by applicant]
Sjoberg et al., “JCTVC-F493: Proposed changes to the HEVC Working Draft,” Joint Collaborative Team on Video Coding (JCT-VC), Jul. 9, 2011, 28 pages. [cited by applicant]
Sjoberg et al., “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transaction on Circuits and Systems for Video Technology, IEEE, Oct. 5, 2012, 22:1858-1870. [cited by applicant]
Wiegand et al., “WD3: Working draft 3 of 1-4 high-efficiency video coding,” 20110330, No. JCTVC-E603, Mar. 30, 2011 (Mar. 30, 2011), XP030009014, ISSN: 0000-0003. [cited by applicant]