IP Library › Granted Patent US 12,477,137
Granted Patent B2
US 12,477,137 · App. 18/746,631 · Granted Nov 18, 2025

Processing sub-partitions using reference pixels

Inventors: Wenhao Zhang (Beijing, CN); Jing Cui (Beijing, CN)
Assignee: HULU, LLC
H04N19/436H04N19/105H04N19/119H04N19/159H04N19/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,477,137
App. No.
18/746,631
Granted
Nov 18, 2025
Kind
B2
Abstract

A method includes transcoding, by a first transcoding process, a first sub-partition of a current block using a first set of reference pixels. Also, the method includes transcoding, by a second transcoding process, a second sub-partition of the current block using the first set of reference pixels. The first transcoding process transcodes a third sub-partition of the current block based on a second set of reference pixels. The second transcoding process transcodes a fourth sub-partition of the current block based on a third set of reference pixels.

Claims (86)

1 . A method comprising:

transcoding, by a first transcoding process, a first sub-partition of a current block using a first set of reference pixels;

transcoding, by a second transcoding process, a second sub-partition of the current block using the first set of reference pixels;

transcoding, by the first transcoding process, a third sub-partition of the current block based on a second set of reference pixels; and

transcoding, by the second transcoding process, a fourth sub-partition of the current block based on a third set of reference pixels.

2 . The method of claim 1 , wherein:

the second set of reference pixels are determined based on transcoding the first sub-partition; and

the third set of reference pixels are determined based on transcoding the second sub-partition.

3 . The method of claim 1 , wherein:

transcoding the first sub-partition and transcoding the second sub-partition is performed in parallel.

4 . The method of claim 3 , wherein:

the third sub-partition and the fourth sub-partition are transcoded in parallel after transcoding the first sub-partition and the second sub-partition.

5 . The method of claim 1 , wherein:

transcoding the first sub-partition comprises:

decoding the first sub-partition to generate first decoded pixels for the first sub-partition;

generating the second set of reference pixels from the first decoded pixels for the first sub-partition;

transcoding the second sub-partition comprises:

decoding the second sub-partition to generate second decoded pixels for the second sub-partition; and

generating the third set of reference pixels from the second decoded pixels for the second sub-partition.

6 . The method of claim 1 , wherein:

transcoding the first sub-partition comprises:

generating first predicted pixels from the first set of reference pixels; and

using the first predicted pixels to transcode the first sub-partition;

transcoding the second sub-partition comprises:

generating second predicted pixels from the first set of reference pixels; and

using the second predicted pixels to transcode the second sub-partition.

7 . The method of claim 1 , wherein transcoding the first sub-partition comprises:

determining first original pixels and first predicted pixels for the first sub-partition;

generating a residual for the first sub-partition from the first original pixels and the first predicted pixels;

transcoding the first residual for the first sub-partition;

decoding the first residual for the first sub-partition to generate first decoded pixels; and

combining the first decoded pixels with the first predicted pixels for use in the second set of reference pixels.

8 . The method of claim 7 , wherein transcoding the second sub-partition comprises:

determining second original pixels and second predicted pixels for the second sub-partition;

generating a residual for the second sub-partition from the second original pixels and the second predicted pixels;

transcoding the second residual for the second sub-partition;

decoding the second residual for the second sub-partition to generate second decoded pixels; and

combining the second decoded pixels with the second predicted pixels for use in the third set of reference pixels.

9 . The method of claim 1 , wherein:

transcoding the first sub-partition comprises:

decoding the first sub-partition;

generating first predicted pixels from the first set of reference pixels; and

generating the second set of reference pixels from the decoded first sub-partition and the first predicted pixels;

and transcoding the second sub-partition comprises:

decoding the second sub-partition;

generating second predicted pixels from the second set of reference pixels; and

generating the third set of reference pixels from the decoded second sub-partition and the second predicted pixels.

10 . The method of claim 1 , wherein transcoding the first sub-partition comprises:

determining first predicted pixels from other reference pixels for another block;

generating a first residual for the first sub-partition from first encoded pixels of the first sub-partition;

generating first decoded pixels from the first predicted pixels and the first residual;

generating first predicted pixels for the first sub-partition from the other reference pixels; and

using the first predicted pixels to decode the third sub-partition.

11 . The method of claim 10 , wherein transcoding the second sub-partition comprises:

determining second predicted pixels from the other reference pixels for another block;

generating a second residual for the second sub-partition from second encoded pixels of the second sub-partition;

generating second decoded pixels from the second predicted pixels and the second residual;

generating second predicted pixels for the second sub-partition from the other reference pixels; and

using the second predicted pixels to decode the fourth sub-partition.

12 . The method of claim 1 , wherein:

the third sub-partition and the fourth sub-partition are located in between the first sub-partition and the second sub-partition.

13 . The method of claim 1 , wherein:

the second set of reference pixels are adjacent to the third sub-partition, and

the third set of reference pixels are adjacent to the fourth sub-partition.

14 . The method of claim 1 , wherein:

the second set of reference pixels and the third set of reference pixels include a first portion of pixels that are different and a second portion of pixels that are the same.

15 . The method of claim 1 , wherein:

the first set of reference pixels, the second set of reference pixels, and the third set of reference pixels include a first portion of pixels that are different and a second portion of pixels that are the same.

16 . The method of claim 1 , wherein:

the first transcoding process and the second transcoding process are different processes.

17 . A non-transitory computer-readable storage medium containing instructions, that when executed, control a computer system to be operable for:

transcoding, by a first transcoding process, a first sub-partition of a current block using a first set of reference pixels;

transcoding, by a second transcoding process, a second sub-partition of the current block using the first set of reference pixels;

transcoding, by the first transcoding process, a third sub-partition of the current block based on a second set of reference pixels; and

transcoding, by the second transcoding process, a fourth sub-partition of the current block based on a third set of reference pixels.

18 . A system comprising:

a first transcoding process operable for:

transcoding a first sub-partition of a current block using a first set of reference pixels; and

transcoding a third sub-partition of the current block based on a second set of reference pixels;

a second transcoding process operable for:

transcoding a second sub-partition of the current block using the first set of reference pixels; and

transcoding a fourth sub-partition of the current block based on a third set of reference pixels.

19 . The system of claim 18 , wherein:

the first transcoding process and the second transcoding process are different processes.

20 . The system of claim 18 , wherein:

the first transcoding process and the second transcoding process trancodes the first sub-partition and the second sub-partition in parallel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2024
From: ZHANG, WENHAO; CUI, JING
To: HULU, LLC
Reel/Frame 067757/0831 →
Continuity (4)
Continuation 17542008 · Dec 3, 2021
Continuation 16886627 · May 28, 2020
Provisional Application 62854736 · May 30, 2019
Related Publication 20240340433A1 · Oct 10, 2024
References Cited (45)
US 10887587B2 · Filippov et al. · 2021 [cited by applicant]
US 20030021344A1 · Panusopone et al. · 2003 [cited by applicant]
US 20080120676A1 · Morad et al. · 2008 [cited by applicant]
US 20080187044A1 · Kim et al. · 2008 [cited by applicant]
US 20120163460A1 · Chien et al. · 2012 [cited by applicant]
US 20130101035A1 · Wang et al. · 2013 [cited by applicant]
US 20130121417A1 · Chong et al. · 2013 [cited by applicant]
US 20130182775A1 · Wang et al. · 2013 [cited by applicant]
US 20130182779A1 · Lim et al. · 2013 [cited by applicant]
US 20130188699A1 · Joshi et al. · 2013 [cited by applicant]
US 20130272370A1 · Coban et al. · 2013 [cited by applicant]
US 20140072041A1 · Seregin et al. · 2014 [cited by applicant]
US 20140334532A1 · Pearson · 2014 [cited by examiner]
US 20150139298A1 · Seregin et al. · 2015 [cited by applicant]
US 20150319451A1 · Henry · 2015 [cited by applicant]
US 20160094851A1 · Pu et al. · 2016 [cited by applicant]
US 20160100191A1 · Mishra et al. · 2016 [cited by applicant]
US 20160134876A1 · Chong et al. · 2016 [cited by applicant]
US 20170094285A1 · Said et al. · 2017 [cited by applicant]
US 20170238005A1 · Chien et al. · 2017 [cited by applicant]
US 20190052883A1 · Ikeda et al. · 2019 [cited by applicant]
US 20190149828A1 · Jeong · 2019 [cited by examiner]
US 20190238837A1 · Filippov et al. · 2019 [cited by applicant]
US 20200382777A1 · Zhang et al. · 2020 [cited by applicant]
US 20200382804A1 · Zhang et al. · 2020 [cited by applicant]
US 20220094956A1 · Zhang et al. · 2022 [cited by applicant]
US 20220132120A1 · Zhang · 2022 [cited by examiner]
CN 103533375A · 2014 [cited by applicant]
CN 103975596A · 2014 [cited by applicant]
CN 113875238A · 2021 [cited by applicant]
EP 3977730 · 2022 [cited by applicant]
KR 20217042533 · 2020 [cited by applicant]
WO WO2019010156A1 · 2019 [cited by examiner]
WO 2020243595A1 · 2020 [cited by applicant]
First Office Action for Chinese Application No. 2020800390449, dated Jul. 8, 2024, 22 pgs. [cited by applicant]
Chen et al, “Algorithm and VLSI Architecture of a Parallel Arithmetic Entropy Coder for Parallel H .264 Video Encoders”, Proceedings of International Symposium on Signals, Systems and Electronics, (2010). [cited by applicant]
Santiago De-Luxan-Hernandez et al, “An Intra Subpartition Coding Mode for VVC”, Berlin, Germany, (2019). [cited by applicant]
De-Luxan-Hernandez (Fraunhofer) S et al: “Non-CE3: ISP withindependent sub-partitions for certain block sizes”, 126. MPEG Meeting; Mar. 25, 2019-Mar. 29, 2019; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/W… [cited by applicant]
Supplemental European Search Report, Application No. 20812562.5, PCT/US2020035360, dated Feb. 14, 2023, 13 pages. [cited by applicant]
Unno (KDDI-Research) K et al: “Non-CE3: Relaxation method ofprocessing dependency in ISP for small blocks”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Videoexploration Team of ISO/IEC JTC1/SC29/WG… [cited by applicant]
Yang (Interdigital) H et al: “CE3-related: Intra sub-partitionimprovement for low decoding latency and hardware implementationefficiency”, 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Explo… [cited by applicant]
Benjamin Bross, et al. “Non-CE3: ISP with independent sub-partitions for certain block sizes”, Joint Video exploration Team(JVET), JVET-N0372-v1, Mar. 23, 2019, pp. 1-8. [cited by applicant]
Notice of Preliminary Rejection, Korea Patent Application No. 10-2021-7042533, Korean Intellectual Property Office (KIPO), Jan. 22, 2025, 11 pages. [cited by applicant]
Examination Report, Communication pursuant to Article 94(3) EPC, European Patent Application No. 20812562.5, Jul. 22, 2025, 5 page. [cited by applicant]
Office Action, Korea Patent Application No. 10-2021-7042533, Korean Intellectual Property Office (KIPO), Sep. 9, 2025, 4 pages. [cited by applicant]