IP Library Granted Patent US 12,238,310
Granted Patent B2
US 12,238,310 · App. 17/813,321 · Granted Feb 25, 2025

Hybrid backward-compatible signal encoding and decoding

Inventors: Luca Rossato (Milan, IT); Guido Meardi (Milan, IT)
Assignee: V-NOVA INTERNATIONAL LIMITED
H04N19/31H04N19/30H04N19/46H04N19/85H04N19/88
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,310
App. No.
17/813,321
Granted
Feb 25, 2025
Kind
B2
Abstract

Computer processor hardware: parses a data stream into first portions of encoded data and second portions of encoded data; implements a first decoder to decode the first portions of encoded data into a first rendition of a signal; implements a second decoder to decode the second portions of encoded data into reconstruction data, the reconstruction data specifying how to modify the first rendition of the signal; and applies the reconstruction data to the first rendition of the signal to produce a second rendition of the signal.

Claims (30)

1. A method comprising:

via computer processor hardware:

receiving a signal;

receiving a first rendition of the signal, the first rendition of the signal being reproduced from first portions of encoded data that are generated by implementing a first encoder;

implementing a second encoder to produce second portions of encoded data, the second portions of encoded data indicating how to modify the first rendition of the signal and produce a second rendition of the signal, the second rendition of the signal being of a higher level of quality than the first rendition of the signal; and

producing a data stream to include at least the second portions of encoded data,

wherein the signal is an original video signal that is received at a first display element resolution,

wherein implementing the second encoder comprises:

implementing a first generator of reconstruction data at a second display element resolution, the second display element resolution being lower than the first display element resolution, and

implementing a second generator of reconstruction data at the first display element resolution;

implementing a down-convertor configured to produce a first down-converted signal at the second display element resolution for the first generator of reconstruction data and a second down-converted signal at a third display element resolution that is lower than the second display element resolution, the second down-converted signal being encoded by the first encoder;

wherein the second portions of encoded data comprise encoded enhancement data;

wherein implementing the first generator of reconstruction data comprises processing the first down-converted signal and a reconstructed rendition of the original video signal as generated from the first portions of encoded data to produce first encoded enhancement data at the second display element resolution;

wherein implementing the second generator of reconstruction data comprises processing the original video signal and a reconstructed rendition of the original video signal as received from the first generator of reconstruction data to produce second encoded enhancement data at the first display element resolution; and

wherein producing the data stream further comprises combining the first portions of encoded data, the first encoded enhancement data, and the second encoded enhancement data into the data stream.

2. The method as in claim 1 , wherein producing a data stream comprises producing a data stream to include the first portions of encoded data and the second portions of encoded data, wherein the data stream is organized as an MPEG transport stream.

3. The method as in claim 1 , wherein the first portions of encoded data are encoded in accordance with an MPEG compression protocol and the second portions of encoded data are encoded according to a hierarchical encoding compression protocol, wherein the second portions of encoded data include compressed residual data and specify upsample operations to be applied to the first rendition of the signal to produce the second rendition of the signal.

4. The method as in claim 3 , further comprising:

tagging the first portions of encoded data with a first unique tag, the first unique tag indicating that the first portions of encoded data are to be decoded by a first decoder; and

tagging the second portions of encoded data with a second unique tag, the second unique tag indicating that the second portions of encoded data are to be decoded by a second decoder.

5. The method as in claim 1 , wherein producing a data stream comprises producing a data stream to include the first portions of encoded data and the second portions of encoded data, wherein the data stream is organized as an MPEG transport stream, and the method further comprises:

tagging the first portions of encoded data with a first unique tag, the first unique tag comprising a first Packet Identifier (PID) and indicating that the first portions of encoded data are to be decoded by a first decoder; and

tagging the second portions of encoded data with a second unique tag, the second unique tag comprising a second Packet Identifier (PID) and indicating that the second portions of encoded data are to be decoded by a second decoder,

wherein the second Packet Identifier (PID) differs from the first Packet Identifier (PID).

6. The method as in claim 1 , wherein producing a data stream comprises producing a data stream to include the first portions of encoded data and the second portions of encoded data, and the method further comprises:

transmitting the data stream to a first destination that decodes only the first portions of encoded data to reproduce and play back the first rendition of the signal; and

transmitting the data stream to a second destination that decodes the first portions of encoded data and the second portions of encoded data, the second destination reproducing the first rendition of the signal based on the decoded first portions of encoded data, the second destination applying the decoded second portions of encoded data to the first rendition of the signal to produce and play back the second rendition of the signal.

7. The method as in claim 1 , wherein the data stream is organized as an MPEG transport stream and the first encoded enhancement data and the second encoded enhancement data are associated to specific Packet Identifiers (PIDs) that differ from the PID of the first portions of encoded data.

8. The method as in claim 7 , wherein the encoded enhancement data comprises compressed residual data and an indication of upsample operations to generate a reconstructed rendition of the original video signal at the first display element resolution.

9. The method as in claim 8 , where the first encoder is a legacy encoder.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2022
From: ROSSATO, LUCA; MEARDI, GUIDO
To: V-NOVA INTERNATIONAL LIMITED
Reel/Frame 060548/0666 →
Continuity (6)
Continuation 17136853 · Dec 29, 2020
Continuation 16871714 · May 11, 2020
Continuation 15850675 · Dec 21, 2017
Division 14252820 · Apr 15, 2014
Provisional Application 61812046 · Apr 15, 2013
Related Publication 20230011071A1 · Jan 12, 2023
References Cited (33)
US 9912945B2 · Rossato · 2018 [cited by examiner]
US 10652560B2 · Rossato · 2020 [cited by examiner]
US 10887612B2 · Rossato · 2021 [cited by examiner]
US 11394985B2 · Rossato · 2022 [cited by examiner]
US 20060083308A1 · Schwarz et al. · 2006 [cited by applicant]
US 20060109901A1 · Ye et al. · 2006 [cited by applicant]
US 20070223582A1 · Borer · 2007 [cited by applicant]
US 20090238279A1 · Tu · 2009 [cited by examiner]
US 20090268806A1 · Kim · 2009 [cited by examiner]
US 20090310680A1 · Jeon et al. · 2009 [cited by applicant]
US 20100046622A1 · Doser · 2010 [cited by examiner]
US 20100088736A1 · Besen · 2010 [cited by applicant]
US 20110110434A1 · Park et al. · 2011 [cited by applicant]
US 20120177110A1 · Kleijn · 2012 [cited by applicant]
US 20130114680A1 · Leontaris · 2013 [cited by applicant]
US 20140010294A1 · Ye · 2014 [cited by applicant]
US 20140037206A1 · Newton · 2014 [cited by applicant]
US 20140064373A1 · Le et al. · 2014 [cited by applicant]
US 20150296232A1 · Hwang · 2015 [cited by applicant]
WO 2007107936 · 2007 [cited by applicant]
WO 2012147010 · 2012 [cited by applicant]
WO 2013011492 · 2013 [cited by applicant]
Schierl, Thomas et al., “Scalable Video Coding Over RTP and MPEG-2 Transport Stream in Broadcast and IPTV channels”, IEEE Wireless Communications, Oct. 2009, Total Pages 8. [cited by applicant]
Schwarz, Heiko et al., “Overview of the Scalable Video Coding Extension of the H264/AVC Standard”, IEEE Transactions on Circuits and Systems for Video Technology, Sep. 2007, Total Pages 18. [cited by applicant]
Singer, David “Updated Part 15 Whitepaper”, 107. MPEG Meeting; Jan. 13, 2014-Jan. 17, 2014; San Jose; (Motion Picture Expert Group or ISO/IEC JTC1/SC29NVG11), No. m 32312, Jan. 16, 2014 (Jan. 16, 2014), XP030060764. [cited by applicant]
International Search Report and Written Opinion, Intellectual Property Office of Singapore, corresponding application PCT/IB2014/060716, dated May 24, 2017 pp. 6. [cited by applicant]
U.S. Appl. No. 15/850,675, filed Dec. 28, 2018, Office Action. [cited by applicant]
U.S. Appl. No. 15/850,675, filed Jun. 14, 2019, Final Office Action. [cited by applicant]
U.S. Appl. No. 15/850,675, filed Jan. 8, 2020, Notice of Allowance. [cited by applicant]
U.S. Appl. No. 16/871,714, filed Sep. 2, 2020, Notice of Allowance. [cited by applicant]
International Preliminary Report on Patentability for corresponding application PCT/IB2014/060716, dated Oct. 20, 2015, 8 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/136,853, mailed on Nov. 17, 2021, 15 pages. [cited by applicant]
Office Action received for European Patent Applicaiton No. 17/136,853, mailed on Mar. 4, 2022, 8 pages. [cited by applicant]