IP Library Granted Patent US 12,389,001
Granted Patent B2
US 12,389,001 · App. 18/189,258 · Granted Aug 12, 2025

Image processing device and method

Inventors: Junichi Tanaka (Kanagawa, JP); Ohji Nakagami (Tokyo, JP); Yoshitaka Morigami (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/126H04N19/103H04N19/107H04N19/176H04N19/18H04N19/184H04N19/30H04N19/463H04N19/59H04N19/593H04N19/597H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,389,001
App. No.
18/189,258
Granted
Aug 12, 2025
Kind
B2
Abstract

The present disclosure relates to an image processing device and method that enable suppression of an increase in the amount of coding of a quantization matrix. An image processing device of the present disclosure includes an up-conversion unit configured to up-convert a quantization matrix limited to a size less than or equal to a transmission size that is a maximum size allowed for transmission, from the transmission size to a size that is identical to a block size that is a processing unit of quantization or dequantization. The present disclosure is applicable to, for example, an image processing device for processing image data.

Claims (25)

1. An image processing device, comprising:

circuitry configured to

set a first quantization matrix corresponding to a first transform unit of a first unit size, a second quantization matrix corresponding to a second transform unit of a second unit size larger than the first unit size, and a third quantization matrix different from the second quantization matrix and corresponding to a third transform unit of a third unit size larger than the second unit size; and

transmit a bit stream including the set first quantization matrix, the set second quantization matrix, and the set third quantization matrix, wherein

the second quantization matrix is an 8×8 matrix

the third quantization matrix is an 8×8 matrix

the second unit size is 16×16, and

the third unit size is 32×32.

2. The image processing device according to claim 1 , wherein the first quantization matrix, the second quantization matrix, and the third quantization matrix are included as a picture parameter set of a bitstream.

3. An image processing method, comprising:

setting a first quantization matrix corresponding to a first transform unit of a first unit size, a second quantization matrix corresponding to a second transform unit of a second unit size larger than the first unit size, and a third quantization matrix different from the second quantization matrix and corresponding to a third transform unit of a third unit size larger than the second unit size; and

transmitting a bit stream including the set first quantization matrix, the set second quantization matrix, and the set third quantization matrix, wherein

the second quantization matrix is an 8×8 matrix,

the third quantization matrix is an 8×8 matrix,

the second unit size is 16×16, and

the third unit size is 32×32.

4. The image processing method according to claim 3 , wherein the first quantization matrix, the second quantization matrix, and the third quantization matrix are included as a picture parameter set of a bitstream.

5. A non-transitory computer readable medium storing computer executable instructions which, when executed by a processor, cause the processor to perform a process comprising:

setting a first quantization matrix corresponding to a first transform unit of a first unit size, a second quantization matrix corresponding to a second transform unit of a second unit size larger than the first unit size, and a third quantization matrix different from the second quantization matrix and corresponding to a third transform unit of a third unit size larger than the second unit size; and

transmitting a bit stream including the set first quantization matrix, the set second quantization matrix, and the set third quantization matrix, wherein

the second quantization matrix is an 8×8 matrix,

the third quantization matrix is an 8×8 matrix,

the second unit size is 16×16, and

the third unit size is 32×32.

6. The non-transitory computer readable medium according to claim 5 , wherein the first quantization matrix, the second quantization matrix, and the third quantization matrix are included as a picture parameter set of a bitstream.

Assignments (1)
CHANGE OF NAME Recorded Mar 24, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063157/0783 →
Priority Claims (3)
JP 2011-277745 · Dec 19, 2011 · national
JP 2012-008462 · Jan 18, 2012 · national
JP 2012-039216 · Feb 24, 2012 · national
Continuity (7)
Continuation 17211177 · Mar 24, 2021
Continuation 16706832 · Dec 9, 2019
Continuation 16138184 · Sep 21, 2018
Continuation 15687082 · Aug 25, 2017
Continuation 15429866 · Feb 10, 2017
Continuation 14359765
Related Publication 20240205405A1 · Jun 20, 2024
References Cited (56)
US 9635354B2 · Tanaka · 2017 [cited by examiner]
US 9781422B2 · Tanaka · 2017 [cited by examiner]
US 10136135B2 · Tanaka · 2018 [cited by examiner]
US 10560697B2 · Tanaka et al. · 2020 [cited by applicant]
US 20050169547A1 · Mihara · 2005 [cited by applicant]
US 20060159165A1 · Lu et al. · 2006 [cited by applicant]
US 20070189626A1 · Tanizawa et al. · 2007 [cited by applicant]
US 20070292039A1 · Kadono et al. · 2007 [cited by applicant]
US 20110135000A1 · Alshina et al. · 2011 [cited by applicant]
US 20120140815A1 · Zhou et al. · 2012 [cited by applicant]
US 20130114695A1 · Joshi · 2013 [cited by examiner]
US 20200112723A1 · Tanaka et al. · 2020 [cited by applicant]
AU 2017203441A1 · 2017 [cited by applicant]
CA 2769733A1 · 2011 [cited by applicant]
CN 1835595A · 2006 [cited by applicant]
CN 1910921A · 2007 [cited by applicant]
CN 101123723A · 2008 [cited by applicant]
CN 101292535A · 2008 [cited by applicant]
CN 101674478A · 2010 [cited by applicant]
CN 101729897A · 2010 [cited by applicant]
CN 101867811A · 2010 [cited by applicant]
CN 102224731A · 2011 [cited by applicant]
CN 102577387A · 2012 [cited by applicant]
JP 2000102004A · 2000 [cited by applicant]
JP 2004254327A · 2004 [cited by applicant]
KR 1998074609A · 1998 [cited by applicant]
KR 20030036129A · 2003 [cited by applicant]
KR 1020040065406A · 2004 [cited by applicant]
WO 2011152518A1 · 2011 [cited by applicant]
WO 2012077408A1 · 2012 [cited by applicant]
Zhou et al., Non-CE04: Carriage of large block size quantization matrices with up-sampling, Nov. 9, 2011, JCTVC-G094, pp. 1-6. (Year: 2011). [cited by examiner]
Zhang et al., Method and syntax for quantization matrices representation, Nov. 9, 2011, JCTVC-G152, pp. 1-8. (Year: 2011). [cited by examiner]
International Search Report issued Mar. 5, 2013 in PCT/JP2012/081057. [cited by applicant]
Minhua Zhou, et al. “Non-CE04: Carriage of large block size quantization matrices with up-sampling” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting, Nov. 19-30,… [cited by applicant]
Kimin Zhang, et al., “Method and syntax for quantization matrices representation” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting, Nov. 21-30, 2011, 8 pages. [cited by applicant]
Junichi Tanaka, et al., “Quantization Matrix for HEVC” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 5th Meeting, Mar. 16-23, 2011, 24 pages. [cited by applicant]
JCTVC-B205 “Test Model under Consideration” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 2nd Meeting, Jul. 21-28, 2010, 198 pages. [cited by applicant]
VCEG-AD06 “Adaptive Quantization Matrix Selection on KTA Software” ITU Telecommunications Standardization Sector 30th Meeting, Oct. 23-24, 2006, 5 pages. [cited by applicant]
Combined Search Report and Examination Report issued Apr. 14, 2015 in Singapore Patent Application No. 11201402920T. [cited by applicant]
Extended Search Report issued Jun. 19, 2015 in European Patent Application No. 12860469.1. [cited by applicant]
Akiyuki Tanizawa, et al., “Simulation results of Adaptive Quantization Matrix Selection on KTA Software”, Proposal, Q.6/SG16 (VCEG), ITU—Telecommunications Standardization Sector Document VCEG-AC07, Study Group 16 Quest… [cited by applicant]
Munsi Haque, et al., “HVS Model based Default Quantization Matrices”, Input Document to JCT-VC, Sony Electronics Inc./Sony Corp., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29… [cited by applicant]
Japanese Office Action issued Nov. 5, 2015 in Patent Application No. 2013-550202. [cited by applicant]
Japanese Office Action issued Nov. 5, 2015 in Patent Application No. 2015-033125. [cited by applicant]
Office Action issued Feb. 16, 2016 in Japanese Patent Application No. 2015-033125. [cited by applicant]
Combined Office Action and Search Report issued Jan. 24, 2017 in Chinese Patent Application No. 201280061142. 8. [cited by applicant]
Combined Office Action and Search Report issued Feb. 23, 2017 in Chinese Patent Application No. 201410668859.X. [cited by applicant]
Singaporean Search Report and Written Opinion issued Sep. 7, 2017 in Patent Application No. 10201407305T. [cited by applicant]
Kazushi Sato et al., “Necessity of Quantization Matrices Compression in HEVC”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Document: JCTVC-E056, Mar. 16-2… [cited by applicant]
Ken McCann, et al., “HM4: High Efficiency Video Coding (HEVC) Test Model 4 Encoder Description”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting Torino, IT, Ju… [cited by applicant]
Korean Office Action dated Apr. 21, 2020, issued in corresponding Korean Patent Application No. 10-2020-7005154. [cited by applicant]
Korean Office Action dated Apr. 21, 2020, issued in corresponding Korean Patent Application No. 10-2020-7005155. [cited by applicant]
Korean Office Action dated Apr. 21, 2020, issued in corresponding Korean Patent Application No. 10-2020-7005156. [cited by applicant]
Korean Office Action dated Apr. 21, 2020, issued in corresponding Korean Patent Application No. 10-2020-7005158. [cited by applicant]
Korean Office Action dated Apr. 21, 2020, issued in corresponding Korean Patent Application No. 10-2020-7005163. [cited by applicant]
Shangguan Jintai, “Multimodal Image Registering”, the Tianjin Science and Technology Press, pp. 97-99, Aug. 2011, with an English translation of Office Action, total 18 pages. [cited by applicant]