IP Library Granted Patent US 10,368,070
Granted Patent B2
US 10,368,070 · App. 15/656,048 · Granted Jul 30, 2019

Image processing device and image processing method

Inventor: Kazushi Sato (Kanagawa, JP)
Assignee: Velos Media, LLC
H04N19/124G06T9/007H04N7/52H04N19/115H04N19/122H04N19/126H04N19/129H04N19/172H04N19/176H04N19/177H04N19/463H04N19/61H04N19/615H04N19/70H04N19/82H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,368,070
App. No.
15/656,048
Granted
Jul 30, 2019
Kind
B2
Abstract

An image processing device includes a buffer for receiving encoded image data, and a processor to execute instructions that cause the processor to: decode the encoded image data from the buffer to generate quantized transform coefficient data; inversely quantize the quantized transform coefficient data using a 32×32 quantization matrix to generate predicted error data, the 32×32 quantization matrix includes a duplicate of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and combine the predicted error data with a predicted image to generate decoded image data.

Claims (1284)

1. An image processing device comprising:

a buffer for receiving encoded image data, and

a processor to execute instructions that cause the processor to:

decode the encoded image data from the buffer to generate quantized transform coefficient data;

inversely quantize the quantized transform coefficient data using a 32×32 quantization matrix to generate predicted error data, the 32×32 quantization matrix includes a duplicate of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combine the predicted error data with a predicted image to generate decoded image data.

2. The image processing device according to claim 1 , further comprising a filter to filter the decoded image data.

3. The image processing device according to claim 1 , wherein the processor is configured to provide the decoded image data for storage in memory.

4. The image processing device according to claim 1 , wherein the processor is configured to provide the decoded image data for display.

5. The image processing device according to claim 1 , wherein the 8×8 quantization matrix is a default quantization matrix.

6. The image processing device according to claim 1 , wherein the processor is configured to store the 8×8 quantization matrix.

7. The image processing device according to claim 1 , wherein the processor is configured to generate the 32×32 quantization matrix by duplicating one of a first element and a second element adjacent to each other in the 8×8 quantization matrix as an element between the first element and the second element in the 32×32 quantization matrix.

8. The image processing device according to claim 1 , wherein the processor is configured to inversely quantize the quantized transform coefficient data using the 32×32 quantization matrix (QM 1 ) set by performing a nearest neighboring process on the elements in the 8×8 quantization matrix (QM 2 ):

QM

1

=

(

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

047

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

)

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

65

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

66

a

77

)

.

9. The image processing device according to claim 8 , wherein the processor is configured to set the 32×32 quantization matrix.

10. An image processing method comprising:

buffering in a buffer encoded image data;

decoding, by a decoder, the encoded image data to generate quantized transform coefficient data;

inversely quantizing, by processing circuitry, the quantized transform coefficient data using a 32×32 quantization matrix to generate predicted error data, the 32×32 quantization matrix includes duplicates of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combining, by the processing circuitry, the predicted error data with a predicted image to generate a decoded image data.

11. The image processing method according to claim 10 , further comprising filtering the decoded image data.

12. The image processing method according to claim 10 , further comprising providing the decoded image data for storage in memory.

13. The image processing method according to claim 10 , further comprising providing the decoded image data for display.

14. The image processing method according to claim 10 , wherein the 8×8 quantization matrix is a default quantization matrix.

15. The image processing method according to claim 10 , further comprising storing the 8×8 quantization matrix.

16. The image processing method according to claim 10 , further comprising generating the 32×32 quantization matrix by duplicating one of a first element and a second element adjacent to each other in the 8×8 quantization matrix as an element between the first element and the second element in the 32×32 quantization matrix.

17. The image processing method according to claim 10 , wherein inversely quantizing includes inversely quantizing, by the processing circuitry, the quantized transform coefficient data using the 32×32 quantization matrix (QM 1 ) set by performing the nearest neighboring process on the elements in the 8×8 quantization matrix (QM 2 ):

QM

1

=

(

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

00

a

00

a

00

a

00

a

10

a

10

a

10

a

10

a

20

a

20

a

20

a

70

a

70

a

70

a

70

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

01

a

01

a

01

a

01

a

11

a

11

a

11

a

11

a

21

a

21

a

21

a

71

a

71

a

71

a

71

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

02

a

02

a

02

a

02

a

12

a

12

a

12

a

12

a

22

a

22

a

22

a

72

a

72

a

72

a

72

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

07

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

a

07

a

047

a

07

a

07

a

17

a

17

a

17

a

17

a

27

a

27

a

27

a

77

a

77

a

77

a

77

)

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

65

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

66

a

77

)

.

18. The image processing method according to claim 17 , further comprising setting, by the processing circuity, the 32×32 quantization matrix.

19. A non-transitory, computer readable medium storing instructions which when executed cause a computer to perform a method, the method comprising:

buffering in a buffer encoded image data;

decoding the encoded image data to generate quantized transform coefficient data;

inversely quantizing the quantized transform coefficient data using a 32×32 quantization matrix to generate predicted error data, the 32×32 quantization matrix includes duplicates of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combining the predicted error data with a predicted image to generate decoded image data.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: VELOS MEDIA, LLC
To: SONY GROUP CORPORATION
Reel/Frame 061902/0867 →
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
SECOND AMENDED AND RESTATED MEMBER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 2, 2018
From: VELOS MEDIA MANAGEMENT, LLC; VELOS MEDIA, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 045806/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2017
From: SATO, KAZUSHI
To: SONY CORPORATION
Reel/Frame 043227/0429 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2017
From: SONY CORPORATION
To: VELOS MEDIA, LLC
Reel/Frame 043227/0455 →
Priority Claims (2)
JP 2010-275116 · Dec 9, 2010 · national
JP 2011-049992 · Mar 8, 2011 · national
Continuity (4)
Continuation 14868916 · Sep 29, 2015
Continuation 14474918 · Sep 2, 2014
Continuation 13881927
Related Publication 20170324954A1 · Nov 9, 2017