IP Library Granted Patent US 11,196,995
Granted Patent B2
US 11,196,995 · App. 16/502,135 · Granted Dec 7, 2021

Image processing device and image processing method

Inventor: Kazushi Sato (Kanagawa, JP)
Assignee: Velos Media, LLC
H04N19/124G06T9/007H04N7/52H04N19/115H04N19/122H04N19/126H04N19/129H04N19/172H04N19/176H04N19/177H04N19/463H04N19/61H04N19/615H04N19/70H04N19/82H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,196,995
App. No.
16/502,135
Granted
Dec 7, 2021
Kind
B2
Abstract

An image processing device includes a buffer for receiving encoded image data, and a processor to execute instructions that cause the processor to: decode the encoded image data from the buffer to generate quantized transform coefficient data; inversely quantize the quantized transform coefficient data using a 16×16 quantization matrix to generate predicted error data, the 16×16 quantization matrix includes a duplicate of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and combine the predicted error data with a predicted image to generate decoded image data.

Claims (1342)

1. An image processing device comprising:

a buffer for receiving encoded image data, and

a processor to execute instructions that cause the processor to:

decode the encoded image data from the buffer to generate quantized transform coefficient data;

inversely quantize the quantized transform coefficient data using a 16×16 quantization matrix to generate predicted error data, the 16×16 quantization matrix includes a duplicate of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combine the predicted error data with a predicted image to generate decoded image data.

2. The image processing device according to claim 1 , further comprising a filter to filter the decoded image data.

3. The image processing device according to claim 1 , wherein the processor is configured to provide the decoded image data for storage in memory.

4. The image processing device according to claim 1 , wherein the processor is configured to provide the decoded image data for display.

5. The image processing device according to claim 1 , wherein the 8×8 quantization matrix is a default quantization matrix.

6. The image processing device according to claim 1 , wherein the processor is configured to store the 8×8 quantization matrix.

7. The image processing device according to claim 1 , wherein the processor is configured to generate the 16×16 quantization matrix by duplicating one of a first element and a second element adjacent to each other in the 8×8 quantization matrix as an element between the first element and the second element in the 16×16 quantization matrix.

8. The image processing device according to claim 1 , wherein the processor is configured to inversely quantize the quantized transform coefficient data using the 16×16 quantization matrix (QM1) set by performing a nearest neighboring process on the elements in the 8×8 quantization matrix (QM2):

QM

1

=

[

a

00

a

00

a

10

a

10

a

20

a

20

a

30

a

30

a

40

a

40

a

50

a

50

a

60

a

60

a

70

a

70

a

00

a

00

a

10

a

10

a

20

a

20

a

30

a

30

a

40

a

40

a

50

a

50

a

60

a

60

a

70

a

70

a

01

a

01

a

11

a

11

a

21

a

21

a

31

a

31

a

41

a

41

a

51

a

51

a

61

a

61

a

71

a

71

a

01

a

01

a

11

a

11

a

21

a

21

a

31

a

31

a

41

a

41

a

51

a

51

a

61

a

61

a

71

a

71

a

02

a

02

a

12

a

12

a

22

a

22

a

32

a

32

a

42

a

42

a

52

a

52

a

62

a

62

a

72

a

72

a

02

a

02

a

12

a

12

a

22

a

22

a

32

a

32

a

42

a

42

a

52

a

52

a

62

a

62

a

72

a

72

a

03

a

03

a

13

a

13

a

23

a

23

a

33

a

33

a

43

a

43

a

53

a

53

a

63

a

63

a

73

a

73

a

03

a

03

a

13

a

13

a

23

a

23

a

33

a

33

a

43

a

43

a

53

a

53

a

63

a

63

a

73

a

73

a

04

a

04

a

14

a

14

a

24

a

24

a

34

a

34

a

44

a

44

a

54

a

54

a

64

a

64

a

74

a

74

a

04

a

04

a

14

a

14

a

24

a

24

a

34

a

34

a

44

a

44

a

54

a

54

a

64

a

64

a

74

a

74

a

05

a

05

a

15

a

15

a

25

a

25

a

35

a

35

a

45

a

45

a

55

a

55

a

65

a

65

a

75

a

75

a

05

a

05

a

15

a

15

a

25

a

25

a

35

a

35

a

45

a

45

a

55

a

55

a

65

a

65

a

75

a

75

a

06

a

06

a

16

a

16

a

26

a

26

a

36

a

36

a

46

a

46

a

56

a

56

a

66

a

66

a

76

a

76

a

06

a

06

a

16

a

16

a

26

a

26

a

36

a

36

a

46

a

46

a

56

a

56

a

66

a

66

a

76

a

76

a

07

a

07

a

17

a

17

a

27

a

27

a

37

a

37

a

47

a

47

a

57

a

57

a

67

a

67

a

77

a

77

a

07

a

07

a

17

a

17

a

27

a

27

a

37

a

37

a

47

a

47

a

57

a

57

a

67

a

67

a

77

a

77

]

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

66

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

67

a

77

)

.

9. The image processing device according to claim 8 , wherein the processor is configured to set the 16×16 quantization matrix.

10. An image processing method comprising:

buffering in a buffer encoded image data;

decoding, by a decoder, the encoded image data to generate quantized transform coefficient data;

inversely quantizing, by processing circuitry, the quantized transform coefficient data using a 16×16 quantization matrix to generate predicted error data, the 16×16 quantization matrix includes duplicates of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combining, by the processing circuitry, the predicted error data with a predicted image to generate a decoded image data.

11. The image processing method according to claim 10 , further comprising filtering the decoded image data.

12. The image processing method according to claim 10 , further comprising providing the decoded image data for storage in memory.

13. The image processing method according to claim 10 , further comprising providing the decoded image data for display.

14. The image processing method according to claim 10 , wherein the 8×8 quantization matrix is a default quantization matrix.

15. The image processing method according to claim 10 , further comprising storing the 8×8 quantization matrix.

16. The image processing method according to claim 10 , further comprising generating the 16×16 quantization matrix by duplicating one of a first element and a second element adjacent to each other in the 8×8 quantization matrix as an element between the first element and the second element in the 16×16 quantization matrix.

17. The image processing method according to claim 10 , wherein inversely quantizing includes inversely quantizing, by the processing circuitry, the quantized transform coefficient data using the 16×16 quantization matrix (QM1) set by performing the nearest neighboring process on the elements in the 8×8 quantization matrix (QM2):

QM

1

=

[

a

00

a

00

a

10

a

10

a

20

a

20

a

30

a

30

a

40

a

40

a

50

a

50

a

60

a

60

a

70

a

70

a

00

a

00

a

10

a

10

a

20

a

20

a

30

a

30

a

40

a

40

a

50

a

50

a

60

a

60

a

70

a

70

a

01

a

01

a

11

a

11

a

21

a

21

a

31

a

31

a

41

a

41

a

51

a

51

a

61

a

61

a

71

a

71

a

01

a

01

a

11

a

11

a

21

a

21

a

31

a

31

a

41

a

41

a

51

a

51

a

61

a

61

a

71

a

71

a

02

a

02

a

12

a

12

a

22

a

22

a

32

a

32

a

42

a

42

a

52

a

52

a

62

a

62

a

72

a

72

a

02

a

02

a

12

a

12

a

22

a

22

a

32

a

32

a

42

a

42

a

52

a

52

a

62

a

62

a

72

a

72

a

03

a

03

a

13

a

13

a

23

a

23

a

33

a

33

a

43

a

43

a

53

a

53

a

63

a

63

a

73

a

73

a

03

a

03

a

13

a

13

a

23

a

23

a

33

a

33

a

43

a

43

a

53

a

53

a

63

a

63

a

73

a

73

a

04

a

04

a

14

a

14

a

24

a

24

a

34

a

34

a

44

a

44

a

54

a

54

a

64

a

64

a

74

a

74

a

04

a

04

a

14

a

14

a

24

a

24

a

34

a

34

a

44

a

44

a

54

a

54

a

64

a

64

a

74

a

74

a

05

a

05

a

15

a

15

a

25

a

25

a

35

a

35

a

45

a

45

a

55

a

55

a

65

a

65

a

75

a

75

a

05

a

05

a

15

a

15

a

25

a

25

a

35

a

35

a

45

a

45

a

55

a

55

a

65

a

65

a

75

a

75

a

06

a

06

a

16

a

16

a

26

a

26

a

36

a

36

a

46

a

46

a

56

a

56

a

66

a

66

a

76

a

76

a

06

a

06

a

16

a

16

a

26

a

26

a

36

a

36

a

46

a

46

a

56

a

56

a

66

a

66

a

76

a

76

a

07

a

07

a

17

a

17

a

27

a

27

a

37

a

37

a

47

a

47

a

57

a

57

a

67

a

67

a

77

a

77

a

07

a

07

a

17

a

17

a

27

a

27

a

37

a

37

a

47

a

47

a

57

a

57

a

67

a

67

a

77

a

77

]

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

66

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

67

a

77

)

.

18. The image processing method according to claim 17 , further comprising setting, by the processing circuity, the 16×16 quantization matrix.

19. A non-transitory, computer readable medium storing instructions which when executed cause a computer to perform a method, the method comprising:

buffering in a buffer encoded image data;

decoding the encoded image data to generate quantized transform coefficient data;

inversely quantizing the quantized transform coefficient data using a 16×16 quantization matrix to generate predicted error data, the 16×16 quantization matrix includes duplicates of at least one of two elements adjacent to each other from an 8×8 quantization matrix; and

combining the predicted error data with a predicted image to generate decoded image data.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: VELOS MEDIA, LLC
To: SONY GROUP CORPORATION
Reel/Frame 061902/0867 →
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2019
From: SATO, KAZUSHI
To: SONY CORPORATION
Reel/Frame 049812/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2019
From: SONY CORPORATION
To: VELOS MEDIA, LLC
Reel/Frame 049812/0368 →
Priority Claims (2)
JP 2010-275116 · Dec 9, 2010 · national
JP 2011-049992 · Mar 8, 2011 · national
Continuity (5)
Continuation 15656048 · Jul 21, 2017
Continuation 14868916 · Sep 29, 2015
Continuation 14474918 · Sep 2, 2014
Continuation 13881927
Related Publication 20190327472A1 · Oct 24, 2019