IP Library Granted Patent US 10,499,057
Granted Patent B2
US 10,499,057 · App. 15/806,691 · Granted Dec 3, 2019

Image processing device and image processing method

Inventor: Kazushi Sato (Kanagawa, JP)
Assignee: Velos Media, LLC
H04N19/124G06T9/007H04N7/52H04N19/115H04N19/122H04N19/126H04N19/129H04N19/172H04N19/176H04N19/177H04N19/463H04N19/61H04N19/615H04N19/70H04N19/82H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,499,057
App. No.
15/806,691
Granted
Dec 3, 2019
Kind
B2
Abstract

An apparatus includes at least one processor provided with at least one memory that includes computer program code. The memory and the computer program code are configured, when working with the at least one processor, to cause the apparatus to decode, from a bitstream, quantized transform coefficient data for 16×16 transform unit, and an 8×8 quantization matrix and to inversely quantize the quantized transform coefficient data for 16×16 transform unit using a 16×16 quantization matrix. The 16×16 quantization matrix is set by duplicating at least one of two elements adjacent to each other in the decoded 8×8 quantization matrix.

Claims (1982)

1. An apparatus, comprising:

at least one processor;

at least one memory including computer program code, the memory and the computer program code configured to, working with the at least one processor, cause the apparatus to perform at least the following:

decode, from a bitstream, quantized transform coefficient data for a 16×16 transform unit, and an 8×8 quantization matrix;

inversely quantize the quantized transform coefficient data for the 16×16 transform unit using a 16×16 quantization matrix, the 16×16 quantization matrix being set by duplicating at least one of two elements adjacent to each other in the decoded 8×8 quantization matrix.

2. The apparatus of claim 1 , wherein the 8×8 quantization matrix included in the bitstream was generated as part of a picture parameter set.

3. The apparatus of claim 1 , wherein the memory includes computer program code configured to, working with the processor, cause the apparatus to inversely quantize the quantized transform coefficient data using the 16×16 quantization matrix (QM 1 ) set by performing the nearest neighboring process on the elements in the 8×8 quantization matrix (QM 2 ):

QM

1

=

(

a

00

a

00

a

01

a

01

a

02

a

02

a

03

a

03

a

04

a

04

a

05

a

05

a

06

a

06

a

07

a

07

a

00

a

10

a

00

a

10

a

01

a

11

a

01

a

11

a

02

a

12

a

02

a

12

a

03

a

13

a

03

a

13

a

04

a

14

a

04

a

14

a

05

a

15

a

05

a

15

a

06

a

16

a

06

a

16

a

07

a

17

a

07

a

17

a

10

a

20

a

10

a

20

a

11

a

21

a

11

a

21

a

12

a

22

a

12

a

22

a

13

a

23

a

13

a

23

a

14

a

24

a

14

a

24

a

15

a

25

a

15

a

25

a

16

a

26

a

16

a

26

a

17

a

27

a

17

a

27

a

20

a

30

a

20

a

30

a

21

a

31

a

21

a

31

a

22

a

32

a

23

a

32

a

23

a

33

a

23

a

33

a

24

a

34

a

24

a

34

a

25

a

35

a

25

a

35

a

26

a

36

a

26

a

36

a

27

a

37

a

27

a

37

a

30

a

40

a

30

a

40

a

31

a

41

a

31

a

41

a

32

a

42

a

32

a

42

a

33

a

43

a

33

a

43

a

34

a

44

a

34

a

44

a

35

a

45

a

35

a

45

a

36

a

46

a

36

a

46

a

37

a

47

a

37

a

47

a

40

a

50

a

40

a

50

a

41

a

51

a

41

a

51

a

42

a

52

a

42

a

52

a

43

a

53

a

43

a

53

a

44

a

54

a

44

a

54

a

45

a

55

a

45

a

55

a

46

a

56

a

46

a

56

a

47

a

57

a

47

a

57

a

50

a

60

a

50

a

60

a

51

a

61

a

51

a

61

a

52

a

62

a

52

a

62

a

53

a

63

a

53

a

63

a

54

a

64

a

54

a

64

a

55

a

65

a

55

a

65

a

56

a

66

a

56

a

66

a

57

a

67

a

57

a

67

a

60

a

70

a

60

a

70

a

61

a

71

a

61

a

71

a

62

a

72

a

62

a

72

a

63

a

73

a

63

a

73

a

64

a

74

a

64

a

74

a

65

a

75

a

65

a

75

a

66

a

76

a

66

a

76

a

67

a

77

a

67

a

77

a

70

a

70

a

71

a

71

a

72

a

72

a

73

a

73

a

74

a

74

a

75

a

75

a

76

a

76

a

77

a

77

)

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

66

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

67

a

77

)

.

4. A method comprising:

decoding, from a bitstream, quantized transform coefficient data for a 16×16 transform unit, and an 8×8 quantization matrix;

inversely quantizing the quantized transform coefficient data for the 16×16 transform unit using a 16×16 quantization matrix, the 16×16 quantization matrix being set by duplicating at least one of two elements adjacent to each other in the decoded 8×8 quantization matrix.

5. The method of claim 4 , wherein the 8×8 quantization matrix included in the bitstream was generated as part of a picture parameter set.

6. The method of claim 4 , further comprising inversely quantizing the quantized transform coefficient data using the 16×16 quantization matrix (QM 1 ) set by performing the nearest neighboring process on the elements in the 8×8 quantization matrix (QM 2 ):

QM

1

=

(

a

00

a

00

a

01

a

01

a

02

a

02

a

03

a

03

a

04

a

04

a

05

a

05

a

06

a

06

a

07

a

07

a

00

a

10

a

00

a

10

a

01

a

11

a

01

a

11

a

02

a

12

a

02

a

12

a

03

a

13

a

03

a

13

a

04

a

14

a

04

a

14

a

05

a

15

a

05

a

15

a

06

a

16

a

06

a

16

a

07

a

17

a

07

a

17

a

10

a

20

a

10

a

20

a

11

a

21

a

11

a

21

a

12

a

22

a

12

a

22

a

13

a

23

a

13

a

23

a

14

a

24

a

14

a

24

a

15

a

25

a

15

a

25

a

16

a

26

a

16

a

26

a

17

a

27

a

17

a

27

a

20

a

30

a

20

a

30

a

21

a

31

a

21

a

31

a

22

a

32

a

23

a

32

a

23

a

33

a

23

a

33

a

24

a

34

a

24

a

34

a

25

a

35

a

25

a

35

a

26

a

36

a

26

a

36

a

27

a

37

a

27

a

37

a

30

a

40

a

30

a

40

a

31

a

41

a

31

a

41

a

32

a

42

a

32

a

42

a

33

a

43

a

33

a

43

a

34

a

44

a

34

a

44

a

35

a

45

a

35

a

45

a

36

a

46

a

36

a

46

a

37

a

47

a

37

a

47

a

40

a

50

a

40

a

50

a

41

a

51

a

41

a

51

a

42

a

52

a

42

a

52

a

43

a

53

a

43

a

53

a

44

a

54

a

44

a

54

a

45

a

55

a

45

a

55

a

46

a

56

a

46

a

56

a

47

a

57

a

47

a

57

a

50

a

60

a

50

a

60

a

51

a

61

a

51

a

61

a

52

a

62

a

52

a

62

a

53

a

63

a

53

a

63

a

54

a

64

a

54

a

64

a

55

a

65

a

55

a

65

a

56

a

66

a

56

a

66

a

57

a

67

a

57

a

67

a

60

a

70

a

60

a

70

a

61

a

71

a

61

a

71

a

62

a

72

a

62

a

72

a

63

a

73

a

63

a

73

a

64

a

74

a

64

a

74

a

65

a

75

a

65

a

75

a

66

a

76

a

66

a

76

a

67

a

77

a

67

a

77

a

70

a

70

a

71

a

71

a

72

a

72

a

73

a

73

a

74

a

74

a

75

a

75

a

76

a

76

a

77

a

77

)

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

66

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

67

a

77

)

.

7. At least one non-transitory, computer-readable medium encoded with instructions that, when executed by a processor, perform:

decoding, from a bitstream, quantized transform coefficient data for a 16×16 transform unit, and an 8×8 quantization matrix;

inversely quantizing the quantized transform coefficient data for the 16×16 transform unit using a 16×16 quantization matrix, the 16×16 quantization matrix being set by duplicating at least one of two elements adjacent to each other in the decoded 8×8 quantization matrix.

8. The non-transitory, computer-readable medium of claim 7 , wherein the 8×8 quantization matrix included in the bitstream was generated as part of a picture parameter set.

9. The non-transitory, computer-readable medium of claim 7 , further encoded with instructions that, when executed by a processor, perform inversely quantizing the quantized transform coefficient data using the 16×16 quantization matrix (QM 1 ) set by performing the nearest neighboring process on the elements in the 8×8 quantization matrix (QM 2 ):

QM

1

=

(

a

00

a

00

a

01

a

01

a

02

a

02

a

03

a

03

a

04

a

04

a

05

a

05

a

06

a

06

a

07

a

07

a

00

a

10

a

00

a

10

a

01

a

11

a

01

a

11

a

02

a

12

a

02

a

12

a

03

a

13

a

03

a

13

a

04

a

14

a

04

a

14

a

05

a

15

a

05

a

15

a

06

a

16

a

06

a

16

a

07

a

17

a

07

a

17

a

10

a

20

a

10

a

20

a

11

a

21

a

11

a

21

a

12

a

22

a

12

a

22

a

13

a

23

a

13

a

23

a

14

a

24

a

14

a

24

a

15

a

25

a

15

a

25

a

16

a

26

a

16

a

26

a

17

a

27

a

17

a

27

a

20

a

30

a

20

a

30

a

21

a

31

a

21

a

31

a

22

a

32

a

23

a

32

a

23

a

33

a

23

a

33

a

24

a

34

a

24

a

34

a

25

a

35

a

25

a

35

a

26

a

36

a

26

a

36

a

27

a

37

a

27

a

37

a

30

a

40

a

30

a

40

a

31

a

41

a

31

a

41

a

32

a

42

a

32

a

42

a

33

a

43

a

33

a

43

a

34

a

44

a

34

a

44

a

35

a

45

a

35

a

45

a

36

a

46

a

36

a

46

a

37

a

47

a

37

a

47

a

40

a

50

a

40

a

50

a

41

a

51

a

41

a

51

a

42

a

52

a

42

a

52

a

43

a

53

a

43

a

53

a

44

a

54

a

44

a

54

a

45

a

55

a

45

a

55

a

46

a

56

a

46

a

56

a

47

a

57

a

47

a

57

a

50

a

60

a

50

a

60

a

51

a

61

a

51

a

61

a

52

a

62

a

52

a

62

a

53

a

63

a

53

a

63

a

54

a

64

a

54

a

64

a

55

a

65

a

55

a

65

a

56

a

66

a

56

a

66

a

57

a

67

a

57

a

67

a

60

a

70

a

60

a

70

a

61

a

71

a

61

a

71

a

62

a

72

a

62

a

72

a

63

a

73

a

63

a

73

a

64

a

74

a

64

a

74

a

65

a

75

a

65

a

75

a

66

a

76

a

66

a

76

a

67

a

77

a

67

a

77

a

70

a

70

a

71

a

71

a

72

a

72

a

73

a

73

a

74

a

74

a

75

a

75

a

76

a

76

a

77

a

77

)

QM

2

=

(

a

00

a

10

a

20

a

30

a

40

a

50

a

60

a

70

a

01

a

11

a

21

a

31

a

41

a

51

a

61

a

71

a

02

a

12

a

22

a

32

a

42

a

52

a

62

a

72

a

03

a

13

a

23

a

33

a

43

a

53

a

63

a

73

a

04

a

14

a

24

a

34

a

44

a

54

a

64

a

74

a

05

a

15

a

25

a

35

a

45

a

55

a

65

a

75

a

06

a

16

a

26

a

36

a

46

a

56

a

66

a

76

a

07

a

17

a

27

a

37

a

47

a

57

a

67

a

77

)

.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: VELOS MEDIA, LLC
To: SONY GROUP CORPORATION
Reel/Frame 061902/0867 →
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: SATO, KAZUSHI
To: SONY CORPORATION
Reel/Frame 049938/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: SONY CORPORATION
To: VELOS MEDIA, LLC
Reel/Frame 049938/0229 →
SECOND AMENDED AND RESTATED MEMBER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 2, 2018
From: VELOS MEDIA MANAGEMENT, LLC; VELOS MEDIA, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 045806/0030 →
Priority Claims (2)
JP 2010-275116 · Dec 9, 2010 · national
JP 2011-049992 · Mar 8, 2011 · national
Continuity (5)
Continuation 15369429 · Dec 5, 2016
Continuation 14868930 · Sep 29, 2015
Continuation 14474918 · Sep 2, 2014
Continuation 13881927
Related Publication 20180070085A1 · Mar 8, 2018