IP Library › Granted Patent US 12,212,763
Granted Patent B2
US 12,212,763 · App. 18/366,041 · Granted Jan 28, 2025

Coding apparatus, coding method, transmission apparatus, and reception apparatus

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/31H04L65/61H04L65/70H04N19/46H04N19/70H04N19/105H04N19/162H04N19/187H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,763
App. No.
18/366,041
Granted
Jan 28, 2025
Kind
B2
Abstract

To perform favorable decoding processing on the receiver side. By an image coding unit, image data of each picture constituting moving image data is classified into a plurality of hierarchies, the image data of the picture in each of the classified hierarchies is coded, the plurality of hierarchies is divided into a predetermined number of hierarchy sets, and a predetermined number of video streams having the coded image data of the picture in each of the divided hierarchy sets is generated. In this case, coding is performed so that a decoding interval of at least the coded image data of the picture in the lowest hierarchy set is a regural interval. By a transmission unit, a container including the generated predetermined number of video streams in a predetermined format is transmitted.

Claims (45)

1. A reception apparatus, comprising:

circuitry configured to:

receive a plurality of video streams including coded image data in each of a first hierarchy set and a second hierarchy set, the coded image data being obtained by classifying image data of pictures into a plurality of hierarchies, coding the image data, and dividing the plurality of hierarchies into the first hierarchy set and the second hierarchy set, wherein

the first hierarchy set corresponds to image data for an enhanced frame rate and includes a highest hierarchy of the plurality of hierarchies, and

the second hierarchy set corresponds to image data for a base frame rate and includes all hierarchies of the plurality of hierarchies other than the highest hierarchy; and

decode the coded image data only in the second hierarchy set in the plurality of video streams or the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire decoded image data of the pictures having the enhanced frame rate or the base frame rate, wherein

decoding timings for the coded image data of each picture in the first hierarchy set and the coded image data of each picture in the second hierarchy set are interleaved and alternately arranged.

2. The reception apparatus according to claim 1 , wherein

the circuitry is configured to decode the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire the decoded image data of the pictures having the enhanced frame rate.

3. The reception apparatus according to claim 1 , wherein

the circuitry is configured to increase a frame rate of the decoded image data based on a display capability.

4. The reception apparatus according to claim 3 , wherein

the circuitry is configured to decode the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire the decoded image data of the pictures having the enhanced frame rate.

5. The reception apparatus according to claim 3 , wherein

the circuitry is configured to make the frame rate of the decoded image data double based on the display capability.

6. The reception apparatus according to claim 5 , wherein

the circuitry is configured to increase the frame rate of the decoded image data from 60 frame per second (fps) to 120 fps based on the display capability.

7. The reception apparatus according to claim 1 , wherein

the circuitry is configured to decrease a frame rate of the decoded image data based on a display capability.

8. The reception apparatus according to claim 7 , wherein

the circuitry is configured to decode the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire the decoded image data of the pictures having the enhanced frame rate.

9. The reception apparatus according to claim 7 , wherein

the circuitry is configured to make the frame rate of the decoded image data half based on the display capability.

10. The reception apparatus according to claim 9 , wherein

the circuitry is configured to decrease the frame rate of the decoded image data from 120 frame per second (fps) to 60 fps based on the display capability.

11. The reception apparatus according to claim 1 , wherein

the circuitry is configured to receive the plurality of video streams carried on a broadcast wave.

12. The reception apparatus according to claim 1 , wherein

the circuitry is configured to receive the plurality of video streams through the Internet.

13. The reception apparatus according to claim 1 , wherein

a decoding timing of each picture in the first hierarchy set is a middle timing of the decoding timings of the pictures in the second hierarchy set.

14. The reception apparatus according to claim 1 , wherein

hierarchy identification information for identifying a hierarchy of each of the pictures is added.

15. The reception apparatus according to claim 14 , wherein

the hierarchy identification information for identifying the hierarchy of each of the pictures is added at a header portion of Network Abstraction Layer (NAL) unit of each of the pictures.

16. A reception method, comprising:

receiving a plurality of video streams including coded image data in each of a first hierarchy set and a second hierarchy set, the coded image data being obtained by classifying image data of pictures into a plurality of hierarchies, coding the image data, and dividing the plurality of hierarchies into the first hierarchy set and the second hierarchy set, wherein

the first hierarchy set corresponds to image data for an enhanced frame rate and includes a highest hierarchy of the plurality of hierarchies, and

the second hierarchy set corresponds to image data for a base frame rate and includes all hierarchies of the plurality of hierarchies other than the highest hierarchy; and

decoding the coded image data only in the second hierarchy set in the plurality of video streams or the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire decoded image data of the pictures having the enhanced frame rate or the base frame rate, wherein

decoding timings for the coded image data of each picture in the first hierarchy set and the coded image data of each picture in the second hierarchy set are interleaved and alternately arranged.

17. The reception method according to claim 16 , wherein the decoding decodes the coded image data in both of the first hierarchy set and the second hierarchy set in the plurality of video streams to acquire the decoded image data of the pictures having the enhanced frame rate.

18. The reception method according to claim 16 , wherein the increasing increases a frame rate of the decoded image data based on a display capability.

19. The reception method according to claim 16 , wherein the decreasing decreases a frame rate of the decoded image data based on a display capability.

20. The reception method according to claim 16 , wherein a decoding timing of each picture in the first hierarchy set is a middle timing of the decoding timings of pictures in the second hierarchy set.

Assignments (1)
CHANGE OF NAME Recorded May 24, 2024
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 067528/0266 →
Priority Claims (1)
JP 2013-197350 · Sep 24, 2013 · national
Continuity (4)
Continuation 17671214 · Feb 14, 2022
Continuation 16682565 · Nov 13, 2019
Continuation 14914227
Related Publication 20230388524A1 · Nov 30, 2023
References Cited (49)
US 10531107B2 · Tsukagoshi · 2020 [cited by applicant]
US 11272196B2 · Tsukagoshi · 2022 [cited by applicant]
US 11758161B2 · Tsukagoshi · 2023 [cited by examiner]
US 20020051581A1 · Takeuchi et al. · 2002 [cited by applicant]
US 20020191625A1 · Kelly · 2002 [cited by applicant]
US 20050083401A1 · Mizutani et al. · 2005 [cited by applicant]
US 20090252228A1 · Boyce · 2009 [cited by applicant]
US 20110164683A1 · Takahashi et al. · 2011 [cited by applicant]
US 20130088644A1 · Atkins · 2013 [cited by examiner]
US 20130101015A1 · He · 2013 [cited by applicant]
US 20130170561A1 · Hannuksela · 2013 [cited by applicant]
US 20130195201A1 · Boyce · 2013 [cited by applicant]
US 20130322530A1 · Rossato · 2013 [cited by applicant]
US 20140092953A1 · Deshpande · 2014 [cited by applicant]
US 20140098886A1 · Crenshaw et al. · 2014 [cited by applicant]
US 20140125762A1 · Tsukagoshi · 2014 [cited by applicant]
US 20140205018A1 · Itoh · 2014 [cited by applicant]
US 20150124884A1 · Yuzawa · 2015 [cited by applicant]
US 20150245046A1 · Tsukuba · 2015 [cited by applicant]
US 20190394475A1 · Toma · 2019 [cited by examiner]
CN 1751503A · 2006 [cited by applicant]
JP 2002010251A · 2002 [cited by applicant]
JP 2006245756A · 2006 [cited by applicant]
JP 2009506626A · 2009 [cited by applicant]
JP 2009267537A · 2009 [cited by applicant]
JP 2010258997A · 2010 [cited by applicant]
JP 2013106341A · 2013 [cited by applicant]
WO 2003075524A1 · 2003 [cited by applicant]
WO 2010032636A1 · 2010 [cited by applicant]
WO WO2012023281A1 · 2012 [cited by applicant]
WO WO2013089024A1 · 2013 [cited by applicant]
Schierl et al., Scalable Video Coding Over RTP and MPEG-2 Transport Stream in Broadcast and IPTV Channels, 2009, IEEE, pp. 64-71. (Year: 2009). [cited by examiner]
International Search Report Issued Nov. 4, 2014, in PCT/JP2014/071098 Filed Aug. 8, 2014. [cited by applicant]
Schierl, et al., “Scalable Video Coding Over RTP and MPEG-2 Transport Stream in Broadcast and IPTV Channels,” IEEE Wireless Communications, vol. 16, No. 5, Oct. 2009, 8 Pages. [cited by applicant]
Sullivan, et al., “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, 20 Pages. [cited by applicant]
Office Action issued Mar. 22, 2016 in Japanese Patent Application No. 2016-026595. [cited by applicant]
Office Action issued Mar. 22, 2016 in Japanese Patent Application No. 2016-026596. [cited by applicant]
Office Action issued Mar. 29, 2016 in Japanese Patent Application No. 2013-197350. [cited by applicant]
Jill Boyce, et al., “Higher layer syntax to improve support for temporal scalability” Vidyo, Inc. Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Document: JCTVC-D200, Jan… [cited by applicant]
Benjamin Bross, et al., “High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Last Call)” Editor, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Do… [cited by applicant]
Kazushi Sato, et al., “Consideration of buffer management issues HEVC scalability” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Document: JCTVC-N0049, Jul. 29-Aug. 2, 2… [cited by applicant]
Combined Chinese Office Action and Search Report issued Apr. 10, 2020, in corresponding Chinese Patent Application No. 201480051418.3 (with English Translation), 29 pages. [cited by applicant]
Extended European Search Report issued Feb. 24, 2017 in Patent Application No. 14848220.1. [cited by applicant]
Text of ISO/IEC FDIS 14496-15, “3rd edition Information technology—Coding of audio-visual objects—Part 15: Carriage of NAL unit structured video in the ISO Base Media File Format”, 104. MPEG Meeting; Apr. 22-26, 2013; I… [cited by applicant]
Japanese Office Action issued Sep. 19, 2017 in Patent Application No. 2016-103835. [cited by applicant]
Combined Office Action and Search Report issued May 3, 2018 in Chinese Patent Application No. 201480051418.3 (with English language translation), 27 pages. [cited by applicant]
Office Action issued Apr. 2, 2019. in Japanese Patent Application No. 2018-091095, (with unedited computer-generated English translation). [cited by applicant]
Rickard Sjoberg, et al., “High-Level Syntax For Bitstream Extraction”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Nov. 2011. [cited by applicant]
Office Action issued Jul. 22, 2019, in Chinese Patent Application No. 201480051418.3 (with unedited computer-generated English translation). [cited by applicant]