IP Library Granted Patent US 11,234,044
Granted Patent B2
US 11,234,044 · App. 16/504,731 · Granted Jan 25, 2022

Transmission apparatus, transmission method, encoding apparatus, encoding method, reception apparatus, and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: Sony Group Corporation
H04N21/432H04N21/4345H04N21/4348
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,234,044
App. No.
16/504,731
Granted
Jan 25, 2022
Kind
B2
Abstract

A transmission apparatus includes a transmission unit. The transmission unit transmits a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames, the image data having the predetermined frame frequency being subjected to mixing processing for each frame, image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing, and further transmits metadata including information regarding the mixing processing in association with image data of each frame.

Claims (63)

1. A transmission apparatus comprising:

an electronic processor; and

a memory including instructions that, when executed by the electronic processor, cause the electronic processor to perform a set of operations including

transmitting a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing, and

transmitting metadata including information regarding the mixing processing in association with image data of the each frame.

2. The transmission apparatus according to claim 1 , wherein

the set of operations further includes inserting the metadata into a payload header of the packet including at least a top of the image data of the each frame.

3. The transmission apparatus according to claim 1 , wherein

the set of operations further includes transmitting the metadata in a metadata-dedicated packet associated with the packet including the image data of the each frame.

4. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information indicating whether image data of a corresponding frame is subjected to mixing processing.

5. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information of a camera shutter speed at capturing.

6. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information of a frame rate of a mixing processing target picture.

7. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information of a frame rate obtained after the mixing processing.

8. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information indicating a mixing processing target picture.

9. The transmission apparatus according to claim 1 , wherein

the information regarding the mixing processing includes information indicating a filter operation coefficient ratio at mixing.

10. The transmission apparatus according to claim 1 , wherein

the mixing processing includes a predetermined number of stages of the mixing processing.

11. The transmission apparatus according to claim 1 , wherein

the packet conforms to a format prescribed by a standard regarding video signal transmission using an internet protocol (IP) network.

12. The transmission apparatus according to claim 11 , wherein

the standard is SMPTE ST2022-6.

13. The transmission apparatus according to claim 11 , wherein

the standard is SMPTE ST2110-20.

14. The transmission apparatus according to claim 1 , wherein the set of operations further includes performing the mixing processing.

15. A transmission method, the method comprising:

transmitting, with an electronic processor, a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing; and

transmitting, with the electronic processor, metadata including information regarding the mixing processing in association with image data of the each frame.

16. An encoding apparatus comprising:

an electronic processor; and

a memory including instructions that, when executed by the electronic processor, cause the electronic processor to perform a set of operations including

receiving a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing;

receiving metadata including information regarding the mixing processing, the metadata being associated with image data of the each frame,

the information regarding the mixing processing including information indicating whether image data of a corresponding frame is subjected to mixing processing or not; and

encoding, on a basis of the information regarding the mixing processing, among the image data having the predetermined frame frequency, image data of a frame subjected to the mixing processing as base layer image data, and among the image data having the predetermined frame frequency, image data of a frame not subjected to the mixing processing as enhanced layer image data.

17. An encoding method, the method comprising:

receiving, with an electronic processor, a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing;

receiving, with the electronic processor, metadata including information regarding the mixing processing, the metadata being associated with image data of the each frame,

the information regarding the mixing processing including information indicating whether image data of a corresponding frame is subjected to mixing processing or not; and

encoding, with the electronic processor, among the image data having the predetermined frame frequency, image data of a frame subjected to the mixing processing as base layer image data, and among the image data having the predetermined frame frequency, image data of a frame not subjected to the mixing processing as enhanced layer image data, on a basis of the information regarding the mixing processing.

18. A reception apparatus comprising:

an electronic processor; and

a memory including instructions that, when executed by the electronic processor, causes the electronic processor to perform a set of operations including

receiving a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing;

receiving metadata including information regarding the mixing processing, the metadata being associated with image data of the each frame;

performing inverse mixing processing on the image data having the predetermined frame frequency on a basis of the information regarding the mixing processing; and

acquiring display image data based on the inverse mixing processing on the image data having the predetermined frame frequency.

19. A reception method, the method comprising:

receiving, with an electronic processor, a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames,

the image data having the predetermined frame frequency being subjected to mixing processing for each frame, and additional image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing;

receiving, with the electronic processor, metadata including information regarding the mixing processing, the metadata being associated with image data of the each frame;

performing, with the electronic processor, inverse mixing processing on the image data having the predetermined frame frequency on a basis of the information regarding the mixing processing; and

acquiring, with the electronic processor, display image data based on the inverse mixing processing on the image data having the predetermined frame frequency.

Assignments (2)
CHANGE OF NAME Recorded Oct 21, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057881/0650 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2019
From: TSUKAGOSHI, IKUO
To: SONY CORPORATION
Reel/Frame 049990/0115 →
Continuity (2)
Provisional Application 62786022 · Dec 28, 2018
Related Publication 20200213657A1 · Jul 2, 2020