Signal processing apparatus and signal processing method
The present technology relates to a signal processing apparatus and a signal processing method adapted to suitably combine a plurality of pieces of coded data. The signal processing apparatus of the present technology includes a selection part configured to select, from among a plurality of pieces of coded data obtained by encoding a plurality of media signals, pieces of the coded data targeted for combination without decoding the pieces of coded data, and a combination part configured to combine the pieces of coded data selected as the target for combination. The selection part selects the pieces of coded data targeted for combination on the basis of a degree of importance calculated for each piece of the coded data. The present technology can be applied to systems that implement a remote live event that can be attended by remote audience from outside an event venue.
1 . A signal processing apparatus, comprising: a central processing unit (CPU) configured to: receive a plurality of pieces of coded data, wherein the plurality of pieces of coded data is associated with a plurality of media signals, and each of the plurality of media signals is encoded; select, from the plurality of pieces of coded data, a first set of pieces of coded data without the first set of pieces of coded data being decoded; and combine the first set of pieces of coded data based on a weighted addition of the first set of pieces of coded data, wherein the combining comprises decoding the first set of pieces of coded data to generate a plurality of frequency signals, combine the plurality of frequency signals, and encode the combined plurality of frequency signals without conversion of the combined plurality of frequency signals to time signals.
2 . The signal processing apparatus according to claim 1 , wherein the CPU is further configured to: determine a respective degree of importance for each of the plurality of pieces of coded data; and select the first set of pieces of coded data based on the respective degree of importance calculated for each of the plurality of pieces of coded data.
3 . The signal processing apparatus according to claim 2 , wherein the CPU is further configured to: determine the respective degree of importance for each of the plurality of pieces of coded data based on a plurality of pieces of attribute information, and each of the plurality of pieces of attribute information corresponds to a respective piece of coded data of the plurality of pieces of coded data.
4 . The signal processing apparatus according to claim 3 , wherein a server includes the signal processing apparatus, the server is connected with a plurality of terminal devices, each of the plurality of terminal devices is associated with a respective user of a plurality of users, the plurality of terminal devices includes a first set of terminal devices and a second set of terminal devices, and the first set of terminal devices transmits the plurality of pieces of coded data to the signal processing apparatus.
5 . The signal processing apparatus according to claim 4 , wherein the plurality of pieces of attribute information indicates a plurality of feature quantities of the plurality of media signals.
6 . The signal processing apparatus according to claim 5 , wherein the first set of terminal devices attaches, at a time of the transmission of the plurality of pieces of coded data, the plurality of pieces of attribute information to the plurality of pieces of coded data.
7 . The signal processing apparatus according to claim 5 , wherein the plurality of feature quantities includes at least one of a respective size of each of the plurality of media signals, a respective degree of change of the each of the plurality of media signals, or a respective type of the each of the plurality of media signals.
8 . The signal processing apparatus according to claim 4 , wherein the CPU is further configured to control transmission, to the second set of terminal devices, of the combined first set of pieces of coded data, the first set of terminal devices is associated with a first set of users of the plurality of users, the second set of terminal devices is associated with a second set of users of the plurality of users, and the plurality of pieces of attribute information indicates a degree of relation between the first set of users and the second set of users.
9 . The signal processing apparatus according to claim 8 , wherein the first set of users includes a plurality of groups, the CPU is further configured to select the first set of pieces of coded data based on the plurality of groups, and the plurality of pieces of attribute information further indicates the plurality of groups.
10 . The signal processing apparatus according to claim 4 , wherein a number of the first set of pieces of coded data corresponds to at least one of a processing load of the server, or a load of communication with the plurality of terminal devices.
11 . The signal processing apparatus according to claim 2 , wherein the CPU is further configured to weight, before the combination of the first set of pieces of coded data, each of the first set of pieces of coded data based on the respective degree of importance.
12 . The signal processing apparatus according to claim 3 , wherein the signal processing apparatus is included in a terminal device, the terminal device is connected with a server, and the server transmits the plurality of pieces of coded data to the signal processing apparatus.
13 . The signal processing apparatus according to claim 12 , wherein the plurality of pieces of attribute information indicates a plurality of attributes of the plurality of media signals.
14 . The signal processing apparatus according to claim 13 , wherein the server attaches, at a time of the transmission of the plurality of pieces of coded data, the plurality of pieces of attribute information to the plurality of pieces of coded data.
15 . The signal processing apparatus according to claim 12 , wherein a number of the first set of pieces of coded data corresponds to at least one of: a processing load of the terminal device, or a reproduction environment for the combined plurality of media signals.
16 . The signal processing apparatus according to claim 12 , wherein the CPU is further configured to: weight, before the combination of the first set of pieces of coded data, each of the first set of pieces of coded data based on each of the plurality of pieces of attribute information and a reproduction environment for the combined plurality of media signals.
17 . The signal processing apparatus according to claim 1 , wherein the plurality of media signals includes at least one of a video signal, an audio signal, or a haptic signal.
18 . The signal processing apparatus according to claim 1 , wherein the plurality of pieces of coded data includes a second set of pieces of coded data, the second set of pieces of coded data is different from the first set of pieces of coded data, and the CPU is further configured to discard the second set of pieces of coded data from the combination of the first set of pieces of coded data.
19 . A signal processing method comprising:
in a signal processing apparatus;
receiving a plurality of pieces of coded data, wherein the plurality of pieces of coded data is associated with a plurality of media signals, and each of the plurality of media signals is encoded; selecting, from the plurality of pieces of coded data, a set of pieces of coded data without decoding the set of pieces of coded data; and combining the first set of pieces of coded data based on a weighted addition of the set of pieces of coded data, wherein the combining comprises decoding the first set of pieces of coded data to generate a plurality of frequency signals, combine the plurality of frequency signals and encode the combined plurality of frequency signals without conversion of the combined plurality of frequency signals to time signals.