IP Library › Granted Patent US 12,198,704
Granted Patent B2
US 12,198,704 · App. 17/293,904 · Granted Jan 14, 2025

Information processing device and method, and program

Inventors: Yuki Yamamoto (Tokyo, JP); Toru Chinen (Kanagawa, JP); Minoru Tsuji (Chiba, JP); Yoshiaki Oikawa (Kanagawa, JP)
Assignee: Sony Group Corporation
G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,704
App. No.
17/293,904
Granted
Jan 14, 2025
Kind
B2
Abstract

The present technology relates to an information processing device and method and a program that make it possible to reduce the total number of objects while the influence on the sound quality is suppressed. The information processing device includes a pass-through object selection unit configured to acquire data of L objects and select, from the L objects, M pass-through objects whose data is to be outputted as it is, and an object generation unit configured to generate, on the basis of the data of multiple non-pass-through objects that are not the pass-through objects among the L objects, the data of N new objects, N being smaller than (L−M). The present technology can be applied to an information processing device.

Claims (56)

1. An information processing device comprising:

a pre-rendering processing device configured to

acquire data of a plurality of objects, the data comprising a plurality of object signals and corresponding metadata,

calculate priority information for one or more of the plurality of objects comprising:

setting the priority information based on a first audio signal in a current time frame and a second audio signal in a previous time frame; and

output additional data comprising the calculated priority information.

2. The information processing device of claim 1 wherein the data further comprises gain information, position information, priority information and spread information.

3. The information processing device of claim 1 wherein the pre-rendering processing device comprises a priority calculation circuit configured to

calculate the priority information based on the data, and

output the additional data to a succeeding stage.

4. The information processing device of claim 3 wherein the pre-rendering processing device is configured to calculate the priority information based on the plurality of object signals and the corresponding metadata.

5. The information processing device of claim 4 wherein the pre-rendering processing device further comprises:

an object generation circuit;

a pass-through object selection circuit configured to

select a plurality of pass-through objects based on the data and the priority information,

output data associated with the pass-through objects supplied from the priority calculation circuit to the succeeding stage, and

supply the metadata and audio signals associated with a plurality of non-pass-through objects supplied from the priority calculation circuit to the object generation circuit.

6. The information processing device of claim 5 wherein the object generation circuit is configured to

generate additional metadata and additional audio signals of a previously presented object based on the metadata and the audio signals associated with the plurality of non-pass-through objects supplied from the priority calculation circuit to the object generation circuit, and

output the additional metadata and additional audio signal of the previously presented object to the succeeding stage.

7. The information processing device of claim 6 further comprising:

an encoding circuit configured to

encode the metadata, the additional metadata, the audio signals, and the additional audio signals to generate a code string, and

output the code string.

8. The information processing device of claim 7 further comprising:

a decoding circuit configured to receive the code string output by the encoding circuit.

9. An information processing method by an information processing device, comprising:

acquiring data of a plurality of objects, the data comprising a plurality of object signals and corresponding metadata;

calculating priority information for one or more of the plurality of objects comprising:

setting the priority information based on a first audio signal in a current time frame and a second audio signal in a previous time frame; and

outputting additional data comprising the calculated priority information.

10. The information processing method by an information processing device of claim 9 wherein the data further comprises gain information, position information, priority information and spread information.

11. The information processing method by the information processing device of claim 10 further comprising:

calculating the priority information based on the data, and

outputting the additional data to a succeeding stage.

12. The information processing method by the information processing device of claim 11 further comprising:

calculating the priority information based on the plurality of object signals and the corresponding metadata.

13. The information processing method by the information processing device of claim 12 further comprising:

selecting a plurality of pass-through objects based on the data and the priority information,

outputting data associated with the pass-through objects to the succeeding stage, and

supplying the metadata and audio signals associated with a plurality of non-pass-through objects supplied.

14. A program stored on a non-transient computer readable medium that when executed, causes a computer to execute the steps of:

acquiring data of a plurality of objects, the data comprising a plurality of object signals and corresponding metadata;

calculating priority information for one or more of the plurality of objects comprising:

setting the priority information based on a first audio signal in a current time frame and a second audio signal in a previous time frame; and

outputting additional data comprising the calculated priority information.

15. The program stored on a non-transient computer readable medium of claim 14 wherein the data further comprises gain information, position information, priority information and spread information.

16. The program stored on a non-transited computer readable medium of claim 15 that when executed, causes the computer to execute the additional steps of:

calculating the priority information based on the data, and

outputting the additional data to a succeeding stage.

17. The program stored on a non-transient computer readable medium of claim 16 that when executed, causes the computer to execute the additional step of:

calculating the priority information based on the plurality of object signals and the corresponding metadata.

18. The program stored on a non-transient computer readable medium of claim 17 that when executed, causes the computer to execute the additional steps of:

selecting a plurality of pass-through objects based on the data and the priority information,

outputting data associated with the pass-through objects to the succeeding stage, and

supplying the metadata and audio signals associated with a plurality of non-pass-through objects supplied.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: YAMAMOTO, YUKI; CHINEN, TORU; TSUJI, MINORU; OIKAWA, YOSHIAKI
To: SONY GROUP CORPORATION
Reel/Frame 057573/0792 →
Priority Claims (1)
JP 2018-217180 · Nov 20, 2018 · national
Continuity (1)
Related Publication 20220020381A1 · Jan 20, 2022
References Cited (29)
US 5883976A · Ohsawa · 1999 [cited by applicant]
US 10249311B2 · Adami · 2019 [cited by examiner]
US 20040083258A1 · Haneda · 2004 [cited by examiner]
US 20120230497A1 · Dressler · 2012 [cited by examiner]
US 20140023196A1 · Xiang · 2014 [cited by examiner]
US 20150142453A1 · Oomen et al. · 2015 [cited by applicant]
US 20160104496A1 · Purnhagen et al. · 2016 [cited by applicant]
US 20160125887A1 · Purnhagen et al. · 2016 [cited by applicant]
US 20160225377A1 · Miyasaka et al. · 2016 [cited by applicant]
US 20160300577A1 · Fersch · 2016 [cited by examiner]
US 20170323647A1 · Murtaza et al. · 2017 [cited by applicant]
US 20170374484A1 · Lando et al. · 2017 [cited by applicant]
US 20180033440A1 · Chinen · 2018 [cited by examiner]
US 20180152802A1 · Briand · 2018 [cited by applicant]
US 20180295464A1 · Breebaart et al. · 2018 [cited by applicant]
CN 101542595A · 2009 [cited by applicant]
CN 105229733A · 2016 [cited by applicant]
CN 107925837A · 2018 [cited by applicant]
JP 2016522911A · 2016 [cited by applicant]
JP 2016525699A · 2016 [cited by applicant]
JP 2018510532A · 2018 [cited by applicant]
WO WO2015056383A1 · 2015 [cited by applicant]
WO WO2018047667A1 · 2018 [cited by applicant]
International Search Report and English translation thereof mailed Jan. 28, 2020 in connection with International Application No. PCT/JP2019/043360. [cited by applicant]
Written Opinion and English translation thereof mailed Jan. 28, 2020 in connection with International Application No. PCT/JP2019/043360. [cited by applicant]
International Preliminary Report on Patentability and English translation thereof mailed Jun. 3, 2021 in connection with International Application No. PCT/JP2019/043360. [cited by applicant]
Extended European Search Report issued Dec. 15, 2021 in connection with European Application No. 19886482.9. [cited by applicant]
[No Author Listed], Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 3: 3D audio. ISO/IEC 23008-3. Feb. 2016. 439 pages. [cited by applicant]
[No Author Listed], Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 3: 3D audio. Amendment 3: MPEG-H 3D Audio Phase 2. ISO/IEC 23008-3. Jan. 2017. 456 pages. [cited by applicant]