Granted Patent B2

US 12,610,207 · App. 17/992,036 · Granted Apr 21, 2026

Inventors: Jae-hyoun Yoo (Daejeon, KR); Kyeongok Kang (Daejeon, KR); Yong Ju Lee (Daejeon, KR); Dae Young Jang (Daejeon, KR)

Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

H04S7/303H04S2400/11

Abstract

Claims (68)

1 . An acoustic signal processing device comprising:

a memory configured to store instructions; and

a processor electrically connected to the memory and configured to execute the instructions,

wherein, when the instructions are executed by the processor, the processor is configured to perform a plurality of operations, and

the plurality of operations comprises:

transforming an object provided as a spatially extended sound source into a cuboid in a virtual reality (VR) space;

obtaining coordinates of the cuboid;

determining a position of a sound source of the object based on the coordinates of the cuboid and coordinates of a user in the VR space; and

outputting sound of the spatially extended sound source based on the position of the sound source of the object,

wherein the determining the position of the sound source of the object comprises the determining the position of the sound source of the object based on a first distance between a center of the cuboid and the user, a second distance between the user and a first channel of the sound source, and a third distance between the user and a second channel of the sound source,

wherein the second distance and the third distance are calculated based on the first distance, a radius, and an angle, and

wherein the radius is a radius of a circle associated with the cuboid,

wherein the radius is a length of a side of a cross-section of the cuboid perpendicular to y-axis, and equal to half of a length of a short side among the sides of the cross-section or equal to half of a length of a long side among the sides of the cross-section, and

wherein the angle is an arctangent of the half of a length of a short side among the sides of the cross-section divided by half of a length of a long side among the sides of the cross-section.

2 . The acoustic signal processing device of claim 1 , wherein the transforming of the object comprises:

obtaining a first maximum value and a first minimum value among x-coordinates of the object;

obtaining a second maximum value and a second minimum value among y-coordinates of the object;

obtaining a third maximum value and a third minimum value among z-coordinates of the object; and

forming the cuboid by using the first maximum value, the first minimum value, the second maximum value, the second minimum value, the third maximum value, and the third minimum value.

3 . The acoustic signal processing device of claim 1 , wherein the determining of the position of the sound source of the object based on the first distance comprises:

calculating a length of a short side of the cuboid and a length of a long side of the cuboid by using the coordinates of the cuboid; and

determining a position of the first channel of the sound source of the object and a position of the second channel of the sound source of the object based on the length of the short side, the length of the long side, and the first distance.

4 . The acoustic signal processing device of claim 3 , wherein the determining of the position of the first channel and the position of the second channel comprises:

calculating the second distance between the user and the first channel and the third distance between the user and the second channel, based on the first distance, the length of the short side, and the length of the long side; and

determining the position of the first channel and the position of the second channel based on the second distance and the third distance.

5 . The acoustic signal processing device of claim 4 , wherein the determining of the position of the first channel and the position of the second channel based on the second distance and the third distance comprises:

determining first horizontal coordinates of the first channel and second horizontal coordinates of the second channel based on the second distance and the third distance; and

determining first vertical coordinates of the first channel and second vertical coordinates of the second channel based on coordinates of the center of the cuboid.

6 . The acoustic signal processing device of claim 5 , wherein the plurality of operations further comprises:

determining positions of one or more of other channels of the sound source of the object by using at least one of the first horizontal coordinates, the second horizontal coordinates, the first vertical coordinates, or the second vertical coordinates.

7 . The acoustic signal processing device of claim 1 , wherein the determining of the position of the sound source of the object comprises:

determining a position of a first channel of the sound source of the object and a position of a second channel of the sound source of the object based on a first field of view (FOV) of a head-mounted display (HMD), the coordinates of the cuboid, and the coordinates of the user.

8 . The acoustic signal processing device of claim 7 , wherein the determining of the position of the first channel and the position of the second channel comprises:

when the first FOV is greater than a threshold value, obtaining a second FOV which is smaller than the first FOV;

determining first horizontal coordinates of the first channel and second horizontal coordinates of the second channel based on the second FOV, the coordinates of the cuboid, and the coordinates of the user; and

determining first vertical coordinates of the first channel and second vertical coordinates of the second channel based on coordinates of a center of the cuboid.

9 . A method of operating an acoustic signal processing device, the method comprising:

transforming an object provided as a spatially extended sound source into a cuboid in a virtual reality (VR) space;

obtaining coordinates of the cuboid;

determining a position of a sound source of the object based on the coordinates of the cuboid and coordinates of a user in the VR space; and

outputting sound of the spatially extended sound source based on the position of the sound source of the object,

wherein the determining the position of the sound source of the object comprises the determining the position of the sound source of the object based on a first distance between a center of the cuboid and the user, a second distance between the user and a first channel of the sound source, and a third distance between the user and a second channel of the sound source,

wherein the second distance and the third distance are calculated based on the first distance, a radius, and an angle, and

wherein the radius is a radius of a circle associated with the cuboid,

wherein the radius is a length of a side of a cross-section of the cuboid perpendicular to y-axis, and equal to half of a length of a short side among the sides of the cross-section or equal to half of a length of a long side among the sides of the cross-section, and

wherein the angle is an arctangent of the half of a length of a short side among the sides of the cross-section divided by half of a length of a long side among the sides of the cross-section.

10 . The method of claim 9 , wherein the transforming of the object comprises:

obtaining a first maximum value and a first minimum value among x-coordinates of the object;

obtaining a second maximum value and a second minimum value among y-coordinates of the object;

obtaining a third maximum value and a third minimum value among z-coordinates of the object; and

forming the cuboid by using the first maximum value, the first minimum value, the second maximum value, the second minimum value, the third maximum value, and the third minimum value.

11 . The method of claim 9 , wherein the determining of the position of the sound source of the object based on the first distance comprises:

calculating a length of a short side of the cuboid and a length of a long side of the cuboid by using the coordinates of the cuboid; and

determining a position of the first channel of the sound source of the object and a position of the second channel of the sound source of the object based on the length of the short side, the length of the long side, and the first distance.

12 . The method of claim 11 , wherein the determining of the position of the first channel and the position of the second channel comprises:

calculating the second distance between the user and the first channel and the third distance between the user and the second channel, based on the first distance, the length of the short side, and the length of the long side; and

determining the position of the first channel and the position of the second channel based on the second distance and the third distance.

13 . The method of claim 12 , wherein the determining of the position of the first channel and the position of the second channel based on the second distance and the third distance comprises:

determining first horizontal coordinates of the first channel and second horizontal coordinates of the second channel based on the second distance and the third distance; and

determining first vertical coordinates of the first channel and second vertical coordinates of the second channel based on coordinates of the center of the cuboid.

14 . The method of claim 13 , further comprising:

determining positions of one or more of other channels of the sound source of the object by using at least one of the first horizontal coordinates, the second horizontal coordinates, the first vertical coordinates, or the second vertical coordinates.

15 . The method of claim 9 , wherein the determining of the position of the sound source of the object comprises:

determining a position of a first channel of the sound source of the object and a position of a second channel of the sound source of the object based on a first field of view (FOV) of a head-mounted display (HMD), the coordinates of the cuboid, and the coordinates of the user.

16 . The method of claim 15 , wherein the determining of the position of the first channel and the position of the second channel comprises:

when the first FOV is greater than a threshold value, obtaining a second FOV which is smaller than the first FOV;

determining first horizontal coordinates of the first channel and second horizontal coordinates of the second channel based on the second FOV, the coordinates of the cuboid, and the coordinates of the user; and

determining first vertical coordinates of the first channel and second vertical coordinates of the second channel based on coordinates of a center of the cuboid.

Assignments (1)

Priority Claims (2)

Continuity (1)

References Cited (14)