IP Library Granted Patent US 10,327,089
Granted Patent B2
US 10,327,089 · App. 15/566,495 · Granted Jun 18, 2019

Positioning an output element within a three-dimensional environment

Inventors: Richard Foss (Eastern Cape, ZA); Antoine Rouget (Hong Kong, CN)
Assignees: DSP4YOU LTD.; Richard Foss
H04S7/303G06F3/017G06F3/0346H04R5/02H04S7/30H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,327,089
App. No.
15/566,495
Granted
Jun 18, 2019
Kind
B2
Abstract

Systems and methods for positioning an output element ( 102, 602 ) within a three-dimensional environment ( 104, 604 ) are described. Movement data relating to movement of a mobile device ( 120, 620 ) is obtained ( 206, 262 ). The movement data is mapped ( 208, 264 ) to movement of a simulated output element ( 503 ) in a virtual environment ( 505 ), which simulates the three-dimensional environment. The movement of the simulated output element is associated with movement of an output element within the three-dimensional environment so as to control the position of the output element within the three-dimensional environment. In one exemplary embodiment an output element ( 102 ) being a sound source is positioned in a three-dimensional, immersive sound environment ( 104 ). In another exemplary embodiment a focal point of a light beam ( 602 ) is positioned in a three-dimensional theatrical environment ( 604 ). The described systems and methods enable a user to control the real-time and/or recorded position and/or movement of an output element by manipulating the orientation of a mobile device ( 120, 620 ).

Claims (37)

1. A method for positioning an output element within a three-dimensional environment including one or more output devices, the method comprising:

obtaining movement data relating to movement of a mobile device along and/or about one or more of an x-axis, y-axis, and z-axis thereof, wherein the movement of the mobile device relates to manipulation of the orientation of the mobile device relative to its x-axis, y-axis and z-axis by a user wishing to control the positon of an output element;

mapping the movement data to movement of a simulated output element along any one of the three axes in a virtual environment, the virtual environment simulating the three-dimensional environment; and

associating the movement of the simulated output element with movement of an output element within the three-dimensional environment, so as to control the position of the output element within the three-dimensional environment by controlling output of the one or more output devices,

wherein associating the movement of the simulated output element with movement of an output element within the three-dimensional environment includes:

generating time-stamped coordinates based on a position of the simulated output element in the virtual environment; and

associating the time-stamped coordinates with an output file arranged to control the position of the output element within the three-dimensional environment by controlling output of the one or more output devices, and

wherein associating the movement of the simulated output element with movement of an output element within the three-dimensional environment further includes:

determining speaker amplitude data, as matrix cross-point data, based on time-stamped coordinates and output device location data; and

transmitting the speaker amplitude data to networked devices for amplified output of the sound source by speakers so as to position the sound source within the three-dimensional environment.

2. The method as claimed in claim 1 , including generating the virtual environment, the virtual environment simulating the three-dimensional environment and including one or more simulated output devices and the simulated output element.

3. The method as claimed in claim 1 , wherein obtaining movement data relating movement of the mobile device includes obtaining the movement data from one or both of an accelerometer and a gyroscope of the mobile device, wherein the accelerometer is a three-axis accelerometer and wherein the gyroscope is a three-axis gyroscope.

4. The method as claimed in claim 1 , including periodically recording a set of coordinates based on the position of the simulated output element within the virtual environment.

5. The method as claimed in claim 1 , wherein the output element is the sound source in an immersive sound environment in which the one or more output devices are speakers.

6. The method as claimed in claim 1 , wherein the output element is one of a light beam or focal point of one or more light beams in a theatrical environment in which the one or more output devices are spot lights.

7. The method as claimed in claim 6 , wherein associating the movement of the simulated output element with movement of an output element within the three-dimensional environment includes mapping movement of the simulated output element to movement of the output devices.

8. The method as claimed in claim 6 , including generating time-stamped orientation coordinates of the output devices, and associating the time-stamped orientation coordinates of the output devices with a digital multiplex (DMX) signal.

9. A system for positioning an output element within a three-dimensional environment including one or more output devices, the system comprising:

an obtaining component for obtaining movement data relating to movement of a mobile device along and/or about one or more of an x-axis, y-axis and z-axis thereof, wherein the movement of the mobile device relates to manipulation of the orientation of the mobile device relative to its x-axis, y-axis and z-axis by a user wishing to control the position of an output element;

a mapping component for mapping the movement data to movement of a simulated output element along any one of three axes in a virtual environment, the virtual environment simulating the three-dimensional environment; and

an associating component for associating the movement of the simulated output element with movement of an output element within the three-dimensional environment, so as to control the position of the output element within the three-dimensional environment by controlling output of the one or more output devices,

wherein the associating component includes:

a time-stamping component for generating time-stamped coordinates based on a position of the simulated output element in the virtual environment;

wherein the associating component is configured to associate the time-stamped coordinates with an output file arranged to control the position of the output element within the three-dimensional environment by controlling output of the one or more output devices, and

wherein the associating component further includes:

an amplitude determining component for determining speaker amplitude data, as matrix cross-point data, based on time-stamped coordinates and output device location data; and,

a transmitting component for transmitting the speaker amplitude data to networked devices for amplified output of the sound source by speakers so as to position the output element within the three-dimensional environment.

10. The system as claimed in claim 9 , including a mobile device which provides the obtaining component and mapping component and which further includes:

a recording component for recording a set of coordinates based on the position of the simulated output element within the virtual environment; and

a communication component for transmitting the set of coordinates to a server computer.

11. The system as claimed in claim 10 , wherein the mobile device includes a movement sensor for sensing movement of the mobile device, wherein the movement sensor includes one or both of a gyroscope and an accelerometer, wherein the accelerometer is a three-axis accelerometer, wherein the gyroscope is a three-axis gyroscope, and wherein the obtaining component obtains movement data from the movement sensor.

12. The system as claimed in claim 10 , wherein the recording component periodically records a set of coordinates based on the position of the simulated output element within the virtual environment.

13. The system as claimed in claim 10 , including the server computer which provides the associating component and further includes:

a communication component for receiving a set of coordinates from the mobile device.

14. The system as claimed in claim 9 , wherein the output element is the sound source in an immersive sound environment in which the one or more output devices are speakers.

15. The system as claimed in claim 9 , wherein the output element is one of a light beam or focal point of one or more light beams in a theatrical environment in which the output devices are spot lights.

16. The system as claimed in claim 15 , wherein the associating component maps movement of the simulated output element to movement of the output devices, wherein the associating component includes a time-stamping component for generating time-stamped orientation coordinates of the output devices, and wherein the associating component associates the time-stamped orientation coordinates of the output devices with a digital multiplex (DMX) signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2017
From: FOSS, RICHARD; ROUGET, ANTOINE
To: FOSS, RICHARD; DSP4YOU LTD.
Reel/Frame 043863/0210 →
Priority Claims (1)
ZA 2015/02484 · Apr 14, 2015 · national
Continuity (1)
Related Publication 20180299962A1 · Oct 18, 2018
Cited By (1)
US 12,663,885