IP Library › Granted Patent US 10,939,203
Granted Patent B2
US 10,939,203 · App. 16/455,834 · Granted Mar 2, 2021

Forecasting sound in a live performance to determine microphone position

Inventors: Aaron K. Baughman (Cary, NC); Gary William Reiss (Buford, GA); Eduardo Morales (Key Biscayne, FL); Nancy Anne Greco (Lagrangeville, NY); David Alvra Wood, III (Scarsdale, NY)
Assignee: International Business Machines Corporation
H04R3/005A63B24/0021B64C39/024G06N3/088A63B71/0605A63B2024/0025B25J18/02B64C2201/127G05D1/0038G06T7/292H04N5/23203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,939,203
App. No.
16/455,834
Granted
Mar 2, 2021
Kind
B2
Abstract

An audio forecasting algorithm that is adjusted (or trained), by machine learning, prior to a sports contest that will be broadcast. The audio forecasting algorithm is then used to position a set of mobile microphones on an ongoing basis during the sports contest. In some embodiments, a band forecasting algorithm is used in the audio forecasting algorithm. In some embodiments, a swarm based correlation algorithm is used in the audio forecasting algorithm.

Claims (42)

1. A computer implemented method (CIM) comprising:

receiving a set of input data set including information related to an on-going event;

applying a swarm based correlation forecasting algorithm to data of the input data set to determine a first set of position(s) respectively for a set of mobile microphone(s), with the swarm based correlation forecasting algorithm providing correlation between elements of each within band forecasting so that patterns of similarity are regressed back into time to provide a further forecast for each correlated band;

communicating the first set of position(s) to a microphone positioning subsystem; and

positioning, by the microphone positioning subsystem, the set of mobile microphone(s) according to the first set of positions;

wherein the swarm based correlation forecasting algorithm has M bands, where M is equal to a number of times an overall signal can be divided by the longest average sound that is being detected.

2. The CIM of claim 1 wherein the event is a sports contest.

3. The CIM of claim 1 further comprising adjusting the swarm based correlation forecasting algorithm based on unsupervised machine learning.

4. The CIM of claim 1 further comprising adjusting the swarm based correlation forecasting algorithm based on supervised machine learning.

5. The CIM of claim 1 wherein the set of microphone(s) include a plurality of microphones respectively mounted on a plurality of unmanned aerial vehicles.

6. The CIM of claim 1 wherein the input data set includes at least the following types of events related information: positions of players in a sports contest, speed of players in the sports contest, direction of movement of players in the sports contest, position of a ball in a sports contest, speed of a ball in the sports contest, and direction of movement of a ball in the sports contest.

7. A computer program product (CPP) comprising:

a set of storage device(s) with each storage device including a set of storage medium(s); and

computer code collectively stored on a set of storage device(s), with the computer code including instructions and data for causing a processor(s) set to perform the following operations:

receiving a set of input data set including information related to an on-going event,

applying a swarm based correlation forecasting algorithm to data of the input data set to determine a first set of position(s) respectively for a set of mobile microphone(s), with the swarm based correlation forecasting algorithm providing correlation between elements of each within band forecasting so that patterns of similarity are regressed back into time to provide a further forecast for each correlated band,

communicating the first set of position(s) to a microphone positioning subsystem, and

positioning, by the microphone positioning subsystem, the set of mobile microphone(s) according to the first set of positions;

wherein the swarm based correlation forecasting algorithm has M bands, where M is equal to a number of times an overall signal can be divided by the longest average sound that is being detected.

8. The CPP of claim 7 wherein the event is a sports contest.

9. The CPP of claim 7 wherein the computer code further includes data and instructions for causing the processor(s) set to perform the following operation(s):

adjusting the swarm based correlation forecasting algorithm based on unsupervised machine learning.

10. The CPP of claim 7 wherein the computer code further includes data and instructions for causing the processor(s) set to perform the following operation(s):

adjusting the swarm based correlation forecasting algorithm based on supervised machine learning.

11. The CPP of claim 7 wherein the set of microphone(s) include a plurality of microphones respectively mounted on a plurality of unmanned aerial vehicles.

12. The CPP of claim 7 wherein the input data set includes at least the following types of events related information: positions of players in a sports contest, speed of players in the sports contest, direction of movement of players in the sports contest, position of a ball in a sports contest, speed of a ball in the sports contest, and direction of movement of a ball in the sports contest.

13. A computer system (CS) comprising:

a processor(s) set:

a set of storage device(s) with each storage device including a set of storage medium(s); and

computer code collectively stored on a set of storage device(s), with the computer code including instructions and data for causing the processor(s) set to perform the following operations:

receiving a set of input data set including information related to an on-going event,

applying a swarm based correlation forecasting algorithm to data of the input data set to determine a first set of position(s) respectively for a set of mobile microphone(s), with the swarm based correlation forecasting algorithm providing correlation between elements of each within band forecasting so that patterns of similarity are regressed back into time to provide a further forecast for each correlated band,

communicating the first set of position(s) to a microphone positioning subsystem, and

positioning, by the microphone positioning subsystem, the set of mobile microphone(s) according to the first set of positions;

wherein the swarm based correlation forecasting algorithm has M bands, where M is equal to a number of times an overall signal can be divided by the longest average sound that is being detected.

14. The CS of claim 13 wherein the event is a sports contest.

15. The CS of claim 13 wherein the computer code further includes data and instructions for causing the processor(s) set to perform the following operation(s):

adjusting the swarm based correlation forecasting algorithm based on unsupervised machine learning.

16. The CS of claim 13 wherein the computer code further includes data and instructions for causing the processor(s) set to perform the following operation(s):

adjusting the swarm based correlation forecasting algorithm based on supervised machine learning.

17. The CS of claim 13 wherein the set of microphone(s) include a plurality of microphones respectively mounted on a plurality of unmanned aerial vehicles.

18. The CS of claim 13 wherein the input data set includes at least the following types of events related information: positions of players in a sports contest, speed of players in the sports contest, direction of movement of players in the sports contest, position of a ball in a sports contest, speed of a ball in the sports contest, and direction of movement of a ball in the sports contest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2019
From: BAUGHMAN, AARON K.; REISS, GARY WILLIAM; MORALES, EDUARDO; GRECO, NANCY ANNE; WOOD, DAVID ALVRA, III
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049618/0403 →
Continuity (1)
Related Publication 20200413189A1 · Dec 31, 2020