Radio frequency (RF) communication system providing enhanced RF equipment configuration updates for mobile vehicles based upon reward matrices and related methods
A radio frequency (RF) communication system may include mobile vehicles, with each mobile vehicle including RF equipment and a controller. The controller may be configured to determine a reward matrix based upon possible RF equipment configurations and associated operational parameters, and operate the RF equipment to implement an RF equipment configuration based upon the reward matrix. The system may also include an oversight controller configured to update respective reward matrices of the mobile vehicles.
1. A radio frequency (RF) communication system comprising:
an oversight controller configured to generate a plurality of operational RF parameter weights corresponding to a steady RF operating state corresponding to a Nash Equilibrium; and
a plurality of mobile vehicles, each mobile vehicle comprising
RF equipment, and
a controller configured to
determine a reward matrix including a plurality of different RF equipment configurations and associated RF operational parameters, and
operate the RF equipment to implement an RF equipment configuration based upon the reward matrix and the operational RF parameter weights from the oversight controller to achieve the steady RF operating state.
2. The RF communication system of claim 1 wherein the possible RF equipment configurations comprise transmit and receive operating configurations.
3. The RF communication system of claim 1 wherein the possible RF equipment configurations comprise radar operating configurations.
4. The RF communication system of claim 1 wherein the possible RF equipment configurations comprise operating frequency band configurations.
5. The RF communication system of claim 1 wherein the oversight controller is configured to update the reward matrices by changing the operational RF parameter weights associated with at least some of the operational parameters.
6. The RF communication system of claim 5 wherein the oversight controller is configured to change the operational RF parameter weights based upon Q-learning.
7. The RF communication system of claim 1 wherein each controller is configured to implement an RF equipment configuration based upon the reward matrix and a linear optimization.
8. The RF communication system of claim 1 wherein each mobile vehicle comprises an unmanned aerial vehicle (UAV).
9. A radio frequency (RF) communication system comprising:
an oversight controller configured to generate a plurality of operational RF parameter weights corresponding to a steady RF operating state corresponding to a Nash Equilibrium; and
a plurality of mobile vehicles, each mobile vehicle comprising
RF equipment, and
a controller configured to
determine a reward matrix including a plurality of different RF equipment configurations and associated operational parameters, and
operate the RF equipment to implement an RF equipment configuration based upon the reward matrix and the operational RF parameter weights from the oversight controller using a linear optimization to achieve the steady RF operating state; and
wherein the oversight controller is configured to update the operational RF parameter weights associated with at least some of the operational parameters.
10. The RF communication system of claim 9 wherein the possible RF equipment configurations comprise transmit and receive operating configurations.
11. The RF communication system of claim 9 wherein the possible RF equipment configurations comprise radar operating configurations.
12. The RF communication system of claim 9 wherein the possible RF equipment configurations comprise operating frequency band configurations.
13. The RF communication system of claim 9 wherein the oversight controller is configured to change the operational RF parameter weights based upon Q-learning.
14. The RF communication system of claim 9 wherein each mobile vehicle comprises an unmanned aerial vehicle (UAV).
15. A radio frequency (RF) communications method for a plurality of mobile vehicles, each mobile vehicle comprising RF equipment, and the method comprising:
an oversight controller configured to generate a plurality of operational RF parameter weights corresponding to a steady RF operating state corresponding to a Nash Equilibrium; and
at each mobile vehicle,
determining a reward matrix including a plurality of different RF equipment configurations and associated RF operational parameters, and
operating the RF equipment to implement an RF equipment configuration based upon the reward matrix and the operational RF parameter weights from the oversight controller to achieve the steady RF operating state.
16. The method of claim 15 wherein the possible RF equipment configurations comprise transmit and receive operating configurations.
17. The method of claim 15 wherein the possible RF equipment configurations comprise radar operating configurations.
18. The method of claim 15 wherein the possible RF equipment configurations comprise operating frequency band configurations.
19. The method of claim 15 further comprising updating the reward matrices comprises updating the reward matrices by changing the operational RF parameter weights associated with at least some of the operational parameters.
20. The method of claim 19 wherein changing the weights comprises changing the weights based upon Q-learning.
21. The method of claim 15 wherein implementing the RF equipment configuration comprises implementing the RF equipment configuration based upon the reward matrix and a linear optimization.
22. The method of claim 15 wherein each mobile vehicle comprises an unmanned aerial vehicle (UAV).