IP Library › Granted Patent US 12,225,499
Granted Patent B2
US 12,225,499 · App. 17/579,771 · Granted Feb 11, 2025

Adaptive sensor position determination for multiple mobile sensors

Inventors: Ofir Ezrielev (Be'er Sheba, IL); Nadav Azaria (Meitar, IL); Avitan Gefen (Lehavim, IL)
Assignee: Dell Products L.P.
H04W64/006G06N3/08H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,499
App. No.
17/579,771
Filed
Jan 20, 2022
Granted
Feb 11, 2025
Kind
B2
Art Unit
2631
USPC
455/456.1
Abstract

Techniques are provided for adaptive sensor position determination for multiple mobile sensors. One method comprises obtaining a spatio-temporal representation of sensor measurements, from multiple mobile sensors, wherein the spatio-temporal representation comprises multiple layers each corresponding to a different point in time, wherein a given layer comprises multiple positions, and wherein each position in the given layer corresponds to a possible location for at least one of the multiple mobile sensors in an environment; applying the spatio-temporal representation to an environment state prediction model that generates a prediction of at least one future sensor measurement value for multiple positions in the spatio-temporal representation; applying the predictions of the at least one future sensor measurement value to a sensor position determination model that determines a new position for each of one or more of the multiple mobile sensors; and initiating a movement of the one or more of the multiple mobile sensors to the new position.

Claims (35)

1. A method, comprising:

obtaining a spatio-temporal representation of sensor measurements, from a plurality of mobile sensors, wherein the spatio-temporal representation comprises a plurality of layers each corresponding to a different point in time, wherein a given layer comprises a plurality of positions, and wherein each position in the given layer of the spatio-temporal representation corresponds to a possible location for at least one of the plurality of mobile sensors in an environment;

applying the spatio-temporal representation to an environment state prediction model that generates a prediction of at least one future sensor measurement value for a plurality of positions in the spatio-temporal representation;

applying the predictions of the at least one future sensor measurement value to a sensor position determination model that determines at least one new position for each of one or more of the plurality of mobile sensors using the predictions; and

initiating a movement of the one or more of the plurality of mobile sensors to the new position;

wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2. The method of claim 1 , wherein the environment state prediction model comprises a graph neural network.

3. The method of claim 1 , wherein the sensor position determination model comprises a reinforcement learning model.

4. The method of claim 3 , wherein the reinforcement learning model determines the new position for the at least some of the plurality of mobile sensors based at least in part on positions having a higher uncertainty value relative to other positions.

5. The method of claim 3 , wherein the reinforcement learning model determines the new position for a given mobile sensor based at least in part on a proximity of the given mobile sensor to the new position.

6. The method of claim 3 , wherein the reinforcement learning model determines the new position for a given mobile sensor based at least in part on an energy cost associated with moving the given mobile sensor to the new position.

7. The method of claim 1 , wherein a number of the positions in a plurality of the layers of the spatio-temporal representation is greater than a number of the plurality of mobile sensors.

8. The method of claim 1 , wherein the plurality of mobile sensors comprises a coordinated group of sensors.

9. The method of claim 1 , wherein the environment state prediction model further generates an uncertainty value for each prediction indicating a confidence of the environment state prediction model in a corresponding prediction and further comprising applying the uncertainty value for each prediction to the sensor position determination model that determines the new position for at least some of the plurality of mobile sensors.

10. An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

the at least one processing device being configured to implement the following steps:

obtaining a spatio-temporal representation of sensor measurements, from a plurality of mobile sensors, wherein the spatio-temporal representation comprises a plurality of layers each corresponding to a different point in time, wherein a given layer comprises a plurality of positions, and wherein each position in the given layer of the spatio-temporal representation corresponds to a possible location for at least one of the plurality of mobile sensors in an environment;

applying the spatio-temporal representation to an environment state prediction model that generates a prediction of at least one future sensor measurement value for a plurality of positions in the spatio-temporal representation;

applying the predictions of the at least one future sensor measurement value to a sensor position determination model that determines at least one new position for each of one or more of the plurality of mobile sensors using the predictions; and

initiating a movement of the one or more of the plurality of mobile sensors to the new position.

11. The apparatus of claim 10 , wherein the environment state prediction model comprises a graph neural network and the sensor position determination model comprises a reinforcement learning model.

12. The apparatus of claim 11 , wherein the reinforcement learning model determines the new position for the at least some of the plurality of mobile sensors based at least in part on positions having a higher uncertainty value relative to other positions.

13. The apparatus of claim 11 , wherein the reinforcement learning model determines the new position for a given mobile sensor based at least in part on one or more of a proximity of the given mobile sensor to the new position and an energy cost associated with moving the given mobile sensor to the new position.

14. The apparatus of claim 10 , wherein a number of the positions in a plurality of the layers of the spatio-temporal representation is greater than a number of the plurality of mobile sensors.

15. The apparatus of claim 10 , wherein the environment state prediction model further generates an uncertainty value for each prediction indicating a confidence of the environment state prediction model in a corresponding prediction and further comprising applying the uncertainty value for each prediction to the sensor position determination model that determines the new position for at least some of the plurality of mobile sensors.

16. A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:

obtaining a spatio-temporal representation of sensor measurements, from a plurality of mobile sensors, wherein the spatio-temporal representation comprises a plurality of layers each corresponding to a different point in time, wherein a given layer comprises a plurality of positions, and wherein each position in the given layer of the spatio-temporal representation corresponds to a possible location for at least one of the plurality of mobile sensors in an environment;

applying the spatio-temporal representation to an environment state prediction model that generates a prediction of at least one future sensor measurement value for a plurality of positions in the spatio-temporal representation;

applying the predictions of the at least one future sensor measurement value to a sensor position determination model that determines at least one new position for each of one or more of the plurality of mobile sensors using the predictions; and

initiating a movement of the one or more of the plurality of mobile sensors to the new position.

17. The non-transitory processor-readable storage medium of claim 16 , wherein the environment state prediction model comprises a graph neural network and the sensor position determination model comprises a reinforcement learning model.

18. The non-transitory processor-readable storage medium of claim 17 , wherein the reinforcement learning model determines the new position for the at least some of the plurality of mobile sensors based at least in part on positions having a higher uncertainty value relative to other positions.

19. The non-transitory processor-readable storage medium of claim 17 , wherein the reinforcement learning model determines the new position for a given mobile sensor based at least in part on one or more of a proximity of the given mobile sensor to the new position and an energy cost associated with moving the given mobile sensor to the new position.

20. The non-transitory processor-readable storage medium of claim 16 , wherein the environment state prediction model further generates an uncertainty value for each prediction indicating a confidence of the environment state prediction model in a corresponding prediction and further comprising applying the uncertainty value for each prediction to the sensor position determination model that determines the new position for at least some of the plurality of mobile sensors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2022
From: EZRIELEV, OFIR; AZARIA, NADAV; GEFEN, AVITAN
To: DELL PRODUCTS L.P.
Reel/Frame 058707/0197 →
Continuity (1)
Related Publication 20230232364A1 · Jul 20, 2023
References Cited (9)
US 11640163B1 · Nguyen · 2023 [cited by examiner]
US 20220050172A1 · Moulton · 2022 [cited by examiner]
US 20230168411A1 · Marvaniya · 2023 [cited by examiner]
CN 113222265A · 2021 [cited by examiner]
Mohammad Omidalizarandi, et al. Positioning Based on Integration of Multi-Sensor Systems Using Kalman Filter and Least Square Adjustment, Oct. 2013, DOI: 10.5194/isprsarchives-XL-1-W3-309-2013, pp. 309-314. [cited by applicant]
James A. Grant et al. Adaptive Sensor Placement for Continuous Spaces, arXiv:1905.06821v1 [stat.ML] May 16, 2019, pp. 1-13. https://arxiv.org/pdf/1905.06821.pdf. [cited by applicant]
Pengcheng Zhan et al. Adaptive Mobile Sensor Positioning for Multi-Static Target Tracking, May 29, 2018, pp. 1-23. https://newport.eecs.uci.edu/˜swindle/pubs/AdaptiveMobileSensorPositioningforMultiStatic.pdf. [cited by applicant]
Mike Ball, Multi-Sensor Positioning Solution Launched for Drones & Robotics, Unmanned Systems Technology, Oct. 12, 2020, pp. 1-6 https://www.unmannedsystemstechnology.com/2020/10/multi-sensor-positioning-solution-launch… [cited by applicant]
Rozemberczki, Benedek, et al. “Pytorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models.” Proceedings of the 30th International Conference on Information and Knowledge Management;… [cited by applicant]