Methods and systems for forecasting crowd dynamics

1. A method of refactoring a flow diagram, comprising:

at a computer system having one or more processors, memory storing one or more programs configured for execution by the one or more processors:

obtaining a temporal sequence of images of a physical venue;

for each of the images, subdividing the respective image into a respective set of logical pixels according to a predetermined mapping;

for each logical pixel of each image, computing a respective crowd density representing a respective number of mobile objects per unit of area in the physical venue at the logical pixel, thereby forming a temporal sequence of crowd density maps corresponding to the temporal sequence of images; and

using successive pairs of crowd density maps to train a model on spatiotemporal changes in crowd density at the physical venue.

2. The method of claim 1 , wherein the mobile objects are selected from the group consisting of: people, non-human animals, motorized vehicles, non-motorized vehicles, airplanes, drones, and mobile robots.

3. The method of claim 1 , wherein the physical venue is a portion of a park, an airport, a train station, an arena, a shopping mall, a factory, a home, a body of water, the sky, or a street corner.

4. The method of claim 1 , wherein each logical pixel corresponds to a respective single physical pixel in the images.

5. The method of claim 1 , wherein each logical pixel corresponds to a respective plurality of physical pixels in the images.

6. The method of claim 1 , further comprising obtaining additional information associated with each of the images and using the additional information to train the model.

7. The method of claim 6 , wherein the additional information includes one or more of: (i) a timestamp for each of the images; (ii) one or more weather parameters associated with each of the images; (iii) a day-of-week indicator for each of the images; (iv) scene context annotations for each logical pixel in each of the images; (v) scene context annotations for each of the images; (vi) range information; and (vii) thermal information.

8. The method of claim 1 , wherein computing the crowd density at each logical pixel comprises convolving each of the each of the images with one or more Gaussian maps.

9. The method of claim 1 , wherein computing the crowd density at each logical pixel comprises down-sampling.

10. The method of claim 1 , wherein a time delta between successive images in the temporal sequence is a value Δt that is between one millisecond and one week.

11. The method of claim 1 , wherein the trained model provides predictions of spatiotemporal changes in crowd density according to input images and requested time offsets from the input images.

12. The method of claim 11 , wherein providing the predictions of spatiotemporal changes in crowd density is further according to scene information, including scene type and/or weather conditions.

13. The method of claim 11 , wherein the trained model also provides accuracy estimates for the provided predictions.

14. The method of claim 1 , wherein the temporal sequence of images comprises a plurality of temporal subsequences, wherein each of the successive pairs of crowd density maps used to train the model comprises a respective pair of crowd density maps within a single respective temporal subsequence.

15. The method of claim 1 , wherein the temporal sequence of images are captured by one or more of: (i) a static surveillance camera, (ii) a PTZ surveillance camera, (iii) a digital camera, (iv) an image sensor of a smartphone, (v) a drone camera, (vi) a vehicle mounted camera, or (vii) a rangefinder camera.

16. The method of claim 1 , wherein a time delta between successive images in the temporal sequence is consistent across the images.

17. The method of claim 1 , wherein a time delta between successive images in the temporal sequence is different across the images.

18. A computer system for modeling crowd movement at physical venues, comprising:

one or more processors;

memory; and

one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs comprising instructions for:

obtaining a temporal sequence of images of a physical venue;

for each of the images, subdividing the respective image into a respective set of logical pixels according to a predetermined mapping;

for each logical pixel of each image, computing a respective crowd density representing a respective number of mobile objects per unit of area in the physical venue at the logical pixel, thereby forming a temporal sequence of crowd density maps corresponding to the temporal sequence of images; and

using successive pairs of crowd density maps to train a model on spatiotemporal changes in crowd density at the physical venue.

19. The computer system of claim 18 , wherein the trained model provides predictions of spatiotemporal changes in crowd density according to input images and requested time offsets from the input images.

20. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system having one or more processors, memory, and a display, the one or more programs comprising instructions for:

obtaining a temporal sequence of images of a physical venue;

for each of the images, subdividing the respective image into a respective set of logical pixels according to a predetermined mapping;

for each logical pixel of each image, computing a respective crowd density representing a respective number of mobile objects per unit of area in the physical venue at the logical pixel, thereby forming a temporal sequence of crowd density maps corresponding to the temporal sequence of images; and

using successive pairs of crowd density maps to train a model on spatiotemporal changes in crowd density at the physical venue.