Granted Patent B2

US 12,469,298 · App. 17/789,752 · Granted Nov 11, 2025

Inventors: Takayoshi Takayanagi (Tokyo, JP); Shohei Yamamoto (Tokyo, JP); Kenta Kawamoto (Tokyo, JP); Kohei Urushido (Tokyo, JP); Shun Lee (Tokyo, JP); Kazumi Aoyama (Tokyo, JP)

Assignee: SONY GROUP CORPORATION

G06V20/53G06V40/10

Abstract

Claims (48)

1 . An information processing apparatus, comprising:

a Central Processing Unit (CPU) configured to:

detect a crowd based on images and location information, wherein

the images are imaged by a camera equipped on a mobile body and a surveillance camera, and

the location information is acquired from the mobile body, the surveillance camera, and at least one mobile communication device;

receive event information from a server;

generate crowd information based on the detected crowd and the event information received from the server;

generate a cost map indicating a risk of passing through a region based on the crowd information;

generate an individual map that is an individual cost map for each piece of information of a plurality of types of modal including at least information from which the crowd information is obtained;

integrate the individual map based on selection of a cost indicating a highest risk from costs registered in the individual map for each piece of information of the plurality of types of modal; and

generate a final cost map based on the integration of the individual map for each piece of information of the plurality of types of modal, wherein each piece of information of the plurality of types of modal includes the images or the location information of a mobile terminal.

2 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

detect a person based on the images, and

detect the crowd based on a detection result of the person.

3 . The information processing apparatus according to claim 1 , wherein the mobile body is an unmanned aerial vehicle (UAV).

4 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to generate the cost map based on an image of the images acquired in a certain period.

5 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to update a cost for a region from a cost that is obtained based on an existing image in the cost map.

6 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to set a cost for a crowd region based on an area, in a real world or on an image, of the crowd region where the crowd is present.

7 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to generate the cost map one of regularly or irregularly.

8 . The information processing apparatus according to claim 7 , wherein the CPU is further configured to reset a cost for a region in which a certain period has elapsed from registration of a cost.

9 . The information processing apparatus according to claim 8 , wherein

the CPU is further configured to utilize the event information to reset the cost for the region in which the certain period has elapsed from the registration of the cost,

the event information is associated with an event where people gather, and

the reset of the cost targets only a cost for a non-event region other than an event region in which an event takes place in the cost map.

10 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to generate the cost map based on weather information.

11 . The information processing apparatus according to claim 1 , wherein the event information is associated with an event where people gather.

12 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to generate a path plan of the mobile body based on the cost map.

13 . The information processing apparatus according to claim 1 , wherein the at least one mobile communication device corresponds to a smartphone.

14 . An information processing method, comprising:

detecting, by a Central Processing Unit (CPU), a crowd based on images and location information, wherein

the images are imaged by a camera equipped on a mobile body and a surveillance camera, and

the location information is acquired from the mobile body, the surveillance camera, and at least one mobile communication device;

receiving, by the CPU, event information from a server;

generating, by the CPU, crowd information based on the detected crowd and the event information received from the server;

generating, by the CPU, a cost map indicating a risk of passing through a region based on the crowd information;

generating, by the CPU, an individual map that is an individual cost map for each piece of information of a plurality of types of modal including at least information from which the crowd information is obtained;

integrating, by the CPU, the individual map based on selection of a cost indicating a highest risk from costs registered in the individual map for each piece of information of the plurality of types of modal; and

generating, by the CPU, a final cost map based on the integration of the individual map for each piece of information of the plurality of types of modal, wherein each piece of information of the plurality of types of modal includes the images or the location information of a mobile terminal.

15 . A non-transitory computer readable medium, having stored thereon, computer executable code, which when executed by a processor, cause the processor to execute operations, the operations comprising:

detecting a crowd based on images and location information, wherein

the images are imaged by a camera equipped on a mobile body and a surveillance camera, and

the location information is acquired from the mobile body, the surveillance camera and at least one mobile communication device;

receiving event information from a server;

generating crowd information based on the detected crowd and the event information received from the server;

generating a cost map indicating a risk of passing through a region based on the crowd information;

generating an individual map that is an individual cost map for each piece of information of a plurality of types of modal including at least information from which the crowd information is obtained;

integrating the individual map based on selection of a cost indicating a highest risk from costs registered in the individual map for each piece of information of the plurality of types of modal; and

generating a final cost map based on the integration of the individual map for each piece of information of the plurality of types of modal, wherein each piece of information of the plurality of types of modal includes the images or the location information of a mobile terminal.

Priority Claims (1)

Continuity (1)

References Cited (16)