Information processing device, mobile device, and information processing system

1 . An image capturing robot comprising:

a camera;

a transceiver;

a memory;

a drive mechanism to drive mobility of the image capturing robot; and

control circuitry that:

acquires, via the transceiver prior to beginning of a stage performance, time-series data that includes:

time-series action schedule data of actions to be performed live on a stage by a performer during the stage performance, and

time-series arrangement schedule data regarding placement of an object on the stage during the stage performance,

generates, prior to the beginning of the stage performance, on a basis of the acquired data, a time-series map of a travel allowance area of the image capturing robot on the stage during the stage performance in which a possibility of collision between the image capturing robot and either of the performer or the object on the stage during the stage performance is equal to or less than a defined collision threshold,

wherein the time-series map of the travel allowance area includes corresponding time-series movement and location information of the image capturing robot corresponding to the time-series action schedule data of actions to be performed live on the stage by the performer and the time-series arrangement schedule data regarding placement of the object on the stage during the stage performance,

stores the generated time-series map in the memory, and

during the stage performance, uses the time-series map from the memory and moves the image capturing robot, under real-time control of the drive mechanism, in accordance with the generated time-series map of the travel allowance area and according to a determined traveling route within the travel allowance area to prevent collision between the image capturing robot and the performer and the object during the stage performance,

wherein the control circuitry:

updates the travel allowance area during the stage performance based on an online comment received during the stage performance, analysis of an attention area associated with the comment received during the stage performance, and generation of real-time data reflecting a map in which an area other than the attention area is included within or as the travel allowance area.

2 . The image capturing robot according to claim 1 ,

wherein the acquired data further includes stage lighting control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage where the stage lighting control schedule data indicates that a scheduled lighting state is equal to or greater than a predefined lighting threshold.

3 . The image capturing robot according to claim 2 ,

wherein the stage lighting control schedule data comprises lighting color control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage that the lighting color control schedule data indicates will be illuminated in a predetermined color.

4 . The image capturing robot according to claim 1 ,

wherein the control circuitry acquires viewpoint position data that includes at least one of first viewpoint position data relative to an audience seat viewing the stage or second viewpoint position data relative to a remote camera aimed at a center of the stage, and

wherein the time-series map of the travel allowance area comprises areas that avoid a line connecting the audience seat to the stage or that avoid a line connecting the remote camera to the stage during the stage performance.

5 . The image capturing robot according to claim 1 , wherein the control circuitry:

acquires, via the camera, real-time data during the stage performance that includes each of real-time action data of actual actions performed by the performer during the stage performance and real-time data arrangement data regarding actual placement of the object on the stage during the stage performance,

generates, based on the acquired real-time data, updates to the time-series map of the travel allowance area in real time during the stage performance, and

controls the drive mechanism to move the image capturing robot in real time during the stage performance in accordance with the updates to the time-series map.

6 . A system comprising:

circuitry configured to:

acquire, prior to beginning of a stage performance, time-series data that includes:

time-series action schedule data of actions to be performed live on a stage by a performer during the stage performance, and

time-series arrangement schedule data regarding placement of an object on the stage during the stage performance,

generate, prior to the beginning of the stage performance, on a basis of the acquired data, a time-series map of a travel allowance area of an image capturing robot on the stage during the stage performance in which a possibility of collision between the image capturing robot and either of the performer or the object on the stage during the stage performance is equal to or less than a defined collision threshold,

wherein the time-series map of the travel allowance area includes corresponding time-series movement and location information of the image capturing robot corresponding to the time-series action schedule data of actions to be performed live on the stage by the performer and the time-series arrangement schedule data regarding placement of the object on the stage during the stage performance,

store the generated time-series map in a memory, and

during the stage performance, use the time-series map from the memory and move the image capturing robot, under real-time control, in accordance with the generated time-series map of the travel allowance area and according to a determined traveling route within the travel allowance area to prevent collision between the image capturing robot and the performer and the object during the stage performance,

wherein the circuitry;

updates the travel allowance area during the stage performance based on an online comment received during the stage performance, analysis of an attention area associated with the comment received during the stage performance, and generation of real-time data reflecting a map in which an area other than the attention area is included within or as the travel allowance area.

7 . The system according to claim 6 ,

wherein the acquired data further includes stage lighting control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage where the stage lighting control schedule data indicates that a scheduled lighting state is equal to or greater than a predefined lighting threshold.

8 . The system according to claim 7 ,

wherein the stage lighting control schedule data comprises lighting color control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage that the lighting color control schedule data indicates will be illuminated in a predetermined color.

9 . The system according to claim 6 ,

wherein the circuitry acquires viewpoint position data that includes at least one of first viewpoint position data relative to an audience seat viewing the stage or second viewpoint position data relative to a remote camera aimed at a center of the stage, and

wherein the time-series map of the travel allowance area comprises areas that avoid a line connecting the audience seat to the stage or that avoid a line connecting the remote camera to the stage during the stage performance.

10 . The system according to claim 6 , wherein the circuitry:

acquires, via a camera, real-time data during the stage performance that includes each of real-time action data of actual actions performed by the performer during the stage performance and real-time data arrangement data regarding actual placement of the object on the stage during the stage performance,

generates, based on the acquired real-time data, updates to the time-series map of the travel allowance area in real time during the stage performance, and

controls a drive mechanism to move the image capturing robot in real time during the stage performance in accordance with the updates to the time-series map.

11 . A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by one or more processors, causes the one or more processors to perform a method comprising:

acquiring, prior to beginning of a stage performance, time-series data that includes:

time-series action schedule data of actions to be performed live on a stage by a performer during the stage performance, and

time-series arrangement schedule data regarding placement of an object on the stage during the stage performance;

generating, prior to the beginning of the stage performance, on a basis of the acquired data, a time-series map of a travel allowance area of an image capturing robot on the stage during the stage performance in which a possibility of collision between the image capturing robot and either of the performer or the object on the stage during the stage performance is equal to or less than a defined collision threshold,

wherein the time-series map of the travel allowance area includes corresponding time-series movement and location information of the image capturing robot corresponding to the time-series action schedule data of actions to be performed live on the stage by the performer and the time-series arrangement schedule data regarding placement of the object on the stage during the stage performance;

storing the generated time-series map in a memory; and

during the stage performance, using the time-series map from the memory and moving the image capturing robot, under real-time control, in accordance with the generated time-series map of the travel allowance area and according to a determined traveling route within the travel allowance area to prevent collision between the image capturing robot and the performer and the object during the stage performance,

wherein the method further comprises:

updating the travel allowance area during the stage performance based on an online comment received during the stage performance, analysis of an attention area associated with the comment received during the stage performance, and generation of real-time data reflecting a map in which an area other than the attention area is included within or as the travel allowance area.

12 . The non-transitory computer-readable storage medium according to claim 11 ,

wherein the acquired data further includes stage lighting control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage where the stage lighting control schedule data indicates that a scheduled lighting state is equal to or greater than a predefined lighting threshold.

13 . The non-transitory computer-readable storage medium according to claim 12 ,

wherein the stage lighting control schedule data comprises lighting color control schedule data, and

wherein the time-series map of the travel allowance area avoids any area on the stage that the lighting color control schedule data indicates will be illuminated in a predetermined color.

14 . The non-transitory computer-readable storage medium according to claim 11 ,

wherein said acquiring includes acquiring viewpoint position data that includes at least one of first viewpoint position data relative to an audience seat viewing the stage or second viewpoint position data relative to a remote camera aimed at a center of the stage, and

wherein the time-series map of the travel allowance area comprises areas that avoid a line connecting the audience seat to the stage or that avoid a line connecting the remote camera to the stage during the stage performance.

15 . The non-transitory computer-readable storage medium according to claim 11 , wherein the method further comprises:

acquiring, via a camera, real-time data during the stage performance that includes each of real-time action data of actual actions performed by the performer during the stage performance and real-time data arrangement data regarding actual placement of the object on the stage during the stage performance,

generating, based on the acquired real-time data, updates to the time-series map of the travel allowance area in real time during the stage performance, and

controlling a drive mechanism to move the image capturing robot in real time during the stage performance in accordance with the updates to the time-series map.