Information processing apparatus, information processing method, information processing system, and storage medium

1. An information processing apparatus comprising:

a recognition unit configured to recognize real objects in an acquired image of a real space and generate a first map of information indicating an allowable degree of superimposition of a virtual object on each of the recognized real objects, in which the information is represented by a numerical value for each of coordinates in the image of the real space;

an acquisition unit configured to acquire a second map of positional information indicating an allowable degree of display of the virtual object in each pixel of the acquired image based on a distance from a real object recognized in association with the virtual object, in which the distance is represented by a numerical value for each of the coordinates in the image of the real space;

a determination unit configured to determine a display condition for displaying the virtual object on the image of the real space based on the first map and the second map; and

a display control unit configured to superimpose and display the virtual object on the image of the real space based on the display condition.

2. The information processing apparatus according to claim 1 , wherein the display condition includes at least one of a position in which the virtual object is to be displayed, a shape of the virtual object, a size of the virtual object, transparency of the virtual object, and an information amount of the virtual object.

3. The information processing apparatus according to claim 1 , wherein the determination unit generates a third map by a calculation using the numerical value in the first map and the numerical value in the second map for each of the coordinates in the image of the real space.

4. The information processing apparatus according to claim 3 , wherein, with respect to each of coordinates in the third map, a total of numerical values of coordinates included in a region corresponding to the virtual object to be displayed is calculated, and the display condition is determined based on the total of numerical values.

5. The information processing apparatus according to claim 1 , wherein in a case where a plurality of the virtual objects is to be superimposed on the image of the real space, the determination unit determines the display condition in such a way that virtual objects of the plurality of virtual objects do not overlap each other.

6. The information processing apparatus according to claim 1 , wherein the recognition unit recognizes the real objects based on a feature amount in each of a plurality of regions obtained by segmenting the image of the real space.

7. The information processing apparatus according to claim 1 , further comprising a detection unit configured to detect a region of interest of a user in the image of the real space,

wherein the determination unit determines the display condition based on the information, the distance, and the detected region of interest.

8. The information processing apparatus according to claim 1 , further comprising a prediction unit configured to predict a temporal change in each of the recognized real objects,

wherein the determination unit determines the display condition based on the information, the distance, and the predicted temporal change.

9. The information processing apparatus according to claim 1 ,

wherein the allowable degree of display of the virtual object is highest at a position away from, by a predetermined distance, the real object.

10. An information processing method comprising:

recognizing real objects in an acquired image of a real space and generating a first map of information indicating an allowable degree of superimposition of a virtual object on each of the recognized real objects in which the information is represented by a numerical value for each of coordinates in the image of the real space;

acquiring a second map of positional information indicating an allowable degree of display of the virtual object in each pixel of the acquired image based on a distance from a real object recognized in association with the virtual object, in which the distance is represented by a numerical value for each of the coordinates in the image of the real space;

determining a display condition for displaying the virtual object on the image of the real space, based on the first map and the second map; and

superimposing and displaying the virtual object on the image of the real space based on the display condition.

11. A non-transitory computer-readable storage medium that stores instructions for causing a computer to perform the information processing method according to claim 10 .

12. An information processing system comprising:

an information processing apparatus;

an imaging apparatus configured to capture an image of a real space; and

a display apparatus configured to display an image of the real space, the image being generated by the information processing apparatus and having a virtual object superimposed thereon,

wherein the information processing apparatus comprising:

a recognition unit configured to recognize real objects in an acquired image of a real space and generate a first map of information indicating an allowable degree of superimposition of a virtual object on each of the recognized real objects, in which the information is represented by a numerical value for each of coordinates in the image of the real space;

an acquisition unit configured to acquire a second map of positional information indicating an allowable degree of display of the virtual object in each pixel of the acquired image based on a distance from a real object recognized in association with the virtual object, in which the distance is represented by a numerical value for each of the coordinates in the image of the real space;

a determination unit configured to determine a display condition for displaying the virtual object on the image of the real space based on the first map and the second map; and

a display control unit configured to superimpose and display the virtual object on the image of the real space based on the display condition.