Image processing to enhance variety of displayable augmented reality objects

1. An image processing apparatus, comprising:

an image acquisition unit configured to acquire an image of a real object, wherein the real object includes a primary recognition target and a secondary recognition target;

a recognition unit configured to:

recognize the primary recognition target in the image based on image recognition; and

calculate a transformation matrix that corresponds to the recognized primary recognition target, wherein the transformation matrix indicates an arrangement of a camera relative to the primary recognition target, and wherein the camera captures the image;

a control unit configured to:

generate a transformed image corresponding to the image based on the transformation matrix;

recognize the secondary recognition target in the transformed image based on the recognized primary recognition target;

set an augmented reality space associated with the image based on the image recognition of the primary recognition target;

determine an augmented reality object to be arranged in the augmented reality space based on the primary recognition target; and

determine a display attribute of the augmented reality object based on a value of the secondary recognition target.

2. The image processing apparatus according to claim 1 , wherein the control unit is further configured to

determine an arrangement of the secondary recognition target in the transformed image based on:

an arrangement of the primary recognition target in the image; and

arrangement data that defines the arrangement of the secondary recognition target relative to the primary recognition target.

3. The image processing apparatus according to claim 2 , wherein the control unit is further configured to:

determine that the secondary recognition target is partially shown in the image based on the arrangement of the secondary recognition target; and

control display of a display object, on a screen, based on the secondary recognition target that is partially shown in the image, wherein the display object recommends a change in an angle of view of the camera that captures the image.

4. The image processing apparatus according to claim 2 ,

wherein the secondary recognition target is recognized based on a partial image of the image acquired by the image acquisition unit; and

wherein the partial image is determined based on the arrangement of the secondary recognition target.

5. The image processing apparatus according to claim 2 ,

wherein the arrangement data further defines a type of the secondary recognition target, and

wherein a recognition process for recognition of the secondary recognition target is selected based on the type of the secondary recognition target.

6. The image processing apparatus according to claim 1 ,

wherein the secondary recognition target includes a visible code editable by a user,

wherein the control unit is further configured to determine the augmented reality object to be arranged in the augmented reality space based on object data, and

wherein a code to recognize the secondary recognition target is mapped to the augmented reality object in the object data.

7. The image processing apparatus according to claim 6 ,

wherein the object data is defined for each of a plurality of candidates for the primary recognition target, and

wherein the control unit is further configured to determine the augmented reality object based on the object data corresponding to the primary recognition target, wherein the primary recognition target is recognized from the plurality of candidates.

8. The image processing apparatus according to claim 1 ,

wherein the primary recognition target is one of a known image of a plurality of known images or a known pattern of a plurality of known patterns, and

wherein the recognition unit is further configured to execute the image recognition based on a comparison of first feature data of the image with second feature data of at least one of the plurality of known images or the plurality of known patterns.

9. The image processing apparatus according to claim 1 , wherein the control unit is further configured to control display of at least one of a first recognition status of the primary recognition target or a second recognition status of the secondary recognition target on a screen.

10. The image processing apparatus according to claim 2 , wherein the arrangement of the primary recognition target and the arrangement of the secondary recognition target include at least one of a position, an attitude, or a size of the primary recognition target and the secondary recognition target.

11. An image processing method, comprising:

acquiring an image of a real object, wherein the real object includes a primary recognition target and a secondary recognition target;

recognizing the primary recognition target in the image based on image recognition;

calculating a transformation matrix that corresponds to the recognized primary recognition target, wherein the transformation matrix indicates an arrangement of a camera relative to the primary recognition target, wherein the camera captures the image;

generating a transformed image corresponding to the image based on the transformation matrix;

recognizing the secondary recognition target in the transformed image based on the recognized primary recognition target;

setting an augmented reality space associated with the image based on the image recognition of the primary recognition target;

determining an augmented reality object to be arranged in the set augmented reality space based on the primary recognition target; and

determining a display attribute of the augmented reality object based on a value of the secondary recognition target.

12. A non-transitory computer-readable medium having stored thereon, computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

acquiring an image of a real object, wherein the real object includes a primary recognition target and a secondary recognition target;

recognizing the primary recognition target in the image based on image recognition;

calculating a transformation matrix that corresponds to the recognized primary recognition target, wherein the transformation matrix indicates an arrangement of a camera relative to the primary recognition target, wherein the camera captures the image;

generating a transformed image that corresponds to the image based on the transformation matrix;

recognizing the secondary recognition target in the transformed image based on the recognized primary recognition target;

setting an augmented reality space associated with the image based on the image recognition of the primary recognition target;

determining an augmented reality object to be arranged in the augmented reality space based on the primary recognition target; and

determining a display attribute of the augmented reality object based on a value of the secondary recognition target.

13. A print medium, comprising:

a primary recognition target that is printed on a print surface of the print medium, wherein the primary recognition target is recognized based on image recognition, wherein the primary recognition target is a frame in which a character is printed in the print medium, and the frame is associated with an image that shows the print medium with an augmented reality space, wherein the frame further includes a secondary recognition target and an edit area for the secondary recognition target, and wherein the secondary recognition target is printed on the print surface, wherein

the primary recognition target is used to determine an augmented reality object to be arranged in the augmented reality space, and

the secondary recognition target is used to determine a display attribute of the augmented reality object based on a value of the secondary recognition target,

wherein the secondary recognition target is recognized in a transformed image based on the recognized primary recognition target,

wherein the transformed image corresponds to the image, wherein the transformed image is generated based on a transformation matrix,

wherein the transformation matrix indicates an arrangement of a camera relative to the primary recognition target, and wherein the camera captures the image.

14. A print-media set, comprising:

a plurality of print media, wherein each print media of the plurality of print media comprises:

a primary recognition target that is printed on a print surface of a corresponding print media of the plurality of print media, wherein the primary recognition target is recognized based on image recognition, wherein the primary recognition target is a frame in which a character is printed in the corresponding print media and the frame is associated with an image that shows the corresponding print media with an augmented reality space,

wherein the frame further includes a secondary recognition target and an edit area for the secondary recognition target, and wherein the secondary recognition target is printed on the print surface, wherein

the primary recognition target is used to determine an augmented reality object to be arranged in the augmented reality space, and

the secondary recognition target is used to determine a display attribute of the augmented reality object based on a value of the secondary recognition target,

wherein the secondary recognition target is recognized in a transformed image based on the recognized primary recognition target,

wherein the transformed image corresponds to the image, wherein the transformed image is generated based on a transformation matrix,

wherein the transformation matrix indicates an arrangement of a camera relative to the primary recognition target, wherein the camera captures the image, and

wherein at least two of the plurality of print media respectively include the primary recognition target having a common appearance and the secondary recognition target different from the primary recognition target.

15. The print-media set according to claim 14 , wherein, on print surfaces of the at least two of the plurality of print media, a relative arrangement of the secondary recognition target to the primary recognition target is fixed.

16. The print medium according to claim 13 , further comprising a scratch layer on a position on the print surface to cover the secondary recognition target.

17. The image processing apparatus according to claim 1 , wherein the recognition unit is configured to determine an appearance of the augmented reality object as the display attribute of the augmented reality object.