Granted Patent B2

US 12,555,331 · App. 18/354,822 · Granted Feb 17, 2026

Inventor: Shinichi Aratani (Kanagawa, JP)

Assignee: Canon Kabushiki Kaisha

G06T19/006

Abstract

Claims (48)

1 . An information processing apparatus that is a first client apparatus connected to a network, the information processing apparatus comprising:

a receiver configured to receive first information, which is information on a virtual object, via the network; and

a controller configured to (1) acquire second information, which is information on an environment of surrounding of the first client apparatus, (2) generate a first image of the virtual object on a basis of the first information and the second information, and (3) control so that the generated first image of the virtual object is displayed on a first display,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein the controller (1) generates the first image of the virtual object on a basis of the first information without using the second information in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is not larger than a threshold, and (2) generates the first image of the virtual object on a basis of the first information and the second information in a case where the difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than the threshold.

2 . The information processing apparatus according to claim 1 , wherein the controller further (1) acquires a real space image capturing the surrounding of the first client apparatus, and (2) controls so that a combined image superimposing the first image of the virtual object on the real space image is displayed on the first display.

3 . The information processing apparatus according to claim 2 , wherein the second information includes exposure information of an image sensor, which captures the surrounding of the client apparatus, or the real space image.

4 . The information processing apparatus according to claim 2 , wherein the controller acquires the second information at a frequency lower than a frame rate of the real space image.

5 . The information processing apparatus according to claim 1 , wherein the second information includes at least one of a position of a light source in the environment, an intensity of the light source, a color temperature of the light source, an environment map indicating the environment, and a luminance of the environment.

6 . The information processing apparatus according to claim 1 , wherein the first information includes a same type of information as the second information.

7 . The information processing apparatus according to claim 1 , wherein in a case where the first image of the virtual object is generated on a basis of the first information and the second information, the controller adjusts the first information on a basis of the second information, and generates the first image of the virtual object on a basis of the first information after the adjustment.

8 . The information processing apparatus according to claim 1 , wherein in a case where the first image of the virtual object is generated on a basis of the first information and the second information, the controller (1) generates an image of the virtual object on a basis of the first information, (2) performs image processing on the image of the virtual object on a basis of the second information, and (3) controls so that the first image which is the image of the virtual object after the image processing is displayed on the first display.

9 . The information processing apparatus according to claim 1 , wherein the receiver is a communication interface configured to receive the first information from a server apparatus via the network,

wherein the controller changes a state of the virtual object in response to an instruction from a user, and

wherein the communication interface transmits third information, which is information on the virtual object after the state has been changed, to the server apparatus via the network.

10 . An information processing apparatus that is a first client apparatus connected to a network, the information processing apparatus comprising:

a receiver configured to receive first information, which is information on a virtual object, via the network; and

a controller configured to (1) acquire second information, which is information on an environment of surrounding of the first client apparatus, (2) generate a first image of the virtual object on a basis of the first information and the second information, and (3) control so that the generated first image of the virtual object is displayed on a first display,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein the controller controls so that a predetermined notification is performed to a user of the first client apparatus in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than a threshold.

11 . An image processing apparatus that is a server apparatus connected to a network, the image processing apparatus comprising:

a receiver configured to receive second information, which is information on an environment of surrounding of a first client apparatus connected to the network, via the network;

a controller configured to (1) acquire first information, which is information on a virtual object, and (2) generate a first image of the virtual object on a basis of the first information and the second information; and

a transmitter configured to transmit the first image of the virtual object generated by the controller to the first client apparatus via the network,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein the controller (1) generates the first image of the virtual object on a basis of the first information without using the second information in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is not larger than a threshold, and (2) generates the first image of the virtual object on a basis of the first information and the second information in a case where the difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than the threshold.

12 . A control method of a first client apparatus connected to a network, the control method comprising:

receiving first information, which is information on a virtual object, via the network;

acquiring second information, which is information on an environment of surrounding of the first client apparatus;

generating a first image of the virtual object on a basis of the first information and the second information; and

controlling so that the generated first image of the virtual object is displayed on a first display,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein (1) the first image of the virtual object is generated on a basis of the first information without using the second information in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is not larger than a threshold, and (2) the first image of the virtual object is generated on a basis of the first information and the second information in a case where the difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than the threshold.

13 . A non-transitory computer-readable medium that stores a program, wherein the program causes a computer to execute the control method according to claim 12 .

14 . An image processing apparatus that is a server apparatus connected to a network, the image processing apparatus comprising:

a receiver configured to receive second information, which is information on an environment of surrounding of a first client apparatus connected to the network, via the network;

a controller configured to (1) acquire first information, which is information on a virtual object, and (2) generate a first image of the virtual object on a basis of the first information and the second information; and

a transmitter configured to transmit the first image of the virtual object generated by the controller to the first client apparatus via the network,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein the controller controls so that a predetermined notification is performed to a user of the first client apparatus in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than a threshold.

15 . A control method of a first client apparatus connected to a network, the control method comprising:

receiving first information, which is information on a virtual object, via the network;

acquiring second information, which is information on an environment of surrounding of the first client apparatus;

generating a first image of the virtual object on a basis of the first information and the second information; and

controlling so that the generated first image of the virtual object is displayed on a first display,

wherein, for a second client apparatus which is placed in an environment of surrounding different from that of the first client apparatus, (1) a second image of the virtual object is generated on a basis of the first information and information on that environment and (2) the second image is displayed on a second display by the second client apparatus, and

wherein it is controlled so that a predetermined notification is performed to a user of the first client apparatus in a case where a difference between the environment of surrounding of the first client apparatus and the environment of surrounding of the second client apparatus is larger than a threshold.

16 . A non-transitory computer-readable medium that stores a program, wherein the program causes a computer to execute the control method according to claim 15 .

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (12)