IP Library Granted Patent US 12684104
Granted Patent B2
US 12684104 · App. 18/722,556 · Granted Jul 14, 2026

Information processing device and information processing method

Inventors: Daisuke Tsuru (Chiba, JP); Mitsuru Nishibe (Chiba, JP); Masaki Uchida (Chiba, JP); Yuto Hayakawa (Tokyo, JP); Kenzo Nishikawa (Tokyo, JP); Takehiro Tominaga (Tokyo, JP); Takanori Minamino (Kanagawa, JP)
Assignee: Sony Interactive Entertainment Inc.
H04N13/344H04N13/366H04N23/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12684104
App. No.
18/722,556
Granted
Jul 14, 2026
Kind
B2
Abstract

An image generation device sequentially acquires a frame 150 of a moving image captured by a stereo camera included in a head-mounted display, and generates a display image 154 to be used for video see-through or the like. A crop section of the image generation device crops a region 152 b in which a floor surface appears, and sets the cropped region as an image 156 for setting a play area in which the user is movable. In addition, the crop section crops a region 152 c with a predetermined size in which the front of the head-mounted display appears, and sets the cropped region as an image 158 for acquiring state information regarding the head-mounted display.

Claims (56)

1 . An information processing device comprising:

a memory comprising computer-executable instructions; and

a processor configured to access the memory and execute the computer-executable instructions to perform operations comprising:

receiving, by the information processing device from a camera in a head-mounted display, a first image;

determining, by the information processing device, based at least in part on a user selection, a first operational mode of the information processing device from a plurality of operational modes;

identifying, by the information processing device, a first predetermined rule associated with the first operational mode from a plurality of predetermined rules, wherein:

each operational mode of the plurality of operational modes is associated with a different predetermined rule of the plurality of predetermined rules;

each predetermined rule of the plurality of predetermined rules defines a different image region of a received image to crop; and

each image region associated with each predetermined rule includes at least a portion of the received image that is mutually exclusive with another image region associated with another predetermined rule of the plurality of predetermined rules;

cropping, by the information processing device, based at least in part on the first predetermined rule, a first image region out of the first image;

analyzing, by the information processing device, the first image region to identify data associated with the first image region; and

causing, by the information processing device, based at least in part on the data, the head-mounted display to display a second image different from the first image.

2 . The information processing device of claim 1 , wherein:

analyzing the first image region includes determining three-dimensional information regarding a surrounding space of the head-mounted display; and

the second image includes play area in which the user wearing the head-mounted display is movable.

3 . The information processing device of claim 2 , further comprising determining, by the information processing device, a posture of the user, wherein analyzing the first image region includes identifying a floor surface based at least in part on the posture.

4 . The information processing device of claim 2 , wherein analyzing the first image region includes analyzing the first image region to identify a floor surface in the three-dimensional information based at least in part on information regarding a direction of gravity that is indicated by a motion sensor incorporated in the head-mounted display.

5 . The information processing device of claim 4 , further comprising cropping, by the information processing device, the floor surface out of the first image.

6 . The information processing device of claim 1 , further comprising expanding the first image region when a positional change of the head-mounted display per unit time is smaller than a threshold value.

7 . The information processing device of claim 1 , further comprising cropping, by the information processing device, a second image region based at least in part on the data.

8 . The information processing device of claim 7 , wherein the data includes a direction of an optical axis of the camera.

9 . The information processing device of claim 1 , wherein:

the data includes a position and a posture of the head-mounted display.

10 . The information processing device of claim 1 , wherein the first image region includes a plurality of image regions.

11 . A computer-implemented method comprising:

receiving, by an electronic device from a camera in a head-mounted display, a first image;

determining, by the electronic device, based at least in part on a user selection, a first operational mode of the electronic device from a plurality of operational modes;

identifying, by the electronic device, a first predetermined rule associated with the first operational mode from a plurality of predetermined rules, wherein:

each operational mode of the plurality of operational modes is associated with a different predetermined rule of the plurality of predetermined rules;

each predetermined rule of the plurality of predetermined rules defines a different image region of a received image to crop; and

each image region associated with each predetermined rule includes at least a portion of the received image that is mutually exclusive with another image region associated with another predetermined rule of the plurality of predetermined rules;

cropping, by the electronic device, based at least in part on the first predetermined rule, a first image region out of the first image;

analyzing, by the electronic device, the first image region to identify data associated with the first image region; and

causing, by the electronic device, based at least in part on the data, the head-mounted display to display a second image different from the first image.

12 . The computer-implemented method of claim 11 , wherein:

the first operational mode is an application operational mode corresponding to an execution of a user-selected application; and

the data includes feature data used in the execution of the user-selected application.

13 . The computer-implemented method of claim 12 , wherein the user-selected application includes a video game application.

14 . The computer-implemented method of claim 11 , wherein the first predetermined rule includes cropping a central interior region of the received image.

15 . The computer-implemented method of claim 11 , wherein the first predetermined rule includes cropping a region of an image based at least in part on a direction of an optical axis of the camera.

16 . The computer-implemented method of claim 11 , wherein cropping the first image region is performed prior to analyzing the first image region.

17 . One or more non-transitory computer-readable media comprising computer-executable instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform operations comprising:

receiving, by an electronic device from a camera in a head-mounted display, a first image;

determining, by the electronic device, based at least in part on a user selection, a first operational mode of the electronic device from a plurality of operational modes;

identifying, by the electronic device, a first predetermined rule associated with the first operational mode from a plurality of predetermined rules, wherein:

each operational mode of the plurality of operational modes is associated with a different predetermined rule of the plurality of predetermined rules;

each predetermined rule of the plurality of predetermined rules defines a different image region of a received image to crop; and

each image region associated with each predetermined rule includes at least a portion of the received image that is mutually exclusive with another image region associated with another predetermined rule of the plurality of predetermined rules;

cropping, by the electronic device, based at least in part on the first predetermined rule, a first image region out of the first image;

analyzing, by the electronic device, the first image region to identify data associated with the first image region; and

causing, by the electronic device, based at least in part on the data, the head- mounted display to display a second image different from the first image.

18 . The one or more non-transitory computer-readable media of claim 17 , wherein:

the first operational mode is an application operational mode corresponding to an execution of a user-selected application; and

the data includes feature data used in the execution of the user-selected application.

19 . The one or more non-transitory computer-readable media of claim 17 , wherein the first predetermined rule includes cropping a central interior region of the received image.

20 . The one or more non-transitory computer-readable media of claim 17 , wherein the first predetermined rule includes cropping a region of an image based at least in part on a direction of an optical axis of the camera.