IP Library › Granted Patent US 11,831,854
Granted Patent B2
US 11,831,854 · App. 17/312,111 · Granted Nov 28, 2023

Information processing system, information processing method, and computer program

Inventor: Koji Ohata (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
H04N13/122H04N13/156H04N13/344H04N13/366
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,831,854
App. No.
17/312,111
Granted
Nov 28, 2023
Kind
B2
Abstract

An information processing apparatus acquires a first image obtained by imaging a real space. The information processing apparatus generates a display image by merging the first image into a second image representing a virtual space to be presented to a user wearing a head-mounted display (HMD), the display image being configured such that the first image has an inconspicuous border. The information processing apparatus displays the generated display image on the HMD.

Claims (20)

1. An information processing system comprising:

an acquisition section configured to acquire a first image obtained by imaging an event taking place in a real space, where the real space includes real elements that are a focus of the event and real peripheral elements establishing a venue having an entertainment setting in which the event takes place, where real elements that are the focus of the event are circumscribed by a peripheral boundary and the real peripheral elements of the venue are not within the peripheral boundary;

a generation section configured to generate a display image by merging the first image into a second image representing a virtual space that establishes an alternative version of the entertainment setting of the venue where the event takes place by: (i) reproducing the real elements that are the focus of the event up to the peripheral boundary, (ii) omitting the real peripheral elements of the venue are not within the peripheral boundary, and (iii) presenting alternative virtual elements from the peripheral boundary and outward instead of the real peripheral elements, such that the first image has an inconspicuous border at the peripheral boundary when the display image is presented to a user wearing a head-mounted display; and

an output section configured to display the display image generated by the generation section, on the head-mounted display.

2. The information processing system according to claim 1 , wherein the second image includes an object covering at least part of the border of the first image.

3. The information processing system according to claim 2 , wherein the object is an image of an item corresponding to a type of the virtual space represented by the second image.

4. The information processing system according to claim 2 , wherein

the first image is obtained by imaging an event taking place on stage, and

the object is an image representing furnishings on a stage.

5. The information processing system according to claim 1 , wherein the generation section generates a display image in which at least part of a boundary between the first image and the second image is unclear.

6. The information processing system according to claim 5 , wherein the generation section choose, as a color of a portion of the second image that is close to the boundary with the first image, a color closely analogous to a color of a portion of the first image that is close to the boundary.

7. The information processing system according to claim 5 , wherein the generation section sets the portion of the second image that is close to the boundary with the first image, to a relatively low image quality.

8. An information processing method causing a computer to perform:

acquiring a first image obtained by imaging an event taking place in a real space, where the real space includes real elements that are a focus of the event and real peripheral elements establishing a venue having an entertainment setting in which the event takes place, where real elements that are the focus of the event are circumscribed by a peripheral boundary and the real peripheral elements of the venue are not within the peripheral boundary;

generating a display image by merging the first image into a second image representing a virtual space that establishes an alternative version of the entertainment setting of the venue where the event takes place by: (i) reproducing the real elements that are the focus of the event up to the peripheral boundary, (ii) omitting the real peripheral elements of the venue are not within the peripheral boundary, and (iii) presenting alternative virtual elements from the peripheral boundary and outward instead of the real peripheral elements, such that the first image has an inconspicuous border at the peripheral boundary when the display image is presented to a user wearing a head-mounted display; and

displaying the display image on the head-mounted display.

9. A non-transitory, computer readable storage medium containing a computer program, which when executed by a computer, causes the computer to perform an information processing method by carrying out actions, comprising:

acquiring a first image obtained by imaging an event taking place in a real space, where the real space includes real elements that are a focus of the event and real peripheral elements establishing a venue having an entertainment setting in which the event takes place, where real elements that are the focus of the event are circumscribed by a peripheral boundary and the real peripheral elements of the venue are not within the peripheral boundary;

generating a display image by merging the first image into a second image representing a virtual space that establishes an alternative version of the entertainment setting of the venue where the event takes place by: (i) reproducing the real elements that are the focus of the event up to the peripheral boundary, (ii) omitting the real peripheral elements of the venue are not within the peripheral boundary, and (iii) presenting alternative virtual elements from the peripheral boundary and outward instead of the real peripheral elements, such that the first image has an inconspicuous border at the peripheral boundary when the display image is presented to a user wearing a head-mounted display; and

displaying the display image on the head-mounted display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2021
From: OHATA, KOJI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 056484/0830 →
Continuity (1)
Related Publication 20220030210A1 · Jan 27, 2022