IP Library Granted Patent US 11,308,670
Granted Patent B2
US 11,308,670 · App. 16/494,063 · Granted Apr 19, 2022

Image processing apparatus and method

Inventors: Kenji Tanaka (Kanagawa, JP); Satoshi Ihara (Kanagawa, JP); Cody Poultney (Ontario, CA)
Assignee: SONY CORPORATION
G06T11/60G06F3/04845G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,670
App. No.
16/494,063
Granted
Apr 19, 2022
Kind
B2
Abstract

The present technology relates to an image processing apparatus and method, and a program that are capable of more facilitating editing. The image processing apparatus includes: an operation detection unit configured to detect an operation input by an operation unit; and a display control unit configured to output, to an immersive presentation device, part or entirety of a spherical image on which an image of the operation unit is superimposed, as a presentation image, to cause the immersive presentation device to display the presentation image, the display control unit being configured to control, in a case where the operation input has been detected, the display of the presentation image such that the operation input is reflected. The present technology is applicable to an editing system.

Claims (30)

1. An image processing apparatus, comprising: circuitry configured to:

control an immersive presentation device to display a spherical image; superimpose an image of a control device on the spherical image to generate a presentation image representing the image of the control device in the immersive presentation device, wherein the presentation image includes an auxiliary screen that comprises a plurality of buttons, and each button of the plurality of buttons is associated with a corresponding edit operation of the spherical image;

control the immersive presentation device to display the presentation image;

detect an operation input from the control device, wherein the operation input corresponds to selection of at least one button of the plurality of buttons in the auxiliary screen such that the operation input is reflected on the presentation image; and

edit, based on the detected operation input associated with the edit, the spherical image in the presentation image displayed on the immersive presentation device.

2. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

generate the image of the control device based on a captured image of the control device, wherein the control device is captured as a subject in the captured image.

3. The image processing apparatus according to claim 2 , wherein the circuitry is further configured to:

control display of the image of the control device at a specific position on the spherical image, wherein the specific position of the image of the control device is based on a position of the immersive presentation device and an orientation of the immersive presentation device.

4. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

generate an image of a model of the control device as the image of the control device.

5. The image processing apparatus according to claim 4 , wherein the circuitry is further configured to:

control display of the image of the control device at a specific position on the spherical image, and wherein the specific position is based on a position of the control device and an orientation of the control device.

6. The image processing apparatus according to claim 1 , wherein the auxiliary screen is at a specific position on the presentation image.

7. The image processing apparatus according to claim 1 , wherein the auxiliary screen is at a specific position on the presentation image, and the specific position is based on a position of the immersive presentation device and an orientation of the immersive presentation device.

8. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

output the presentation image to a plurality of immersive presentation devices.

9. The image processing apparatus according to claim 1 , the circuitry is further configured to detect the operation input based on a position of the immersive presentation device and an orientation of the immersive presentation device.

10. An image processing method, comprising:

in an image processing apparatus:

controlling an immersive presentation device to display a spherical image;

superimposing an image of a control device on the spherical image to generate a presentation image representing the image of the control device in the immersive presentation device, wherein the presentation image includes an auxiliary screen that comprises a plurality of buttons, and each button of the plurality of buttons is associated with a corresponding edit operation of the spherical image;

controlling the immersive presentation device to display the presentation image;

detecting an operation input from the control device, wherein the operation input corresponds to selection of at least one button of the plurality of buttons in the auxiliary screen such that the operation input is reflected on the presentation image; and

editing, based on the detected operation input associated with the edit, the spherical image in the presentation image displayed in the immersive presentation device.

11. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling an immersive presentation device to display a spherical image; superimposing an image of a control device on the spherical image to generate a presentation image representing the image of the control device in the immersive presentation device, wherein the presentation image includes an auxiliary screen that comprises a plurality of buttons, and each button of the plurality of buttons is associated with a corresponding edit operation of the spherical image;

controlling the immersive presentation device to display the presentation image;

detecting an operation input from the control device, wherein the operation input corresponds to selection of at least one button of the plurality of buttons in the auxiliary screen such that the operation input is reflected on the presentation image; and

editing, based on the detected operation input associated with the edit, the spherical image in the presentation image displayed on the immersive presentation device.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2019
From: TANAKA, KENJI; IHARA, SATOSHI; POULTNEY, CODY
To: SONY CORPORATION
Reel/Frame 050984/0464 →