IP Library › Granted Patent US 11,606,503
Granted Patent B2
US 11,606,503 · App. 16/922,913 · Granted Mar 14, 2023

Information processing apparatus, setting method, and storage medium

Inventors: Kazuhiro Matsubayashi (Yokohama, JP); Rei Ishikawa (Wako, JP)
Assignee: Canon Kabushiki Kaisha
H04N5/23296H04N5/2224H04N5/23206H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,503
App. No.
16/922,913
Granted
Mar 14, 2023
Kind
B2
Abstract

An information processing apparatus includes a first reception unit configured to receive an input corresponding to an operation on a first operation unit, a second reception unit configured to receive an input corresponding to an operation on a second operation unit, a first setting unit configured to set a target position to be included in a visual field according to a virtual viewpoint corresponding to a virtual viewpoint image, based on an input received by the first reception unit, and a second setting unit configured to set a position and orientation of the virtual viewpoint relative to the target position, based on an input received by the second reception unit.

Claims (46)

1. An information processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

receive a first input;

receive a second input corresponding to an operation on a second operation unit;

receive a third input corresponding to an operation on a third operation unit;

set, based on the received first input, a target position to be included in a visual field according to a first virtual viewpoint corresponding to a first virtual viewpoint image and a visual field according to a second virtual viewpoint corresponding to a second virtual viewpoint image; and

set, based on the received second input, a position of the first virtual viewpoint relative to the set target position and view direction from the first virtual viewpoint relative to the set target position, and set, based on the received third input, a position of the second virtual viewpoint relative to the set target position and view direction from the second virtual viewpoint relative to the set target position.

2. The information processing apparatus according to claim 1 , wherein the position of the first virtual viewpoint and the view direction from the first virtual viewpoint are set in an associated manner so that the target position exists in a predetermined direction when viewed from the first virtual viewpoint.

3. The information processing apparatus according to claim 2 , wherein the predetermined direction is the view direction from the first virtual viewpoint.

4. The information processing apparatus according to claim 2 , wherein the predetermined direction is a direction set based on a user operation.

5. The information processing apparatus according to claim 1 , wherein the one or more processors further execute the instructions to receive a fourth input corresponding to an operation on a fourth operation unit, and

wherein the target position in a three-dimensional space is set based on the received first input and the received third input.

6. The information processing apparatus according to claim 1 , wherein the one or more processors further execute the instructions to receive a fifth input corresponding to an operation on a fifth operation unit, and

wherein a three-dimensional position of the first virtual viewpoint, and the view direction from the first virtual viewpoint in a pan direction and a tilt direction are set based on the received second input and the received fifth input.

7. The information processing apparatus according to claim 6 , wherein the view direction from the first virtual viewpoint in a roll direction based on the received fifth input.

8. The information processing apparatus according to claim 1 , wherein the one or more processors further execute the instructions to set a viewing angle of the visual field according to the first virtual viewpoint based on the received second input.

9. The information processing apparatus according to claim 1 , the one or more processors further execute the instructions to receive a sixth input corresponding to an operation on a sixth operation unit,

wherein a first target position is set based on the received first input and sets a second target position is set based on the received sixth input, and

wherein the position of the first virtual viewpoint and of the view direction from the first virtual viewpoint relative to a selected target position from among a plurality of target positions including the first and the second target positions are set based on the received second input.

10. The information processing apparatus according to claim 1 , wherein the one or more processors further execute the instructions to:

instruct a first display unit to display an image indicating the set target position; and

instruct a second display unit to display an image according to the set position of the first virtual viewpoint and the set view direction from the first virtual viewpoint.

11. The information processing apparatus according to claim 10 , wherein the first and the second display units are display units of different display apparatuses.

12. The information processing apparatus according to claim 10 , wherein the first and the second display units are different display areas of the same display apparatus.

13. The information processing apparatus according to claim 1 , wherein the one or more processors further execute the instructions to output information indicating the position of the set first virtual viewpoint and the set view direction from the first virtual viewpoint to a generating device configured to generate the virtual viewpoint image based on a plurality of images acquired by capturing an imaging region from different directions by using a plurality of imaging apparatuses and the output information.

14. A setting method comprising:

receiving a first input;

receiving a second input corresponding to an operation on a second operation unit;

receiving a third input corresponding to an operation on a third operation unit;

setting, based on the received first input, a target position to be included in a visual field according to a first virtual viewpoint corresponding to a first virtual viewpoint image and a visual field according to a second virtual viewpoint corresponding to a second virtual viewpoint image; and

setting, based on the received second input, a position of the first virtual viewpoint relative to the set target position and view direction from the first virtual viewpoint relative to the set target position, and set, based on the received third input, a position of the second virtual viewpoint relative to the set target position and view direction from the second virtual viewpoint relative to the set target position.

15. The setting method according to claim 14 , wherein the position of the first virtual viewpoint and the view direction from the first virtual viewpoint are set in an associated manner so that the target position exists in a predetermined direction when viewed from the first virtual viewpoint.

16. The setting method according to claim 14 ,

wherein the first input corresponds to an operation on a first operation unit,

wherein the target position is set based on an operation on the first operation unit by a first user, and

wherein the position and orientation of the virtual viewpoint are set based on an operation on the second operation unit by a second user.

17. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a setting method, the setting method comprising:

receiving a first input;

receiving a second input corresponding to an operation on a second operation unit;

receiving a third input corresponding to an operation on a third operation unit;

setting, based on the received first input, a target position to be included in a visual field according to a first virtual viewpoint corresponding to a first virtual viewpoint image and a visual field according to a second virtual viewpoint corresponding to a second virtual viewpoint image; and

setting, based on the received second input, a position of the first virtual viewpoint relative to the set target position and view direction from the first virtual viewpoint relative to the set target position, and set, based on the received third input, a position of the second virtual viewpoint relative to the set target position and view direction from the second virtual viewpoint relative to the set target position.

18. The information processing apparatus according to claim 1 , wherein the first input corresponds to an operation on a first operation unit.

19. The information processing apparatus according to claim 18 , wherein the first and the second operation units are operation units separately provided in different housings.

20. The information processing apparatus according to claim 18 , wherein the first and the second operation units are different joy sticks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2020
From: MATSUBAYASHI, KAZUHIRO; ISHIKAWA, REI
To: CANON KABUSHIKI KAISHA
Reel/Frame 054013/0732 →
Priority Claims (1)
JP JP2019-129614 · Jul 11, 2019 · national
Continuity (1)
Related Publication 20210014425A1 · Jan 14, 2021