IP Library › Granted Patent US 12,112,425
Granted Patent B2
US 12,112,425 · App. 17/846,026 · Granted Oct 8, 2024

Information processing apparatus, method of operating information processing apparatus, and program for generating virtual viewpoint image

Inventors: Kazunori Tamura (Saitama, JP); Takashi Aoki (Saitama, JP); Fuminori Irie (Saitama, JP); Masahiko Miyata (Saitama, JP); Yasunori Murakami (Saitama, JP)
Assignee: FUJIFILM Corporation
G06T15/20G06T7/0002G06T2207/30168G06T2207/30221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,112,425
App. No.
17/846,026
Granted
Oct 8, 2024
Kind
B2
Abstract

An information processing apparatus includes a processor and a memory connected to or incorporated in the processor. The processor acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and generates the virtual viewpoint image by using the reference imaging device information as a reference, on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given.

Claims (33)

1. An information processing apparatus comprising:

a processor; and

a memory that is connected to or incorporated in the processor,

wherein the processor

acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and

on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given,

generates the virtual viewpoint image by using the reference imaging device information as a reference, wherein a position, an imaging direction, and an angle of view of the virtual viewpoint image match the position, the imaging direction, and the angle of view of the reference imaging device.

2. The information processing apparatus according to claim 1 , wherein in a case where the reference imaging device information is continuously transmitted by a transmission device, the processor is configured to generate the virtual viewpoint image by using, as a reference, the reference imaging device information transmitted from the transmission device, on a condition that the instruction is given.

3. The information processing apparatus according to claim 1 , wherein the processor is configured to update the reference imaging device information each time the processor acquires the reference imaging device information.

4. The information processing apparatus according to claim 1 , wherein the processor is configured to

acquire image quality information indicating an image quality of a first reference image obtained by imaging the imaging region with the reference imaging device, and

determine an image quality of the virtual viewpoint image on the basis of the image quality information on a condition that the instruction is given.

5. The information processing apparatus according to claim 1 , wherein the processor is configured to output a superimposed image in which the virtual viewpoint image is superimposed on a second reference image obtained by imaging the imaging region with the reference imaging device, on a condition that the instruction is given.

6. The information processing apparatus according to claim 5 , wherein the processor is configured to gradually change a ratio between the second reference image and the virtual viewpoint image in the superimposed image.

7. The information processing apparatus according to claim 1 , wherein the processor is configured to

output the virtual viewpoint image to a display, and

receive a change signal for continuously changing at least one of a viewpoint position, a line-of-sight direction, or an angle of view in the output virtual viewpoint image.

8. The information processing apparatus according to claim 1 ,

wherein the reference imaging device is an imaging device capable of changing at least one of the position, the imaging direction, or the angle of view.

9. The information processing apparatus according to claim 1 , wherein the processor is configured to acquire the reference imaging device information on the basis of a third reference image obtained by imaging the imaging region with the reference imaging device.

10. The information processing apparatus according to claim 1 ,

wherein the reference imaging device information is the position, the imaging direction, and the angle of view of the reference imaging device.

11. The information processing apparatus according to claim 1 ,

wherein the reference imaging device is one of the plurality of imaging devices.

12. The information processing apparatus according to claim 11 ,

wherein the reference imaging device is capable of being switched between the plurality of imaging devices.

13. The information processing apparatus according to claim 1 , wherein the processor is configured to

output a fourth reference image obtained by imaging the imaging region with the reference imaging device,

acquire the reference imaging device information, and

generate a virtual viewpoint image corresponding to the fourth reference image by using the reference imaging device information as a reference, on a condition that the instruction is given.

14. A method of operating an information processing apparatus including a processor and a memory connected to or incorporated in the processor, the method comprising:

acquiring reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device; and

on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given, generating the virtual viewpoint image by using the reference imaging device information as a reference, wherein, a position, an imaging direction, and an angle of view of the virtual viewpoint image match the position, the imaging direction, and the angle of view of the reference imaging device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2022
From: TAMURA, KAZUNORI; AOKI, TAKASHI; IRIE, FUMINORI; MIYATA, MASAHIKO; MURAKAMI, YASUNORI
To: FUJIFILM CORPORATION
Reel/Frame 060281/0111 →
Priority Claims (1)
JP 2019-237438 · Dec 26, 2019 · national
Continuity (2)
Continuation PCTJP2020041983 · Nov 10, 2020
Related Publication 20220319102A1 · Oct 6, 2022
Cited By (1)
US 12,462,344