IP Library Granted Patent US 12701206
Granted Patent B2
US 12701206 · App. 18/965,926 · Granted Aug 4, 2026

Information processing apparatus, information processing method, and program

Inventors: Kazunori Tamura (Saitama, JP); Fuminori Irie (Saitama, JP); Takashi Aoki (Saitama, JP); Masahiko Miyata (Saitama, JP)
Assignee: FUJIFILM CORPORATION
H04N13/117G06F1/1694H04N21/21805H04N21/2187G06F2200/1637
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12701206
App. No.
18/965,926
Granted
Aug 4, 2026
Kind
B2
Abstract

An information processing apparatus includes an acquisition unit that acquires a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction, and an execution unit that executes a specific process in a case in which a difference degree between the free viewpoint video acquired by the acquisition unit and the reference video acquired by the acquisition unit is equal to or more than a first threshold value.

Claims (50)

1 . An information processing apparatus comprising:

a processor; and

a memory built in or connected to the processor,

wherein the processor is configured to:

acquire a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction, and

execute a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value,

the specific process being a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value.

2 . The information processing apparatus according to claim 1 ,

wherein the specific process is a process including a notification process of giving notification based on the degree of similarity being less than the first threshold value.

3 . The information processing apparatus according to claim 2 ,

wherein the notification process is a process of giving at least one of visible notification, audible notification, or tactile notification based on the degree of similarity being less than the first threshold value.

4 . The information processing apparatus according to claim 1 ,

wherein the specific process is a process including a process of limiting a range in which the viewpoint position is able to be indicated to a viewpoint position range determined as a range in which the degree of similarity is set to be equal to or more than the first threshold value, and limiting a range in which the visual line direction is able to be indicated to a visual line direction range determined as a range in which the degree of similarity is set to be equal to or more than the first threshold value.

5 . The information processing apparatus according to claim 1 ,

wherein the specific process is a process including a change process of performing, on the free viewpoint video change for setting the difference degree to be less than the first threshold value.

6 . The information processing apparatus according to claim 5 ,

wherein the change process is a process of changing the free viewpoint video by changing at least one of the viewpoint position or the visual line direction.

7 . The information processing apparatus according to claim 1 ,

wherein the processor is configured to execute the specific process depending on a change in the free viewpoint video.

8 . The information processing apparatus according to claim 7 ,

wherein the processor selectively sets a following mode in which the processor executes the specific process while following the change in the free viewpoint video, and a non-following mode in which the processor does not execute the specific process while following the change in the free viewpoint video.

9 . The information processing apparatus according to claim 8 ,

wherein the processor is configured to set the following mode in a case in which a change amount of the degree of similarity is less than a second threshold value, and sets the non-following mode in a case in which the change amount is equal to or more than the second threshold value.

10 . The information processing apparatus according to claim 8 ,

wherein the processor is configured to set the following mode in a case in which a frequency at which the degree of similarity changes is less than a third threshold value, and sets the non-following mode in a case in which the frequency is equal to or more than the third threshold value.

11 . The information processing apparatus according to claim 1 ,

wherein the processor is configured to further display the free viewpoint video on a first display device.

12 . The information processing apparatus according to claim 11 , wherein:

the first display device includes a detector that detects a posture of the first display device, and

the processor is configured to execute the specific process in a case in which the posture detected by the detector is a predetermined posture, and does not execute the specific process in a case in which the posture detected by the detector is a posture different from the predetermined posture.

13 . The information processing apparatus according to claim 11 ,

wherein the processor is configured to display the reference video on a second display device different from the first display device.

14 . The information processing apparatus according to claim 1 ,

wherein the processor is configured to execute change in the first threshold value according to instruction information for giving an instruction for changing the first threshold value received by a reception device in a case in which the instruction information is received by the reception device.

15 . The information processing apparatus according to claim 1 ,

wherein the free viewpoint video is a virtual viewpoint video.

16 . The information processing apparatus according to claim 1 ,

wherein the reference video is a live broadcast video.

17 . The information processing apparatus according to claim 1 ,

wherein the reference video is an image obtained by imaging the imaging region by a reference imaging apparatus.

18 . The information processing apparatus according to claim 1 ,

wherein the viewpoint position and the visual line direction are a viewpoint position and a visual line direction as indicated from an outside.

19 . An information processing method comprising:

acquiring a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction; and

executing a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value,

wherein the specific process is a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value.

20 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute a process comprising:

acquiring a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction; and

executing a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value,

wherein the specific process is a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value.