IP Library › Granted Patent US 11,141,557
Granted Patent B2
US 11,141,557 · App. 16/285,682 · Granted Oct 12, 2021

Information processing apparatus, information processing method, and storage medium

Inventor: Yoshiko Iida (Yokohama, JP)
Assignee: CANON KABUSHIKI KAISHA
A61M21/02G06T7/215G06T19/003H04N21/21805A61M2021/005A61M2205/507
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,141,557
App. No.
16/285,682
Granted
Oct 12, 2021
Kind
B2
Abstract

Provided is an information processing apparatus comprising: a first obtaining unit configured to obtain viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on the basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses; a second obtaining unit configured to obtain condition information indicating a condition associated with the amount of change of a background in the virtual viewpoint video; a determination unit configured to determine whether the viewpoint information obtained by the first obtaining unit satisfies the condition indicated by the condition information obtained by the second obtaining unit; and an output unit configured to output information according to the result of the determination by the determination unit.

Claims (40)

1. An information processing apparatus comprising:

a first obtaining unit configured to obtain viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on a basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses;

a second obtaining unit configured to obtain condition information indicating a condition associated with an amount of change of a background in the virtual viewpoint video;

a determination unit configured to determine whether the viewpoint information obtained by the first obtaining unit satisfies the condition indicated by the condition information obtained by the second obtaining unit; and

an output unit configured to output information according to a result of the determination by the determination unit.

2. The information processing apparatus according to claim 1 , wherein the information output from the output unit is information indicating an evaluation on visually-induced motion sickness due to the virtual viewpoint video.

3. The information processing apparatus according to claim 2 , wherein

on a basis of the viewpoint information obtained by the first obtaining unit, the determination unit determines whether the amount of change of the background in the virtual viewpoint video corresponding to the viewpoint information exceeds a threshold value corresponding to the condition information obtained by the second obtaining unit, and

the output unit outputs information indicating that the virtual viewpoint video causes visually-induced motion sickness, in a case where the determination unit determines that the amount of change of the background exceeds the threshold value.

4. The information processing apparatus according to claim 1 , wherein the condition information obtained by the second obtaining unit further indicates a condition associated with an amount of change of a foreground in the virtual viewpoint video.

5. The information processing apparatus according to claim 1 , wherein the condition information obtained by the second obtaining unit indicates a condition corresponding to an environment in which the virtual viewpoint video is to be viewed by a user.

6. The information processing apparatus according to claim 1 , wherein the condition information obtained by the second obtaining unit indicates a condition corresponding to a pattern of movement of the virtual viewpoint.

7. The information processing apparatus according to claim 1 , further comprising a display control unit configured to cause a display unit to display an image corresponding to the information output from the output unit.

8. The information processing apparatus according to claim 7 , wherein the display control unit causes the display unit to display information representing a virtual viewpoint recommended on a basis of the information output from the output unit.

9. The information processing apparatus according to claim 1 , wherein the output unit outputs information indicating the result of the determination by the determination unit and information for identifying a frame in the virtual viewpoint video according to the result of the determination, as the information according to the result of the determination.

10. The information processing apparatus according to claim 1 , wherein the output unit outputs information indicating the result of the determination by the determination unit and information indicating an area in the virtual viewpoint video in which the amount of change of the background is more than or equal to a threshold value, as the information according to the result of the determination.

11. The information processing apparatus according to claim 1 , wherein

the determination unit determines whether the viewpoint information satisfies the condition indicated by the condition information, for each of a plurality of periods in a playback period of the virtual viewpoint video, and

the output unit outputs information according to a result of the determination on each of the plurality of periods in the playback period.

12. The information processing apparatus according to claim 1 , further comprising a changing unit configured to change the viewpoint information obtained by the first obtaining unit, on a basis of the information output from the output unit.

13. The information processing apparatus according to claim 1 , further comprising a determination unit configured to determine a playback speed of the virtual viewpoint video on a basis of the information output from the output unit.

14. The information processing apparatus according to claim 1 , further comprising:

a third obtaining unit configured to obtain other viewpoint information indicating a virtual viewpoint determined on a basis of a user operation, after the output unit outputs the information according to the result of the determination; and

a generation unit configured to generate a virtual viewpoint video on a basis of the other viewpoint information determined by the third obtaining unit.

15. The information processing apparatus according to claim 14 , wherein the third obtaining unit determines the other virtual viewpoint on a basis of an input according to the user operation and user information.

16. The information processing apparatus according to claim 1 , wherein

the background is an area in the virtual viewpoint video other than a foreground corresponding to a predetermined object, and

the background in the virtual viewpoint video changes in accordance with change of the virtual viewpoint corresponding to the virtual viewpoint video.

17. The information processing apparatus according to claim 1 , wherein the viewpoint information obtained by the first obtaining unit indicates a position and direction of the virtual viewpoint at each of a plurality of time points.

18. The information processing apparatus according to claim 1 , wherein the determination unit determines whether the viewpoint information satisfies the condition indicated by the condition information, on a basis of a position and direction of the virtual viewpoint indicated by the viewpoint information in a three-dimensional space and a position of an object in the three-dimensional space.

19. An information processing method comprising:

obtaining viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on a basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses;

obtaining condition information indicating a condition associated with an amount of change of a background in the virtual viewpoint video;

determining whether the obtained viewpoint information satisfies the condition indicated by the condition information; and

outputting information according to a result of the determination.

20. A non-transitory computer readable storage medium storing a program which performs an image processing method, the method comprising:

obtaining viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on a basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses;

obtaining condition information indicating a condition associated with an amount of change of a background in the virtual viewpoint video;

determining whether the obtained viewpoint information satisfies the condition indicated by the condition information; and

outputting information according to a result of the determination.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2019
From: IIDA, YOSHIKO
To: CANON KABUSHIKI KAISHA
Reel/Frame 049386/0885 →
Priority Claims (1)
JP JP2018-036651 · Mar 1, 2018 · national
Continuity (1)
Related Publication 20190269881A1 · Sep 5, 2019