IP Library › Granted Patent US 11,558,598
Granted Patent B2
US 11,558,598 · App. 17/182,416 · Granted Jan 17, 2023

Control apparatus and control method for same

Inventor: Tomohiro Yano (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N13/279H04N13/282H04N13/293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,558,598
App. No.
17/182,416
Granted
Jan 17, 2023
Kind
B2
Abstract

A control apparatus which controls a virtual camera according to a user operation related to an operation of the virtual camera, when the control apparatus accepts the user operation, determines whether or not to restrict moving of the virtual camera according to the accepted user operation depending on whether or not a predetermined condition for the virtual camera is fulfilled.

Claims (37)

1. A control apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

specify a position of a virtual viewpoint and a direction of a view from the virtual viewpoint;

accept input to move the virtual viewpoint corresponding to a virtual viewpoint image; and

restrict a movement of the virtual viewpoint to a specific region based on the direction of the view from the virtual viewpoint,

wherein in a case where the movement of the virtual viewpoint is continuously restricted for a predetermined time, control for moving the virtual viewpoint to a predetermined position is performed, and

wherein the movement of the virtual viewpoint to the specific region is restricted in a case where an angle formed by the direction of the view from the virtual viewpoint and a normal direction of a boundary surface of the specific region is within a specific angle range, and the movement of the virtual viewpoint to the specific region is not restricted in a case where the angle formed by the direction of the view from the virtual viewpoint and the normal direction of the boundary surface of the specific region is not within the specific angle range.

2. The control apparatus according to claim 1 , wherein the specific angle range is a range in which an angle formed by the normal direction of the boundary surface of the specific region and the direction of the view from the virtual viewpoint equals or falls below a predetermined value.

3. The control apparatus according to claim 1 , wherein the specific angle range is a range in which an elevation angle of the direction of the view from the virtual viewpoint equals or exceeds a predetermined value.

4. The control apparatus according to claim 1 , wherein the specific angle range is a range in which a proportion of a field of view of the virtual viewpoint that is occupied by the specific region equals or exceeds a threshold.

5. The control apparatus according to claim 1 , wherein the virtual viewpoint image is generated based on a plurality of captured images that are obtained by capturing images from multiple directions using a plurality of image capturing devices.

6. The control apparatus according to claim 5 , wherein the specific region is a region included in at least one of the plurality of captured images.

7. The control apparatus according to claim 1 , wherein restricting the movement of the virtual viewpoint includes control for invalidating input for moving the virtual viewpoint.

8. The control apparatus according to claim 1 , wherein restricting the movement of the virtual viewpoint includes control for reducing a moving speed of the virtual viewpoint.

9. The control apparatus according to claim 1 , wherein restricting the movement of the virtual viewpoint includes control for delaying a start of the movement of the virtual viewpoint to an outside of the specific region.

10. The control apparatus according to claim 1 , wherein the specific region is a region in an underground, in a case where an elevation angle of the direction of the view from the virtual viewpoint is less than a predetermined value, the movement of the virtual viewpoint is restricted so that the virtual viewpoint does not move into the specific region in accordance with input for moving the virtual viewpoint vertically downward.

11. The control apparatus according to claim 1 , wherein the direction of the view from the virtual viewpoint is restricted if the virtual viewpoint is positioned inside the specific region.

12. The control apparatus according to claim 1 , wherein the direction of the view from the virtual viewpoint is changed to a direction within the specific angle range in a case where a predetermined condition is fulfilled under a situation in which the virtual viewpoint is positioned outside the specific region and the direction of the view from the virtual viewpoint is inside the specific angle range.

13. The control apparatus according to claim 1 , wherein the position of the virtual viewpoint is changed to a position inside the specific region in a case where a predetermined condition is fulfilled under a situation in which the virtual viewpoint is positioned inside the specific region.

14. A control method comprising:

specifying a position of a virtual viewpoint and a direction of a view from the virtual viewpoint;

accepting input to move the virtual viewpoint corresponding to a virtual viewpoint image; and

restricting a movement of the virtual viewpoint to a specific region based on the direction of the view from the virtual viewpoint,

wherein in the restricting, the movement of the virtual viewpoint to the specific region is restricted in a case where an angle formed by the direction of the view from the virtual viewpoint and a normal direction of a boundary surface of the specific region is within a specific angle range, and the movement of the virtual viewpoint to the specific region is not restricted in a case where the angle formed by the direction of the view from the virtual viewpoint and the normal direction of the boundary surface of the specific region is not within the specific angle range.

15. A computer-readable storage medium storing a computer program for causing a computer to perform a control method comprising:

specifying a position of a virtual viewpoint and a direction of a view from the virtual viewpoint;

accepting input to move the virtual viewpoint corresponding to a virtual viewpoint image; and

restricting a movement of the virtual viewpoint to a specific region based on the direction of the view from the virtual viewpoint,

wherein in the restricting, the movement of the virtual viewpoint to the specific region is restricted in a case where an angle formed by the direction of the view from the virtual viewpoint and a normal direction of a boundary surface of the specific region is within a specific angle range, and the movement of the virtual viewpoint to the specific region is not restricted in a case where the angle formed by the direction of the view from the virtual viewpoint and the normal direction of the boundary surface of the specific region is not within the specific angle range.

16. The control apparatus according to claim 1 , wherein in a case where the movement of the virtual viewpoint is continuously restricted for the predetermined time, control for moving the virtual viewpoint to the predetermined position is performed.

17. The control apparatus according to claim 16 , wherein the predetermined position is a position outside the specific region.

18. The control apparatus according to claim 1 , wherein in a case where the movement of the virtual viewpoint is continuously restricted for the predetermined time, the direction of the view from the virtual viewpoint is changed to the specific angle range.

19. The control apparatus according to claim 1 , wherein the specific region is a region whose boundaries are planes that are specified based on a plurality of coordinate axes in a virtual space.

20. The control apparatus according to claim 1 , wherein the specific region is a region determined based on a three-dimensional model.

21. The control apparatus according to claim 20 , wherein the specific region is a region in a three-dimensional space in which a three-dimensional model of an object is present.

22. The control apparatus according to claim 21 , wherein the region in which the three-dimensional model of the object is present is a region in which at least one of a three-dimensional model of a foreground object, a three-dimensional model of a background object, and a three-dimensional model of a virtual object is present.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2021
From: YANO, TOMOHIRO
To: CANON KABUSHIKI KAISHA
Reel/Frame 055792/0066 →
Priority Claims (1)
JP JP2018-167210 · Sep 6, 2018 · national
Continuity (2)
Continuation PCTJP2019033550 · Aug 27, 2019
Related Publication 20210176450A1 · Jun 10, 2021
Cited By (1)
US 12,513,276