IP Library Granted Patent US 11,205,360
Granted Patent B2
US 11,205,360 · App. 16/917,683 · Granted Dec 21, 2021

Display control apparatus, display control method, and non-transitory computer-readable storage medium

Inventor: Yasuo Okutani (Kawasaki, JP)
Assignee: Canon Kabushiki Kaisha
G09G3/06G06F3/0412G06T15/20G06T19/00G09G5/14G09G5/377G06T1/00G09G5/00G09G2320/068H04N7/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,205,360
App. No.
16/917,683
Granted
Dec 21, 2021
Kind
B2
Abstract

A plurality of virtual viewpoint images corresponding to positions and directions of a plurality of virtual viewpoints are displayed on an operation screen for an operation associated with the position and direction of the virtual viewpoint. The virtual viewpoint image corresponding to the virtual viewpoint selected as a position and direction operation target among the plurality of virtual viewpoints is generated based on a plurality of captured images obtained by capturing an image capturing target region by a plurality of cameras, and is transmitted to another apparatus.

Claims (52)

1. A display control apparatus comprising:

one or more hardware processors; and

one or more memories which store instructions executable by the one or more hardware processors to cause the display control apparatus to perform at least:

receiving an input associated with first operation for changing a position of a virtual viewpoint corresponding to a virtual viewpoint image;

causing a display screen to display a plurality of virtual viewpoint images corresponding respectively to a plurality of virtual viewpoints, wherein a position of a virtual viewpoint of the plurality of virtual viewpoints is changeable based on the received input associated with the first operation; and

receiving an input associated with second operation for selecting at least one virtual viewpoint image from among the plurality of virtual viewpoint images displayed on the display screen,

wherein a virtual viewpoint image corresponding to a virtual viewpoint selected based on the received input associated with the second operation is generated based on a plurality of captured images obtained by image capturing with a plurality of imaging apparatuses.

2. The display control apparatus according to claim 1 , wherein the virtual viewpoint image corresponding to the virtual viewpoint selected based on the received input associated with the second operation is output to another apparatus.

3. The display control apparatus according to claim 2 , wherein the virtual viewpoint image corresponding to the selected virtual viewpoint is output by broadcasting.

4. The display control apparatus according to claim 2 , wherein the instructions further cause the display control apparatus to perform:

outputting, to a generation apparatus for generating a virtual viewpoint image, information indicating a position of a virtual viewpoint changed based on the received input associated with the first operation, and

wherein the virtual viewpoint image generated by the generation apparatus is output to another apparatus.

5. The display control apparatus according to claim 2 , wherein the instructions further cause the display control apparatus to perform:

switching, in response to the received input associated with the second operation, a virtual viewpoint corresponding to a virtual viewpoint image to be output to another apparatus.

6. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

receiving an input associated with third operation for newly registering a virtual viewpoint, and

wherein in response to the received input associated with the third operation, the number of virtual viewpoint images displayed on the display screen increases.

7. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

receiving an input associated with third operation for switching a virtual viewpoint image displayed on the display screen, and

wherein in response to the received input associated with the third operation, virtual viewpoint images displayed on the display screen switch from a first set of virtual viewpoint images corresponding to a first set of virtual viewpoints to a second set of virtual viewpoint images corresponding to a second set of virtual viewpoints.

8. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

receiving an input associated with third operation for deleting a virtual viewpoint, and

wherein in response to the received input associated with the third operation, the number of virtual viewpoint images displayed on the display screen decreases.

9. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

receiving an input associated with third operation for rearranging virtual viewpoint images displayed on the display screen, and

wherein in response to the received input associated with the third operation, the virtual viewpoint images displayed on the display screen are rearranged.

10. The display control apparatus according to claim 1 , wherein the virtual viewpoint image corresponding to the virtual viewpoint selected based on the received input associated with the second operation is displayed with larger size on the display screen than sizes of other virtual viewpoint images displayed on the display screen.

11. The display control apparatus according to claim 1 , wherein the virtual viewpoint image corresponding to the virtual viewpoint selected based on the received input associated with the second operation is displayed with a higher frame rate on the display screen than frame rates of other virtual viewpoint images displayed on the display screen.

12. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

generating a virtual viewpoint image corresponding to a position of a virtual viewpoint changed based on the received input associated with the first operation.

13. The display control apparatus according to claim 1 , wherein a virtual viewpoint image corresponding to a virtual viewpoint selected based on the second operation is displayed at a position where a virtual viewpoint image corresponding to a virtual viewpoint selected before the second operation was displayed.

14. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

selecting a target virtual viewpoint whose position is to be changed based on the received input associated with the first operation from among the plurality of virtual viewpoint corresponding respectively to the plurality of virtual viewpoint images displayed on the display screen.

15. The display control apparatus according to claim 1 , wherein the instructions further cause the display control apparatus to perform:

receiving an input associated with third operation for changing a view direction corresponding to a virtual viewpoint, and

wherein a view direction corresponding to a virtual viewpoint of the plurality of virtual viewpoints is changeable based on the received input associated with the third operation.

16. A display control method comprising:

receiving an input associated with first operation for changing a position of a virtual viewpoint corresponding to a virtual viewpoint image;

causing a display screen to display a plurality of virtual viewpoint images corresponding respectively to a plurality of virtual viewpoints, wherein a position of a virtual viewpoint of the plurality of virtual viewpoints is changeable based on the received input associated with the first operation; and

receiving an input associated with second operation for selecting at least one virtual viewpoint image from among the plurality of virtual viewpoint images displayed on the display screen,

wherein a virtual viewpoint image corresponding to a virtual viewpoint selected based on the received input associated with the second operation is generated based on a plurality of captured images obtained by image capturing with a plurality of imaging apparatuses.

17. The display control method according to claim 16 , wherein the virtual viewpoint image corresponding to the selected virtual viewpoint is output by broadcasting.

18. The display control method according to claim 16 , further comprising:

generating a virtual viewpoint image corresponding to a position of a virtual viewpoint changed based on the received input associated with the first operation; and

outputting the generated virtual viewpoint image to another apparatus.

19. The display control method according to claim 16 , further comprising

selecting a target virtual viewpoint whose position is to be changed based on the received input associated with the first operation from among the plurality of virtual viewpoint corresponding respectively to the plurality of virtual viewpoint images displayed on the display screen.

20. A non-transitory computer-readable storage medium for storing a computer program for causing a computer to perform a display control method comprising:

receiving an input associated with first operation for changing a position of a virtual viewpoint corresponding to a virtual viewpoint image;

causing a display screen to display a plurality of virtual viewpoint images corresponding respectively to a plurality of virtual viewpoints, wherein a position of a virtual viewpoint of the plurality of virtual viewpoints is changeable based on the received input associated with the first operation; and

receiving an input associated with second operation for selecting at least one virtual viewpoint image from among the plurality of virtual viewpoint images displayed on the display screen,

wherein a virtual viewpoint image corresponding to a virtual viewpoint selected based on the received input associated with the second operation is generated based on a plurality of captured images obtained by image capturing with a plurality of imaging apparatuses.

Priority Claims (1)
JP JP2017-245392 · Dec 21, 2017 · national
Continuity (3)
Continuation 16701910 · Dec 3, 2019
Continuation PCTJP2018042948 · Nov 21, 2018
Related Publication 20200335020A1 · Oct 22, 2020
Cited By (1)
US 12,675,962