IP Library › Granted Patent US 12,266,133
Granted Patent B2
US 12,266,133 · App. 18/167,410 · Granted Apr 1, 2025

Image capture apparatus and control method thereof

Inventor: Tadayoshi Ono (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
G06T7/70H04N23/66G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,266,133
App. No.
18/167,410
Filed
Feb 10, 2023
Granted
Apr 1, 2025
Kind
B2
Art Unit
2486
USPC
348/143
Abstract

An image capture apparatus comprises a controller that controls the image capture apparatus so as to output, to an external, data of a first image for detecting a position and orientation of the image capture apparatus, and capture a second image of an external display apparatus displaying the first image, The controller further controls the image capture apparatus so as to capture, a third image, of which background is the external display apparatus displaying a fourth image that is generated in accordance with the position and orientation of the image capture apparatus detected based on data of the second image data.

Claims (31)

1. An image capture apparatus comprising:

one or more processors that execute a program stored in a memory and thereby function as a controller that controls operation of the image capture apparatus,

wherein the controller controls the image capture apparatus so as to repeatedly execute (1) to (3):

(1) output, to an external, data for detecting a position and orientation of the image capture apparatus;

(2) capture a first image of an external display apparatus displaying an image based on the data; and

(3) capture, a second image, of which background is the external display apparatus displaying a third image that is generated in accordance with the position and orientation of the image capture apparatus detected based on the first image, and

wherein the controller controls the image capture apparatus such that frequencies of (1) and (2) to be lower when a magnitude of motion of the image capture apparatus is less than a threshold than when the magnitude is greater than or equal to the threshold.

2. The image capture apparatus according to claim 1 ,

wherein the image capture apparatus captures a part of a display screen of the external display apparatus, and

the image based on the data is an image that enables the image capture apparatus to identify which part of the display screen has been captured by the image capture apparatus from data of the second image.

3. The image capture apparatus according to claim 1 ,

wherein the third image is computer graphics (CG) representing a virtual space observed from the image capture apparatus.

4. The image capture apparatus according to claim 1 ,

wherein the first image and the second image are captured according to control by an external device different from the external display apparatus.

5. The image capture apparatus according to claim 4 , wherein the controller further controls the image capture apparatus so as to:

output, for the external device to detect the position and orientation of the image capture apparatus, the first image.

6. The image capture apparatus according to claim 4 , wherein the controller further controls the image capture apparatus so as to:

detect the position and orientation of the image capture apparatus based on the first image and a plurality of three-dimensional positions of the external display apparatus; and

output, to the external device, information on the position and orientation detected.

7. The image capture apparatus according to claim 6 ,

wherein the plurality of three-dimensional positions are supplied from the external device.

8. A control method executed by an image capture apparatus, the control method comprising:

(1) outputting, to an external, data for detecting a position and orientation of the image capture apparatus;

(2) capturing a first image of an external display apparatus displaying an image based on the data; and

(3) capturing, a second image, of which background is the external display apparatus displaying a third image that is generated in accordance with the position and orientation of the image capture apparatus detected based on the first image, and

wherein (1) to (3) are repeatedly executed and execution frequencies of (1) and (2) are lower when a magnitude of motion of the image capture apparatus is less than a threshold than when the magnitude is greater than or equal to the threshold.

9. A non-transitory computer-readable medium storing one or more programs including executable instructions for causing a computer of an image capture apparatus to repeatedly execute:

(1) outputting, to an external, data for detecting a position and orientation of the image capture apparatus;

(2) capturing a first image of an external display apparatus displaying an image based on the data; and

(3) capturing, a second image, of which background is the external display apparatus displaying a third image that is generated in accordance with the position and orientation of the image capture apparatus detected based on the first image, and

wherein execution frequencies of (1) and (2) are lower when a magnitude of motion of the image capture apparatus is less than a threshold than when the magnitude is greater than or equal to the threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2023
From: ONO, TADAYOSHI
To: CANON KABUSHIKI KAISHA
Reel/Frame 062898/0493 →
Priority Claims (1)
JP 2022-021432 · Feb 15, 2022 · national
Continuity (1)
Related Publication 20230260150A1 · Aug 17, 2023
References Cited (3)
US 11375179B1 · Clemens · 2022 [cited by examiner]
JP 3631151B2 · 2005 [cited by applicant]
WO WO2023095392A1 · 2023 [cited by examiner]