IP Library Granted Patent US 12,306,403
Granted Patent B2
US 12,306,403 · App. 17/838,340 · Granted May 20, 2025

Electronic device and method for controlling electronic device

Inventor: Takumi Tsuchiya (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
G02B27/0172H04N23/617H04N23/69G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,306,403
App. No.
17/838,340
Granted
May 20, 2025
Kind
B2
Abstract

An electronic device, for supporting image capturing by an imaging apparatus, includes at least one processor and/or at least one circuit which function as: a generating unit configured to generate a first object in a virtual space corresponding to a current image capturing range of the imaging apparatus, and a second object in a virtual space corresponding to an image capturing range in a case where the imaging apparatus has a predetermined position and a predetermined orientation; and a display control unit configured to display the first object and the second object.

Claims (45)

1. An electronic device for supporting image capturing by an imaging apparatus, the electronic device comprising at least one processor and/or at least one circuit which function as:

a generating unit configured to generate, in a virtual space, a first object indicating a current image capturing range of the imaging apparatus, and a second object presenting, as a moving destination of the first object, an image capturing range in a case where the imaging apparatus has a predetermined position and a predetermined orientation; and

a display control unit configured to display the first object and the second object,

wherein, when the generating unit determines that a user of the image capturing apparatus has caused the first object to overlay with the second object, the generating unit generates the second object corresponding to an image capturing range in a case where the imaging apparatus has a newly determined predetermined position and a newly determined predetermined orientation.

2. The electronic device according to claim 1 , wherein

the display control unit displays the first object and the second object in a state of superimposing the first object and the second object on an image in which a real space is captured.

3. The electronic device according to claim 1 , wherein

the generating unit determines the predetermined position and the predetermined orientation, based on path information which indicates a future movement of the imaging apparatus.

4. The electronic device according to claim 3 , wherein

the path information is inputted by a user.

5. The electronic device according to claim 3 , wherein

the path information includes at least any of: a movement to move the imaging apparatus straight at a constant speed; a movement to rotate the imaging apparatus in a horizontal direction around the imaging apparatus or a user; a movement to rotate the imaging apparatus at a constant speed around an imaging axis of the imaging apparatus; and a movement to rotate the imaging apparatus around a subject.

6. The electronic device according to claim 3 , wherein

based on the path information, the generating unit generates a plurality of the second objects by regarding a position and an orientation of the imaging apparatus at each of a plurality of timings in the future as the predetermined position and the predetermined orientation.

7. The electronic device according to claim 1 , wherein

the generating unit determines the predetermined position and the predetermined orientation, based on changes between the position and orientation of the imaging apparatus in the past and the current position and orientation of the imaging apparatus, and generates the second object.

8. The electronic device according to claim 7 , wherein

the generating unit further generates a third object in a virtual space corresponding to an image capturing range in the case where the imaging apparatus has the position and the orientation in the past, and

the display control unit further displays the third object.

9. The electronic device according to claim 1 , wherein

the at least one processor and/or the at least one circuit further function as an acquiring unit configured to acquire information on a virtual space by recognizing a position of an object and a distance to the object in a real space.

10. The electronic device according to claim 1 , wherein

the generating unit generates the first object such that the position of the first object becomes any of: a position at a focal distance of the imaging apparatus; a position at a predetermined distance from the imaging apparatus; and a position where a size of the first object becomes a predetermined size.

11. The electronic device according to claim 1 , wherein

the generating unit generates the second object such that a relative relationship of the predetermined position and the position of the second object becomes the same as a relative relationship of the current position of the imaging apparatus and the position of the first object.

12. The electronic device according to claim 1 , wherein

the display control unit displays the second object in a case where a difference of the positions or a difference of the orientations between the first object and the second object is a threshold or more.

13. The electronic device according to claim 1 , wherein

the display control unit displays the second object in a case where a moving speed of the electronic device is not constant, or a case where a path of the movement of the electronic device is irregular.

14. The electronic device according to claim 1 , wherein

the imaging apparatus is integrated into the electronic device.

15. The electronic device according to claim 1 , wherein

the imaging apparatus is separated from the electronic device.

16. The electronic device according to claim 1 , wherein

the electronic device is a head mounted type display device.

17. The electronic device according to claim 1 , wherein

the generating unit requests an external device to perform processing to generate the first object and the second object, and acquires the first object and the second object generated by the external device.

18. A method for controlling an electronic device for supporting image capturing by the imaging apparatus, the method comprising:

a generation step of generating, in a virtual space, a first object indicating a current image capturing range of the imaging apparatus, and a second object presenting, as a moving destination of the first object, an image capturing range in a case where the imaging apparatus has a predetermined position and a predetermined orientation; and

a display control step of displaying the first object and the second object,

wherein, when it is determined that a user of the imaging apparatus has caused the first object to overlay with the second object, the second object, which corresponds to an image capturing range in a case where the imaging apparatus has a newly determined predetermined position and a newly determined predetermined orientation, is generated.

19. A non-transitory computer-readable medium that stores a program, wherein the program causes a computer to execute a control method of an electronic device for supporting image capturing by the imaging apparatus, the control method comprising:

a generation step of generating, in a virtual space, a first object indicating a current image capturing range of the imaging apparatus, and a second object presenting, as a moving destination of the first object, an image capturing range in a case where the imaging apparatus has a predetermined position and a predetermined orientation; and

a display control step of displaying the first object and the second object

wherein, when it is determined that a user of the imaging apparatus has caused the first object to overlay with the second object, the second object, which corresponds to an image capturing range in a case where the imaging apparatus has a newly determined predetermined position and a newly determined predetermined orientation, is generated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2022
From: TSUCHIYA, TAKUMI
To: CANON KABUSHIKI KAISHA
Reel/Frame 060343/0691 →
Priority Claims (1)
JP 2021-103950 · Jun 23, 2021 · national
Continuity (1)
Related Publication 20220413295A1 · Dec 29, 2022
References Cited (23)
US 10447966B2 · Ritchey · 2019 [cited by examiner]
US 10896545B1 · Kin · 2021 [cited by examiner]
US 20140072274A1 · Nitta et al. · 2014 [cited by applicant]
US 20140210955A1 · Fujita · 2014 [cited by examiner]
US 20180352144A1 · Miao · 2018 [cited by examiner]
US 20190005728A1 · Leppanen · 2019 [cited by examiner]
US 20190362556A1 · Ben-Dor · 2019 [cited by examiner]
US 20200307616A1 · Nithiyanantham · 2020 [cited by examiner]
US 20210058609A1 · Takahashi et al. · 2021 [cited by applicant]
US 20210116249A1 · Pecota · 2021 [cited by examiner]
US 20210142565A1 · Lekse · 2021 [cited by examiner]
US 20210173480A1 · Osterhout · 2021 [cited by examiner]
US 20210365707A1 · Mao · 2021 [cited by examiner]
US 20210375048A1 · Kang · 2021 [cited by examiner]
US 20210390780A1 · Canberk · 2021 [cited by examiner]
US 20210405363A1 · Canberk · 2021 [cited by examiner]
US 20210409628A1 · Kalkgruber · 2021 [cited by examiner]
JP 2011193286A · 2011 [cited by applicant]
JP 2013165366A · 2013 [cited by applicant]
JP 2017069911A · 2017 [cited by applicant]
JP 2020167499A · 2020 [cited by applicant]
WO 2019013204A · 2019 [cited by applicant]
The above foreign patent documents were cited in the Apr. 15, 2025 Japanese Office Action, which is enclosed without an English Translation, that issued in Japanese Patent Application No. 2021-103950. [cited by applicant]