IP Library Granted Patent US 9,992,419
Granted Patent B2
US 9,992,419 · App. 14/778,047 · Granted Jun 5, 2018

Display control apparatus for displaying a virtual object

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,992,419
App. No.
14/778,047
Granted
Jun 5, 2018
Kind
B2
Abstract

A display control apparatus includes: an image acquisition section that acquires a captured image obtained by imaging an imaging range; and a display control section that controls a display section in such a way that a virtual object corresponding to an imaging subject reflecting on the captured image is displayed. The display control section displays the virtual object in such a way that a ratio of an amount of movement of the virtual object in a virtual image to an amount of movement of the imaging range in real space changes according to an imaging magnification of the captured image.

Claims (43)

1. A display control apparatus, comprising:

one or more processors configured to:

control a camera to acquire a first image of an imaging region in real space,

wherein the imaging region in the real space comprises at least one real subject in the real space, and

wherein the imaging region in the real space moves based on an imaging direction of the camera;

acquire from a storage medium, a virtual image that represents at least one portion of the at least one real subject, based on an amount of features of the at least one real subject;

extract a virtual object from the virtual image, based on a first amount of movement of the imaging region in the real space and an imaging magnification amount of the first image; and

control a display device to display the virtual object such that the virtual object moves within the virtual image by a second amount of movement,

wherein the second amount of movement is based on the first amount of movement of the imaging region in the real space and the imaging magnification amount of the first image.

2. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to:

control the display device to display the virtual object,

wherein a ratio of the second amount of movement of the virtual object in the virtual image to the first amount of movement of the imaging region in the real space decreases with an increase in the imaging magnification amount of the first image.

3. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to prohibit movement of the virtual object in the virtual image, based on the first amount of movement of the imaging region in the real space that is smaller than a first threshold.

4. The display control apparatus according to claim 3 , wherein the one or more processors are further configured to change the first threshold based on the imaging magnification amount of the first image.

5. The display control apparatus according to claim 4 , wherein the one or more processors are further configured to increase the first threshold based on the imaging magnification amount of the first image that is higher than a minimum imaging magnification value.

6. The display control apparatus according to claim 3 , wherein the one or more processors are further configured to prohibit movement of the virtual object in the virtual image, based on the first amount of movement of the imaging region in the real space that is larger than a second threshold.

7. The display control apparatus according to claim 6 , wherein the one or more processors are further configured to change the second threshold, based on the imaging magnification amount of the first image.

8. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to perform one of:

control the display device to display the first image, based on sharpness of the first image that exceeds a threshold value; or

control the display device to display the virtual object, based on the sharpness of the first image that is less than the threshold value.

9. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to control the display device to display a range of the imaging magnification amount of the first image in which a clarity level of the virtual object in the display device is within a threshold range.

10. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to control the display device to display a recommended imaging magnification range associated with the virtual image.

11. The display control apparatus according to claim 10 , wherein the one or more processors are further configured to control the display device to display the recommended imaging magnification range associated with each of a plurality of areas of the virtual image.

12. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to:

control a filter circuit to filter the virtual object, based on the first image; and

display the filtered virtual object.

13. The display control apparatus according to claim 1 , wherein the one or more processors are further configured to display the virtual object such that a posture of the virtual object changes based on the imaging magnification amount of the first image.

14. A display control method, comprising:

controlling a camera for acquiring a first image of an imaging region in real space,

wherein the imaging region in the real space comprises at least one real subject in the real space, and

wherein the imaging region in the real space moves based on an imaging direction of the camera;

acquiring from a storage medium, a virtual image that represents at least one portion of the at least one real subject, based on an amount of features of the at least one real subject;

extracting a virtual object from the virtual image, based on a first amount of movement of the imaging region in the real space and an imaging magnification amount of the first image; and

controlling a display device to display the virtual object such that the virtual object moves within the virtual image by a second amount of movement,

wherein the second amount of movement is based on the first amount of movement of the imaging region in the real space and the imaging magnification amount of the first image.

15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions for causing a computer to execute operations, the operations comprising:

controlling a camera for acquiring a first image of an imaging region in real space,

wherein the imaging region in the real space comprises at least one real subject in the real space, and

wherein the imaging region in the real space moves based on an imaging direction of the camera;

acquiring from a storage medium, a virtual image that represents at least one portion of the at least one real subject, based on an amount of features of the at least one real subject;

extracting a virtual object from the virtual image, based on a first amount of movement of the imaging region in the real space and an imaging magnification amount of the first image; and

controlling a display device to display the virtual object such that the virtual object moves within the virtual image by a second amount of movement,

wherein the second amount of movement is based on the first amount of movement of the imaging region in the real space and the imaging magnification amount of the first image.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2015
From: NIELSEN, FRANK
To: SONY CORPORATION
Reel/Frame 036630/0464 →