IP Library Granted Patent US 11,836,883
Granted Patent B2
US 11,836,883 · App. 17/745,295 · Granted Dec 5, 2023

Display control device, display control method, and recording medium

Inventor: Shingo Tsurumi (Saitama, JP)
Assignee: SONY CORPORATION
G06T19/20G06F3/011G06F3/017G06F3/04815G06F3/04883G06T7/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,883
App. No.
17/745,295
Granted
Dec 5, 2023
Kind
B2
Abstract

There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Claims (46)

1. A display control device comprising:

an operation acquisition part configured to acquire user operation information of a user operation; and

a display controller configured to

place a virtual object within a space corresponding to a real space in accordance with a recognition result of a real object in the real space shown in an image captured by an image capturing device,

move the virtual object within the space based on the user operation specifying the virtual object, and

control to shift a display position of the virtual object in the space from a first position to a second position on a basis of an environment of the real space corresponding to the first position to which the virtual object is moved based on the user operation.

2. The display control device according to claim 1 ,

wherein the display controller is further configured to move the virtual object based on the user operation specifying the virtual object with an operation part separately from the display control device.

3. The display control device according to claim 1 ,

wherein the display controller is further configured to shift the display position of the virtual object to a movement-capable region on a basis of the environment of the virtual object.

4. The display control device according to claim 3 ,

wherein, in a case where the environment of the virtual object is a movement-incapable region, the display controller is further configured to shift the display position of the virtual object to a movement-capable region on a basis of the environment of the virtual object.

5. The display control device according to claim 1 ,

wherein the display controller is further configured to move the virtual object by changing a position and an attitude of the image capturing device during the user operation specifying the virtual object with an operation part separately from the display control device.

6. The display control device according to claim 1 ,

wherein the display controller is further configured to cause the virtual object to move within the space under a state where a relative position relationship between the image capturing device and the virtual object is maintained.

7. The display control device according to claim 1 ,

wherein the display controller is further configured to cause the virtual object to move within the space with a predetermined motion.

8. The display control device according to claim 1 ,

wherein the user operation is an operation specifying the virtual object and includes using one or more operating objects to specify the virtual object.

9. The display control device according to claim 8 ,

wherein the operation specifying the virtual object includes an operation of tapping the virtual object.

10. The display control device according to claim 1 ,

wherein the display control device is head mounted display (HMD).

11. The display control device according to claim 1 ,

wherein the display controller is further configured to change a size of the virtual object based on an operation of changing a distance between multiple operating objects detected by a sensor.

12. The display control device according to claim 11 ,

wherein the display controller is further configured to limit a size change of the virtual object.

13. The display control device according to claim 11 ,

wherein the operation of changing a distance between multiple operation objects is pinch-open operation.

14. The display control device according to claim 1 ,

wherein the display controller is further configured to place the virtual object in a manner that the virtual object has an attitude corresponding to a gravity vector.

15. The display control device according to claim 1 ,

wherein the display controller is further configured to place the virtual object in accordance with a position and attitude of the real object.

16. The display control device according to claim 1 ,

wherein the display controller is further configured to cause the virtual object to perform a predetermined motion on a basis of the environment of the virtual object.

17. A display control method comprising:

acquiring user operation information of a user operation;

placing a virtual object within a space corresponding to a real space in accordance with a recognition result of a real object in the real space shown in an image captured by an image capturing device;

moving the virtual object within the space based on the user operation specifying the virtual object; and

controlling to shift a display position of the virtual object in the space from a first position to a second position on a basis of an environment of the real space corresponding to the first position to which the virtual object is moved based on the user operation.

18. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer, causes the computer to execute a method, the method comprising:

acquiring user operation information of a user operation;

placing a virtual object within a space corresponding to a real space in accordance with a recognition result of a real object in the real space shown in an image captured by an image capturing device;

moving the virtual object within the space based on the user operation specifying the virtual object; and

controlling to shift a display position of the virtual object in the space from a first position to a second position on a basis of an environment of the real space corresponding to the first position to which the virtual object is moved based on the user operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2022
From: TSURUMI, SHINGO
To: SONY CORPORATION
Reel/Frame 060381/0837 →
Priority Claims (1)
JP 2013-068395 · Mar 28, 2013 · national
Continuity (6)
Continuation 17162535 · Jan 29, 2021
Continuation 16927665 · Jul 13, 2020
Continuation 15855377 · Dec 27, 2017
Continuation 15045246 · Feb 16, 2016
Continuation 14169474 · Jan 31, 2014
Related Publication 20220277531A1 · Sep 1, 2022