IP Library Granted Patent US 11,348,326
Granted Patent B2
US 11,348,326 · App. 17/162,535 · Granted May 31, 2022

Display control device, display control method, and recording medium

Inventor: Shingo Tsurumi (Saitama, JP)
Assignee: SONY CORPORATION
G06T19/20G06F3/011G06F3/017G06F3/04815G06F3/04883G06T7/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,348,326
App. No.
17/162,535
Granted
May 31, 2022
Kind
B2
Abstract

There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Claims (50)

1. A display control device comprising:

an image capturing device configured to capture an image of a real space;

a touch sensor configured to detect a user operation;

a display configured to display the image captured by the image capturing device; and

a display controller configured to place a virtual object within an augmented reality space corresponding to the real space in accordance with a recognition result of a real object in the real space, the virtual object displayed by being superimposed on the image,

wherein the display controller is further configured to move the virtual object within the augmented reality space in accordance with the user operation which is a touch operation specifying the virtual object, and control a movement of the virtual object within the augmented reality space on a basis of an environment of a destination of the real space corresponding to a position of the augmented reality space where the virtual object is moved in accordance with the user operation.

2. The display control device according to claim 1 ,

wherein the display controller causes a display position of the virtual object to be shifted on a basis of the environment of the real space corresponding to a where the virtual object is moved in accordance with the user operation.

3. The display control device according to claim 1 ,

wherein the display controller causes a display position of the virtual object to be shifted to a movement-capable region on a basis of the environment of the virtual object at the destination.

4. The display control device according to claim 3 ,

wherein, in a case where the environment of the virtual object at the destination is a movement-incapable region, the display controller causes the display position of the virtual object to be shifted to a movement-capable region on a basis of the environment of the virtual object at the destination.

5. The display control device according to claim 1 ,

wherein the display controller causes the virtual object to move within the augmented reality space in accordance with a change of a position and attitude of the image capturing device.

6. The display control device according to claim 5 ,

wherein the display controller causes the virtual object to move within the augmented reality space under a state where a relative position relationship between the image capturing device and the virtual object is maintained.

7. The display control device according to claim 1 ,

wherein the display controller causes the virtual object to move within the augmented reality space with a predetermined motion.

8. The display control device according to claim 1 ,

wherein the user operation is an operation specifying the virtual object and includes using one or more operating objects to specify the virtual object.

9. The display control device according to claim 8 ,

wherein the operation specifying the virtual object includes an operation of tapping the virtual object.

10. The display control device according to claim 1 ,

wherein the display control device is a smartphone.

11. The display control device according to claim 1 ,

wherein the display controller is further configured to change a size of the virtual object based on an operation of changing a distance between multiple operating objects detected by the touch sensor.

12. The display control device according to claim 11 ,

wherein the display controller is further configured to limit a size change of the virtual object.

13. The display control device according to claim 11 ,

wherein the operation of changing a distance between multiple operation objects is pinch-open operation.

14. The display control device according to claim 1 ,

wherein the display controller places the virtual object in a manner that the virtual object has an attitude corresponding to a gravity vector.

15. The display control device according to claim 1 ,

wherein the display controller places the virtual object in accordance with a position and attitude of the real object.

16. The display control device according to claim 1 ,

wherein the display controller causes the virtual object to perform a predetermined motion on a basis of the environment of the virtual object at the destination.

17. A display control method comprising:

capturing an image of a real space;

detecting a user operation;

displaying the image;

placing a virtual object within an augmented reality space corresponding to the real space in accordance with a recognition result of a real object in the real space, the virtual object displayed by being superimposed on the image;

moving the virtual object within the augmented reality space in accordance with the user operation which is a touch operation specifying the virtual object; and

controlling a movement of the virtual object within the augmented reality space on a basis of an environment of a destination of the real space corresponding to a position of the augmented reality space where the virtual object is moved in accordance with the user operation.

18. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer, causes the computer to execute a method, the method comprising:

capturing an image of a real space;

detecting a user operation;

displaying the image;

placing a virtual object within an augmented reality space corresponding to the real space in accordance with a recognition result of a real object in the real space, the virtual object displayed by being superimposed on the image;

moving the virtual object within the augmented reality space in accordance with the user operation which is a touch operation specifying the virtual object; and

controlling a movement of the virtual object within the augmented reality space on a basis of an environment of a destination of the real space corresponding to a position of the augmented reality space where the virtual object is moved in accordance with the user operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2021
From: TSURUMI, SHINGO
To: SONY CORPORATION
Reel/Frame 055180/0394 →
Priority Claims (1)
JP JP2013-068395 · Mar 28, 2013 · national
Continuity (5)
Continuation 16927665 · Jul 13, 2020
Continuation 15855377 · Dec 27, 2017
Continuation 15045246 · Feb 16, 2016
Continuation 14169474 · Jan 31, 2014
Related Publication 20210150823A1 · May 20, 2021
Cited By (1)
US 12,417,604