IP Library Granted Patent US 12,417,604
Granted Patent B2
US 12,417,604 · App. 18/597,932 · Granted Sep 16, 2025

Display control device, display control method, and recording medium

Inventor: Shingo Tsurumi (Saitama, JP)
Assignee: SONY CORPORATION
G06T19/20G06F3/011G06F3/017G06F3/04815G06F3/04883G06T7/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,604
App. No.
18/597,932
Granted
Sep 16, 2025
Kind
B2
Abstract

There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Claims (39)

1. An information processing system comprising:

circuitry configured to:

acquire an image of a real space captured by an image capturing device;

control a displaying of a virtual object in the image as a first size, wherein a distance between the virtual object at a first position and the image capturing device is a first distance in a space corresponding to the real space;

control a displaying of the virtual object in the image as a second size in response to a change in the distance from the first distance to a second distance further than the first distance in the space; and

control a displaying of a change of a display position of the virtual object from the first position in the space to a second position in the space different from the first position in response to a user operation.

2. The information processing system according to claim 1 , further comprising:

the image capturing device.

3. The information processing system according to claim 2 , wherein the circuitry is further configured to:

initiate change of an attitude of the virtual object in the image in response to acquiring a change of an attitude of the information processing system.

4. The information processing system according to claim 1 , wherein the user operation includes an operation of tapping the virtual object.

5. The information processing system according to claim 1 , wherein the user operation includes an operation of holding the virtual object between two operating objects.

6. The information processing system according to claim 5 , wherein the two operating objects include two fingers of a user.

7. The information processing system according to claim 1 , wherein the user operation is an operation of a gesture of looking at the virtual object.

8. The information processing system according to claim 1 , wherein, in a case where the second position is a movement-incapable region, the circuitry is further configured to shift a display position of the virtual object to a movement-capable region.

9. The information processing system according to claim 8 , wherein the movement-incapable region is a pillar or a wall.

10. The information processing system according to claim 1 , wherein the virtual object includes a plurality of virtual objects.

11. The information processing system according to claim 1 , wherein the circuitry is further configured to:

initiate a change of a size of the virtual object in the space in response to a second user operation.

12. The information processing system according to claim 11 , wherein the second user operation includes an operation of changing a distance between multiple operating objects detected by a sensor.

13. The information processing system according to claim 12 , wherein the size of the virtual object increases in response to an increase in the distance between the multiple operating objects.

14. The information processing system according to claim 12 , wherein the size of the virtual object has a limit on enlargement or reduction.

15. The information processing system according to claim 14 , wherein the circuitry is further configured to initiate a notice to a user based on the size of the virtual object reaching the limit.

16. An information processing method comprising:

acquiring an image of a real space captured by an image capturing device;

displaying a virtual object in the image as a first size, wherein a distance between the virtual object at a first position and the image capturing device is a first distance in a space corresponding to the real space;

displaying the virtual object in the image as a second size in response to a change in the distance from the first distance to a second distance further than the first distance in the space; and

displaying a change of a display position of the virtual object from the first position in the space to a second position in the space different from the first position in response to a user operation.

17. The information processing method according to claim 16 , wherein the user operation includes an operation of holding the virtual object between two operating objects.

18. The information processing method according to claim 16 , wherein the user operation is an operation of a gesture of looking at the virtual object.

19. The information processing method according to claim 16 , further comprising:

shifting, in a case where the second position is a movement-incapable region, a display position of the virtual object to a movement-capable region.

20. The information processing method according to claim 16 , further comprising:

changing of a size of the virtual object in the space in response to a second user operation.

21. An information processing system, comprising:

circuitry configured to:

acquire an image of a real space captured by an image capturing device;

control a displaying of a virtual object in the image as a first size, wherein a distance between the virtual object and the image capturing device is a first distance in a space corresponding to the real space; and

control a displaying of the virtual object in the image as a second size in response to change the distance from the first distance to a second distance further than the first distance in the space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2024
From: TSURUMI, SHINGO
To: SONY CORPORATION
Reel/Frame 066748/0705 →
Priority Claims (1)
JP 2013-068395 · Mar 28, 2013 · national
Continuity (8)
Continuation 18470971 · Sep 20, 2023
Continuation 17745295 · May 16, 2022
Continuation 17162535 · Jan 29, 2021
Continuation 16927665 · Jul 13, 2020
Continuation 15855377 · Dec 27, 2017
Continuation 15045246 · Feb 16, 2016
Continuation 14169474 · Jan 31, 2014
Related Publication 20240212304A1 · Jun 27, 2024
References Cited (62)
US 7991220B2 · Nagai et al. · 2011 [cited by applicant]
US 8072470B2 · Marks · 2011 [cited by applicant]
US 8872854B1 · Levitt · 2014 [cited by applicant]
US 8933931B2 · Balan et al. · 2015 [cited by applicant]
US 9165405B2 · Meier et al. · 2015 [cited by applicant]
US 9261954B2 · Tsurumi · 2016 [cited by applicant]
US 9886798B2 · Tsurumi · 2018 [cited by applicant]
US 10497175B2 · Mount et al. · 2019 [cited by applicant]
US 10922902B2 · Tsurumi · 2021 [cited by applicant]
US 11348326B2 · Tsurumi · 2022 [cited by applicant]
US 20020075286A1 · Yonezawa et al. · 2002 [cited by applicant]
US 20040021664A1 · Takemoto et al. · 2004 [cited by applicant]
US 20040109009A1 · Yonezawa et al. · 2004 [cited by applicant]
US 20040130579A1 · Ishii et al. · 2004 [cited by applicant]
US 20080024523A1 · Tomite et al. · 2008 [cited by applicant]
US 20080094417A1 · Cohen · 2008 [cited by applicant]
US 20080100620A1 · Nagai et al. · 2008 [cited by applicant]
US 20080111832A1 · Emam et al. · 2008 [cited by applicant]
US 20090066690A1 · Harrison · 2009 [cited by applicant]
US 20090066725A1 · Nogami et al. · 2009 [cited by applicant]
US 20100134516A1 · Cooper · 2010 [cited by applicant]
US 20110090252A1 · Yoon et al. · 2011 [cited by applicant]
US 20110304611A1 · Suzuki · 2011 [cited by applicant]
US 20110304639A1 · Noge · 2011 [cited by applicant]
US 20110304711A1 · Ito et al. · 2011 [cited by applicant]
US 20120030568A1 · Migos et al. · 2012 [cited by applicant]
US 20120056992A1 · Kuroda · 2012 [cited by applicant]
US 20120075424A1 · Kawamoto et al. · 2012 [cited by applicant]
US 20120105473A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120210255A1 · Ooi et al. · 2012 [cited by applicant]
US 20120212509A1 · Benko et al. · 2012 [cited by applicant]
US 20120250940A1 · Kasahara · 2012 [cited by applicant]
US 20120256956A1 · Kasahara · 2012 [cited by applicant]
US 20120256961A1 · Ogasawara et al. · 2012 [cited by applicant]
US 20120293549A1 · Osako · 2012 [cited by applicant]
US 20130095924A1 · Geisner et al. · 2013 [cited by applicant]
US 20130194304A1 · Latta et al. · 2013 [cited by applicant]
US 20130222410A1 · Kameyama et al. · 2013 [cited by applicant]
US 20130293584A1 · Anderson · 2013 [cited by applicant]
US 20130328762A1 · McCulloch et al. · 2013 [cited by applicant]
US 20130335301A1 · Wong et al. · 2013 [cited by applicant]
US 20130335405A1 · Scavezze et al. · 2013 [cited by applicant]
US 20140009494A1 · Kasahara · 2014 [cited by applicant]
US 20140078175A1 · Forutanpour et al. · 2014 [cited by applicant]
US 20140104274A1 · Hilliges et al. · 2014 [cited by applicant]
US 20140210858A1 · Kim · 2014 [cited by applicant]
US 20140218361A1 · Abe et al. · 2014 [cited by applicant]
US 20140267412A1 · Calian et al. · 2014 [cited by applicant]
US 20140282220A1 · Wantland et al. · 2014 [cited by applicant]
US 20140292809A1 · Tsurumi · 2014 [cited by applicant]
US 20140300633A1 · Sako et al. · 2014 [cited by applicant]
US 20140354686A1 · Mullins · 2014 [cited by applicant]
US 20140375691A1 · Kasahara · 2014 [cited by applicant]
US 20150022444A1 · Ooi · 2015 [cited by applicant]
US 20150029223A1 · Kaino et al. · 2015 [cited by applicant]
US 20150356787A1 · Abe et al. · 2015 [cited by applicant]
CN 102693005A · 2012 [cited by applicant]
CN 102750079A · 2012 [cited by applicant]
JP 2009237845A · 2009 [cited by applicant]
JP 2012058968A · 2012 [cited by applicant]
Andrew J. Davison “Real-Time Simultaneous Localisation and Mapping with a Single Camera”, Robotics Research Group, Dept. of Engineering Science, University of Oxford, Oct. 2003, 8 pages. [cited by applicant]
Jan. 26, 2017, CN communication issued for related CN application No. 201410108001.8. [cited by applicant]