IP Library › Granted Patent US 12,353,613
Granted Patent B2
US 12,353,613 · App. 18/530,399 · Granted Jul 8, 2025

Information processing apparatus and information processing method

Inventors: Atsushi Ishihara (Kanagawa, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Hiroyuki Aga (Tokyo, JP); Koichi Kawasaki (Tokyo, JP); Mitsuru Nishibe (Chiba, JP); Yuji Kusano (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06F3/011G02B27/0172G02B27/0176G06F3/017G06F3/147G06T19/006G02B2027/0138G02B2027/014G02B2027/0178G09G3/003G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,613
App. No.
18/530,399
Granted
Jul 8, 2025
Kind
B2
Abstract

An information processing apparatus including circuitry that acquires information indicating a spatial relationship between a real object and a virtual object, and initiate generation of a user feedback based on the acquired information, the user feedback being displayed to be augmented to a generated image obtained based on capturing by an imaging device, or augmented to a perceived view of the real world, and wherein a characteristic of the user feedback is changed when the spatial relationship between the real object and the virtual object changes.

Claims (38)

1. An information processing apparatus, comprising:

circuitry configured to:

receive positional information of a real object in a real space;

initiate to display a virtual object in the real space;

initiate to display a virtual indicator; and

control, based on a distance between the real object and the virtual object, a size of the virtual indicator, wherein

a first size of the virtual indicator for a first value of the distance is larger than a second size of the virtual indicator for a second value of the distance, and

the first value of the distance is larger than the second value of the distance.

2. The information processing apparatus according to claim 1 , wherein the real object is a hand of a user of the information processing apparatus.

3. The information processing apparatus according to claim 1 , wherein the real object is a pointer held by a user of the information processing apparatus.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to calculate the distance based on information of a position at which the virtual object is in the real space and the positional information of the real object.

5. The information processing apparatus according to claim 1 , wherein the virtual indicator has a ring shape.

6. The information processing apparatus according to claim 1 , wherein the circuitry is configured to control a radius of the virtual indicator such that sharpness of the virtual indicator increases as the distance decreases.

7. The information processing apparatus according to claim 1 , further comprising a sensor configured to acquire the positional information of the real object.

8. The information processing apparatus according to claim 1 , wherein the size of the virtual indicator is smallest based on the real object that touches the virtual object.

9. A method, comprising:

receiving positional information of a real object in a real space;

initiating to display a virtual object in the real space;

initiating to display a virtual indicator; and

controlling, based on a distance between the real object and the virtual object, a size of the virtual indicator, wherein

a first size of the virtual indicator for a first value of the distance is larger than a second size of the virtual indicator for a second value of the distance, and

the first value of the distance is larger than the second value of the distance.

10. An information processing apparatus, comprising:

circuitry configured to:

receive positional information of a real object in a real space;

initiate to display a virtual object in the real space; and

control, based on the positional information, a transparency of the virtual object.

11. The information processing apparatus according to claim 10 , wherein the circuitry is configured to increase the transparency of the virtual object based on the real object that enters into a determined range.

12. The information processing apparatus according to claim 10 , wherein the transparency is semitransparent.

13. The information processing apparatus according to claim 10 , wherein the real object is a hand of a user of the information processing apparatus.

14. The information processing apparatus according to claim 10 , wherein the real object is a pointer held by a user of the information processing apparatus.

15. The information processing apparatus according to claim 10 , wherein the virtual object has a first transparency based on the real object is in front of the virtual object and has a second transparency based on the real object is behind the virtual object.

16. A method, comprising:

receiving positional information of a real object in a real space;

initiating to display a virtual object in the real space; and

controlling, based on the positional information, a transparency of the virtual object.

17. The method according to claim 16 , further comprising increasing the transparency of the virtual object based on the real object that enters into a determined range.

18. The method according to claim 16 , wherein the virtual object has a first transparency based on the real object is in front of the virtual object and has a second transparency based on the real object is behind the virtual object.

Assignments (1)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
Priority Claims (1)
JP 2015-073561 · Mar 31, 2015 · national
Continuity (5)
Continuation 17893496 · Aug 23, 2022
Continuation 17168231 · Feb 5, 2021
Continuation 16566477 · Sep 10, 2019
Continuation 15560111
Related Publication 20240111358A1 · Apr 4, 2024
References Cited (44)
US 10452128B2 · Ishihara et al. · 2019 [cited by applicant]
US 10948977B2 · Ishihara et al. · 2021 [cited by applicant]
US 11449133B2 · Ishihara et al. · 2022 [cited by applicant]
US 11868517B2 · Ishihara · 2024 [cited by examiner]
US 20110154201A1 · Nakanishi · 2011 [cited by examiner]
US 20120206452A1 · Geisner et al. · 2012 [cited by applicant]
US 20120218395A1 · Andersen et al. · 2012 [cited by applicant]
US 20130147793A1 · Jeon et al. · 2013 [cited by applicant]
US 20130335303A1 · Maciocci et al. · 2013 [cited by applicant]
US 20140204002A1 · Bennet et al. · 2014 [cited by applicant]
US 20140292809A1 · Tsurumi · 2014 [cited by applicant]
US 20140354602A1 · He et al. · 2014 [cited by applicant]
US 20150130715A1 · Izumi · 2015 [cited by examiner]
US 20150193940A1 · Shoji · 2015 [cited by applicant]
US 20160125656A1 · James et al. · 2016 [cited by applicant]
CN 102473322A · 2012 [cited by applicant]
CN 103164518A · 2013 [cited by applicant]
CN 103635869A · 2014 [cited by applicant]
CN 103858073A · 2014 [cited by applicant]
CN 104335142A · 2015 [cited by applicant]
CN 104407701A · 2015 [cited by applicant]
EP 2862042A1 · 2015 [cited by applicant]
JP 2015519673A · 2015 [cited by applicant]
KR 1020150023702A · 2015 [cited by applicant]
WO 2013093906A1 · 2013 [cited by applicant]
WO 2013188054A1 · 2013 [cited by applicant]
Volkert Buchmann, Trond T. Nilsen, and Mark Billinghurst, University of South Australia, Interaction With Partially Transparent Hands and Objects, Jan. 2005, Conference: User Interfaces 2005, Sixth Australasian User Int… [cited by examiner]
Office Action for JP Patent Application No. 2015-073561, issued on Jun. 18, 2019, 07 pages of Office Action and 06 pages of English Translation. [cited by applicant]
Office Action for EP Patent Application No. 16712095.5, issued on Mar. 13, 2019, 13 pages of Office Action. [cited by applicant]
International Search Report and Written Opinion of PCT Application No. PCT/JP2016/000871, issued on Jul. 20, 2016, 18 pages of ISRWO. [cited by applicant]
Intemational Preliminary Report on Patentability of PCT Application No. PCT/JP2016/000871, issued on Oct. 12, 2017, 15 pages of IPRP. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/560,111, issued on Feb. 5, 2019, 14 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/560,111, issued on Jun. 19, 2019, 13 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/560,111, issued on Jul. 15, 2019, 03 pages. [cited by applicant]
Office Action for EP Patent Application No. 16712095.5, issued on Dec. 2, 2019, 23 pages of Office Action. [cited by applicant]
Office Action for CN Patent Application No. 201680017768.7, issued on Mar. 19, 2020, 10 pages of Office Action and 16 pages of English Translation. [cited by applicant]
Ex Parte Quayle Action for U.S. Appl. No. 16/566,477 issued on Aug. 17, 2020, 08 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/566,477, issued on Nov. 4, 2020, 09 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/168,231, issued on May 16, 2022, 10 pages. [cited by applicant]
Advisory Action for U.S. Appl. No. 17/168,231, issued on Apr. 4, 2022, 3 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/168,231, issued on Sep. 16, 2021, 14 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/168,231, issued on Jan. 24, 2022, 12 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/893,496, issued on Sep. 1, 2023, 09 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/893,496, issued on May 24, 2023, 20 pages. [cited by applicant]