IP Library Granted Patent US 11,449,133
Granted Patent B2
US 11,449,133 · App. 17/168,231 · Granted Sep 20, 2022

Information processing apparatus and information processing method

Inventors: Atsushi Ishihara (Kanagawa, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Hiroyuki Aga (Tokyo, JP); Koichi Kawasaki (Tokyo, JP); Mitsuru Nishibe (Chiba, JP); Yuji Kusano (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/011G02B27/0172G02B27/0176G06F3/017G06F3/147G06T19/006G02B2027/014G02B2027/0138G02B2027/0178G09G3/003G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,449,133
App. No.
17/168,231
Granted
Sep 20, 2022
Kind
B2
Abstract

An information processing apparatus including circuitry that acquires information indicating a spatial relationship between a real object and a virtual object, and initiate generation of a user feedback based on the acquired information, the user feedback being displayed to be augmented to a generated image obtained based on capturing by an imaging device, or augmented to a perceived view of the real world, and wherein a characteristic of the user feedback is changed when the spatial relationship between the real object and the virtual object changes.

Claims (33)

1. A display control apparatus, comprising:

a sensor configured to acquire positional information of a hand of a user of a head-mounted display; and

a processor configured to:

set a virtual light source corresponding to a gaze direction of the user;

control the head-mounted display to display a virtual object over a view of a real world; and

control, based on the positional information and the virtual light source, the head-mounted display to display a virtual indicator of the hand on the virtual object.

2. The display control apparatus according to claim 1 , wherein the processor is further configured to set the virtual light source to radiate a virtual light forward from a position of a head of the user.

3. The display control apparatus according to claim 1 , wherein the processor is further configured to control, based on the positional information, the head-mounted display to decrease a size of the virtual indicator as a distance between the hand and the virtual object decreases.

4. The display control apparatus according to claim 1 , wherein the processor is further configured to:

set an effective range of visual feedback of the virtual indicator in a depth direction, excluding a range around a face of the user; and

control the head-mounted display not to display the virtual indicator in a case where the hand is not within the effective range.

5. The display control apparatus according to claim 1 , wherein the head-mounted display is an optical see-through head-mounted display configured to stereoscopically display, using optical units for left and right eyes of the user, the virtual object and the virtual indicator by adjustment of a convergence of the user.

6. The display control apparatus according to claim 1 , wherein

the head-mounted display is a smartphone,

the sensor is an imaging device that is installed in the smartphone and configured to capture the real world, and

the processor is further configured to control the smartphone to display the view of the real world, a first virtual object, and a second virtual object simultaneously.

7. The display control apparatus according to claim 1 , wherein the processor is further configured to control, based on the positional information, the head-mounted display to increase a sharpness of the virtual indicator as a distance between the hand and the virtual object decreases.

8. A display control method, comprising:

acquiring, from a sensor of a head-mounted display, positional information of a hand of a user of the head-mounted display;

setting a virtual light source corresponding to a gaze direction of the user;

controlling the head-mounted display to display a virtual object over a view of a real world; and

controlling, based on the positional information and the virtual light source, the head-mounted display to display a virtual indicator of the hand on the virtual object.

9. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a display control apparatus for a head-mounted display, cause the display control apparatus to execute operations, the operations comprising:

acquiring, from a sensor of the head-mounted display, positional information of a hand of a user of the head-mounted display;

setting a virtual light source corresponding to a gaze direction of the user;

controlling the head-mounted display to display a virtual object over a view of a real world; and

controlling, based on the positional information and the virtual light source, the head-mounted display to display a virtual indicator of the hand on the virtual object.

10. A display control apparatus, comprising:

a sensor configured to acquire positional information of a hand of a user of a head-mounted display; and

a processor configured to:

control the head-mounted display to display a virtual object over a view of a real world;

control, based on the positional information, the head-mounted display to display a virtual indicator of the hand on the virtual object, wherein the virtual indicator is a ring-shaped indicator; and

control, based on the positional information, the head-mounted display to decrease a radius of the ring-shaped indicator as a distance between the hand and the virtual object decreases.

Priority Claims (1)
JP 2015-073561 · Mar 31, 2015 · national
Continuity (3)
Continuation 16566477 · Sep 10, 2019
Continuation 15560111
Related Publication 20210157398A1 · May 27, 2021
Cited By (1)
US 12,353,613