IP Library › Granted Patent US 10,613,330
Granted Patent B2
US 10,613,330 · App. 15/669,128 · Granted Apr 7, 2020

Information processing device, notification state control method, and program

Inventors: Maki Imoto (Tokyo, JP); Atsushi Izumihara (Tokyo, JP); Koji Ihara (Chiba, JP); Shigeru Kawada (Chiba, JP)
Assignee: SONY CORPORATION
G02B27/0172G02B27/017G06F3/011G06F3/013G06F3/147G02B2027/014G02B2027/0132G02B2027/0138G02B2027/0141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,613,330
App. No.
15/669,128
Granted
Apr 7, 2020
Kind
B2
Abstract

Provided is an information processing device to enable a user and an outside person to communicate smoothly, the information processing device including: a necessity degree determination unit configured to determine, based on outside information indicating a situation external to a user, a degree of necessity that the user be notified of the outside information; and a notification state control unit configured to switch a notification state of the outside information with respect to the user based on the determined degree of necessity.

Claims (47)

1. An information processing device comprising:

at least one processor configured to:

control a head-mounted display to display a content image based on content information;

acquire an external image that is captured by a camera of the head-mounted display and includes an external object in an external situation with respect to the head-mounted display;

determine a pattern corresponding to the external object included in the external image;

control the head-mounted display to arrange the pattern within the content image, the pattern indicating a position of the external object in the external situation; and

increase a size of the pattern as a distance between the external object and the head-mounted display decreases.

2. The information processing device according to claim 1 ,

wherein outside information acquired from the external object includes sound information.

3. The information processing device according to claim 1 ,

wherein outside information acquired from the external object includes information indicating that the external object is approaching the head-mounted display.

4. The information processing device according to claim 3 ,

wherein the external object is a person.

5. The information processing device according to claim 1 ,

wherein the at least one processor is configured to control the head-mounted display to substantially keep a size of the content image when the pattern is arranged within the content image by being superimposed over the content image.

6. The information processing device according to claim 1 ,

wherein the pattern comprises a circle shape of which a diameter increases as the distance between the external object and the head-mounted display decreases.

7. The information processing device according to claim 1 ,

wherein the head-mounted display includes a main body part configured to prevent a user of the head-mounted display from seeing the external situation.

8. The information processing device according to claim 7 ,

wherein the head-mounted display includes an outside indicator and a display unit,

wherein the display unit is positioned at an inner side of the main body part, the inner side being opposite to the user when the user wears the head-mounted display,

wherein the outside indicator is positioned at an outer side of the main body part, the outer side being an opposite side of the main body part from the inner side, and

wherein the at least one processor is further configured to

control the outside indicator to indicate a first notification that the user recognizes the external object when the pattern is arranged within the content image, and

control the outside indicator to indicate a second notification that the user does not recognize the external object when the pattern is not arranged within the content image.

9. The information processing device according to claim 8 ,

wherein the first notification includes an eye image of the user based on line-of-sight information of the user.

10. The information processing device according to claim 7 ,

wherein the head-mounted display further includes a display unit and a sensor,

wherein the display unit is positioned at an inner side of the main body part, the inner side being opposite to the user when the user wears the head-mounted display,

wherein the sensor is configured to detect the distance between the external object and the head-mounted display, and is positioned at an outer side of the main body part, the outer side being an opposite side of the main body part from the inner side, and

wherein the at least one processor is further configured to increase the size of the pattern as the detected distance decreases.

11. The information processing device according to claim 1 ,

wherein the pattern comprises at least one of a circle shape or a line shape corresponding to the external object.

12. An information processing method, implemented via at least one processor, the method comprising:

controlling a head-mounted display to display a content image based on content information;

acquiring an external image that is captured by a camera of the head-mounted display and includes an external object in an external situation with respect to the head-mounted display;

determining a pattern corresponding to the external object included in the external image;

controlling the head-mounted display to arrange the pattern within the content image, the pattern indicating a position of the external object in the external situation; and

increasing a size of the pattern as a distance between the external object and the head-mounted display decreases.

13. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer, causes the computer to execute a method, the method comprising:

controlling a head-mounted display to display a content image based on content information;

acquiring an external image that is captured by a camera of the head-mounted display and includes an external object in an external situation with respect to the head-mounted display;

determining a pattern corresponding to the external object included in the external image;

controlling the head-mounted display to arrange the pattern within the content image, the pattern indicating a position of the external object in the external situation; and

increasing a size of the pattern as a distance between the external object and the head-mounted display decreases.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2017
From: IMOTO, MAKI; IZUMIHARA, ATSUSHI; IHARA, KOJI; KAWADA, SHIGERU
To: SONY CORPORATION
Reel/Frame 043455/0028 →
Priority Claims (1)
JP 2013-074830 · Mar 29, 2013 · national
Continuity (2)
Continuation 14773797
Related Publication 20170336640A1 · Nov 23, 2017
Cited By (1)
US 12,417,591