IP Library › Granted Patent US 11,284,047
Granted Patent B2
US 11,284,047 · App. 16/637,423 · Granted Mar 22, 2022

Information processing device and information processing method

Inventors: Takuya Ikeda (Tokyo, JP); Fumihiko Iida (Kanagawa, JP); Kentaro Ida (Tokyo, JP); Seiji Suzuki (Kanagawa, JP); Ryuichi Suzuki (Tokyo, JP)
Assignee: SONY CORPORATION
H04N9/3102
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,047
App. No.
16/637,423
Granted
Mar 22, 2022
Kind
B2
Abstract

An information processing device including a recognition unit that recognizes a projection environment in space on the basis of sensor data obtained by sensing the space in which content is projected, and an inducement control unit that presents, to a user, inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state with improved visibility.

Claims (42)

1. An information processing device, comprising:

a recognition unit configured to recognize a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected;

an inducement decision unit configured to calculate a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein

the inducement information is different from the projected content,

the inducement information is a notification that prompts a user action from a user, and

the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and

an inducement control unit configured to present, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein

the inducement information is presented based on the priority of the inducement information, and

the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

2. The information processing device according to claim 1 , wherein the human state is at least one of a viewing or listening distance of the user from a projection plane, a posture of the user, a state of the user, an angular difference from the projection plane, a direction of a line of sight of the user, or a viewing or listening position of the user.

3. The information processing device according to claim 1 , wherein the environmental state is at least one of a shadowing object around a projection plane, an obstacle on the projection plane, a reflection of the projection plane, at least one of a color, a character, or a diagram on the projection plane, an environmental illuminance, or an environmental sound.

4. The information processing device according to claim 1 , wherein the inducement control unit is further configured to present the inducement information to the user via at least one of an audio, an image, or a vibration.

5. The information processing device according to claim 4 , wherein the inducement decision unit is further configured to determine a notification mode, based on one of the audio or the image, to present the inducement information to the user.

6. The information processing device according to claim 1 , wherein the inducement decision unit is further configured to:

calculate evaluation values of the factor associated with the human state and the factor associated with the environmental state, wherein the evaluation values are calculated based on the sensor data; and

decide the inducement information, of at least one factor from the factor associated with the human state and the factor associated with the environmental state, to be presented to the user based on the priority, wherein the priority of the inducement information is calculated based on the calculated evaluation values.

7. The information processing device according to claim 6 , wherein an evaluation value of the factor associated with the environmental state corresponds to an amount of reduction in a projection area of the content.

8. The information processing device according to claim 1 , wherein the inducement control unit is further configured to move a projection image from a direction of a line of sight of the user to a projection location.

9. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on display of a projection image at a viewing or listening position, the user action.

10. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on indication of a shadowing object in a projection image, the user action to exclude the shadowing object.

11. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on explicit indication of an obstacle on a projection plane in the space of a projection image, the user action to exclude the obstacle.

12. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on superimposition of a projection image on a texture on a projection plane, the user action to erase the texture.

13. The information processing device according to claim 1 , wherein the inducement control unit is further configured to control display of the inducement information in a direction of a line of sight of the user.

14. An information processing method, comprising,

by a processor:

recognizing a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected;

calculating a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein

the inducement information is different from the projected content,

the inducement information is a notification that prompts a user action from a user, and

the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and

presenting, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein

the inducement information is presented based on the priority of the inducement information, and

the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

recognizing a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected,

calculating a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein

the inducement information is different from the projected content,

the inducement information is a notification that prompts a user action from a user, and

the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and

presenting, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein

the inducement information is presented based on the priority of the inducement information,

the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2020
From: IKEDA, TAKUYA; IIDA, FUMIHIKO; IDA, KENTARO; SUZUKI, SEIJI; SUZUKI, RYUICHI
To: SONY CORPORATION
Reel/Frame 052578/0409 →
Priority Claims (1)
JP JP2017-157746 · Aug 18, 2017 · national
Continuity (1)
Related Publication 20200228763A1 · Jul 16, 2020
Cited By (1)
US 12,487,513