IP Library Granted Patent US 11,594,158
Granted Patent B2
US 11,594,158 · App. 17/366,980 · Granted Feb 28, 2023

Information processing device, information processing method, and recording medium

Inventor: Yasushi Miyajima (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
G09F9/3026G09F19/22G09F23/0058G09F27/00G09F27/005G09F2027/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,594,158
App. No.
17/366,980
Granted
Feb 28, 2023
Kind
B2
Abstract

[Object] To provide an information processing device, an information processing method, and a recording medium capable of appropriately presenting necessary information while maintaining scenery. [Solution] An information processing device including: a communication unit configured to receive sensor data detected by a sensor for grasping a surrounding situation; and a control unit configured to perform control to generate a control signal for displaying an image including appropriate information on a display unit installed around the sensor, in accordance with at least one of an attribute of a user, a situation of the user, or an environment detected from the sensor data, generate a control signal for displaying a blending image that blends into surroundings of the display unit on the display unit in a case where information presentation is determined to be unnecessary, and transmit the control signal to the display unit via the communication unit.

Claims (31)

1. An information processing device comprising: circuitry configured to

receive sensor data detected by a sensor for capturing an area surrounding the sensor;

generate a control signal for displaying an image including instructional information on a display installed around the sensor, in accordance with at least one of a person or a living thing accompanying a user or an object owned by the user recognized on a basis of the sensor data, the instruction information being different based on the person or living thing accompanying the user, or based on the object owned by the user;

generate a control signal for displaying a blending image that gives the display an appearance of surroundings of the display on the display in a case where the user is unaccompanied by the person or the living thing and the user does not have the object; and

transmit the control signal to the display.

2. The information processing device according to claim 1 , wherein the circuitry is configured to determine that the blending image is to be displayed based on a characteristic of the person.

3. The information processing device according to claim 2 , wherein the characteristic of the person includes a proficiency of using an apparatus associated with the display.

4. The information processing device according to claim 3 , wherein the apparatus includes the display.

5. The information processing device according to claim 1 , wherein

the display is installed on a front surface of a storage and is configured to display a storage interior image captured by a camera in the storage, and

the circuitry is configured to

generate a control signal for displaying the storage interior image on the display when a specific user is recognized on a basis of the sensor data,

generate a control signal for displaying the blending image on the display when a specific user is not recognized, and

transmit the generated control signal to the display.

6. The information processing device according to claim 5 , wherein the circuitry recognizes the specific user on a basis of user speech voice data that gives an instruction to check an inside of the storage.

7. The information processing device according to claim 6 , wherein the circuitry performs predetermined processing on a storage interior image captured by the camera in the storage in response to the instruction given by the user, and then generates a control signal for displaying the storage interior image.

8. The information processing device according to claim 1 , wherein

the display is installed on a passage, and

the circuitry is configured to generate a control signal for displaying an image including instructional guidance information on the display, in accordance with a number of users detected from the sensor data,

generate a control signal for displaying the blending image on the display when presentation of guidance information is determined to be unnecessary, and

transmit the generated control signal to the display.

9. An information processing method comprising:

receiving, with circuitry, sensor data detected by a sensor for capturing an area surrounding the sensor;

generating, with the circuitry, a control signal for displaying an image including instructional information on a display installed around the sensor, in accordance with at least one of a person or a living thing accompanying a user or an object owned by the user recognized on a basis of the sensor data, the instruction information being different based on the person or living thing accompanying the user, or based on the object owned by the user;

generating, with the circuitry, a control signal for displaying a blending image that gives the display an appearance of surroundings of the display on the display in a case where the user is unaccompanied by the person or the living thing and the user does not have the object; and

transmitting, with the circuitry, the control signal to the display.

10. A non-transitory computer-readable medium encoded with computer-readable instructions that, when executed by circuitry, cause the circuitry to perform a method comprising:

receiving sensor data detected by a sensor for capturing an area surrounding the sensor;

generating a control signal for displaying an image including instructional information on a display installed around the sensor, in accordance with at least one of a person or a living thing accompanying a user or an object owned by the user recognized on a basis of the sensor data, the instruction information being different based on the person or living thing accompanying the user, or based on the object owned by the user;

generating a control signal for displaying a blending image that gives the display an appearance of surroundings of the display on the display in a case where the user is unaccompanied by the person or the living thing and the user does not have the object; and

transmitting the control signal to the display.

Assignments (1)
CHANGE OF NAME Recorded Nov 4, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 061882/0500 →
Priority Claims (1)
JP 2016-221658 · Nov 14, 2016 · national
Continuity (2)
Continuation 16330637
Related Publication 20210327313A1 · Oct 21, 2021