IP Library › Granted Patent US 11,631,380
Granted Patent B2
US 11,631,380 · App. 16/978,546 · Granted Apr 18, 2023

Information processing apparatus, information processing method, and recording medium

Inventors: Hiroshi Yuasa (Kanagawa, JP); Kazuma Aiki (Tokyo, JP)
Assignee: SONY CORPORATION
G09G5/10G02B27/0172G02B27/283G06T7/73G06T11/203G02B2027/014G02B2027/0118G02B2027/0178G09G2320/0666G09G2360/144H04N5/2352
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,631,380
App. No.
16/978,546
Granted
Apr 18, 2023
Kind
B2
Abstract

The present technology relates to an information processing apparatus and an information processing method enabling a user to visually recognize a surrounding environment promptly based on a sudden change in brightness. An information processing apparatus of the present technology includes an acquisition section that acquires environmental information which is information associated with an environment including an object present in a real space, and a display control section that exercises display control based on the environmental information with respect to form information representing a form of the object over a display section that displays predetermined information in a visually recognizable state while superimposing the predetermined information on the real space based on occurrence of a change in brightness of the real space higher than a threshold. The present technology is applicable to an HMD that displays information while superimposing the information on a scene in front of a user.

Claims (67)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire environmental information that includes information associated with an environment, wherein

the environment includes a plurality of objects present in a real space, and

the environmental information includes information associated with at least one of a position of each of the plurality of objects, a distance of each of the plurality of objects from a user, a height of each of the plurality of objects, or a type of each of the plurality of objects;

control display of specific information in a visually recognizable state by superimposition of the specific information on the real space;

control display of form information based on the acquired environmental information and occurrence of a change in brightness of the real space, wherein

the change in the brightness is higher than a threshold value,

the form information represents a form of each of the plurality of objects,

the form information representing the form of a first object of the plurality of objects is displayed in a first color,

the form information representing the form of a second object of the plurality of objects is displayed in a second color different from the first color, and

the distance of the first object from the user is different from the distance of the second object from the user;

calculate a degree of hazard of each object of the plurality of objects based on a posture of the user;

change a display method of the form information based on the calculated degree of hazard;

decrease luminance of the displayed form information based on dark adaptation characteristics of the user; and

gradually raise a color temperature of the displayed form information based on the dark adaptation characteristics of the user.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control a change in the luminance of the form information based on at least one of attributes of the user or a state of the user including at least one of a position or the posture of the user.

3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control display of a contour line of the plurality of objects as the form information.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

calculate the degree of hazard of each of the plurality of objects further based of at least one of a position of the user and irregularities of each of the plurality of objects; and

control the display of the form information based on the calculated degree of hazard.

5. The information processing apparatus according to claim 4 , wherein the circuitry is further configured to:

control display of a contour line of each of the plurality of objects as the form information; and

change at least any of a type, a thickness, or a gray level of the contour line based on the degree of hazard.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the display of the form information that represents feature points of the plurality of objects.

7. The information processing apparatus according to claim 1 , further comprising a light control element that includes:

a first transparent electrode;

a second transparent electrode; and

an electrochromic element between the first transparent electrode and the second transparent electrode, wherein

the light control element is configured to guide light in the real space to eyes of the user at a specific transmittance, and

the circuitry is further configured to control, based on the occurrence of the change in the brightness of the real space that is higher than the threshold value, the light control element to raise transmittance of the light control element.

8. The information processing apparatus according to claim 7 , further comprising a head mounted display wearable on a head of the user.

9. The information processing apparatus according to claim 1 , further comprising a camera configured to image the real space,

wherein the circuitry is further configured to increase a gain and an exposure time of the camera based on the occurrence of the change in the brightness of the real space that is higher than the threshold value.

10. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to display the form information as an alternative to the specific information displayed before the occurrence of the change in the brightness.

11. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to end the display of the form information based on the brightness of the real space that is equal to a specific brightness.

12. The information processing apparatus according to claim 1 , the circuitry is further configured to determine the dark adaptation characteristics of the user based on attributes of the user that include at least one of an age of the user, an eyesight of the user, or a gender of the user.

13. An information processing method, comprising:

acquiring, by an information processing apparatus, environmental information that includes information associated with an environment, wherein

the environment includes a plurality of objects present in a real space, and

the environmental information includes information associated with at least one of a position of each of the plurality of objects, a distance of each of the plurality of objects from a user, a height of each of the plurality of objects, or a type of each of the plurality of objects;

controlling, by the information processing apparatus, display of specific information in a visually recognizable state by superimposition of the specific information on the real space;

controlling, by the information processing apparatus, display of form information based on the acquired environmental information and occurrence of a change in brightness of the real space, wherein

the change in the brightness is higher than a threshold value,

the form information represents a form of each of the plurality of objects,

the form information representing the form of a first object of the plurality of objects is displayed in a first color,

the form information representing the form of a second object of the plurality of objects is displayed in a second color different from the first color, and

the distance of the first object from the user is different from the distance of the second object from the user;

calculating a degree of hazard of each object of the plurality of objects based on a posture of the user;

changing a display method of the form information based on the calculated degree of hazard;

decreasing, by the information processing apparatus, luminance of the displayed form information based on dark adaptation characteristics of the user; and

gradually raising a color temperature of the displayed form information based on the dark adaptation characteristics of the user.

14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

acquiring environmental information that includes information associated with an environment, wherein

the environment includes a plurality of objects present in a real space, and

the environmental information includes information associated with at least one of a position of each of the plurality of objects, a distance of each of the plurality of objects from a user, a height of each of the plurality of objects, or a type of each of the plurality of objects;

controlling display of specific information in a visually recognizable state by superimposition of the specific information on the real space;

controlling display of form information based on the acquired environmental information and occurrence of a change in brightness of the real space, wherein

the change in the brightness is higher than a threshold value,

the form information represents a form of each of the plurality of objects,

the form information representing the form of a first object of the plurality of is displayed in a first color,

the form information representing the form of a second object of the plurality of objects is displayed in a second color different from the first color, and

the distance of the first object from the user is different from the distance of the second object from the user;

calculating a degree of hazard of each object of the plurality of objects based on a posture of the user;

changing a display method of the form information based on the calculated degree of hazard;

decreasing luminance of the displayed form information based on dark adaptation characteristics of the user; and

gradually raising a color temperature of the displayed form information based on the dark adaptation characteristics of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2021
From: YUASA, HIROSHI; AIKI, KAZUMA
To: SONY CORPORATION
Reel/Frame 056238/0440 →
Priority Claims (1)
JP JP2018-046335 · Mar 14, 2018 · national
Continuity (1)
Related Publication 20210020141A1 · Jan 21, 2021