IP Library Granted Patent US 11,244,496
Granted Patent B2
US 11,244,496 · App. 16/635,254 · Granted Feb 8, 2022

Information processing device and information processing method

Inventors: Jun Kimura (Kanagawa, JP); Kazuyuki Yamamoto (Kanagawa, JP)
Assignee: SONY CORPORATION
G06T15/20G06F3/013G06T17/20G06T2210/36G06T2210/62
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,496
App. No.
16/635,254
Granted
Feb 8, 2022
Kind
B2
Abstract

An information processing device including a control unit that senses a state that causes decrease of a display frame rate of a virtual object presented to a user and dynamically change a display detail level of the virtual object in accordance with a result of the sensing is provided.

Claims (39)

1. An information processing device, comprising:

a control unit configured to:

sense a state that causes decrease of a display frame rate of a virtual object presented to a user; and

dynamically change, upon the sense of the state, a display detail level of the virtual object based on a display distance from the user to a display position of the virtual object,

wherein, based on the display distance equal to a first distance, the display detail level is increased as compared to a case in which the display distance is equal to a second distance shorter than the first distance.

2. The information processing device according to claim 1 , wherein the control unit is further configured to dynamically change the display detail level of the virtual object based on a sensed amount of display processing operation of the virtual object.

3. The information processing device according to claim 1 , wherein, based on the display distance equal to the first distance, the control unit is further configured to increase a display area of the virtual object as compared to a case in which the display distance is equal to the second distance.

4. The information processing device according to claim 1 , further comprising a display unit configured to display the virtual object, wherein

the control unit is further configured to change the display detail level of the virtual object based on a ratio of a display area of the virtual object with respect to a display area of the display unit.

5. The information processing device according to claim 1 , wherein the control unit is further configured to change the display detail level of the virtual object based on a number of the virtual objects displayed to the user.

6. The information processing device according to claim 1 , wherein the control unit is further configured to change the display detail level of the virtual object based on a type of the virtual object.

7. The information processing device according to claim 1 , wherein the control unit is further configured to dynamically change the display detail level of the virtual object based on a sensed state of a processing operation at the control unit.

8. The information processing device according to claim 7 , wherein the control unit is further configured to change the display detail level of the virtual object based on the display frame rate of the virtual object.

9. The information processing device according to claim 7 , wherein the control unit is further configured to change the display detail level of the virtual object based on a recognition frame rate at which a state of at least one of the user or a surrounding of the user is recognized by the control unit.

10. The information processing device according to claim 9 , wherein the control unit is further configured to:

distribute processing capacity of the control unit into at least one of a display processing operation for display of the virtual object or a recognition processing operation for the recognition frame rate, and

change the display detail level of the virtual object based on the processing capacity distributed to the recognition processing operation.

11. The information processing device according to claim 7 , wherein the control unit is further configured to dynamically change the display detail level of the virtual object based on a sensed state of the user.

12. The information processing device according to claim 11 , wherein

the virtual object includes a first virtual object, and a second virtual object having an identification request level higher than an identification request level of the first virtual object, and

the control unit is further configured to, upon determination of a gaze of the user at the second virtual object, increase the display detail level of the second virtual object as compared to a case in which the gaze of the user is at the first virtual object.

13. The information processing device according to claim 1 , wherein the control unit is further configured to change at least one of a display resolution of the virtual object or a level of an effect processing operation on the virtual object.

14. The information processing device according to claim 13 , wherein the effect processing operation comprises at least one of a change of a shading processing operation on the virtual object, a change of the state of a wire frame display of the virtual object, a change between a two-dimensional display and a three-dimensional display of the virtual object, or a change of transparency of the virtual object.

15. The information processing device according to claim 1 , wherein

the information processing device is a wearable device mounted on a head of the user, and

the information processing device further includes a display unit positioned in front of the eyes of the user when the information processing device is mounted on the head of the user.

16. The information processing device according to claim 15 , wherein

the display unit is a transmissive display, and

the display unit is configured to display the virtual object in a superimposing manner over real space.

17. An information processing method, comprising:

sensing a state that causes decrease of a display frame rate of a virtual object presented to a user; and

dynamically changing, upon the sensing of the state, a display detail level of the virtual object based on a display distance from the user to a display position of the virtual object,

wherein, based on the display distance equal to a first distance, the display detail level is increased as compared to a case in which the display distance is equal to a second distance shorter than the first distance.

18. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause a computer to perform operations, comprising:

sensing a state that causes decrease of a display frame rate of a virtual object presented to a user; and

dynamically changing, upon the sensing of the state, a display detail level of the virtual object based on a display distance from the user to a display position of the virtual object,

wherein, based on the display distance equal to a first distance, the display detail level is increased as compared to a case in which the display distance is equal to a second distance shorter than the first distance.

19. The information processing device according to claim 9 , wherein

the control unit is further configured to recognize the state of at least one of the user or the surrounding of the user based on at least one of a user-posture recognition operation, a real-space depth recognition operation, or a user-sight line recognition operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2020
From: KIMURA, JUN; YAMAMOTO, KAZUYUKI
To: SONY CORPORATION
Reel/Frame 052506/0971 →
Priority Claims (1)
JP JP2017-152893 · Aug 8, 2017 · national
Continuity (1)
Related Publication 20210142552A1 · May 13, 2021
Cited By (1)
US 12,456,164