IP Library Granted Patent US 11,443,719
Granted Patent B2
US 11,443,719 · App. 16/982,886 · Granted Sep 13, 2022

Information processing apparatus and information processing method

Inventor: Atsushi Ishihara (Kanagawa, JP)
Assignee: SONY CORPORATION
G09G5/38G06F3/011G09G2340/0435G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,719
App. No.
16/982,886
Granted
Sep 13, 2022
Kind
B2
Abstract

Provided is an information processing apparatus including a rendering control unit that switches a rendering frequency of a virtual image between a first rendering frequency and a second rendering frequency higher than the first rendering frequency on the basis of a sensing result relating to a real space, and a display control unit that causes a display device to display the virtual image on the basis of the sensing result and either the first rendering frequency or the second rendering frequency.

Claims (57)

1. An information processing apparatus, comprising:

a central processing unit (CPU) configured to:

receive, from a sensor, a sensing result related to a real space;

switch a rendering frequency of a virtual image between a first rendering frequency and a second rendering frequency based on an accuracy of the sensing result, wherein

the accuracy of the sensing result includes a recognition accuracy of position and attitude related to a display device that displays the virtual image, and

the second rendering frequency is greater than the first rendering frequency;

set the rendering frequency of the virtual image to the first rendering frequency in a case where the recognition accuracy is a first recognition accuracy;

set the rendering frequency of the virtual image to the second rendering frequency in a case where the recognition accuracy is a second recognition accuracy, wherein the second recognition accuracy is higher than the first recognition accuracy; and

control the display device to display the virtual image based on the sensing result and one of the first rendering frequency or the second rendering frequency.

2. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

control the rendering frequency of the virtual image to the first rendering frequency based on a first change amount of the virtual image; and

control the rendering frequency of the virtual image to the second rendering frequency based on a second change amount of the virtual image, and

the second change amount is larger than the first change amount.

3. The information processing apparatus according to claim 2 , wherein the CPU is further configured to prohibit re-rendering of the virtual image at the first rendering frequency.

4. The information processing apparatus according to claim 2 , wherein the CPU is further configured to:

reduce re-rendering of the virtual image based on the first change amount of the virtual image; and

correct a display position of the virtual image while the re-rendering of the virtual image is reduced.

5. The information processing apparatus according to claim 4 , wherein the CPU is further configured to:

render the virtual image based on the position and the attitude related to the display device; and

correct the display position of the rendered virtual image in two-dimensions.

6. The information processing apparatus according to claim 2 , wherein the CPU is further configured to re-render the virtual image at the second rendering frequency.

7. The information processing apparatus according to claim 2 , wherein

the first change amount is smaller than a determined threshold,

the second change amount is larger than the determined threshold, and

the CPU is further configured to change the determined threshold to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency.

8. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control a frame rate of the virtual image to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency.

9. The information processing apparatus according to claim 1 , wherein

the CPU is further configured to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on a positional relationship between a user of the display device and the virtual image.

10. The information processing apparatus according to claim 9 , wherein the CPU is further configured to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on a distance between the user and the virtual image.

11. The information processing apparatus according to claim 10 , wherein the CPU is further configured to:

control the rendering frequency of the virtual image to the first rendering frequency in a case where the distance between the user and the virtual image is a first distance; and

control the rendering frequency of the virtual image to the second rendering frequency in a case where the distance between the user and the virtual image is a second distance, and

the second distance is smaller than the first distance.

12. The information processing apparatus according to claim 11 , wherein the CPU is further configured to reduce the rendering frequency of the virtual image as the distance between the user and the virtual image becomes larger.

13. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

determine one of a characteristic of the virtual image or a state of the virtual image based on the sensing result; and

switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on one of the characteristic of the virtual image or the state of the virtual image.

14. The information processing apparatus according to claim 13 , wherein the CPU is further configured to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on at least one of complexity of a shape of the virtual image, a pattern of the virtual image, color of the virtual image, a size of the virtual image, or a state of an operation of the virtual image.

15. The information processing apparatus according to claim 1 , wherein the CPU is further configured to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on a resolution of the display device.

16. The information processing apparatus according to claim 1 , wherein the CPU is further configured to switch the rendering frequency of the virtual image between the first rendering frequency and the second rendering frequency based on a positional relationship between a line of sight of a user of the display device and the virtual image.

17. The information processing apparatus according to claim 1 , wherein the CPU is further configured to reduce the first rendering frequency below a frame rate of the virtual image displayed by the display device.

18. An information processing method, comprising:

receiving, from a sensor, a sensing result related to a real space;

switching, by a processor, a rendering frequency of a virtual image between a first rendering frequency and a second rendering frequency based on an accuracy of the sensing result, wherein

the accuracy of the sensing result includes a recognition accuracy of position and attitude related to a display device that displays the virtual image, and

the second rendering frequency is greater than the first rendering frequency;

setting, by the processor, the rendering frequency of the virtual image to the first rendering frequency in a case where the recognition accuracy is a first recognition accuracy;

setting, by the processor, the rendering frequency of the virtual image to the second rendering frequency in a case where the recognition accuracy is a second recognition accuracy, wherein the second recognition accuracy is higher than the first recognition accuracy; and

controlling, by the processor, the display device to display the virtual image based on the sensing result and one of the first rendering frequency or the second rendering frequency.

19. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

receiving, from a sensor, a sensing result related to a real space;

switching a rendering frequency of a virtual image between a first rendering frequency and a second rendering frequency based on an accuracy of the sensing result, wherein

the accuracy of the sensing result includes a recognition accuracy of position and attitude related to a display device that displays the virtual image, and

the second rendering frequency is greater than the first rendering frequency;

setting the rendering frequency of the virtual image to the first rendering frequency in a case where the recognition accuracy is a first recognition accuracy;

setting the rendering frequency of the virtual image to the second rendering frequency in a case where the recognition accuracy is a second recognition accuracy, wherein the second recognition accuracy is higher than the first recognition accuracy; and

controlling the display device to display the virtual image based on the sensing result and one of the first rendering frequency or the second rendering frequency.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: ISHIHARA, ATSUSHI
To: SONY CORPORATION
Reel/Frame 056322/0102 →