IP Library Granted Patent US 11,521,354
Granted Patent B2
US 11,521,354 · App. 17/138,847 · Granted Dec 6, 2022

Information processing apparatus and non-transitory computer readable medium

Inventors: Toshiyuki Komoda (Kanagawa, JP); Jun Ohashi (Kanagawa, JP)
Assignee: FUJIFILM Business Innovation Corp.
G06T19/00G06F3/012G06F3/013G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,521,354
App. No.
17/138,847
Granted
Dec 6, 2022
Kind
B2
Abstract

An information processing apparatus includes a processor configured to: display, in a virtual space recognized by a user, a first object at a position corresponding to a first coordinate system that is independent of the user's head movement; display, in the virtual space, a second object at a position corresponding to a second coordinate system that is dependent on the user's head movement; and change the first object to the second object in response to an operation performed by the user on the first object.

Claims (43)

1. An information processing apparatus comprising:

a processor configured to

display, in a virtual space recognized by a user, a first object at a position corresponding to a first coordinate system that is independent of the user's head movement,

display, in the virtual space, a second object at a position corresponding to a second coordinate system that is dependent on the user's head movement, wherein the second coordinate system comprising a face orientation of the user, and

change the first object to the second object in response to an operation performed by the user on the first object, wherein:

the operation is an operation using a gaze of the user, and

the processor is configured to,

analyze the gaze of the user based on a gaze history of the user measured at a predetermined cycle, wherein the gaze history comprising a measurement time and coordinate information of the gaze of the user,

in a case where a direction of the gaze and a position at which the first object is displayed have a predetermined first relationship, change the first object to the second object, wherein the second object is set to follow the face orientation of the user, and

the predetermined first relationship is satisfied when the direction of the gaze and the position at which the first object is displayed overlap for more than a predetermined amount of time,

wherein the processor is configured to

suspend displaying of the second object at a position which does not fit in the user's field of view corresponding to the second coordinate system in the virtual space when a predetermined second condition is satisfied, and

resume the suspended displaying of the second object to fit in the user's field of view when a predetermined third condition is satisfied,

wherein the predetermined second condition is satisfied in response to an interruption process, wherein the interruption process is triggered by a notification, and

the predetermined third condition is satisfied when the interruption process is completed.

2. The information processing apparatus according to claim 1 , wherein the processor is configured to change a display form of the second object in a case where a direction of a gaze of the user on the second object and a position at which the second object is displayed have a predetermined second relationship.

3. The information processing apparatus according to claim 2 , wherein the processor is configured to, in a case where a number of the second objects is greater than or equal to a predetermined threshold, display the second objects according to a rule different from a rule in a case where the number is less than the threshold.

4. The information processing apparatus according to claim 3 , wherein the processor is configured to arrange and display the second objects so as not to overlap each other in a case where the number of the second objects is less than the threshold, and arrange and display the second objects so as to overlap each other in a case where the number of the second objects is greater than or equal to the threshold.

5. The information processing apparatus according to claim 2 , wherein the processor is configured to change a size of the second objects according to a number of the second objects, and display the second objects.

6. The information processing apparatus according to claim 1 , wherein the processor is configured to, in a case where a number of the second objects is greater than or equal to a predetermined threshold, display the second objects according to a rule different from a rule in a case where the number is less than the threshold.

7. The information processing apparatus according to claim 6 , wherein the processor is configured to arrange and display the second objects so as not to overlap each other in a case where the number of the second objects is less than the threshold, and arrange and display the second objects so as to overlap each other in a case where the number of the second objects is greater than or equal to the threshold.

8. The information processing apparatus according to claim 1 , wherein the processor is configured to change a size of the second objects according to a number of the second objects, and display the second objects.

9. The information processing apparatus according to claim 8 , wherein the processor is configured to display each of the second objects to be smaller as the number of the second objects increases.

10. The information processing apparatus according to claim 1 , wherein the operation is an operation of changing content of the first object.

11. The information processing apparatus according to claim 1 , wherein the processor is configured to change the second object to the first object when a predetermined first condition is satisfied.

12. The infoi nation processing apparatus according to claim 1 , wherein:

the processor is configured to

suspend the displaying of the second object in response to a command to execute a second process that takes precedence over a first process being executed, and

resume the suspended displaying of the second object in response to completion of the second process.

13. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:

displaying, in a virtual space recognized by a user, a first object at a position corresponding to a first coordinate system that is independent of the user's head movement;

displaying, in the virtual space, a second object at a position corresponding to a second coordinate system that is dependent on the user's head movement, wherein the second coordinate system comprising a face orientation of the user; and

changing the first object to the second object in response to an operation performed by the user on the first object, wherein:

the operation is an operation using a gaze of the user, and

the process comprising:

analyzing the gaze of the user based on a gaze history of the user measured at a predetermined cycle, wherein the gaze history comprising a measurement time and coordinate information of the gaze of the user,

in a case where a direction of the gaze and a position at which the first object is displayed have a predetermined first relationship, changing the first object to the second object, wherein the second object is set to follow the face orientation of the user, and

the predetermined first relationship is satisfied when the direction of the gaze and the position at which the first object is displayed overlap for more than a predetermined amount of time,

wherein the process further comprising:

suspending displaying of the second object at a position which does not fit in the user's field of view corresponding to the second coordinate system in the virtual space when a predetermined second condition is satisfied, and

resuming the suspended displaying of the second object to fit in the user's field of view when a predetermined third condition is satisfied,

wherein the predetermined second condition is satisfied in response to an interruption process, wherein the interruption process is triggered by a notification, and

the predetermined third condition is satisfied when the interruption process is completed.

Assignments (2)
CHANGE OF NAME Recorded May 18, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056266/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2021
From: KOMODA, TOSHIYUKI; OHASHI, JUN
To: FUJI XEROX CO., LTD.
Reel/Frame 054820/0274 →
Priority Claims (1)
JP JP2020-131929 · Aug 3, 2020 · national
Continuity (1)
Related Publication 20220036655A1 · Feb 3, 2022