IP Library Granted Patent US 12,223,600
Granted Patent B2
US 12,223,600 · App. 17/157,940 · Granted Feb 11, 2025

Information processing apparatus, display device, information processing system, and non-transitory computer readable medium storing program

Inventor: Hirotake Sasaki (Kanagawa, JP)
Assignee: FUJIFILM Business Innovation Corp.
G06T19/00G06F3/012G06T7/70G06T15/20G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,600
App. No.
17/157,940
Granted
Feb 11, 2025
Kind
B2
Abstract

Provided is an information processing apparatus including a processor configured to display, in a virtual space, plural objects, and an operation object for operating the objects, based on input information from a user, extract an object group from the plural objects, specify one object from the object group, according to an operation of the operation object in the virtual space, and display the one specified object in an identifiable manner with respect to other objects other than the one object.

Claims (56)

1. An information processing apparatus comprising:

a processor configured to

display, in a virtual space, a plurality of objects, and an operation object for operating the plurality of objects, based on input information from a user;

extract an object group from the plurality of objects, wherein the object group comprises multiple objects that overlap with each other;

specify one object from the multiple objects of the object group, according to an operation of the operation object in the virtual space;

display the one specified object in a first location;

detect a point of view of the user; and

move the one specified object from the first location to a second location or a third location based on the point of view of the user, wherein the one specified object in the second location is less overlapped with the multiple objects than the one specified object in the first location, wherein move the one specified object from the first location to the second location or the third location comprising:

move the one specified object in a first direction from the first location to the second location if a relationship between a position of the multiple objects in the virtual space and a position of the point of view of the user is a first relationship; and

if the relationship between the position of the multiple objects in the virtual space and the position of the point of view of the user is a second relationship, move the one specified object in a second direction from the first location to the third location.

2. The information processing apparatus according to claim 1 , wherein

the processor is configured to extract the multiple objects which are present in a user's visible range, as the object group.

3. The information processing apparatus according to claim 1 , wherein

the processor is configured to extract the object group from the plurality of objects, according to a position of the operation object.

4. The information processing apparatus according to claim 1 , wherein

the processor is further configured to display a guide object, which is an object that guides the movement of the operation object in the virtual space, as the guide area.

5. The information processing apparatus according to claim 4 , wherein the guide object is displayed as at least one of a line and a surface.

6. The information processing apparatus according to claim 4 , wherein

the guide object is divided by the number of objects constituting the object group, and each divided section corresponds to any of the multiple objects, and

the processor is configured to specify and display the one specified object corresponding to a section closest to the operation object, in the section, as the one object, in an identifiable manner with respect to the other objects.

7. The information processing apparatus according to claim 1 , wherein

the processor is configured to change a display mode of the one specified object, depending on a relationship between a position of the object group in the virtual space and a position of a user's head.

8. The information processing apparatus according to claim 7 , wherein

the processor is configured to change a display mode of the one specified object, depending on a relationship between a position of the object group in the virtual space and a field of view of the user.

9. The information processing apparatus according to claim 7 , wherein

the processor is configured to display the one specified object by changing a posture of the one specified object, according to postures of the objects constituting the object group in the virtual space.

10. The information processing apparatus of claim 1 , wherein the processor is further configured to set a guide area, that guides a movement of the operation object in the virtual space, to specify the one object from the object group as the operation object moves along the guide area.

11. The information processing apparatus of claim 1 , wherein the processor is further configured to:

in response to moving the one specified object in the first direction or the second direction, the multiple objects, not including the one specified object, are stationary as displayed within the virtual space.

12. A display device configured to

display, in a virtual space, a plurality of objects, and an operation object for operating the objects, based on input information from a user;

display in a first location one object specified from multiple objects of an object group extracted from the plurality of objects, according to an operation of the operation object in the virtual space, wherein the object group comprises the multiple objects that overlap with each other;

display the virtual space based on a detected point of view of the user; and

display the one specified object moved from the first location to a second location or a third location based on the detected point of view of the user, wherein the one specified object in the second location is less overlapped with the multiple objects than the one specified object in the first location, wherein display the one specified object from the first location to the second location or the third location comprising:

display moving the one specified object in a first direction from the first location to the second location if a relationship between a position of the plurality of objects in the virtual space and a position of the point of view of the user is a first relationship; and

if the relationship between the position of the plurality of objects in the virtual space and the position of the point of view of the user is a second relationship, display moving the one specified object in a second direction from the first location to the third location.

13. An information processing system comprising:

a display device that displays a virtual space; and

the information processing apparatus of claim 1 .

14. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:

displaying, in a virtual space, a plurality of objects, and an operation object for operating the plurality of objects, based on input information from a user;

extracting an object group from the plurality of objects, wherein the object group comprises multiple objects that overlap with each other;

specifying one object from the multiple objects of the object group, according to an operation of the operation object in the virtual space;

displaying the one specified object in a first location;

detecting a point of view of the user; and

having determined that a relationship between a position of the plurality of objects in the virtual space and a position of the point of view of the user is a first relationship, moving the one specified object in a first direction from the first location to a second location; and

having determined that the relationship between the position of the plurality of objects in the virtual space and the position of the point of view of the user is a second relationship, moving the one specified object in a second direction from the first location to a third location.

15. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:

displaying, in a virtual space, a plurality of objects, and an operation object for operating the plurality of objects, based on input information from a user;

extracting an object group from the plurality of objects, wherein the object group comprises multiple objects that overlap with each other;

specifying one object from the multiple objects of the object group, according to an operation of the operation object in the virtual space;

displaying the one specified object in a first location;

detecting a point of view of the user; and

moving the one specified object from the first location to a second location based on the point of view of the user, wherein the one specified object in the second location is less overlapped with the multiple objects than the one specified object in the first location and a first distance between the one specified object in the first location and the multiple objects is less than a second distance between the one specified object in the second location and the multiple objects.

16. The non-transitory computer readable medium of claim 15 , wherein the wherein the one specified object in the second location is less overlapped with the multiple objects than the one specified object in the first location comprising:

the one specified object in the second location is no longer overlapped with the multiple objects then the one specified object in the first location.

Assignments (2)
CHANGE OF NAME Recorded May 14, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056237/0177 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2021
From: SASAKI, HIROTAKE
To: FUJI XEROX CO., LTD.
Reel/Frame 055040/0878 →
Priority Claims (1)
JP 2020-156605 · Sep 17, 2020 · national
Continuity (1)
Related Publication 20220084287A1 · Mar 17, 2022
References Cited (17)
US 10001844B2 · Namba et al. · 2018 [cited by applicant]
US 10732797B1 · Perez, III · 2020 [cited by examiner]
US 11487359B2 · Nakade et al. · 2022 [cited by applicant]
US 11803240B2 · Nakade et al. · 2023 [cited by applicant]
US 20140351758A1 · Yoshida · 2014 [cited by examiner]
US 20150135132A1 · Josephson · 2015 [cited by examiner]
US 20150350563A1 · Hendricks · 2015 [cited by examiner]
US 20170109936A1 · Powderly · 2017 [cited by examiner]
US 20230418376A1 · Nakade et al. · 2023 [cited by applicant]
JP 2005107963 · 2005 [cited by applicant]
JP 2005352738 · 2005 [cited by applicant]
JP 2017500673 · 2017 [cited by applicant]
JP 2017059062 · 2017 [cited by applicant]
WO 2015051047 · 2015 [cited by applicant]
WO 2020110270 · 2020 [cited by applicant]
“Office Action of Japan Counterpart Application”, issued on Mar. 5, 2024, with English translation thereof, p. 1-p. 6. [cited by applicant]
Office Action of Japan Counterpart Application, with English translation thereof, issued on May 14, 2024, pp. 1-3. [cited by applicant]