IP Library Granted Patent US 12,360,613
Granted Patent B2
US 12,360,613 · App. 17/897,971 · Granted Jul 15, 2025

Information processing device, information processing method, and non-transitory computer readable medium

Inventors: Takashi Morikawa (Kanagawa, JP); Hirotake Sasaki (Kanagawa, JP); Kiyoshi Iida (Kanagawa, JP); Toshihiko Suzuki (Kanagawa, JP)
Assignee: FUJIFILM Business Innovation Corp.
G06F3/0346G06F3/011G06F3/012G06F3/013G06F3/038G06T11/00G06T15/20G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,360,613
App. No.
17/897,971
Granted
Jul 15, 2025
Kind
B2
Abstract

An information processing device includes a processor configured to: based on an attitude of equipment being worn or held by a user, set a sight direction of the user in a virtual three-dimensional space; based on a virtual viewpoint and the sight direction set in the virtual three-dimensional space, generate a two-dimensional image by projecting the virtual three-dimensional space; cause the two-dimensional image to be displayed on a display; based on an attitude of a pointer being held by the user, set an emission angle of a ray emitted virtually to the virtual three-dimensional space; and in a case where sensitivity reduction conditions that an amount of angular change of the sight direction of the user within a predetermined time is less than or equal to a threshold viewing angle and that an amount of angular change of an emission angle of the ray within a predetermined time is less than or equal to a threshold emission angle are satisfied, reduce the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer, compared to a case where the sensitivity reduction conditions are not satisfied.

Claims (44)

1. An information processing device comprising:

a processor configured to:

based on an attitude of equipment being worn or held by a user, set a sight direction of the user in a virtual three-dimensional space;

based on a virtual viewpoint and the sight direction set in the virtual three-dimensional space, generate a two-dimensional image by projecting the virtual three-dimensional space;

cause the two-dimensional image to be displayed on a display;

based on an attitude of a pointer being held by the user, set an emission angle of a ray emitted virtually to the virtual three-dimensional space; and

in a case where sensitivity reduction conditions that an amount of angular change of the sight direction of the user within a predetermined time is less than or equal to a threshold viewing angle and that an amount of angular change of an emission angle of the ray within a predetermined time is less than or equal to a threshold emission angle are satisfied, reduce the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer, compared to a case where the sensitivity reduction conditions are not satisfied.

2. The information processing device according to claim 1 ,

wherein the processor is configured to detect a distance from an emission position of the ray to an irradiation point of the ray in the virtual three-dimensional space, and

wherein the sensitivity reduction conditions further include a condition that the distance from the emission position of the ray to the irradiation point of the ray in the virtual three-dimensional space is equal to or more than a threshold distance.

3. The information processing device according to claim 2 , wherein the processor is configured to, as the distance from the emission position of the ray to the irradiation point of the ray in the virtual three-dimensional space increases, reduce the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer by a larger amount.

4. The information processing device according to claim 3 ,

wherein the processor is configured to:

generate an information display object indicating information about a virtual object pointed by the ray in the virtual three-dimensional space;

cause a two-dimensional image including an image obtained by projecting the information display object to be displayed on the display; and

even if the sight direction of the user changes more than the threshold viewing angle after the sensitivity reduction conditions are satisfied, in a case where it is determined, based on the changed sight direction of the user, that the user is looking at the information display object, maintain a state in which the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer is reduced.

5. The information processing device according to claim 2 ,

wherein the processor is configured to:

generate an information display object indicating information about a virtual object pointed by the ray in the virtual three-dimensional space;

cause a two-dimensional image including an image obtained by projecting the information display object to be displayed on the display; and

even if the sight direction of the user changes more than the threshold viewing angle after the sensitivity reduction conditions are satisfied, in a case where it is determined, based on the changed sight direction of the user, that the user is looking at the information display object, maintain a state in which the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer is reduced.

6. The information processing device according to claim 1 , wherein the processor is configured to, as the amount of angular change of the emission angle of the ray within the predetermined time decreases, reduce the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer by a larger amount.

7. The information processing device according to claim 6 ,

wherein the processor is configured to:

generate an information display object indicating information about a virtual object pointed by the ray in the virtual three-dimensional space;

cause a two-dimensional image including an image obtained by projecting the information display object to be displayed on the display; and

even if the sight direction of the user changes more than the threshold viewing angle after the sensitivity reduction conditions are satisfied, in a case where it is determined, based on the changed sight direction of the user, that the user is looking at the information display object, maintain a state in which the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer is reduced.

8. The information processing device according to claim 1 ,

wherein the processor is configured to:

generate an information display object indicating information about a virtual object pointed by the ray in the virtual three-dimensional space;

cause a two-dimensional image including an image obtained by projecting the information display object to be displayed on the display; and

even if the sight direction of the user changes more than the threshold viewing angle after the sensitivity reduction conditions are satisfied, in a case where it is determined, based on the changed sight direction of the user, that the user is looking at the information display object, maintain a state in which the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer is reduced.

9. An information processing method comprising:

based on an attitude of equipment being worn or held by a user, setting a sight direction of the user in a virtual three-dimensional space;

based on a virtual viewpoint and the sight direction set in the virtual three-dimensional space, generating a two-dimensional image by projecting the virtual three-dimensional space;

causing the two-dimensional image to be displayed on a display;

based on an attitude of a pointer being held by the user, setting an emission angle of a ray emitted virtually to the virtual three-dimensional space; and

in a case where sensitivity reduction conditions that an amount of angular change of the sight direction of the user within a predetermined time is less than or equal to a threshold viewing angle and that an amount of angular change of an emission angle of the ray within a predetermined time is less than or equal to a threshold emission angle are satisfied, reducing the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer, compared to a case where the sensitivity reduction conditions are not satisfied.

10. A non-transitory computer readable medium storing a program causing a computer to execute a process for information processing, the process comprising:

based on an attitude of equipment being worn or held by a user, setting a sight direction of the user in a virtual three-dimensional space;

based on a virtual viewpoint and the sight direction set in the virtual three-dimensional space, generating a two-dimensional image by projecting the virtual three-dimensional space;

causing the two-dimensional image to be displayed on a display;

based on an attitude of a pointer being held by the user, setting an emission angle of a ray emitted virtually to the virtual three-dimensional space; and

in a case where sensitivity reduction conditions that an amount of angular change of the sight direction of the user within a predetermined time is less than or equal to a threshold viewing angle and that an amount of angular change of an emission angle of the ray within a predetermined time is less than or equal to a threshold emission angle are satisfied, reducing the amount of angular change of the emission angle of the ray relative to the amount of angular change of the attitude of the pointer, compared to a case where the sensitivity reduction conditions are not satisfied.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2022
From: MORIKAWA, TAKASHI; SASAKI, HIROTAKE; IIDA, KIYOSHI; SUZUKI, TOSHIHIKO
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 060930/0886 →
Priority Claims (1)
JP 2022-010001 · Jan 26, 2022 · national
Continuity (1)
Related Publication 20230236674A1 · Jul 27, 2023
References Cited (16)
US 7978178B2 · Pehlivan · 2011 [cited by examiner]
US 8793620B2 · Stafford · 2014 [cited by applicant]
US 9483143B2 · Malkin · 2016 [cited by examiner]
US 9971401B2 · Stafford · 2018 [cited by applicant]
US 20020024500A1 · Howard · 2002 [cited by examiner]
US 20130141011A1 · Fushimi · 2013 [cited by examiner]
US 20150293586A1 · Kritt · 2015 [cited by examiner]
US 20160210473A1 · Cohen · 2016 [cited by examiner]
US 20170160796A1 · Oto · 2017 [cited by examiner]
US 20180168444A1 · Foss · 2018 [cited by examiner]
US 20210167982A1 · Iida · 2021 [cited by examiner]
US 20220219533A1 · Narushima · 2022 [cited by examiner]
US 20230244311A1 · Kaku · 2023 [cited by examiner]
JP H09265353A · 1997 [cited by applicant]
JP 5807989B2 · 2015 [cited by applicant]
Author: Nguyen et al.; Title: 3DTouch: A wearable 3D input device for 3D applications; pp. 8; Date: Mar. 2015; Source: https://www.researchgate.net/publication/317300060_3DTouch_Towards_a_Wearable_3D_Input_Device_for_3D… [cited by examiner]