IP Library › Granted Patent US 12,412,354
Granted Patent B2
US 12,412,354 · App. 18/307,107 · Granted Sep 9, 2025

Information processing apparatus, information processing method, and non-transitory computer readable medium

Inventor: Naohito Nakamura (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T19/20G06T7/70G06V10/761G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,354
App. No.
18/307,107
Granted
Sep 9, 2025
Kind
B2
Abstract

An information processing apparatus according to the present invention acquires information indicating a position or an orientation of an object for operating a virtual object; and controls a position or an orientation of a graphic corresponding to the object on a basis of the acquired information, wherein the position or the orientation of the graphic in a first state is controlled on a basis of first information that is information indicating the position or the orientation of the graphic in the first state in which the information is acquired with accuracy higher than predetermined accuracy and second information that is information indicating the position or the orientation of the graphic in a second state in which the information is not acquired with the accuracy higher than the predetermined accuracy.

Claims (54)

1. An information processing apparatus comprising:

a processor; and

a memory storing a program which, when executed by the processor, causes the information processing apparatus to:

execute acquisition processing of acquiring information indicating a position or an orientation of an object for operating a virtual object; and

execute control processing of controlling a position or an orientation of a graphic corresponding to the object on a basis of the acquired information, wherein

in the control processing, when shifting from a second state in which the object is not reflected in a captured image to a first state in which the object is reflected in a captured image, the position or the orientation of the graphic in the first state is controlled on a basis of

first information that is information indicating the position or the orientation of the graphic in the first state and

second information that is information indicating the position or the orientation of the graphic in the second state.

2. The information processing apparatus according to claim 1 , wherein

the second state is a state in which the information is not acquired.

3. The information processing apparatus according to claim 1 , wherein

the second state is a state in which the information is acquired based on detection result of a sensor included in the object and not based on the captured image.

4. The information processing apparatus according to claim 1 , wherein

in the control processing, when shifting from the second state to the first state, if a difference between the first information and the second information is larger than a threshold, the position or the orientation of the graphic in the first state is controlled on a basis of the first information and the second information.

5. The information processing apparatus according to claim 1 , wherein

in the control processing, when shifting from the second state to the first state, if a difference in a position or an orientation in a specific two-dimensional plane coordinate system between the graphic in a position or an orientation corresponding to the first information and the graphic in a position or an orientation obtained by changing a position or an orientation corresponding to the second information by a change amount based on the first information and the second information is larger than a threshold, the position or the orientation of the graphic in the first state is controlled on a basis of the first information and the second information.

6. The information processing apparatus according to claim 1 , wherein

in the control processing, when shifting from the second state to the first state, if a user uses the graphic, the position or the orientation of the graphic in the first state is controlled on a basis of the first information and the second information.

7. The information processing apparatus according to claim 6 , wherein

a case in which the user uses the graphic is a case in which the user holds the object or a case in which a movement amount of the object is at least a threshold.

8. The information processing apparatus according to claim 1 , wherein

in the control processing, when shifting from the second state to the first state, the position or the orientation of the graphic in the first state is determined by changing a position or an orientation of the graphic corresponding to the first information by a change amount based on the first information and the second information.

9. The information processing apparatus according to claim 8 , wherein

in the control processing, when shifting from the second state to the first state, the position or the orientation of the graphic corresponding to the first information is changed by a change amount based on a difference between the first information and the second information.

10. The information processing apparatus according to claim 8 , wherein

in the control processing, when shifting from the second state to the first state, the position or the orientation of the graphic corresponding to the first information is changed by a change amount based on a difference between a portion indicated by the graphic in the second state and a portion indicated by the graphic in a case in which the position or the orientation of the graphic is set at the position or the orientation corresponding to the first information.

11. The information processing apparatus according to claim 8 , wherein

in the control processing, the change amount is gradually reduced.

12. The information processing apparatus according to claim 1 , wherein

in the control processing, the position or the orientation of the graphic in the first state is controlled so that a portion indicated by the graphic in the second state is maintained even after the second state is shifted to the first state.

13. The information processing apparatus according to claim 1 , wherein

in the control processing, the position or the orientation of the graphic in the first state is controlled so as to gradually come close to a position or an orientation of the graphic corresponding to the first information.

14. The information processing apparatus according to claim 1 , wherein

in the control processing, in the first state, a display mode of the graphic is differentiated between a case, in which the graphic is displayed on a display in a position or an orientation based on the first information and the second information, and a case, in which the graphic is displayed on the display in a position and an orientation corresponding to the first information.

15. The information processing apparatus according to claim 1 , wherein

in the control processing, in the first state, the graphic is displayed in a position and an orientation based on the first information and the second information and another graphic is displayed in a position and an orientation corresponding to the first information in a display mode different from a display mode of the graphic.

16. The information processing apparatus according to claim 1 , wherein

in the acquisition processing, it is capable of acquiring the information using a captured image.

17. The information processing apparatus according to claim 1 , wherein

the object is a ring-type controller attachable to a finger of a user.

18. The information processing apparatus according to claim 1 , wherein

the information processing apparatus is a head-mounted display.

19. An information processing method comprising:

an acquisition step of acquiring information indicating a position or an orientation of an object for operating a virtual object; and

a control step of controlling a position or an orientation of a graphic corresponding to the object on a basis of the information acquired in the acquisition step, wherein

in the control step, when shifting from a second state in which the object is not reflected in a captured image to a first state in which the object is reflected in a captured image, the position or the orientation of the graphic in the first state is controlled on a basis of

first information that is information indicating the position or the orientation of the graphic in the first state and

second information that is information indicating the position or the orientation of the graphic in the second state.

20. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute an information processing method comprising:

an acquisition step of acquiring information indicating a position or an orientation of an object for operating a virtual object; and

a control step of controlling a position or an orientation of a graphic corresponding to the object on a basis of the information acquired in the acquisition step, wherein

in the control step, when shifting from a second state in which the object is not reflected in a captured image to a first state in which the object is reflected in a captured image, the position or the orientation of the graphic in a first state is controlled on a basis of

first information that is information indicating the position or the orientation of the graphic in the first state and

second information that is information indicating the position or the orientation of the graphic in the second state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2023
From: NAKAMURA, NAOHITO
To: CANON KABUSHIKI KAISHA
Reel/Frame 063901/0325 →
Priority Claims (1)
JP 2022-080036 · May 16, 2022 · national
Continuity (1)
Related Publication 20230368483A1 · Nov 16, 2023
References Cited (10)
US 10537795B2 · Bristol · 2020 [cited by applicant]
US 20090070093A1 · Nakanishi · 2009 [cited by examiner]
US 20130104084A1 · Mlyniec · 2013 [cited by examiner]
US 20140204002A1 · Bennet · 2014 [cited by examiner]
US 20160217612A1 · Petill · 2016 [cited by examiner]
US 20170060230A1 · Faaborg · 2017 [cited by examiner]
US 20170115727A1 · Matsuike · 2017 [cited by examiner]
JP 2020519992A · 2020 [cited by applicant]
JP 202160627A · 2021 [cited by applicant]
JP 202278778A · 2022 [cited by applicant]