IP Library Granted Patent US 12,175,702
Granted Patent B2
US 12,175,702 · App. 17/438,771 · Granted Dec 24, 2024

Information processing device, information processing method, and recording medium

Inventors: Haruka Fujisawa (Kanagawa, JP); Fujio Arai (Tokyo, JP); Hidenori Aoki (Chiba, JP); Ryo Fukazawa (Kanagawa, JP); Keijiroh Nagano (Tokyo, JP); Tomohiko Gotoh (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
G06T7/73G06F3/011G06V10/761G06V10/771
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,175,702
App. No.
17/438,771
Granted
Dec 24, 2024
Kind
B2
Abstract

An information processing device including a control unit that controls a display terminal that arranges a virtual object in a real space by using a coordinate system associated with the real space, in which the control unit determines whether to update first spatial information of a first display terminal and second spatial information of a second display terminal, which are used for determining a position of the virtual object, based on a first operation state of the first display terminal and a second operation state of the second display terminal that shares the virtual object with the first display terminal.

Claims (40)

1. An information processing device comprising

a control unit that controls a display terminal that arranges a virtual object in a real space by using a coordinate system associated with the real space,

wherein the control unit determines whether to update first spatial information of a first display terminal and second spatial information of a second display terminal, which are used for determining a position of the virtual object, based on a first operation state of the first display terminal and a second operation state of the second display terminal that shares the virtual object with the first display terminal, and

wherein the control unit is implemented via at least one processor.

2. The information processing device according to claim 1 , wherein the control unit determines whether to update the first spatial information and the second spatial information based on whether the first operation state and the second operation state are similar.

3. The information processing device according to claim 2 ,

wherein the control unit determines not to update the first spatial information and the second spatial information

when the first operation state and the second operation state are similar, and

the control unit determines to update the first spatial information and the second spatial information

when the first operation state and the second operation state are dissimilar.

4. The information processing device according to claim 2 , wherein the control unit calculates a similarity level between the first operation state and the second operation state, and decides whether the first operation state and the second operation state are similar based on a result of comparison of the similarity level with a first threshold.

5. The information processing device according to claim 4 , wherein the control unit calculates the similarity level based on third spatial information which is an update destination candidate acquired by the first display terminal in the first operation state and fourth spatial information which is an update destination candidate acquired by the second display terminal in the second operation state.

6. The information processing device according to claim 5 , wherein the control unit performs a process of matching between a feature point included in the third spatial information and a feature point included in the fourth spatial information, and calculates the similarity level based on a number of feature points successful in the matching.

7. The information processing device according to claim 4 , wherein the control unit changes the first threshold in accordance with a positional relationship between the first display terminal and the second display terminal.

8. The information processing device according to claim 4 ,

wherein the control unit further determines whether to update the first spatial information and the second spatial information based on whether the similarity level exceeds a third threshold, and

the third threshold is a maximum value of a similarity level calculated in a period in which a predetermined condition is satisfied.

9. The information processing device according to claim 8 ,

wherein the control unit determines to update the first spatial information and the second spatial information

when the similarity level exceeds the third threshold, and

the control unit determines not to update the first spatial information or the second spatial information

when the similarity level does not exceed the third threshold.

10. The information processing device according to claim 2 , wherein the control unit further determines whether to update the first spatial information and the second spatial information in accordance with a moving distance of the first display terminal or a moving distance of the second display terminal after a last update of the first spatial information and the second spatial information.

11. The information processing device according to claim 10 ,

wherein the control unit determines to update the first spatial information and the second spatial information

when the moving distance is a second threshold or more, and

the control unit determines not to update the first spatial information or the second spatial information

when the moving distance is not the second threshold or more.

12. The information processing device according to claim 4 , wherein the control unit calculates the similarity level between the first operation state having a specific positional relationship with a predetermined position and the second operation state having a specific relationship with the predetermined position in time series different from the first operation state.

13. An information processing device comprising:

an output unit including a first output device that presents a virtual object to a first user; and

a control unit that determines a position of the virtual object to be arranged in a coordinate system associated with a real space,

wherein the control unit determines whether to update first spatial information of the first output device and second spatial information of the second output device, which are used for determining the position of the virtual object, based on a first operation state of the first output device and a second operation state of a second output device which is externally provided and shares the virtual object with the first output device, and

wherein the control unit is implemented via at least one processor.

14. An information processing method to be executed by a processor, the method comprising:

controlling a display terminal that arranges a virtual object in a real space by using a coordinate system associated with the real space; and

determining whether to update first spatial information of a first display terminal and second spatial information of a second display terminal, which are used for determining a position of the virtual object, based on a first operation state of the first display terminal and a second operation state of the second display terminal that shares the virtual object with the first display terminal.

15. A non-transitory computer-readable recording medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method comprising:

controlling a display terminal that arranges a virtual object in a real space by using a coordinate system associated with the real space; and

determining whether to update first spatial information of a first display terminal and second spatial information of a second display terminal, which are used for determining a position of the virtual object, based on a first operation state of the first display terminal and a second operation state of the second display terminal that shares the virtual object with the first display terminal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2021
From: FUJISAWA, HARUKA; ARAI, FUJIO; AOKI, HIDENORI; FUKAZAWA, RYO; NAGANO, KEIJIROH; GOTOH, TOMOHIKO
To: SONY GROUP CORPORATION
Reel/Frame 057465/0722 →
Priority Claims (1)
JP 2019-075688 · Apr 11, 2019 · national
Continuity (1)
Related Publication 20220164981A1 · May 26, 2022