IP Library › Granted Patent US 12,554,317
Granted Patent B2
US 12,554,317 · App. 18/730,320 · Granted Feb 17, 2026

Information processing device and information processing method

Inventors: Keijiroh Nagano (Tokyo, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Shin Shiroma (Tokyo, JP); Takuya Ikeda (Tokyo, JP); Ikuo Yamano (Tokyo, JP); Kei Takahashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,554,317
App. No.
18/730,320
Granted
Feb 17, 2026
Kind
B2
Abstract

There is provided an information processing device and an information processing method that facilitate designating a desired range in an object in XR. The information processing device includes: an object recognition unit that recognizes a state of a target object that is a real object or a virtual object that exists in a field of view of a user; an operation body recognition unit that recognizes a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object; and a designated range setting unit that sets the designated range on a basis of at least one of a state of the target object or a state of the operation body. The present technology can be applied to, for example, a head mount display (HMD).

Claims (78)

1 . An information processing device comprising:

circuitry configured to:

recognize a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognize a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object; and

set the designated range on a basis of at least one of a state of the target object or a state of the operation body,

wherein the state of the operation body includes a stationary time of the operation body,

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value, and

wherein the circuitry is further configured to set the designated range in a display mode different from a surrounding.

2 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range on a basis of a distance between the operation body and the target object.

3 . The information processing device according to claim 2 ,

wherein the circuitry is further configured to reduce the designated range as a distance between the operation body and the target object decreases.

4 . The information processing device according to claim 3 ,

wherein the circuitry is further configured to set a range in which the designated range can be changed on a basis of a distance between the user and the target object.

5 . The information processing device according to claim 2 ,

wherein the circuitry is further configured to move a position of the designated range in the target object in a depth direction with respect to the user on a basis of a distance between the operation body and the target object.

6 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range on a basis of a shape of the operation body.

7 . The information processing device according to claim 6 ,

wherein the circuitry is further configured to set the designated range on a basis of a distance between at least two predetermined points of the operation body.

8 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range on a basis of a posture of the operation body.

9 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range on a basis of a distance between a plurality of the operation bodies.

10 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range as a default designated range on a basis of the designated range set by another user.

11 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to set the designated range further on a basis of a moving speed of the target object.

12 . The information processing device according to claim 1 , further comprising

a user state recognition unit that recognizes a state of the user,

wherein the circuitry is further configured to set a range in which the designated range is reduced on a basis of at least one of a state of the user or a state of the operation body.

13 . The information processing device according to claim 12 ,

wherein the circuitry is further configured to set a range in which the designated range is reduced on a basis of a position to which the user pays attention or a position indicated by the user.

14 . The information processing device according to claim 1 , wherein the circuitry is further configured to:

recognize a state of the user; and

select the target object from among objects in a field of view of a user on a basis of at least one of a state of the user or a state of the operation body.

15 . The information processing device according to claim 14 ,

wherein the circuitry is further configured to select the target object on a basis of a position to which the user pays attention or a position indicated by the user.

16 . The information processing device according to claim 1 , wherein the circuitry is further configured to control display of the designated range by projection of video in a field of view of the user or onto the target object.

17 . The information processing device according to claim 1 ,

wherein the operation body is a hand of the user.

18 . An information processing method performed by an information processing device, comprising:

recognizing a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognizing a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object; and

setting the designated range on a basis of at least one of a state of the target object or a state of the operation body,

wherein the state of the operation body includes a stationary time of the operation body,

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value, and

wherein the designated range is set in a display mode different from a surrounding.

19 . A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:

recognizing a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognizing a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object; and

setting the designated range on a basis of at least one of a state of the target object or a state of the operation body,

wherein the state of the operation body includes a stationary time of the operation body,

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value, and

wherein the designated range is set in a display mode different from a surrounding.

20 . The information processing device according to claim 1 , wherein the designated range is set to a third area of the target object larger than the second area on a basis of the stationary time of the operation body being more than a second threshold value.

21 . An information processing device comprising:

circuitry configured to:

recognize a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognize a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object;

set the designated range on a basis of at least one of a state of the target object or a state of the operation body; and

set the designated range as a default designated range on a basis of the designated range set by another user,

wherein the state of the operation body includes a stationary time of the operation body, and

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value.

22 . An information processing method performed by an information processing device, comprising:

recognizing a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognizing a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object;

setting the designated range on a basis of at least one of a state of the target object or a state of the operation body; and

setting the designated range as a default designated range on a basis of the designated range set by another user,

wherein the state of the operation body includes a stationary time of the operation body, and

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value.

23 . A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:

recognizing a state of a target object that is a real object or a virtual object that exists in a field of view of a user;

recognizing a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object;

setting the designated range on a basis of at least one of a state of the target object or a state of the operation body; and

setting the designated range as a default designated range on a basis of the designated range set by another user,

wherein the state of the operation body includes a stationary time of the operation body, and

wherein the designated range is set to a first area of the target object on a basis of the stationary time of the operation body being more than a threshold value and the designated range is set to a second area of the target object smaller than the first area on a basis of the stationary time of the operation body being less than the threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2024
From: NAGANO, KEIJIROH; ISHIKAWA, TSUYOSHI; SHIROMA, SHIN; IKEDA, TAKUYA; YAMANO, IKUO; TAKAHASHI, KEI
To: SONY GROUP CORPORATION
Reel/Frame 068027/0775 →
Priority Claims (1)
JP 2022-018456 · Feb 9, 2022 · national
Continuity (1)
Related Publication 20250130625A1 · Apr 24, 2025
References Cited (15)
US 8558759B1 · Prada Gomez · 2013 [cited by examiner]
US 20130335303A1 · Maciocci · 2013 [cited by examiner]
US 20150058723A1 · Cieplinski · 2015 [cited by examiner]
US 20150234567A1 · Wakatsuki · 2015 [cited by examiner]
US 20170090725A1 · Jansky · 2017 [cited by examiner]
US 20180046359A1 · Kim · 2018 [cited by examiner]
US 20180158243A1 · Gleason · 2018 [cited by examiner]
US 20190057531A1 · Sareen · 2019 [cited by applicant]
US 20190362557A1 · Lacey · 2019 [cited by examiner]
US 20220113842A1 · Kim · 2022 [cited by examiner]
JP 2002042172A · 2002 [cited by applicant]
JP 2018045338A · 2018 [cited by applicant]
JP 2018081694A · 2018 [cited by applicant]
JP 2021009552A · 2021 [cited by applicant]
WO WO2020195292A1 · 2020 [cited by applicant]