IP Library › Granted Patent US 12,140,948
Granted Patent B2
US 12,140,948 · App. 17/632,791 · Granted Nov 12, 2024

Information processing device, information processing method, information processing program, and control device

Inventor: Tomoya Kimura (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G05D1/0044G05D1/0016G05D1/0219G05D1/0246
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,140,948
App. No.
17/632,791
Granted
Nov 12, 2024
Kind
B2
Abstract

An information processing device ( 100 ) includes an acquisition unit ( 151 ) that acquires instruction information including an instruction from an operator on a moving direction for a moving body, a transformation unit ( 154 ) that transforms the moving direction included in the instruction information acquired by the acquisition unit ( 151 ) into a moving direction in a relative coordinate system based on a reference position, which is determined according to a surrounding environment of the moving body, and a relative position of the moving body, and a control unit ( 156 ) that controls a moving direction of the moving body on the basis of the moving direction transformed by the transformation unit ( 154 ).

Claims (43)

1. An information processing device comprising:

circuitry configured to

acquire instruction information including instruction from an operator on a first moving direction for a moving body in an absolute coordinate system,

transform, in real time, the first moving direction included in the acquired instruction information into a second moving direction in a relative coordinate system based on a reference position, which is determined according to a surrounding environment of the moving body, and a relative position of the moving body to the reference position, the reference position being determined based on a centroid of a group comprising a plurality of operation targets as a group to be photographed by the moving body,

determine that the one of the plurality of targets is separated from the group, under a condition that a distance between the one of the plurality of targets and the centroid of the group exceeds a predetermined threshold,

switch the reference position, in the relative coordinate system, from the current reference position determined based on the plurality of targets, to a new reference position determined based on the one of the plurality of targets that is separate from the group, and

control the moving body on the basis of the second moving direction.

2. The information processing device according to claim 1 , wherein

the circuitry is configured to

transform the first moving direction included in the acquired instruction information into the second moving direction in the relative coordinate system based on the reference position, which is a position of at least one of operation targets of the moving body, and the relative position of the moving body.

3. The information processing device according to claim 2 , wherein

the circuitry is configured to

transform the first moving direction included in the acquired instruction information into the second moving direction in the relative coordinate system based on the reference position, which is located at a predetermined relative position from the position of at least one of the operation targets of the moving body, and the relative position of the moving body.

4. The information processing device according to claim 3 , wherein

the circuitry is configured to

transform the first moving direction included in the acquired instruction information into the second moving direction in the relative coordinate system based on the reference position located at the predetermined relative position, which is determined according to the surrounding environment of the moving body, from the position of at least one of the operation targets of the moving body and the relative position of the moving body.

5. The information processing device according to claim 1 , wherein the circuitry is configured to determine whether environmental information related to the surrounding environment of the moving body satisfies a predetermined condition, change, in a case where the circuitry determines that the environment information satisfies the predetermined condition, the reference position to a reference position corresponding to the predetermined condition, and

transform the first moving direction included in the acquired instruction information into the second moving direction in a relative coordinate system based on the changed reference position and the relative position of the moving body.

6. The information processing device according to claim 5 , wherein

the circuitry is configured to acquire, as the environmental information, sensor information that is related to the surrounding environment of the moving body and detected by a sensor, and

determine whether the acquired sensor information acquired by satisfies a predetermined condition.

7. The information processing device according to claim 5 , wherein

the circuitry is configured to

determine whether an amount of change in the acquired sensor information acquired satisfies the predetermined condition.

8. A control device comprising:

circuitry configured to

control transmission of instruction from an operator on a first moving direction for a moving body in an absolute coordinate system, to the moving body, and

display, in a manner visible to the operator, a simulation image of a case where the first moving direction of the moving body is transformed, in real time, into a second moving direction in a relative coordinate system based on a reference position determined according to a surrounding environment of the moving body and a relative position of the moving body and the moving body is controlled on the basis of the transformed second moving direction,

wherein the reference position is determined based on a centroid of a group comprising a plurality of operation targets as a group to be photographed by the moving body,

under a condition that a distance between the one of the plurality of targets and the centroid of the group exceeds a predetermined threshold, it is determined that the one of the plurality of targets is separated from the group,

the reference position is switched, in the relative coordinate system, from the current reference position determined based on the plurality of targets, to a new reference position determined based on the one of the plurality of targets that is separate from the group.

9. An information processing method comprising:

acquiring instruction information including an instruction from an operator on a first moving direction for a moving body in an absolute coordinate system;

transforming, in real time, the first moving direction included in the acquired instruction information into a second moving direction in a relative coordinate system based on a reference position, which is determined according to a surrounding environment of the 4 moving body, and a relative position of the moving body to the reference position, the reference position being determined based on a centroid of a group comprising a plurality of operation targets as a group to be photographed by the moving body;

determining that the one of the plurality of targets is separated from the group, under a condition that a distance between the one of the plurality of targets and the centroid of the group exceeds a predetermined threshold;

switching the reference position, in the relative coordinate system, from the current reference position determined based on the plurality of targets, to a new reference position determined based on the one of the plurality of targets that is separate from the group; and

controlling the moving body on the basis of the transformed second moving direction.

10. A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by an information processing device, cause the information processing device to perform a method, the method comprising:

acquiring instruction information including an instruction from an operator on a first moving direction for a moving body in an absolute coordinate system;

transforming, in real time, the first moving direction included in the acquired instruction information into a second moving direction in a relative coordinate system based on a reference position, which is determined according to a surrounding environment of the moving body, and a relative position of the moving body to the reference position, the reference position being determined based on a centroid of a group comprising a plurality of operation targets as a group to be photographed by the moving body;

determining that the one of the plurality of targets is separated from the group, under a condition that a distance between the one of the plurality of targets and the centroid of the group exceeds a predetermined threshold;

switching the reference position, in the relative coordinate system, from the current reference position determined based on the plurality of targets, to a new reference position determined based on the one of the plurality of targets that is separate from the group; and

controlling the moving body on the basis of the transformed second moving direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2022
From: KIMURA, TOMOYA
To: SONY GROUP CORPORATION
Reel/Frame 058884/0746 →
Priority Claims (1)
JP 2019-165477 · Sep 11, 2019 · national
Continuity (1)
Related Publication 20220291679A1 · Sep 15, 2022