IP Library › Granted Patent US 12,292,742
Granted Patent B2
US 12,292,742 · App. 17/802,962 · Granted May 6, 2025

Information processing method and information processor

Inventors: Keisuke Maeda (Tokyo, JP); Tatsuya Ishizuka (Tokyo, JP); Mitsuru Nakada (Tokyo, JP); Dai Kobayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G05D1/0246G05D1/0212G05D1/0274
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,292,742
App. No.
17/802,962
Granted
May 6, 2025
Kind
B2
Abstract

There is provided an information processing method of the present disclosure includes performing processing to receive, on a predetermined coordinate system, input information including multiple scheduled points of shooting by a camera provided in a mobile body and information on respective camera attitudes at the multiple scheduled shooting points. The information processing method further includes performing processing to create a prior trajectory of the mobile body on a basis of the received input information.

Claims (38)

1. An information processing method, comprising:

receiving, on a specific coordinate system, input information including:

a first information corresponding to multiple scheduled points of shooting by a camera in a mobile body, and

a second information corresponding to respective camera attitudes at the multiple scheduled points of shooting;

creating a prior trajectory of the mobile body based on the received input information, wherein the creation of the prior trajectory includes creation of a partial trajectory based on

a first camera attitude at a first scheduled point of shooting of the multiple scheduled points of shooting, and

a second camera attitude at a second scheduled point of shooting of the multiple scheduled points of shooting;

evaluating that the created partial trajectory is passable by the mobile body, wherein

the evaluation includes a determination that a moving direction, based on a movement through the partial trajectory, is passable by a kinetic capability of the mobile body; and

controlling a drive mechanism of the mobile body based on the evaluation.

2. The information processing method according to claim 1 , further comprising: creating the partial trajectory based on a determination that the partial trajectory is evaluated as unpassable.

3. The information processing method according to claim 1 , further comprising: receiving the input information based on a determination that the partial trajectory is evaluated as unpassable.

4. The information processing method according to claim 1 , wherein the evaluation includes processing to evaluate that at least one of a speed, acceleration, or jerk upon movement through the partial trajectory is passable by the kinetic capability of the mobile body.

5. The information processing method according to claim 1 , wherein the creation of the partial trajectory includes creation of multiple trajectory candidates between a plurality of attitudes of the first camera attitude and the second camera attitude, based on the kinetic capability of the mobile body.

6. The information processing method according to claim 1 , wherein the specific coordinate system includes a map coordinate system.

7. The information processing method according to claim 1 , wherein the specific coordinate system includes a self-position coordinate system.

8. An information processing device, comprising:

a memory; and

a central processing unit (CPU) configured to;

receive, on a specific coordinate system, input information including:

a first information corresponding to multiple scheduled points of shooting by a camera in a mobile body, and

a second information corresponding to respective camera attitudes at the multiple scheduled points of shooting;

create a prior trajectory of the mobile body based on the received input information, wherein the creation of the prior trajectory includes creation of a partial trajectory based on

a first camera attitude at a first scheduled point of shooting of the multiple scheduled points of shooting, and

a second camera attitude at a second scheduled point of shooting of the multiple scheduled points of shooting;

evaluate that the created partial trajectory is passable by the mobile body, wherein

the evaluation includes a determination that a moving direction, based on a movement through the partial trajectory, is passable by a kinetic capability of the mobile body; and

control a drive mechanism of the mobile body based on the evaluation.

9. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

receiving, on a specific coordinate system, input information including:

a first information corresponding to multiple scheduled points of shooting by a camera in a mobile body, and

a second information corresponding to respective camera attitudes at the multiple scheduled points of shooting;

creating a prior trajectory of the mobile body based on the received input information, wherein the creation of the prior trajectory includes creation of a partial trajectory based on

a first camera attitude at a first scheduled point of shooting of the multiple scheduled points of shooting, and

a second camera attitude at a second scheduled shooting point of shooting of the multiple scheduled points of shooting;

evaluating that the created partial trajectory is passable by the mobile body, wherein

the evaluation includes a determination that a moving direction, based on a movement through the partial trajectory, is passable by a kinetic capability of the mobile body; and

controlling a drive mechanism of the mobile body based on the evaluation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2022
From: MAEDA, KEISUKE; ISHIZUKA, TATSUYA; NAKADA, MITSURU; KOBAYASHI, DAI
To: SONY GROUP CORPORATION
Reel/Frame 060920/0751 →
Priority Claims (1)
JP 2020-039276 · Mar 6, 2020 · national
Continuity (1)
Related Publication 20230107289A1 · Apr 6, 2023
References Cited (25)
US 20160004795A1 · Novak · 2016 [cited by applicant]
US 20190050005A1 · Kenneally · 2019 [cited by examiner]
JP 2003266347A · 2003 [cited by applicant]
JP 2007015037A · 2007 [cited by applicant]
JP 2010202178A · 2010 [cited by applicant]
JP 2012059176A · 2012 [cited by applicant]
JP 2012185752A · 2012 [cited by applicant]
JP 2016095841A · 2016 [cited by applicant]
JP 2017173966A · 2017 [cited by applicant]
JP 2017208678A · 2017 [cited by applicant]
JP 2018039420A · 2018 [cited by applicant]
JP 2018509676A · 2018 [cited by applicant]
JP 2018535487A · 2018 [cited by applicant]
JP 2019032234A · 2019 [cited by applicant]
JP 2020135327A · 2020 [cited by applicant]
WO 2018193574A1 · 2018 [cited by applicant]
WO WO2018198281A · 2018 [cited by applicant]
WO 2019171824A1 · 2019 [cited by applicant]
International Search Report and Written Opinion of PCT Application No. PCT/JP2021/007151, issued on May 18, 2021, 10 pages of ISRWO. [cited by applicant]
“Use Waypoint 2.0 with DJI GO 4 and Enjoy Automatic Drone Flight!”, Drone Guide, Feb. 19, 2019, 13 pages. [cited by applicant]
Tassa, et al., “Control-Limited Differential Dynamic Programming”, IEEE, International Conference on Robotics and Automation (ICRA), May 31-Jun. 7, 2014, 08 pages. [cited by applicant]
Alberto Elfes, “Using occupancy grids for mobile robot perception and navigation”, Computer, ResearchGate, Jul. 1989, pp. 46-57. [cited by applicant]
Rusu, et al., “3D is here: Point Cloud Library (PCL)”, IEEE, International Conference on Robotics and Automation (ICRA), May 9-13, 2011, 04 pages. [cited by applicant]
Paden, et al., “A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehicles”, Arxiv, Cornell University, Apr. 25, 2016, 27 pages. [cited by applicant]
How to use the way point 2.0 by a camera and DJI GO—I will enjoy the automatic flight of a drone! [cited by applicant]