IP Library Granted Patent US 11,886,182
Granted Patent B2
US 11,886,182 · App. 17/417,176 · Granted Jan 30, 2024

Systems and methods of detecting intent of spatial control

Inventors: Matthew D. Summer (Melbourne, FL); William S. Bowman (Melbourne, FL); Andrew D. Falendysz (Winter Green, FL); Kevin M. Makovy (Palm Bay, FL); Daniel R. Hedman (Palm Bay, FL); Bradley D. Truesdell (Vero Beach, FL)
Assignee: Tomahawk Robotics, Inc.
G05D1/0016B62D57/02G05D1/0033G05D1/0038G05D1/0223G06F3/0346
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,886,182
App. No.
17/417,176
Granted
Jan 30, 2024
Kind
B2
Abstract

Systems and methods of manipulating/controlling robots. In many scenarios, data collected by a sensor (connected to a robot) may not have very high precision (e.g., a regular commercial/inexpensive sensor) or may be subjected to dynamic environmental changes. Thus, the data collected by the sensor may not indicate the parameter captured by the sensor with high accuracy. The present robotic control system is directed at such scenarios. In some embodiments, the disclosed embodiments can be used for computing a sliding velocity limit boundary for a spatial controller. In some embodiments, the disclosed embodiments can be used for teleoperation of a vehicle located in the field of view of a camera.

Claims (41)

1. A method of detecting an intent of spatial control of a vehicle comprising:

receiving, from a spatial controller, spatial motion data generated from movement of the spatial controller with respect to a global reference frame, wherein the spatial motion data of the spatial controller is representative of a desired motion of at least a portion of a vehicle;

computing, from the spatial motion data, an initial desired velocity vector representing a desired linear velocity or a desired angular velocity of at least the portion of the vehicle;

transforming the initial desired velocity vector from the global reference frame into a control reference frame;

identifying, from a set of principal axis directions that are parallel to principal axes of the control reference frame, a nearest principal axis direction based on comparing a direction of the initial desired velocity vector with the set of principal axis directions;

computing a misalignment angle that represents a deviation in the direction of the initial desired velocity vector from the nearest principal axis direction;

upon determining that the misalignment angle is less than or equal to an axis-snapping tolerance value, defining a final desired velocity vector by rotating the initial desired velocity vector such that the final desired velocity vector parallel to the nearest principal axis direction; and

sending information indicating the final desired velocity vector to at least the portion of the vehicle.

2. The method of claim 1 , wherein at least the portion of the vehicle is remotely located from the spatial controller, and wherein sending the final desired velocity vector uses a wired network connection or a wireless network connection.

3. The method of claim 1 , further comprising:

upon determining that the misalignment angle is greater than the axis-snapping tolerance value, defining the final desired velocity vector equal to the initial desired velocity vector.

4. The method of claim 1 , wherein transforming the initial desired velocity vector from the global reference frame into the control reference frame includes:

selecting the control reference frame from one of: a reference frame of the spatial controller, a reference frame of a user interface, a reference frame of at least the portion of the vehicle.

5. The method of claim 1 , wherein sending the information indicating the final desired velocity vector includes:

transforming the final desired velocity vector into a reference frame of at least the portion of the vehicle.

6. A method of detecting an intended regime of a velocity command associated with spatial control of a vehicle comprising:

receive, from a spatial controller, spatial motion data generated from movement of the spatial controller with respect to a global reference frame, wherein the spatial motion data is representative of a desired motion of at least a portion of a vehicle;

compute, from the spatial motion data, a desired linear velocity vector and a desired angular velocity vector of at least the portion of the vehicle;

compute a linear ratio by dividing a magnitude of the desired linear velocity vector by a linear magnitude threshold and an angular ratio by dividing a magnitude of the desired angular velocity vector by an angular magnitude threshold;

upon determining that the linear ratio or the angular ratio satisfies one or more rules associated with the desired linear velocity vector, ignoring the desired linear velocity vector;

upon determining that the linear ratio or the angular ratio satisfies one or more rules associated with the desired angular velocity vector, ignoring the desired angular velocity vector; and

sending data indicating the desired linear velocity vector and the desired angular velocity vector to at least the portion of the vehicle.

7. The method of claim 6 , wherein sending the data indicating the desired linear velocity vector and the desired angular velocity vector includes:

transforming the desired linear velocity vector and the desired angular velocity vector into a reference frame defined with respect to at least the portion of the vehicle.

8. The method of claim 6 , wherein ignoring the desired linear velocity vector and/or ignoring the desired angular velocity vector includes:

setting the desired linear velocity vector and/or the desired angular velocity vector to zero.

9. The method of claim 6 , wherein the desired linear velocity vector and/or the desired angular velocity vector are represented in at least one of: a 1-dimensional space, a 2-dimensional space, or a 3-dimensional space.

10. The method of claim 6 , wherein the spatial motion data generated from the movement of the spatial controller includes at least one linear degree-of-freedom and at least one angular degree-of-freedom.

11. The method of claim 6 , wherein the one or more rules associated with the desired linear velocity vector include a rule to determine whether the linear ratio is less than 1 and also less than the angular ratio.

12. The method of claim 6 , wherein the one or more rules associated with the desired angular velocity vector include a rule to determine whether the angular ratio is less than 1 and also less than the linear ratio.

13. A method of computing a sliding velocity limit boundary for a spatial controller comprising:

receiving, at a computing device electronically coupled to the spatial controller configured to remotely operate a vehicle, information describing a first position boundary of the spatial controller corresponding to a maximum velocity of the vehicle or a part thereof;

receiving information describing a current position of the spatial controller;

using the information describing the current position of the spatial controller to determine that the current position of the spatial controller is outside the first position boundary;

identifying a displacement vector corresponding to a difference between the current position of the spatial controller and the first position boundary;

adding the displacement vector to the first position boundary to generate a second position boundary such that the current position of the spatial controller is at the second position boundary;

updating the first position boundary as the second position boundary; and

computing a target velocity of the vehicle or the part thereof, based on a difference between the current position of the spatial controller and a center of the first position boundary such that the vehicle or the part thereof to move in accordance with the target velocity.

14. The method of claim 13 , wherein the current position of the spatial controller, the first position boundary, and the second position boundary are represented using one of: a 1-dimensional space, a 2-dimensional space, or a 3-dimensional space.

15. The method of claim 13 , further comprising:

upon determining that the current position of the spatial controller is inside the first position boundary, keeping the first position boundary unchanged.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 058136 FRAME: 0924. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 4, 2023
From: SUMMER, MATTHEW D.; BOWMAN, WILLIAM S.; FALENDYSZ, ANDREW D.; MAKOVY, KEVIN M.; HEDMAN, DANIEL R.; TRUESDELL, BRADLEY D.
To: TOMAHAWK ROBOTICS, INC.
Reel/Frame 065762/0058 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Oct 30, 2023
From: TOMAHAWK ROBOTICS, INC.
To: BANK OF AMERICA, N.A., AS THE ADMINISTRATIVE AGENT
Reel/Frame 065394/0847 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2021
From: SUMMER, MATTHEW D.; BOWMAN, WILLIAM S.; FALENDYSZ, ANDREW D.; MAKOVY, KEVIN M.; HEDMAN, DANIEL R.; TRUESDELL, BRADLEY D.
To: TOMAHAWK ROBOTICS
Reel/Frame 058136/0924 →
Continuity (2)
Provisional Application 62786888 · Dec 31, 2018
Related Publication 20220083069A1 · Mar 17, 2022