IP Library › Granted Patent US 12,459,123
Granted Patent B2
US 12,459,123 · App. 18/167,851 · Granted Nov 4, 2025

Robot system with object detecting sensors

Inventors: Pei Jui Wang (New Taipei, TW); Gerry Vannuffelen (Danville, CA)
Assignee: Mantis Robotics, Inc.
B25J9/1676B25J9/1694B25J13/086G01S13/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,459,123
App. No.
18/167,851
Filed
Feb 11, 2023
Granted
Nov 4, 2025
Kind
B2
Art Unit
3656
USPC
700/255
Abstract

A robot system is provided that includes movable parts, one or more object detecting sensors, and one or more processors, wherein the one or more object detecting sensors is dispose at or near the elbow, the wrist, or the position between the elbow and the wrist of the robot. Multiple embodiments are introduced for the implementation of the object detection of the robot system.

Claims (53)

1 . A robot system comprising:

a base;

a plurality of movable linkages driven by joints with actuators, wherein a movable linkage in the plurality of movable linkages farthest from the base has a tool end and is configured to drive the tool end along an axis, the joints comprise a pivot joint hinging a proximal linkage and a distal linkage from the plurality of movable linkages, the pivot joint has at least one pivot axis, and the pivot joint is located in an elbow or a wrist of the robot system;

at least one joint monitoring sensor configured to monitor the joints;

one or more object detecting sensors mounted to at least one movable linkage of the plurality of movable linkages, wherein the one or more object detecting sensors are oriented to exhibit a total field of view that covers a direction selected from the group consisting of:

an axial direction of the at least one pivot axis of the pivot joint,

a radial direction of the at least one pivot axis of the pivot joint; and

a direction oriented between the axial direction and the radial direction of the at least one pivot axis of the pivot joint; and

one or more processors communicatively coupled to the joint monitoring sensors and the one or more object detecting sensors, the one or more processors being configured to:

detect an external object based on information generated by the one or more object detecting sensors, and

when the external object is detected intruding on a first monitoring zone, reduce a moving speed of at least one movable linkage of the plurality of movable linkages, wherein at least one non-overlapping space between fields of view of the one or more object detecting sensors has a projection in the first monitoring zone, and wherein an overlap of the projection with the external object is smaller than a size of the external object when the at least one movable linkage is moving in a set movable range.

2 . The robot system of claim 1 , wherein the one or more object detecting sensors comprise a sensor selected from the group consisting of: an optical radar, an optical imaging sensor, an array of proximity sensors, and an imaging radar, wherein the one or more processors is configured to detect the external object intruding on the first monitoring zone by comparing a set environmental model and detections performed by the one or more object detecting sensors, and wherein the set environmental model is generated by an element selected from the group consisting of: a preset digital data, a computer-aided design (CAD) file, and the one or more object detecting sensors.

3 . The robot system of claim 1 , wherein the one or more object detecting sensors comprise a radar sensor comprising at least a radio wave transmitter and a receiver, the one or more processors is configured to:

detect a speed of the external object based on an output of the radar sensor;

compensate the detected speed when the at least one movable linkage is moving based on a position of a mounting point of the radar sensor and kinematics of the robot system, and

detect that the external object is intruding on the first monitoring zone when the external object has a speed greater than a set threshold.

4 . The robot system of claim 3 , wherein the first monitoring zone has an external boundary and the one or more processors is configured to neglect radio wave signals received at the receiver from a location expected to be outside of the first monitoring zone based on a frequency or amplitude of the radio wave signals received at the receiver.

5 . The robot system of claim 3 , wherein the first monitoring zone has an internal boundary and the one or more processors is configured to stop motion of the at least one movable linkage when the external object is detected as intruding within the internal boundary of the first monitoring zone.

6 . The robot system of claim 1 , wherein the one or more processors is configured with one or more immunity zones within the first monitoring zone, in which the one or more processors does not detect whether the external object is intruding.

7 . The robot system of claim 1 , wherein the object detecting sensor comprises at least two detecting elements with overlapping detecting fields of view, and wherein the one or more processors is configured to:

compare sensing information from the at least two detecting elements, and

stop motion of the at least one movable linkages while a difference in the sensing information is greater than a set threshold.

8 . The robot system of claim 1 , wherein the one or more processors is configured to detect that the external object is intruding on the first monitoring zone when the one or more processors detects that the external object has a speed greater than a set threshold and an approaching direction, wherein the one or more processors is further configured to detect that the external object is a leaving object when the one or more processors detects that the external object has a speed greater than the set threshold with a direction away from at least one movable linkage, and wherein the one or more processors is further configured to control the at least one movable linkage to re-initialize a motion or increase its speed according to one or more conditions including a number of intruding objects within a set distance from the at least one movable linkage.

9 . The robot system of claim 1 , wherein the one or more processors is further configured to:

detect that the external object is a departing object when the external object is detected in a second monitoring zone with a speed greater than a set threshold and a direction away from the at least one movable linkage, the second monitoring zone having an internal boundary defined by an external boundary of the first monitoring zone, and

control the at least one movable linkage to re-initialize a motion or increase speed according to one or more conditions including a number of external objects detected as intruding within a set range of distances from the at least one movable linkage.

10 . The robot system of claim 1 , wherein the set movable range is constrained by a set limit, the one or more processors is configured to monitor positions of one or more position monitoring points on one or more of the movable linkages, and the one or more processors is configured to stop motion of the at least one movable linkage when any of the monitored positions exceeds the set limit.

11 . The robot system of claim 1 , further comprising a vertical articulated robot that includes the plurality of movable linkages, the plurality of movable linkages having four or more degrees of freedom.

12 . The robot system of claim 1 , further comprising a software interface including a two-dimensional or three-dimensional visualization of the one or more fields of view of the one or more object detecting sensors.

13 . The robot system of claim 12 , the one or more processors being further configured to simulate the one or more fields of view of the one or more object detecting sensors according to a motion of the at least one movable linkage.

14 . The robot system of claim 1 , further comprising a guiding function in which the one or more processors moves the at least one of the movable linkages according to output from the one or more object detecting sensors.

15 . The robot system of claim 14 , further comprises a switching function to switch the one or more processors between detecting whether the external object is intruding and performing a gesture detection function.

16 . The robot system of claim 1 , wherein the one or more processors is configured to, when the intruding object is detected in the first monitoring zone, stop motion of the at least one movable linkage of the plurality of movable linkages.

17 . The robot system of claim 1 , wherein the one or more processors is configured to, when the intruding object is detected in the first monitoring zone, monitor a speed of one or more monitoring points on the plurality of movable linkages and stop the at least one movable linkage when the monitored speed exceeds a set speed limit.

18 . The robot system of claim 1 , wherein the one or more object detecting sensors are oriented to exhibit a total field of view that covers an axial direction of the at least one pivot axis of the pivot joint and a radial direction of the at least one pivot axis of the pivot joint.

19 . A robot comprising:

a base;

a plurality of movable linkages coupled to joints with actuators, wherein the joints comprise a pivot joint hinging a proximal linkage and a distal linkage from the plurality of movable linkages, and the pivot joint having at least one pivot axis;

an object detecting sensor mounted to at least one movable linkage of the plurality of movable linkages, the object detecting sensor having a total field of view that covers a direction selected from the group consisting of:

an axial direction of the at least one pivot axis of the pivot joint,

a radial direction of the at least one pivot axis of the pivot joint; and

a direction oriented between the axial direction and the radial direction of the at least one pivot axis of the pivot joint; and

one or more processors configured to:

detect an external object based on information generated by the one or more object detecting sensors, and

when the external object is detected within a monitoring zone proximate the robot, reduce a speed of at least one movable linkage of the plurality of movable linkages, wherein at least one non-overlapping space between fields of view of the object detecting sensor has a projection in the monitoring zone, and wherein an overlap of the projection with the external object is smaller than a size of the external object when the plurality of movable linkage is moving in a set movable range.

20 . Apparatus comprising:

one or more object detecting sensors mountable to at least one movable linkage in a plurality of movable linkages of a robot, the one or more object detecting sensors having at least a first field of view, a second field of view, and a total field of view that includes the first field of view and the second field of view, wherein the total field of view is oriented to overlap:

an axial direction of a pivot axis of a pivot joint between the plurality of movable linkages,

a radial direction of the pivot axis, or

a direction oriented between the axial direction and the radial direction of the pivot axis; and

one or more processors communicatively coupled to the one or more object detecting sensors and configured to:

detect an external object based on information generated by the one or more object detecting sensors, and

when the external object is detected intruding on a first monitoring zone, reduce a moving speed of the robot, wherein at least one non-overlapping space between the first field of view and the second field of view has a projection in the first monitoring zone, and wherein an overlap of the projection with the external object is smaller than a size of the external object when the at least one movable linkage is moving in a set movable range.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2023
From: VANNUFFELEN, GERRY; WANG, PEI JUI
To: MANTIS ROBOTICS, INC.
Reel/Frame 062665/0890 →
Continuity (3)
Provisional Application 63268116 · Feb 16, 2022
Provisional Application 63268272 · Feb 19, 2022
Related Publication 20230256606A1 · Aug 17, 2023
References Cited (32)
US 7385550B2 · Winter et al. · 2008 [cited by applicant]
US 7783386B2 · Merte et al. · 2010 [cited by applicant]
US 9043025B2 · Brooks et al. · 2015 [cited by applicant]
US 9073548B2 · Mizutani et al. · 2015 [cited by applicant]
US 9403276B2 · Nishimura et al. · 2016 [cited by applicant]
US 9475200B2 · Schlaich et al. · 2016 [cited by applicant]
US 10005184B2 · Gerio et al. · 2018 [cited by applicant]
US 10295331B2 · Albert et al. · 2019 [cited by applicant]
US 10422870B2 · Mindell et al. · 2019 [cited by applicant]
US 10675767B2 · Takaoki et al. · 2020 [cited by applicant]
US 10788576B2 · Matthias et al. · 2020 [cited by applicant]
US 10800032B2 · Kamisono · 2020 [cited by examiner]
US 11014240B2 · Cole et al. · 2021 [cited by applicant]
US 11318617B2 · Nakayama et al. · 2022 [cited by applicant]
US 11453123B2 · Peng et al. · 2022 [cited by applicant]
US 20190061155A1 · Hashimoto et al. · 2019 [cited by applicant]
US 20190143522A1 · Miyazawa · 2019 [cited by applicant]
US 20190193267A1 · Peng · 2019 [cited by applicant]
US 20190270199A1 · Ning et al. · 2019 [cited by applicant]
US 20190366544A1 · Oka · 2019 [cited by examiner]
US 20190389069A1 · Kalbavi · 2019 [cited by examiner]
US 20210239794A1 · Fauth et al. · 2021 [cited by applicant]
US 20210394367A1 · Correll · 2021 [cited by applicant]
US 20220176560A1 · Akagi et al. · 2022 [cited by applicant]
US 20220203538A1 · Ning et al. · 2022 [cited by applicant]
DE 102016007520 · 2017 [cited by applicant]
DE 212017000107 · 2018 [cited by applicant]
EP 3605135 · 2020 [cited by applicant]
JP 5343641 · 2013 [cited by applicant]
JP 2018103345 · 2018 [cited by applicant]
JP 2020075308 · 2020 [cited by applicant]
WO 2018134112 · 2018 [cited by applicant]