IP Library Granted Patent US 9,785,149
Granted Patent B2
US 9,785,149 · App. 15/139,073 · Granted Oct 10, 2017

Time-dependent navigation of telepresence robots

Inventors: Yulun Wang (Goleta, CA); Charles S. Jordan (Santa Barbara, CA); Tim Wright (Santa Barbara, CA); Michael Chan (Santa Barbara, CA); Marco Pinter (Santa Barbara, CA); Kevin Hanrahan (Santa Barbara, CA); Daniel Sanchez (Summerland, CA); James Ballantyne (Santa Barbara, CA); Cody Herzog (Santa Barbara, CA); Blair Whitney (Santa Barbara, CA); Fuji Lai (Goleta, CA); Kelton Temby (Goleta, CA); Eben Christopher Rauhut (Watertown, MA); Justin H. Kearns (Cambridge, MA); Cheuk Wah Wong (Bedford, MA); Timothy Sturtevant Farlow (Needham, MA)
Assignees: INTOUCH TECHNOLOGIES, INC.; IROBOT CORPORATION
G05D1/0217B25J9/1689B25J11/009G05D1/0011G05D1/0088G05D1/028G05D1/0214G05D1/0259G05D1/0261G05D1/0274G06F19/3418G06T11/00G05D1/024G05D2201/0206
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,785,149
App. No.
15/139,073
Granted
Oct 10, 2017
Kind
B2
Abstract

A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a map, or by using a joystick or other peripheral device.

Claims (35)

1. A telepresence robot, comprising:

a drive system configured to move the telepresence robot according to drive instructions;

a control system in communication with the drive system, the control system configured to generate the drive instructions to cause the drive system to move the telepresence robot along a navigation path;

a mapping module in communication with the control system, the mapping module configured to access a map data source, the map data source including:

a robot map representative of a robot operating surface; and

one or more time-dependent navigation tags, each time-dependent navigation tag being a data structure comprising:

spatial coordinates locatable relative to the robot map and associated with the robot operating surface; and

tag information comprising a time-dependent robot action modifier;

a positioning system in communication with the control system configured to provide positioning information associated with a current position;

a tag identification system configured to identify at least one time-dependent navigation tag that includes a time-dependent robot action modifier associated with the navigation path of the telepresence robot; and

a navigation system configured to generate the navigation path, the navigation path comprising a sequence of coordinates from the current position on the robot map to a desired position on the robot map,

wherein the navigation system is configured to be triggered by an identified time-dependent navigation tag and associated time-dependent robot action modifier to plan the navigation path based, at least in part, on the time-dependent robot action modifier associated with the identified time-dependent navigation tag.

2. The telepresence robot of claim 1 , wherein the navigation system is configured to generate the navigation path by generating a plurality of potential navigation paths, wherein each potential navigation path has an associated cost based on the time-dependent robot action modifiers associated with the time-dependent navigation tags along the respective potential navigation path; and

selecting the navigation path from the plurality of potential navigation path based on the associated cost.

3. The telepresence robot of claim 1 , further comprising:

a plurality of sensors configured to identify obstacles in a vicinity of the telepresence robot; and

an obstacle avoidance system in communication with the plurality of sensors and in communication with the control system, wherein the control system is further configured to generate additional drive instructions to avoid obstacles in the vicinity of the telepresence robot.

4. The telepresence robot of claim 3 , wherein the plurality of sensors comprises a three-dimensional image sensor that forms a point cloud, including a three-dimensional occupancy of obstacles, and

wherein the drive instructions are configured to avoid the three-dimensional occupancy of the obstacles.

5. The telepresence robot of claim 1 , further comprising a plurality of sensors monitoring time-dependent obstacles, time-dependent environmental conditions and time-dependent occupancy conditions, wherein the plurality of sensors are mounted on the telepresence robot and in remote communication with the telepresence robot.

6. The telepresence robot of claim 5 , wherein the telepresence robot is configured to create a time-dependent navigation tag based on information from the plurality of sensors and time of day information.

7. The telepresence robot of claim 1 , wherein the map data source is stored remotely, such that the mapping module is configured to access the map data source via a communication system.

8. The telepresence robot of claim 1 , wherein the map data source is stored within the telepresence robot, such that the mapping module is configured to access an internal map data source.

9. The telepresence robot of claim 8 , wherein the internal map data source is synced with a remotely stored map data source.

10. The telepresence robot of claim 1 , wherein the positioning system comprises an RFID reader,

wherein the positioning system associates a plurality of RFID chips with a corresponding plurality of coordinates on the plan view robot map, and the positioning system is configured to determine the current position of the telepresence robot based at least in part on a location of one or more RFID chips within range of the RFID reader.

11. A method for controlling a telepresence robot, comprising:

retrieving at least a portion of a robot map;

retrieving at least one of one or more time-dependent navigation tags, each time-dependent navigation tag represented by a data structure including:

tag coordinates describing a location of the at least one of one or more time-dependent navigation tag relative to the robot map; and

cost information associated with navigating in the relative location of the time-dependent navigation tag during a time period;

determining a current position of a telepresence robot relative to the robot map;

generating a navigation path comprising a sequence of coordinates from the current position to a desired position on the robot map, wherein generating the navigation path includes:

generating a plurality of potential navigation paths, wherein each potential navigation path has an associated cost based on time-dependent navigation tags associated with the respective potential navigation path, wherein each time-dependent navigation tag comprises a time-dependent robot action modifier configured to trigger a response action by a telepresence robot during a time period; and

selecting a navigation path from the plurality of potential navigation paths based on the associated cost.

Assignments (15)
NOTICE OF ASSIGNMENT OF SECURITY INTEREST IN INTELLECTUAL PROPERTY Recorded Nov 25, 2025
From: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
To: SANTRUM HONG KONG CO., LIMITED, AS SUCCESSOR COLLATERAL AGENT
Reel/Frame 073707/0516 →
CONFIRMATORY GRANT OF SECURITY INTEREST IN UNITED STATES PATENTS Recorded Jul 18, 2025
From: TELADOC HEALTH, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 072066/0931 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2025
From: IROBOT CORPORATION
To: TELADOC HEALTH, INC.
Reel/Frame 071376/0085 →
SECURITY INTEREST Recorded Aug 9, 2023
From: IROBOT CORPORATION
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 064532/0856 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2023
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: IROBOT CORPORATION
Reel/Frame 064430/0001 →
SECURITY INTEREST Recorded Nov 3, 2022
From: IROBOT CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061878/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXEUTION DATE OF THE MERGER FROM 01/11/2020 TO 07/01/2020, PREVIOUSLY RECORDED ON REEL 053705 FRAME 0728. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Jan 14, 2021
From: INTOUCH TECHNOLOGIES, INC.; JONATA SUB ONE, INC.
To: INTOUCH TECHNOLOGIES, INC.
Reel/Frame 054986/0508 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF THE MERGER FROM 01/11/2020 TO 07/01/2020 PREVIOUSLY RECORDED AT REEL: 053705 FRAME: 0839. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 14, 2021
From: INTOUCH TECHNOLOGIES, INC.; JONATA SUB TWO, INC.
To: JONATA SUB TWO, INC.
Reel/Frame 054999/0001 →
MERGER Recorded Sep 4, 2020
From: INTOUCH TECHNOLOGIES, INC.; JONATA SUB TWO, INC.
To: JONATA SUB TWO, INC.
Reel/Frame 053705/0839 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2020
From: INTOUCH TECHNOLOGIES, INC.
To: TELADOC HEALTH, INC.
Reel/Frame 053743/0661 →
MERGER AND CHANGE OF NAME Recorded Sep 4, 2020
From: INTOUCH TECHNOLOGIES, INC.; JONATA SUB TWO, INC.
To: INTOUCH TECHNOLOGIES, INC.
Reel/Frame 054690/0327 →
MERGER Recorded Sep 4, 2020
From: INTOUCH TECHNOLOGIES, INC.; JONATA SUB ONE, INC.
To: INTOUCH TECHNOLOGIES, INC.
Reel/Frame 053705/0728 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY AT REEL/FRAME NO. 45488/0518 Recorded Jul 1, 2020
From: MIDCAP FINANCIAL TRUST, AS AGENT
To: INTOUCH TECHNOLOGIES, INC.; ACUTECARE TELEMEDICINE, LLC; C30 CORPORATION; INTOUCH HEALTH PROVIDERS, LLC; ITH DTC, LLC
Reel/Frame 053117/0060 →
SECURITY INTEREST Recorded Mar 2, 2018
From: INTOUCH TECHNOLOGIES, INC.; ACUTECARE TELEMEDICINE, LLC; C30 CORPORATION; INTOUCH HEALTH PROVIDERS, LLC; ITH DTC, LLC
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 045488/0518 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2016
From: WANG, YULUN; JORDAN, CHARLES S.; WRIGHT, TIM; CHAN, MICHAEL; PINTER, MARCO; HANRAHAN, KEVIN; SANCHEZ, DANIEL; BALLANTYNE, JAMES; HERZOG, CODY; WHITNEY, BLAIR; LAI, FUJI; TEMBY, KELTON; RAUHUT, EBEN CHRISTOPHER; KEARNS, JUSTIN H.; WONG, CHEUK WAH; FARLOW, TIMOTHY STURTEVANT
To: INTOUCH TECHNOLOGIES, INC.; IROBOT CORPORATION
Reel/Frame 038633/0453 →
Continuity (4)
Continuation 13958413 · Aug 2, 2013
Continuation In Part 13360579 · Jan 27, 2012
Provisional Application 61437433 · Jan 28, 2011
Related Publication 20170023944A1 · Jan 26, 2017