IP Library Granted Patent US 12,705,880
Granted Patent B2
US 12,705,880 · App. 18/149,588 · Granted Aug 11, 2026

Perception and fitting for a stair tracker

Inventors: Eric Cary Whitman (Watertown, MA); Gene Brown Merewether (Cambridge, MA)
Assignee: Boston Dynamics, Inc.
G06V20/10B62D57/02G05D1/10G06F18/243G06V10/44G06V10/764
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,705,880
App. No.
18/149,588
Granted
Aug 11, 2026
Kind
B2
Abstract

A method for perception and fitting for a stair tracker includes receiving sensor data for a robot adjacent to a staircase. For each stair of the staircase, the method includes detecting, at a first time step, an edge of a respective stair of the staircase based on the sensor data. The method also includes determining whether the detected edge is a most likely step edge candidate by comparing the detected edge from the first time step to an alternative detected edge at a second time step, the second time step occurring after the first time step. When the detected edge is the most likely step edge candidate, the method includes defining, by the data processing hardware, a height of the respective stair based on sensor data height about the detected edge. The method also includes generating a staircase model including stairs with respective edges at the respective defined heights.

Claims (45)

1 . A four-legged robot, the four-legged robot comprising:

four legs;

memory storing computer-executable instructions; and

a processor in communication with the memory, wherein the processor is configured to execute the computer-executable instructions, wherein execution of the computer-executable instructions causes the processor to:

receive data associated with a stair located within an environment of the four-legged robot;

identify that the stair is located within the environment based on the data associated with the stair, wherein the data associated with the stair indicates one or more identifications of the stair by the four-legged robot using image data or identification of an entry into a stair mode from a non-stair mode associated with traversal of the environment based on a speed of the four-legged robot;

determine a modified speed of the four-legged robot at which to traverse a set of stairs including the stair in response to the one or more identifications of the stair by the four-legged robot using the image data or the identification of the entry into the stair mode from the non-stair mode; and

subsequent to determining the modified speed, instruct the four-legged robot to navigate to a footstep location in a non-stair portion of the environment and traverse, at the modified speed, the set of stairs from the footstep location in the non-stair portion of the environment.

2 . The four-legged robot of claim 1 , wherein the processor and the computer-executable instructions are configured to modify the speed of the four-legged robot by adjusting a speed limit of the four-legged robot.

3 . The four-legged robot of claim 1 , wherein the data associated with the stair comprises sensor data from one or more sensors of the four-legged robot, the sensor data corresponding to the environment.

4 . The four-legged robot of claim 1 , wherein the processor and the computer-executable instructions are configured to receive the data associated with the stair from a user computing device, wherein the data associated with the stair indicates the identification of the entry into the stair mode.

5 . The four-legged robot of claim 1 , wherein the processor and the computer-executable instructions are configured to modify the speed of the four-legged robot by adjusting the speed from a first speed to the modified speed, wherein the four-legged robot is configured to utilize the modified speed for traversal of the set of stairs and the first speed for traversal of the non-stair portion of the environment.

6 . The four-legged robot of claim 1 , wherein the processor and the computer-executable instructions are configured to instruct the four-legged robot to traverse the set of stairs by controlling the four-legged robot to descend the set of stairs such that a back portion of the four-legged robot precedes a front portion of the four-legged robot down the set of stairs, wherein the back portion is associated with fewer sensors as compared to the front portion.

7 . The four-legged robot of claim 6 , wherein the four legs are associated with one or more knee joints configured to extend the four legs from a closed position to an open position where segments of the four legs form openings facing away from the back portion and toward the front portion.

8 . The four-legged robot of claim 1 , wherein the processor and the computer-executable instructions are configured to modify the speed by switching from a first speed of the four-legged robot to the modified speed.

9 . The four-legged robot of claim 8 , wherein the four-legged robot is configured to traverse the non-stair portion of the environment according to the first speed.

10 . The four-legged robot of claim 1 , wherein the modified speed is based on a slope associated with the stair.

11 . A legged robot, the legged robot comprising:

two or more legs;

one or more sensors; and

a control system, the control system comprising data processing hardware and memory hardware in communication with the data processing hardware, the memory hardware storing instructions, wherein execution of the instructions by the data processing hardware causes the data processing hardware to:

receive image data from the one or more sensors, the image data corresponding to an environment with a stair, wherein the legged robot traverses the environment based on a speed of the legged robot;

identify the stair based on the image data;

determine a modified speed of the legged robot at which to traverse a set of stairs including the stair in response to identifying the stair based on the image data; and

subsequent to determining the modified speed, instruct the legged robot to navigate to a footstep location in a non-stair portion of the environment and traverse, at the modified speed, the set of stairs from the footstep location in the non-stair portion of the environment.

12 . The legged robot of claim 11 , wherein the execution of the instructions by the data processing hardware causes the data processing hardware to enter a stair mode based on identifying the stair.

13 . The legged robot of claim 11 , wherein the execution of the instructions by the data processing hardware causes the data processing hardware to:

receive a command to activate a stair mode of the legged robot; and

enter the stair mode based on the command, wherein identifying the stair is further based on entering the stair mode.

14 . The legged robot of claim 11 , wherein the execution of the instructions by the data processing hardware causes the data processing hardware:

detect an edge of the stair based on the image data; and

define a height of the stair based on the edge of the stair, wherein instructing the legged robot to traverse the set of stairs is further based on the height of the stair.

15 . The legged robot of claim 11 , wherein the execution of the instructions by the data processing hardware causes the data processing hardware:

determine a rise of the stair; and

determine a run of the stair, wherein the modified speed is based on the rise of the stair and the run of the stair.

16 . A method comprising:

receiving, at data processing hardware, data identifying an entry into a stair mode of a four-legged robot from a non-stair mode of the four-legged robot, wherein the four-legged robot traverses an environment of the four-legged robot by moving four legs of the four-legged robot at a first speed lower than or equal to a speed limit of the four-legged robot based on the non-stair mode;

instructing, by the data processing hardware, the four-legged robot to operate according to the stair mode, wherein instructing the four-legged robot to operate according to the stair mode comprises determining, by the data processing hardware, an adjusted speed limit of the four-legged robot in response to the entry into the stair mode, and wherein a speed of movement of the four legs is limited using different speed limits based on operation according to the non-stair mode and operation according to the stair mode; and

subsequent to determining the adjusted speed limit, instructing, by the data processing hardware, the four-legged robot to traverse a set of stairs at a second speed lower than or equal to the adjusted speed limit.

17 . The method of claim 16 , further comprising:

determining a stride length of the four-legged robot based on a run of the set of stairs, wherein determining the adjusted speed limit is based on the stride length.

18 . The method of claim 16 , further comprising:

determining a cadence of the four-legged robot based on a run of the set of stairs, wherein determining the adjusted speed limit is based on the cadence.

19 . The method of claim 16 , wherein instructing the four-legged robot to operate according to the stair mode comprises adjusting, by the data processing hardware, a controller used by the four-legged robot from a first controller to a second controller based on the entry into the stair mode, wherein instructing the four-legged robot to traverse the set of stairs at a second speed lower than or equal to the adjusted speed limit comprises instructing the four-legged robot to traverse the set of stairs at a second speed lower than or equal to the adjusted speed limit using the second controller.

20 . The method of claim 16 , wherein receiving data identifying the entry into the stair mode comprises receiving the data identifying the entry into the stair mode from a remote controller of the four-legged robot.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2026
From: WHITMAN, ERIC CARY; MEREWETHER, GENE BROWN
To: BOSTON DYNAMICS, INC.
Reel/Frame 074813/0379 →
Continuity (3)
Continuation 16877721 · May 19, 2020
Provisional Application 63013677 · Apr 22, 2020
Related Publication 20230143315A1 · May 11, 2023
References Cited (314)
US 3533483A · Ballinger · 1970 [cited by applicant]
US 5378969A · Haikawa · 1995 [cited by applicant]
US 5402050A · Ozawa · 1995 [cited by examiner]
US 5416393A · Gomi et al. · 1995 [cited by applicant]
US 5737217A · Nishikawa et al. · 1998 [cited by applicant]
US 5838130A · Ozawa · 1998 [cited by applicant]
US 5872893A · Takenaka et al. · 1999 [cited by applicant]
US 5974366A · Kawai et al. · 1999 [cited by applicant]
US 6021363A · Nishikawa et al. · 2000 [cited by applicant]
US 6177776B1 · Kawai et al. · 2001 [cited by applicant]
US 6317652B1 · Osada · 2001 [cited by applicant]
US 6438454B1 · Kuroki · 2002 [cited by applicant]
US 6527071B1 · Villedieu · 2003 [cited by applicant]
US 6718231B2 · Konno et al. · 2004 [cited by applicant]
US 7053577B2 · Nagasaka · 2006 [cited by applicant]
US 7127326B2 · Lewis · 2006 [cited by applicant]
US 7219064B2 · Nakakita et al. · 2007 [cited by applicant]
US 7319918B2 · Takenaka et al. · 2008 [cited by applicant]
US 7482775B2 · Zaier · 2009 [cited by applicant]
US 7653216B2 · Kanade et al. · 2010 [cited by applicant]
US 7878276B2 · Limbacher · 2011 [cited by applicant]
US 7912583B2 · Gutmann et al. · 2011 [cited by applicant]
US 8289321B2 · Gutmann et al. · 2012 [cited by applicant]
US 8410732B2 · Kassow et al. · 2013 [cited by applicant]
US 8457830B2 · Goulding · 2013 [cited by applicant]
US 8614559B2 · Kassow et al. · 2013 [cited by applicant]
US 8630763B2 · Goulding · 2014 [cited by applicant]
US 8688273B2 · Lee et al. · 2014 [cited by applicant]
US 8737692B2 · Asatani · 2014 [cited by applicant]
US 8779715B2 · Kassow et al. · 2014 [cited by applicant]
US 9089968B2 · Goulding · 2015 [cited by applicant]
US 9096281B1 · Li · 2015 [cited by examiner]
US 9446518B1 · Blankespoor · 2016 [cited by applicant]
US 9488987B2 · Goulding · 2016 [cited by applicant]
US 9499218B1 · Stephens · 2016 [cited by applicant]
US 9527538B2 · Kaneko et al. · 2016 [cited by applicant]
US 9552640B2 · Yoon · 2017 [cited by applicant]
US 9561592B1 · Da Silva · 2017 [cited by applicant]
US 9594377B1 · Perkins · 2017 [cited by examiner]
US 9630319B2 · Vicenti · 2017 [cited by applicant]
US 9849926B2 · Saunders · 2017 [cited by applicant]
US 9862095B2 · Takagi et al. · 2018 [cited by applicant]
US 9868210B1 · Whitman · 2018 [cited by applicant]
US 9878751B1 · Thorne et al. · 2018 [cited by applicant]
US 9908240B1 · Da Silva · 2018 [cited by applicant]
US 9926025B1 · Blankespoor et al. · 2018 [cited by applicant]
US 9975245B1 · Whitman · 2018 [cited by applicant]
US 9989970B1 · Morey et al. · 2018 [cited by applicant]
US 10081098B1 · Nelson · 2018 [cited by applicant]
US 10099378B2 · Kaneko et al. · 2018 [cited by applicant]
US 10102429B2 · Schnittman · 2018 [cited by applicant]
US 10126757B2 · Goulding · 2018 [cited by applicant]
US 10144342B2 · Ji et al. · 2018 [cited by applicant]
US 10179619B1 · Urata · 2019 [cited by applicant]
US 10196104B1 · Kagami · 2019 [cited by applicant]
US 10327969B2 · Galonska · 2019 [cited by applicant]
US 10414318B2 · Valtanen · 2019 [cited by applicant]
US 10434651B1 · Blankespoor et al. · 2019 [cited by applicant]
US 10528051B1 · Perkins et al. · 2020 [cited by applicant]
US 10688667B1 · Berard et al. · 2020 [cited by applicant]
US 10908612B2 · Palan et al. · 2021 [cited by applicant]
US 10926756B2 · Coulter et al. · 2021 [cited by applicant]
US 11059532B1 · Fay et al. · 2021 [cited by applicant]
US 11073842B1 · Whitman et al. · 2021 [cited by applicant]
US 11077898B2 · Saunders et al. · 2021 [cited by applicant]
US 11123869B2 · Whitman et al. · 2021 [cited by applicant]
US 11247344B2 · Berard et al. · 2022 [cited by applicant]
US 11287826B2 · Whitman et al. · 2022 [cited by applicant]
US 11298826B1 · Jackowski et al. · 2022 [cited by applicant]
US 11383381B2 · Whitman et al. · 2022 [cited by applicant]
US 11413570B2 · Jefferson et al. · 2022 [cited by applicant]
US 11416003B2 · Whitman et al. · 2022 [cited by applicant]
US 11447195B2 · Whitman · 2022 [cited by applicant]
US 11548151B2 · Whitman et al. · 2023 [cited by applicant]
US 11599128B2 · Whitman et al. · 2023 [cited by applicant]
US 11660752B2 · Whitman et al. · 2023 [cited by applicant]
US 12077229B2 · Whitman · 2024 [cited by applicant]
US 12094195B2 · Komoroski · 2024 [cited by applicant]
US 12151380B2 · Whitman et al. · 2024 [cited by applicant]
US 20020022907A1 · Takenaka et al. · 2002 [cited by applicant]
US 20050131581A1 · Sabe et al. · 2005 [cited by applicant]
US 20060185911A1 · Gunderson et al. · 2006 [cited by applicant]
US 20070257910A1 · Gutmann et al. · 2007 [cited by applicant]
US 20080086241A1 · Phillips et al. · 2008 [cited by applicant]
US 20080281468A1 · Jacobsen et al. · 2008 [cited by applicant]
US 20090321150A1 · Kwon et al. · 2009 [cited by applicant]
US 20110054690A1 · Gal · 2011 [cited by applicant]
US 20110208444A1 · Solinsky · 2011 [cited by applicant]
US 20110231050A1 · Goulding · 2011 [cited by applicant]
US 20120072052A1 · Powers et al. · 2012 [cited by applicant]
US 20120215355A1 · Bewley et al. · 2012 [cited by applicant]
US 20130116820A1 · Lee et al. · 2013 [cited by applicant]
US 20140277718A1 · Izhikevich et al. · 2014 [cited by applicant]
US 20150073592A1 · Kaneko et al. · 2015 [cited by applicant]
US 20160174459A1 · Balutis et al. · 2016 [cited by applicant]
US 20160297072A1 · Williams et al. · 2016 [cited by applicant]
US 20160362147A1 · Mailey · 2016 [cited by examiner]
US 20170243365A1 · Nuijten · 2017 [cited by applicant]
US 20180035606A1 · Burdoucci · 2018 [cited by applicant]
US 20180111261A1 · Asada et al. · 2018 [cited by applicant]
US 20190156472A1 · Link et al. · 2019 [cited by applicant]
US 20190210225A1 · Hong · 2019 [cited by applicant]
US 20190256159A1 · Zhou et al. · 2019 [cited by applicant]
US 20190325763A1 · Hux et al. · 2019 [cited by applicant]
US 20190351555A1 · Blankespoor et al. · 2019 [cited by applicant]
US 20190377349A1 · van der Merwe et al. · 2019 [cited by applicant]
US 20190388247A1 · Goldfarb · 2019 [cited by examiner]
US 20200117198A1 · Whitman et al. · 2020 [cited by applicant]
US 20200150655A1 · Artes et al. · 2020 [cited by applicant]
US 20200324412A1 · Whitman et al. · 2020 [cited by applicant]
US 20200397202A1 · Artes et al. · 2020 [cited by applicant]
US 20210041887A1 · Whitman et al. · 2021 [cited by applicant]
US 20210055113A1 · Jeon et al. · 2021 [cited by applicant]
US 20210089037A1 · Fukuoka et al. · 2021 [cited by applicant]
US 20210096560A1 · Al-Mohssen et al. · 2021 [cited by applicant]
US 20210114620A1 · Yu et al. · 2021 [cited by applicant]
US 20210299867A1 · Kenneally · 2021 [cited by examiner]
US 20210323618A1 · Komoroski · 2021 [cited by applicant]
US 20210331317A1 · Whitman et al. · 2021 [cited by applicant]
US 20210331754A1 · Whitman · 2021 [cited by applicant]
US 20210333804A1 · Whitman et al. · 2021 [cited by applicant]
US 20220089234A1 · Sprowitz · 2022 [cited by examiner]
US 20220253060A1 · Xu · 2022 [cited by applicant]
US 20220388170A1 · Merewether · 2022 [cited by applicant]
US 20220390952A1 · Yu et al. · 2022 [cited by applicant]
US 20220410390A1 · Whitman et al. · 2022 [cited by applicant]
US 20230008677A1 · Whitman et al. · 2023 [cited by applicant]
US 20230356397A1 · Rivot et al. · 2023 [cited by applicant]
US 20230415343A1 · Whitman et al. · 2023 [cited by applicant]
US 20240174310A1 · Whitman et al. · 2024 [cited by applicant]
US 20240193936A1 · Komoroski · 2024 [cited by applicant]
US 20240378846A1 · Tsuzaki · 2024 [cited by applicant]
US 20250135646A1 · Whitman et al. · 2025 [cited by applicant]
US 20260064124A1 · Whitman · 2026 [cited by applicant]
CN 103273984 · 2013 [cited by applicant]
CN 103273985 · 2013 [cited by applicant]
CN 103963864A · 2014 [cited by applicant]
CN 205034207U · 2016 [cited by applicant]
CN 107943021 · 2018 [cited by applicant]
CN 207780600U · 2018 [cited by applicant]
CN 109202901 · 2019 [cited by applicant]
CN 109434795A · 2019 [cited by applicant]
CN 106547206 · 2019 [cited by applicant]
CN 209615483U · 2019 [cited by applicant]
CN 113661462 · 2021 [cited by applicant]
CN 115667061 · 2023 [cited by applicant]
CN 115702405 · 2023 [cited by applicant]
CN 115702445 · 2023 [cited by applicant]
EP 1502843A2 · 2005 [cited by applicant]
JP 61257375 · 1986 [cited by applicant]
JP S63176720 · 1988 [cited by applicant]
JP 5318342 · 1993 [cited by applicant]
JP H07166974 · 1995 [cited by applicant]
JP H07237154A · 1995 [cited by applicant]
JP 2001079787A · 2001 [cited by applicant]
JP 2003236781 · 2003 [cited by applicant]
JP 2003340763 · 2003 [cited by applicant]
JP 2004181600 · 2004 [cited by applicant]
JP 2007041656 · 2007 [cited by applicant]
JP 2007175831A · 2007 [cited by applicant]
JP 4295947B2 · 2009 [cited by examiner]
JP 4476468B2 · 2010 [cited by applicant]
JP 4613692B2 · 2011 [cited by applicant]
JP 2013072813 · 2013 [cited by applicant]
JP 2013237126 · 2013 [cited by applicant]
JP 2014100767 · 2014 [cited by applicant]
JP 2015051483 · 2015 [cited by applicant]
JP 2015054391 · 2015 [cited by applicant]
JP 2015080832 · 2015 [cited by applicant]
JP 7351920 · 2023 [cited by applicant]
JP 7351920B2 · 2023 [cited by applicant]
KR 20100093833 · 2010 [cited by applicant]
KR 20100093834 · 2010 [cited by applicant]
KR 20160055731A · 2016 [cited by applicant]
KR 20230006507 · 2023 [cited by applicant]
WO WO2003090982 · 2003 [cited by applicant]
WO WO2005087452 · 2005 [cited by applicant]
WO WO2005087452A1 · 2005 [cited by examiner]
WO WO2009131341 · 2009 [cited by applicant]
WO WO2012086604 · 2012 [cited by applicant]
WO WO2018035320 · 2018 [cited by applicant]
WO WO2020209888 · 2020 [cited by applicant]
WO WO2021216231 · 2021 [cited by applicant]
WO WO2021216235 · 2021 [cited by applicant]
WO WO2021216264 · 2021 [cited by applicant]
WO WO2024058844 · 2024 [cited by applicant]
Aoi et al., “Adaptive Control Strategies for Interlimb Coordination in Legged Robots: A Review,” Frontiers in Neurorobotics, Aug. 2017, 21 pages, https://doi.org/10.3389/fnbot.2017.00039. [cited by applicant]
Battaglia, “Design of the SCOUT II Quadruped with Preliminary Stair-Climbing,” McGill University, May 1999, 143 pages, https://escholarship.mcgill.ca/downloads/4f16c4825?locale=en. [cited by applicant]
Bazeille et al., “Vision Enhanced Reactive Locomotion Control for Trotting on Rough Terrain”, In 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA) Apr. 22, 2013; pp. 1-6, https://doi.org/10.1… [cited by applicant]
Bazeille, et al., “Quadruped Robot Trotting Over Irregular Terrain Assisted by Stereo-Vision,” Intelligent Service Robotics, Mar. 2014, 12 pages, https://iit-dlslab.github.io/papers/bazeille14isr.pdf. [cited by applicant]
Bellicoso et al., “Perception-less Terrain Adaptation through Whole Body Control and Hierarchical Optimization.,” 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), Nov. 2016, pp. 558-564, doi: … [cited by applicant]
Bellicoso et al., “Dynamic Locomotion through Online Nonlinear Motion Optimization for Quadrupedal Robots,” IEEE Robotics and Automation Letters, Jul. 2018, vol. 3, No. 3, pp. 2261-2268, doi: 10.1109/LRA.2018.2794620. [cited by applicant]
“Boston Dynamics: The Coming Robot Revolution—Marc Raibert,” video screen shots taken from https://www.youtube.com/watch?v=FahbCJ330Vg, Nov. 14, 2017, downloaded Jan. 31, 2024, 7 pages. [cited by applicant]
“Boston Dynamics Spot Mini at MIT AGI lecture,” video screen shots taken from https://www.youtube.com/watch?v=I_l6-iwyKvc, Feb. 18, 2018, downloaded Apr. 17, 2024, 3 pages. [cited by applicant]
Brewer, “Development of a Quadruped Robot and Parameterized Stair-Climbing Behavior,” University of Maryland, Jan. 2011, 132 pages, https://drum.lib.umd.edu/bitstreams/023eee39-6342-4d49-b7b3-cfc95077d988/download. [cited by applicant]
Camurri M., “Multisensory State Estimation and Mapping on Dynamic Legged Robots”, Thesis for Doctor of Philosophy, University of Genova, Italy, Mar. 2017, 1-145 pages, https://iit-dlslab.github.io/papers/camurri17phd.pd… [cited by applicant]
Chu J., “‘Blind’ Cheetah 3 robot can climb stairs littered with obstacles”, MIT News Office Jul. 4, 2018, 10 pages, https://news.mit.edu/2018/blind-cheetah-robot-climb-stairs-obstacles-disaster-zones-0705. [cited by applicant]
Eich et al., “Adaptive compliance control of a multi-legged stair-climbing robot based on proprioceptive data,” Industrial Robot, Jun. 2009, vol. 36 No. 4, pp. 331-339. https://doi.org/10.1108/01439910910957084. [cited by applicant]
Ellenberg, “A Stability-Estimator to Unify Humanoid Locomotion: Walking, Stair-Climbing and Ladder-Climbing,” Drexel University, Jun. 2014, 106 pages, DOI: https://doi.org/10.17918/etd-4538. [cited by applicant]
Fankhauser et al., “Robot-Centric Elevation Mapping with Uncertainty Estimates”, In Mobile Service Robotics Apr. 1, 20147; pp. 433-440, https://core.ac.uk/download/pdf/148004368.pdf. [cited by applicant]
Fankhauser et al., “Free Gait—An Architecture for the Versatile Control of Legged Robots,” 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), Nov. 2016, pp. 1052-1058, doi: 10.1109/HUMANOIDS.201… [cited by applicant]
Focchi et al., “Heuristic Planning for Rough Terrain Locomotion in Presence of External Disturbances and Variable Perception Quality”, Advances in Robotics Research: From Lab to Market: ECHORD++: Robotic Science Support… [cited by applicant]
Gehring et al., “Quadrupedal Locomotion Using Trajectory Optimization and Hierarchical Whole Body Control,” 2017 IEEE International Conference on Robotics and Automation (ICRA), May 2017, pp. 4788-4794, doi: 10.1109/ICR… [cited by applicant]
“Google-owned robot lab Boston Dynamics shows off its Spot Mini prototype at TechCrunch Disrupt,” video screen shots taken from https://www.youtube.com/watch?v=qNo-muuj128, Dec. 5, 2016, downloaded Apr. 17, 2024, 4 page… [cited by applicant]
Gutmann et al., “Stair Climbing for Humanoid Robots Using Stereo Vision,” 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), Sep. 28, 2004, pp. 1407-1413 vol. 2, d… [cited by applicant]
Haynes et al., “Multistable Phase Regulation for Robust Steady and Transitional Legged Gaits.,” TheInternational Journal of Robotics Research, Sep. 2012, vol. 31, Issue 14, pp. 1712-1738, https://doi.org/10.1177/0278364… [cited by applicant]
Hutter et al., “ANYmal—A Highly Mobile and Dynamic Quadrupedal Robot”, 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS) Oct. 9, 2016; pp. 38-44, https://doi.org/10.1109/IROS.2016.7758092. [cited by applicant]
Ilyas et al., “Design of sTetro: A Modular, Reconfigurable, and Autonomous Staircase Cleaning Robot,” Journal of Sensors, Jul. 2018, 25 pages, https://doi.org/10.1155/2018/8190802. [cited by applicant]
Kaslin et al., “Towards a Passive Adaptive Planar Foot with Ground Orientation and Contact ForceSensing for Legged Robots,” 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2018, pp.… [cited by applicant]
Kim et al., “Realization of Dynamic Stair Climbing for Biped Humanoid Robot Using Force/Torque Sensors,” Journal of Intelligent and Robotic Systems, Apr. 2009, vol. 56, pp. 389-423, DOI:10.1007/s10846-009-9324-z. [cited by applicant]
Ko, et al., “Trajectory Planning and Four-Leg Coordination for Stair Climbing in a Quadruped Robot,”2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct. 2010, 6 pages, http://peichunlin.me.ntu.… [cited by applicant]
Lan et al., “Novel design of a wheeled robot with double swing arms capable of autonomous stair climbing,” Proceedings of the 2018 International Conference on Mechatronic Systems and Robots May 2, 20185 (pp. 110-114) ht… [cited by applicant]
Lee et al., “Robust Recovery Controller for a Quadrupedal Robot using Deep Reinforcement Learning,” arXiv.org, Jan. 2019, 8 pages, https://doi.org/10.48550/arXiv.1901.07517. [cited by applicant]
Li et al., “A Kinect-sensor-based Tracked Robot for Exploring and Climbing Stairs,” International Journal of Advanced Robotic Systems, Jan. 2014,11(5), 11 pages, doi:10.5772/58583. [cited by applicant]
Liu et al., The development of a multi-legged robot using eight-bar linkages as leg mechanisms with switchable modes for walking and stair climbing. In2017 3rd International Conference on Control, Automation and Robotic… [cited by applicant]
Marion, et al., “Director: A User Interface Designed for Robot Operation with Shared Autonomy,” Journal of Field Robotics, Dec. 2016, 25 pages, https://groups.csail.mit.edu/robotics-center/public_papers/Marion16.pdf. [cited by applicant]
“Meet Spot, the robot dog that can run, hop and open doors | Marc Raibert,” video screen shots taken from https://www.youtube.com/watch?v=AO4In7d6X-c, Aug. 14, 2017, downloaded Jan. 31, 2024, 5 pages. [cited by applicant]
Pack D.J., “Sensor-Based Planning and Control for a Quadruped Walking Robot,” Purdue University, 1996, 190 pages; https://dl.acm.org/doi/book/10.5555/240733. [cited by applicant]
Patil et al., Deep learning based stair detection and statistical image filtering for autonomous stair climbing. In 2019 3rd IEEE International Conference on Robotic Computing (IRC) Feb. 25, 2019 (pp. 159-166). [cited by applicant]
Qi et al., “Perceptive autonomous stair climbing for quadrupedal robots,” 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Sep. 27, 2021 (pp. 2313-2320) https://doi.org/10.1109/IROS51168.2… [cited by applicant]
Raibert et al., “Dynamically Stable Legged Locomotion,” The Leg Laboratory, Report LL-6, Sep. 1989, 207 pages, https://apps.dtic.mil/sti/tr/pdf/ADA225713.pdf. [cited by applicant]
Raković et al., “Biped walking and stairs climbing using reconfigurable adaptive motion primitives”. In 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids) Nov. 1, 20165 (pp. 57-62). [cited by applicant]
Shkolnik et al., “Bounding on Rough Terrain with the LittleDog Robot,” The International Journal of Robotics Research, Dec. 2010, 30(2) pp. 192-215, doi:10.1177/0278364910388315. [cited by applicant]
“Silicon Valley—Erlich Hits the Robotic Deer,” video screen shots taken from https://www.youtube.com/watch?v=-mHYoXedZ10, Apr. 30, 2016, downloaded Apr. 17, 2024, 8 pages. [cited by applicant]
Suganuma, et al., “A Remote Operated Quadruped Robot System for Investigation of Reactor Building,” 2014 22nd International Conference on Nuclear Engineering, Jul. 2014, 4 pages, https://citeseerx.ist.psu.edu/document?r… [cited by applicant]
“The Spot by Boston Dynamics comes on stage at Disrupt SF,” video screen shots taken fromhttps://www.youtube.com/watch?v=3Q0ZC_wDoGI, Sep. 14, 2016, downloaded Jan. 31, 2024, 4 pages. [cited by applicant]
Thu et al., “Autonomous stairs ascending and descending algorithm for tri-star wheeled robot,” 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM) Jul. 18, 2018 (pp. 328-333) https://doi.org/… [cited by applicant]
Vatankhah M., “Synergy Pattern Identification of Hip, Knee, Ankle Joints During Human Stair Ascent as a Bio-Inspired Model for Humanoid Robots,” Stevens Institute of Technology, 2018, 104 pages, ISBN: 9780438259966. [cited by applicant]
“Vision-free MIT Cheetah”, video screen shots taken from https://www.youtube.com/watch?v=QZ1DaQgg3IE, Jul. 5, 2018, downloaded Jan. 16, 2024, 25 pages. [cited by applicant]
Zeng et al., “Leg Trajectory Planning for Quadruped Robots with High-Speed Trot Gait,” Applied Sciences, Apr. 2019, 21 pages, doi: 10.3390/app9071508. [cited by applicant]
Korean Office Action dated Aug. 19, 2024 in Application No. 10-2022-7036795; 22 Pages. [cited by applicant]
Communication Relating to the Results of the Partial International Search for PCT/US2023/025760, dated Apr. 9, 2024, 15 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2023/025760, dated Jun. 6, 2024, 21 pages. [cited by applicant]
Defendant Ghost Robotics Corporation's Supplemental Identification of Invalidity References in [cited by applicant]
Defendant Ghost Robotics Corporation's Final Invalidity Contentions in [cited by applicant]
Exhibit C1(i) (Redacted), [cited by applicant]
Exhibit C1(ii) (Redacted), [cited by applicant]
Exhibit C1(iii) (Redacted), [cited by applicant]
Exhibit C2 (Redacted), [cited by applicant]
Exhibit C3 (Redacted), [cited by applicant]
Exhibit E1, [cited by applicant]
Exhibit E2, [cited by applicant]
Exhibit E3, [cited by applicant]
Exhibit E4, [cited by applicant]
Request for Ex Parte Reexamination in U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, filed Dec. 31, 2023, 49 pages. [cited by applicant]
Declaration of Dr. Darwin Caldwell in Support of Ex Parte Reexamination in U.S. Pat. No. 11,660,752, filed Dec. 31, 2023, 27 pages. [cited by applicant]
Order Granting Request for Ex Parte Reexamination in U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Feb. 20, 2024, 18 pages. [cited by applicant]
U.S. Office Action in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Jun. 18, 2024, 48 pages. [cited by applicant]
Dornhege et al., “Behavior maps for online planning of obstacle negotiation and climbing on rough terrain”, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 2007, pp. 3005-30… [cited by applicant]
Gutmann et al., “A Modular Architecture for Humanoid Robot Navigation,” 5th IEEE-RAS International Conference on Humanoid Robots, Tsukuba, Japan, 2005, pp. 26-31. [cited by applicant]
“Spot Autonomous Navigation”, https://www.youtube.com/watch?v=Ve9kWX_KXus, May 10, 2018 (pp. 3, 5, 6, 11, 13, and 14 correspond to screenshots supplied by the USPTO during prosecution of U.S. Appl. No. 17/933,066). [cited by applicant]
International Preliminary Report on Patentability, PCT/US2021/022869, Oct. 25, 2022, 7 pages. [cited by applicant]
International Preliminary Report on Patentability, PCT/US2021/025302, Oct. 25, 2022, 10 pages. [cited by applicant]
International Preliminary Report on Patentability, PCT/US2022/022953, Oct. 25, 2022, 9 pages. [cited by applicant]
Office Action in European Application No. 19766387.5-1205, Dec. 20, 2022, 5 pages. [cited by applicant]
“The New Spot”, https://www.youtube.com/watch?v=kgaO45SyaO4, Nov. 13, 2017. [cited by applicant]
“Hey Buddy, Can You Give Me a Hand?”, https://www.youtube.com/watch?v=fUyU3IKzoio, Feb. 12, 2018. [cited by applicant]
“Introducing Spot (Previously SpotMini)”, https://www.youtube.com/watch?v=tf7IEVTDjng, Jun. 23, 2016. [cited by applicant]
“Testing Robustness”, https://www.youtube.com/watch?v=aFuA50H9uek, Feb. 20, 2018. [cited by applicant]
“SpotMini”, The Wayback Machine, http://web.archive.org/web/20171118145237/https://bostondynamics.com/spot-mini, downloaded Jul. 31, 2023, 3 pages. [cited by applicant]
“Behold the Future”, The Wayback Machine, http://web.archive.org/web/20161003004018/http://beholdthefuture.com/, downloaded Jul. 31, 2023, 3 pages. [cited by applicant]
Fu et al., “Gait Synthesis and Sensory Control of Stair Climbing for a Humanoid Robot,” in IEEE Transactions on Industrial Electronics, May 2008, pp. 2111-2120 vol. 55, No. 5, doi: 10.1109/TI E.2008.921205. (Year: 2008). [cited by applicant]
Complaint filed Nov. 11, 2022, [cited by applicant]
Delmerico, et al., “Ascending Stairway Modeling from Dense Depth Imagery for Traversability Analysis,” 2013 IEEE International Conference on Robotics and Automation, May 6, 2013, pp. 2283-2290, doi: 10.1109/ICRA.2013.66… [cited by applicant]
Gutmann et al., “Stair Climbing for humanoid robots using stereo vision,” 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), Sep. 28, 2004, pp. 1407-1413 vol. 2, d… [cited by applicant]
“Honda's Asimo Robot buckling on the stairs”, https://www.youtube.com/watch?v=VTIV0Y5yAww, Dec. 12, 2006. [cited by applicant]
Gutmann et al., “A Floor and Obstacle Height Map for 3D Navigation of a Humanoid Robot,” Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Apr. 2005, pp. 1066-1071, doi: 10.1109/ROBOT.200… [cited by applicant]
Obringer, et al., “How Asimo Works”, https://science.howstuffworks.com/asimo.htm#pt1, printed Jan. 3, 2023 in 20 pages. [cited by applicant]
Orsolino, et al., “Feasible Region: an Actuation-Aware Extension of the Support Region,” IEEE Transactions on Robotics (TRO) 2020, Mar. 19, 2019, 19 pages, doi: 10.48550/arXiv.1903.07999 (Year: 2019). [cited by applicant]
Osswald, et al., “Autonomous Climbing of Spiral Staircases with Humanoids,” 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sep. 25, 2011, pp. 4844-4849, doi: 10.1109/IROS.2011.6048209 (… [cited by applicant]
Osswald, et al., “From 3D Point Clouds to Climbing Stairs: A Comparison of Plane Segmentation Approaches for Humanoids,” 11th IEEE RAS International Conference on Humanoid Robots (Humanoids), Oct. 26, 2011, pp. 93-98, d… [cited by applicant]
Heydari et al., “Model predictive control for biped robots in climbing stairs,” 2014 22nd Iranian Conference on Electrical Engineering (ICEE), May 2014, pp. 1209-1214, doi: 10.1109/IranianCEE.2014.6999719. (Year: 2014). [cited by applicant]
Ishikawa et al., “Bipedal walking control against swing foot collision using swing foot trajectory regeneration and impact mitigation ,” Sep. 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IRO… [cited by applicant]
International Search Report, PCT/US2019/047928, Jan. 3, 2020, 15 pages. [cited by applicant]
International Preliminary Report on Patentability, PCT/US2019/047928, Oct. 12, 2021, 7 pages. [cited by applicant]
International Search Report, PCT/US2021/025302, Aug. 11, 2021, 17 pages. [cited by applicant]
International Search Report, PCT/US2021/022953, Jul. 23, 2021, 15 pages. [cited by applicant]
International Search Report, PCT/US2021/022869, Jun. 14, 2021, 17 pages. [cited by applicant]
Tong et al., “Real-Time Map Building for Path Planning of a Humanoid Robot,” 2009 Asia-Pacific Conference on Information Processing, 2009, pp. 211-214, doi: 10.1109/APCIP.2009.60 (Year: 2009). [cited by applicant]
Santos et al., “Step Modeling and Safe Path Planning for a Lower Limb Exoskeleton,” 2019 19th International Conference on Advanced Robotics (ICAR), 2019, pp. 560-565, doi: 10.1109/ICAR46387.2019.8981644 (Year: 2019). [cited by applicant]
“Robust Rough-Terrain Locomotion with a Quadrupedal Robot (ANYmal),” video screen shots taken from https://www.youtube.com/watch?v=CpzQu25iLa0, Sep. 19, 2017, downloaded Nov. 6, 2023, 14 pages. [cited by applicant]
“Legged Robot ANYmal Climbing Stairs in Zurich,” video screen shots taken from https://www.youtube.com/watch?v=vSveQrJLRTo, Jan. 17, 2018, downloaded Nov. 6, 2023, 6 pages. [cited by applicant]
“ANYmal climbing stairs at Oxford Robotics,” video screen shots taken from https://www.youtube.com/watch?v=MrZIWzrGb_g, Jun. 28, 2018, downloaded Nov. 6, 2023, 8 pages. [cited by applicant]
Di Carlo et al., “Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-PredictiveControl,” 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 2018, pp. 1-9, doi: 10.1… [cited by applicant]
“Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model Predictive Control,” video screen shots taken from https://www.youtube.com/watch?v=q6zxCvCxhic, Sep. 9, 2019, downloaded Nov. 6, 2023, 16 pages. [cited by applicant]
Fankhauser et al., “Robust Rough-Terrain Locomotion with a Quadrupedal Robot,” 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 2018, pp. 5761-5768, doi: 10.1109/ICRA.2018.… [cited by applicant]
Gutmann et al., “Real-Time Path Planning for Humanoid Robot Navigation,” IJCAI, 2005, pp. 1232-1237, https://www.ijcai.org/Proceedings/05/Papers/0974.pdf. [cited by applicant]
Hodgins et al., “Adjusting Step Length for Rough Terrain Locomotion,” IEEE Transactions on Robotics and Automation, Jun. 1991, vol. 7, No. 3, pp. 289-298, doi: 10.1109/70.88138. [cited by applicant]
“Introducing Spot Classic (Previously Spot)”, video screen shots taken from https://www.youtube.com/watch?v=M8YjvHYbZ9w, Feb. 9, 2015, downloaded Aug. 10, 2023, 14 pages. [cited by applicant]
Kolter et al., “Stereo Vision and Terrain Modeling for Quadruped Robots,” 2009 IEEE International Conference on Robotics and Automation, Kobe, 2009, pp. 1557-1564, doi: 10.1109/ROBOT.2009.5152795. [cited by applicant]
Kolter et al., “The Stanford Little Dog: A Learning and Rapid Replanning Approach to Quadruped Locomotion,” International Journal of Robotics Research (First published online Jan. 25, 2011), https://journals.sagepub.com… [cited by applicant]
Michel et al., “GPU-Accelerated Real-Time 3D Tracking for Humanoid Locomotion and Stair Climbing,” 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 2007, pp. 463-469, doi: 10… [cited by applicant]
Ren et al., “Toward Robust Stair Climbing of the Quadruped using Proprioceptive Sensing,” Technical Report Carnegie Mellon University Robotics Institute Summer Scholars Working Papers Journal, vol. 6, Fall 2018, pp. 112… [cited by applicant]
Shih et al., “Ascending and Descending Stairs for a Biped Robot,” IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, May 1999, vol. 29, No. 3, pp. 255-268, doi: 10.1109/3468.759271. [cited by applicant]
Stoeter et al., “Autonomous Stair-Climbing with Miniature Jumping Robots,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Apr. 2005, vol. 35, No. 2, pp. 313-325, doi: 10.1109/TSMCB.2004.843270. [cited by applicant]
Answer in [cited by applicant]
Amended Answer in [cited by applicant]
Defendant Ghost Robotics Corporation's Initial Invalidity Contentions in [cited by applicant]
Exhibit C1 (Redacted) in [cited by applicant]
Exhibit C2 in [cited by applicant]
Exhibit C3 in [cited by applicant]
Exhibit E1 in [cited by applicant]
Exhibit E2 in [cited by applicant]
Exhibit E3 in [cited by applicant]
Second Amended Answer in [cited by applicant]
U.S. Office Action in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Sep. 27, 2024, 60 pages. [cited by applicant]
U.S. Office Action in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Nov. 21, 2024, 12 pages. [cited by applicant]
U.S. Office Action in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Dec. 19, 2024, 15 pages. [cited by applicant]
Notice of Intent to Issue Ex Parte Reexamination Certificate in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Mar. 11, 2025, 5 pages. [cited by applicant]
Ex Parte Reexamination Certificate in Ex Parte Reexamination of U.S. Pat. No. 11,660,752 by Ghost Robotics Corporation, mailed Apr. 9, 2025, 2 pages. [cited by applicant]
European Office Action dated Jul. 9, 2025 in Application No. 21720650.7; 10 pages. [cited by applicant]
Asatani et al., “Real-Time Step Edge Estimation Using Stereo Images for Biped Robot”, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sep. 25-30, 2011, pp. 4463-4468. [cited by applicant]
Tong et al., “Real-Time Path Planning for Humanoid Robot”, 2009 Third International Symposium on Intelligent Information Technology Application, 2009, pp. 692-695. [cited by applicant]
“Vision-free MIT Cheetah”, YouTube, uploaded by Massachusetts Institute of Technology (MIT), video screen shots taken from https://www.youtube.com/watch?v=QZ1DaQgg3IE; Jul. 5, 2018, downloaded Nov. 26, 2024, 81 pages. [cited by applicant]