IP Library Granted Patent US 11,565,401
Granted Patent B1
US 11,565,401 · App. 17/208,683 · Granted Jan 31, 2023

Operating multiple testing robots based on robot instructions and/or environmental parameters received in a request

Inventors: Peter Pastor Sampedro (Oakland, CA); Mrinal Kalakrishnan (Mountain View, CA); Ali Yahya Valdovinos (Palo Alto, CA); Adrian Li (San Francisco, CA); Kurt Konolige (Menlo Park, CA); Vincent Dureau (San Francisco, CA)
Assignee: X DEVELOPMENT LLC
B25J9/0084B25J9/163G05B2219/39271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,565,401
App. No.
17/208,683
Granted
Jan 31, 2023
Kind
B1
Abstract

Methods and apparatus related to receiving a request that includes robot instructions and/or environmental parameters, operating each of a plurality of robots based on the robot instructions and/or in an environment configured based on the environmental parameters, and storing data generated by the robots during the operating. In some implementations, at least part of the stored data that is generated by the robots is provided in response to the request and/or additional data that is generated based on the stored data is provided in response to the request.

Claims (47)

1. A method, comprising:

providing an interactive graphical interface for display at a client device, the interactive graphical interface including an environmental object interaction element;

determining, based on one or more user interactions at the client device and with the interactive graphical interface, environmental parameters for a simulated operating space of a robot simulator, wherein determining the environmental parameters comprises:

determining, responsive to an interaction, of the user interactions, with the environmental object interaction element of the interactive graphical interface, an object class specified by the interaction, the object class having a plurality of object class environmental objects as members;

configuring a simulated operating space of the robot simulator based on the environmental parameters determined based on the user interactions at the client device, wherein configuring the simulated operating space comprises:

including, in the simulated operating space, an object class environmental object, of the object class environmental objects, wherein including the object class environmental object is responsive to the interaction by the user specifying the object class and responsive to the object class environmental objects being members of the object class;

receiving robot instructions that specify at least part of operation of a robot to be simulated by the robot simulator and in the simulated operating space;

causing the robot simulator to operate based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters;

storing, in one or more computer readable media, simulated data generated by the robot simulator during the operation of the robot simulator based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters; and

providing, for display at the client device or an additional client device, information that is based on the simulated data.

2. The method of claim 1 , further comprising:

providing, in the interactive graphical interface, a depiction of the simulated operating space.

3. The method of claim 1 , further comprising:

receiving, from the client device, an indication of a duration of time;

wherein causing the robot simulator to operate based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters comprises causing the robot simulator to operate for the duration of time.

4. The method of claim 1 , wherein the object class includes specification of a particular room type.

5. The method of claim 3 , wherein the particular room type is a kitchen.

6. The method of claim 1 , wherein the object class environmental object is an obstacle.

7. The method of claim 1 , wherein the object class environmental object is an object to be directly interacted with by the robot simulator.

8. The method of claim 1 , wherein the robot instructions comprise object code that is executable by the robot simulator.

9. The method of claim 1 , wherein the robot instructions comprise source code, and wherein a compilation of the source code is executable by the robot simulator.

10. The method of claim 1 , wherein the information comprises a success rate of a task implemented by the robot instructions.

11. A method, comprising:

configuring a simulated operating space of a robot simulator based on environmental parameters determined based on user interactions, at a client device, that are directed at an interactive graphical interface, wherein configuring the simulated operating space comprises:

including, in the simulated operating space, an object class environmental object, wherein including the object class environmental object is responsive to at least one of the user interactions specifying an object class and responsive to the object class environmental object being a member of the object class;

receiving robot instructions that specify at least part of operation of a robot to be simulated by the robot simulator and in the simulated operating space;

operating the robot simulator based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters;

storing, in one or more computer readable media, simulated data generated by the robot simulator during the operation of the robot simulator based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters; and

providing, for display at the client device or an additional client device, information that is based on the simulated data.

12. The method of claim 11 , further comprising:

receiving, from the client device or an additional client device, an indication of a duration of time;

wherein operating the robot simulator based on the robot instructions and with the simulated operating space that is configured based on the environmental parameters comprises operating the robot simulator for the duration of time.

13. The method of claim 11 , wherein the object class includes specification of a particular room type.

14. The method of claim 11 , wherein the object class environmental object is an obstacle.

15. The method of claim 11 , wherein the robot instructions comprise object code that is executable by the robot simulator.

16. The method of claim 11 , wherein the robot instructions comprise source code, and wherein a compilation of the source code is executable by the robot simulator.

17. The method of claim 11 , wherein the information comprises a success rate of a task implemented by the robot instructions.

18. A method, comprising:

receiving user interface input generated via a user interface input device of a client computing device;

generating, based on the user interface input, a request that includes robot instructions and environmental parameters,

wherein the robot instructions specify at least part of operation of the robot, and

wherein the environmental parameters indicate:

one or more properties of environmental objects that are external to the robot and that are to be interacted with by the robot during operation of the robot based on the robot instructions, and

lighting conditions during operation of the robot based on the robot instructions;

transmitting the request via one or more network interfaces of the client computing device; and

receiving, by the client computing device or an additional computing device in response to the request:

information that is based on simulated data generated by a robot simulator operated based on the robot instructions of the request and with a simulated operating space configured based on the environmental parameters of the request.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: GOOGLE LLC
To: GDM HOLDING LLC
Reel/Frame 071109/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: X DEVELOPMENT LLC
To: GOOGLE LLC
Reel/Frame 063992/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2021
From: PASTOR SAMPEDRO, PETER; KALAKRISHNAN, MRINAL; VALDOVINOS, ALI YAHYA; LI, ADRIAN; KONOLIGE, KURT; DUREAU, VINCENT
To: GOOGLE INC.
Reel/Frame 055856/0553 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2021
From: GOOGLE INC.
To: X DEVELOPMENT LLC
Reel/Frame 055856/0562 →
Cited By (1)
US 12,661,794