IP Library › Granted Patent US 11,554,071
Granted Patent B2
US 11,554,071 · App. 17/467,461 · Granted Jan 17, 2023

Robotic assistant and method for controlling the same

Inventors: Houzhu Ding (San Gabriel, CA); Chengkun Zhang (Temple City, CA); Zhen Xiu (Chino Hills, CA); Huan Tan (Pasadena, CA)
Assignee: UBTECH ROBOTICS CORP LTD
A61H3/04G02B27/0179A61H2003/043A61H2201/0165A61H2201/1635A61H2201/5043G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,554,071
App. No.
17/467,461
Granted
Jan 17, 2023
Kind
B2
Abstract

A robotic assistant includes a base; an elevation mechanism positioned on the base; a display rotatably mounted on the elevation mechanism; a camera positioned on the display; and a control system that receives command instructions. In response to the command instructions, the control system is to detect movement of a face of the user in a vertical direction based on the images captured by the camera. In response to detection of the movement of the face of the user in the vertical direction, the control system is to rotate the display and actuate the elevation mechanism to the move the display up and down to allow the camera to face the face of the user during the movement of the face of the user in the vertical direction.

Claims (48)

1. A robotic assistant, comprising:

a base;

an elevation mechanism positioned on the base;

a display rotatably mounted on the elevation mechanism;

a camera positioned on the display, the camera configured to capture images of a user; and

a control system that receives command instructions;

wherein in response to the command instructions, the control system is configured to detect movement of a face of the user in a vertical direction based on the images;

wherein in response to detection of the movement of the face of the user in the vertical direction, the control system is configured to rotate the display and actuate the elevation mechanism to the move the display up and down to allow the camera to face the face of the user during the movement of the face of the user in the vertical direction.

2. The robotic assistant of claim 1 , further comprising a display holder positioned on a top of the elevation mechanism and a motor fixed to the display holder, wherein the display is indirectly mounted on the elevation mechanism through the display holder, and the motor is configured to drive the display to rotate with respect to the display holder.

3. The robotic assistant of claim 2 , further comprising a rotary damper coupled to the display holder, wherein the rotary damper is configured to control speed of rotation of the display.

4. The robotic assistant of claim 1 , further comprising two handles securely coupled to the elevation mechanism, wherein the two handles are configured to be fit into hands of the user to provide two hand grips.

5. The robotic assistant of claim 2 , further comprising a limit switch securely coupled to the display holder, wherein the limit switch is configured to be activated in response to the display rotating to a predetermined position, and the control system is configured to stop rotation of the display in response to the limit switch being activated.

6. The robotic assistant of claim 1 , wherein the elevation mechanism comprises an actuator mounted on the base, a main body that is vertically positioned on the base, and a sliding member slidably connected to the main body, the display is positioned on the sliding member, and the actuator is configured to drive the sliding member to move up and down.

7. A robotic assistant, comprising:

a base;

an elevation mechanism disposed in a vertical direction and mounted on the base;

a display rotatably coupled to the elevation mechanism;

a camera fixed to the display, the camera configured to capture images of a user;

one or more processors;

a memory; and

one or mere programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprises:

instructions for detecting movement of a face of the user in a vertical direction based on the images; and

instructions for, in response to detection of the movement of the face of the user in the vertical direction, rotating the display and actuating the elevation mechanism to the move the display up and down to allow the camera to face the face of the user during the movement of the face of the user in the vertical direction.

8. The robotic assistant of claim 7 , further comprising a display holder positioned on a top of the elevation mechanism and a motor fixed to the display holder, wherein the display is indirectly mounted on the elevation mechanism through the display holder, and the motor is configured to drive the display to rotate with respect to the display holder.

9. The robotic assistant of claim 8 , further comprising a rotary damper coupled to the display holder, wherein the rotary damper is configured to control speed of rotation of the display.

10. The robotic assistant of claim 7 , further comprising two handles securely coupled to the elevation mechanism, wherein the two handles are configured to be fit into hands of the user to provide two hand grips.

11. The robotic assistant of claim 8 , further comprising a limit switch securely coupled to the display holder, wherein the limit switch is configured to be activated in response to the display rotating to a predetermined position, and the control system is configured to stop rotation of the display in response to the limit switch being activated.

12. The robotic assistant of claim 7 , wherein the elevation mechanism comprises an actuator mounted on the base, a main body that is vertically positioned on the base, and a sliding member slidably connected to the main body, the display is positioned on the sliding member, and the actuator is configured to drive the sliding member to move up and down.

13. A method for controlling a robotic assistant, the method comprising:

providing a base;

providing an elevation mechanism positioned on the base;

providing a display rotatably coupled to the elevation mechanism;

providing a camera fixed to the display;

obtaining a plurality of images of a user using the camera;

detecting movement of a face of the user in a vertical direction based on the images;

in response to detection of the movement of the face of the user in the vertical direction, rotating the display and actuating the elevation mechanism to the move the display up and down to allow the camera to face the face of the user during the movement of the face of the user in the vertical direction.

14. The method of claim 13 , wherein rotating the display comprises:

determining a key point in the face of the user in a current one of the images;

determining an angle between a fine passing through the key point and a camera center and an optical axis of the camera;

determining moving direction of the face of the user in the vertical direction; and

rotating the display based on the moving direction of the face of the user in the vertical direction and the angle.

15. The method of claim 14 , wherein actuating the elevation mechanism to the move the display up and down comprises, after determining moving direction of the face of the user in the vertical direction,

actuating the elevation mechanism to the move the display up or down based on the moving direction of the face of the user in the vertical direction.

16. The method of claim 13 , further comprising providing a display holder positioned on a top of the elevation mechanism and a motor fixed to the display holder, wherein the display is indirectly mounted on the elevation mechanism through the display holder, and the motor is configured to drive the display to rotate with respect to the display holder.

17. The method of claim 16 , further comprising providing a rotary damper coupled to the display holder, wherein the rotary damper is configured to control speed of rotation of the display.

18. The method of claim 13 , further comprising providing two handles securely coupled to the elevation mechanism, wherein the two handles are configured to be fit into hands of the user to provide two hand grips.

19. The method of claim 16 , further comprising providing a limit switch securely coupled to the display holder, wherein the limit switch is configured to be activated in response to the display rotating to a predetermined position, and the control system is configured to stop rotation of the display in response to the limit switch being activated.

20. The method of claim 13 , wherein the elevation mechanism comprises an actuator mounted on the base, a main body that is vertically positioned on the base, and a sliding member slidably connected to the main body, the display is positioned on the sliding member, and the actuator is configured to drive the sliding member to move up and down.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2023
From: UBTECH NORTH AMERICA RESEARCH AND DEVELOPMENT CENTER CORP; UBTECH ROBOTICS CORP LTD
To: UBKANG (QINGDAO) TECHNOLOGY CO., LTD.
Reel/Frame 062319/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2021
From: DING, HOUZHU; ZHANG, CHENGKUN; XIU, ZHEN; TAN, HUAN
To: UBTECH NORTH AMERICA RESEARCH AND DEVELOPMENT CENTER CORP; UBTECH ROBOTICS CORP LTD
Reel/Frame 057392/0893 →
Continuity (2)
Continuation In Part 17113127 · Dec 7, 2020
Related Publication 20220175609A1 · Jun 9, 2022